2024-09-12T01:23:32.065 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:23:32.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:23:32.195 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552 branch: squid description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901552' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 targets: smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6LBnfLypFH5e4a6xybRHgabj1kPhbpLWPvazz2+0GKr4wdNpuf2mWzlCmH+uoB+u5GR7kpBC1ZpFpn5IV3wQY= smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIfXxzEqYitYAldYPR70wE/cST0iWm4+sllY6dXuqlagUWCRWL63Oke27bIym0e/ol+lvmLvxPCKG168Rbip8GE= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-12T01:23:32.195 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:23:32.196 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:23:32.196 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:23:32.198 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:23:32.220 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:23:32.220 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:23:32.221 INFO:teuthology.packaging:ref: None 2024-09-12T01:23:32.221 INFO:teuthology.packaging:tag: None 2024-09-12T01:23:32.221 INFO:teuthology.packaging:branch: squid 2024-09-12T01:23:32.221 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:23:32.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:23:32.460 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:23:32.462 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:23:32.468 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:23:32.468 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:23:32.474 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:23:32.494 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:23:32.500 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:23:32.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:17:56.422935', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL6LBnfLypFH5e4a6xybRHgabj1kPhbpLWPvazz2+0GKr4wdNpuf2mWzlCmH+uoB+u5GR7kpBC1ZpFpn5IV3wQY='} 2024-09-12T01:23:32.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:17:56.420984', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIfXxzEqYitYAldYPR70wE/cST0iWm4+sllY6dXuqlagUWCRWL63Oke27bIym0e/ol+lvmLvxPCKG168Rbip8GE='} 2024-09-12T01:23:32.564 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:23:32.570 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-12T01:23:32.570 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-12T01:23:32.570 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:23:32.655 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0e6a357be0>, signals=[15]) 2024-09-12T01:23:32.655 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:23:32.661 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:23:32.661 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:23:32.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:23:32.751 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T01:23:32.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:23:32.852 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:23:32.858 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2024-09-12T01:23:32.877 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2024-09-12T01:23:32.877 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:23:32.936 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:23:32.937 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:23:32.937 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:23:32.937 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:23:32.937 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2024-09-12T01:23:32.970 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-12T01:23:32.989 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-12T01:23:32.990 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-12T01:23:33.047 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2024-09-12T01:23:33.047 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="9" 2024-09-12T01:23:33.047 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="9" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:23:33.048 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:23:33.049 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-12T01:23:33.078 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:23:33.087 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:23:33.092 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:23:33.093 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:23:33.095 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:23:33.112 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:23:33.118 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:23:33.118 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:23:33.153 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:23:33.263 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:23:33.337 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:23:33.352 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:23:33.352 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T01:23:33.352 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:23:33.353 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:23:33.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:23:33.370 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T01:23:33.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:23:33.371 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-12T01:23:33.428 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:23:33.429 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.14.0-503.el9.x86_64 2024-09-12T01:23:33.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum install -y kernel 2024-09-12T01:23:33.430 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:23:33.430 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.14.0-503.el9.x86_64 2024-09-12T01:23:33.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2024-09-12T01:23:35.709 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-09-12T01:23:37.628 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-12T01:23:41.418 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-12T01:23:47.702 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-12T01:23:49.286 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 19 kB 00:00 2024-09-12T01:23:50.323 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-12T01:23:55.988 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-12T01:23:58.078 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:23:58.078 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:23:58.166 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:23:58.176 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 79 M 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 126 M 2024-09-12T01:23:58.177 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:23:58.305 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 211 kB/s | 23 kB 00:00 2024-09-12T01:23:58.501 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 20 MB 00:19 2024-09-12T01:24:00.322 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-09-12T01:24:02.847 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.3 MB/s | 29 MB 00:04 2024-09-12T01:24:02.876 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-12T01:24:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.8 MB/s | 35 MB 00:05 2024-09-12T01:24:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:24:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:Total 15 MB/s | 79 MB 00:05 2024-09-12T01:24:04.017 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:24:04.427 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:24:04.427 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:24:04.460 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-12T01:24:05.356 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-12T01:24:05.441 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:24:05.441 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:24:08.048 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:24:08.749 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:24:08.839 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:24:10.754 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T01:24:11.771 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:24:11.899 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:24:12.785 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:24:12.785 INFO:teuthology.orchestra.run.smithi153.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:24:12.884 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:24:12.894 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:24:12.894 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-12T01:24:12.894 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:24:12.894 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:24:12.894 INFO:teuthology.orchestra.run.smithi153.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout:Install 4 Packages 2024-09-12T01:24:12.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:24:12.896 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 79 M 2024-09-12T01:24:12.896 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 126 M 2024-09-12T01:24:12.896 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:24:13.288 INFO:teuthology.orchestra.run.smithi153.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 201 kB/s | 23 kB 00:00 2024-09-12T01:24:14.338 INFO:teuthology.orchestra.run.smithi153.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 27 MB/s | 29 MB 00:01 2024-09-12T01:24:14.522 INFO:teuthology.orchestra.run.smithi153.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 12 MB/s | 16 MB 00:01 2024-09-12T01:24:14.830 INFO:teuthology.orchestra.run.smithi153.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-12T01:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:24:14.831 INFO:teuthology.orchestra.run.smithi153.stdout:Total 41 MB/s | 79 MB 00:01 2024-09-12T01:24:15.517 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:24:15.876 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:24:15.876 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:24:16.873 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:24:16.873 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:24:17.114 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:24:17.158 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:24:19.340 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:24:20.023 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:24:20.116 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:24:22.390 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:24:22.926 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:24:23.052 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:24:27.908 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:24:27.943 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:24:32.783 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:02.594 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:02.635 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:02.933 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:02.933 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:25:02.933 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:25:02.933 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:25:03.762 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:25:04.146 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:25:04.235 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:25:04.235 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:25:04.236 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:25:04.236 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:25:04.236 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:25:04.236 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-12T01:25:04.236 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:25:04.236 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:25:04.296 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:25:04.297 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:25:04.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -qi grub2-tools 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Name : grub2-tools 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Epoch : 1 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Version : 2.06 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Release : 82.el9 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: x86_64 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Group : Unspecified 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Size : 8274670 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:License : GPLv3+ 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:25:04.337 INFO:teuthology.orchestra.run.smithi066.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:Packager : builder@centos.org 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:Vendor : CentOS 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:Summary : Support tools for GRUB. 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:Description : 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:hardware devices. 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:25:04.338 INFO:teuthology.orchestra.run.smithi066.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:25:04.340 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:25:04.340 INFO:teuthology.task.kernel:Updating grub on smithi066 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:25:04.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:25:05.038 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2024-09-12T01:25:06.382 INFO:teuthology.orchestra.run.smithi066.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:25:06.414 INFO:teuthology.orchestra.run.smithi066.stderr:done 2024-09-12T01:25:06.416 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2024-09-12T01:25:06.432 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.Zkh9J0DN0E 2024-09-12T01:25:06.432 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Zkh9J0DN0E 2024-09-12T01:25:06.501 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.Zkh9J0DN0E 2024-09-12T01:25:06.645 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.Zkh9J0DN0E is 6KB 2024-09-12T01:25:06.693 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.Zkh9J0DN0E 2024-09-12T01:25:06.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:25:06.772 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:25:06.772 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:25:06.772 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:25:06.773 INFO:teuthology.orchestra.run.smithi066.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:25:06.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:25:06.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2024-09-12T01:25:11.128 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:11.168 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:11.528 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:11.528 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:25:11.529 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:25:11.529 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:25:12.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:25:12.403 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:25:12.750 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:25:12.836 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:25:12.837 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:25:12.837 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:25:12.837 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:25:12.837 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:25:12.838 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-12T01:25:12.838 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:25:12.838 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:25:12.896 INFO:teuthology.orchestra.run.smithi153.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:25:12.910 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:25:12.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo rpm -qi grub2-tools 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Name : grub2-tools 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Epoch : 1 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Version : 2.06 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Release : 82.el9 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: x86_64 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Group : Unspecified 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Size : 8274670 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:License : GPLv3+ 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:25:12.942 INFO:teuthology.orchestra.run.smithi153.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:Packager : builder@centos.org 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:Vendor : CentOS 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:Summary : Support tools for GRUB. 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:Description : 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout:hardware devices. 2024-09-12T01:25:12.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:25:12.944 INFO:teuthology.orchestra.run.smithi153.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:25:12.944 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:25:12.944 INFO:teuthology.task.kernel:Updating grub on smithi153 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:25:12.945 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:25:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-12T01:25:14.925 INFO:teuthology.orchestra.run.smithi153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:25:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-12T01:25:14.966 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-12T01:25:14.981 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.53XhP4HeQf 2024-09-12T01:25:14.982 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.53XhP4HeQf 2024-09-12T01:25:15.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.53XhP4HeQf 2024-09-12T01:25:15.210 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.53XhP4HeQf is 6KB 2024-09-12T01:25:15.259 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.53XhP4HeQf 2024-09-12T01:25:15.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:25:15.337 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:25:15.337 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:25:15.337 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:25:15.337 INFO:teuthology.orchestra.run.smithi153.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:25:15.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:25:15.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-12T01:25:36.957 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-12T01:25:36.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:25:36.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:25:45.506 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-12T01:25:45.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:25:45.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:25:55.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T01:26:04.093 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T01:26:04.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:26:04.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:26:07.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T01:26:13.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:26:13.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:26:16.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T01:26:19.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:26:19.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:26:22.529 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2024-09-12T01:26:28.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:26:28.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:26:37.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:26:37.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:26:46.593 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-12T01:27:01.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:27:01.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:27:01.938 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T01:27:02.291 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:27:02.291 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:27:02.291 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-12T01:27:02.306 INFO:teuthology.orchestra.run.smithi153.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:27:02.306 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:27:02.306 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:27:02.306 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:27:03.308 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-12T01:27:03.308 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T01:27:03.406 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-12T01:27:03.432 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:09.571 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-12T01:27:09.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:27:09.988 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:27:09.988 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2024-09-12T01:27:10.004 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:27:10.004 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:27:10.004 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:27:10.004 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:27:11.005 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-12T01:27:11.006 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T01:27:11.096 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2024-09-12T01:27:11.120 DEBUG:teuthology.parallel:result is None 2024-09-12T01:27:11.120 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:27:11.127 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:27:11.127 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:27:11.130 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:27:11.149 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:27:11.154 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:27:11.163 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:27:11.163 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:27:11.190 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:27:11.332 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:27:11.337 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:27:11.338 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:27:11.340 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:27:11.371 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:27:11.373 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:27:11.382 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:27:11.384 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:27:11.385 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:27:11.392 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:27:11.392 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:27:11.432 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:27:11.461 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:27:11.470 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:27:11.470 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:27:11.502 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:27:11.520 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:27:11.606 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:27:11.653 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:27:11.748 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:27:11.785 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:27:11.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:27:11.855 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:27:11.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:27:11.950 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:27:12.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:27:12.077 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:27:12.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:27:12.143 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2024-09-12T01:27:12.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-12T01:27:12.204 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:27:12.240 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:27:12.686 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:27:12.697 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:27:12.697 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:27:12.713 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:27:12.727 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:27:12.727 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2024-09-12T01:27:12.796 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2024-09-12T01:27:12.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo service auditd rotate 2024-09-12T01:27:12.871 INFO:teuthology.orchestra.run.smithi153.stdout:Rotating logs: 2024-09-12T01:27:12.873 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:27:12.874 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2024-09-12T01:27:12.901 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2024-09-12T01:27:12.901 DEBUG:teuthology.orchestra.run.smithi153:> /usr/sbin/getenforce 2024-09-12T01:27:12.964 INFO:teuthology.orchestra.run.smithi153.stdout:Permissive 2024-09-12T01:27:12.965 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi153.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:27:12.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:27:12.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:27:12.991 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:27:13.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:27:13.021 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:27:13.021 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:27:13.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:27:13.135 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:27:13.149 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:27:13.161 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:27:13.162 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi066.front.sepia.ceph.com,smithi153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:30:59.692 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi153.front.sepia.ceph.com')] 2024-09-12T01:30:59.694 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:30:59.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:30:59.797 DEBUG:teuthology.orchestra.run.smithi066:> true 2024-09-12T01:30:59.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2024-09-12T01:30:59.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:30:59.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:30:59.975 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-12T01:31:00.053 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-12T01:31:00.053 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:31:00.064 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:31:00.065 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:31:00.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:31:00.068 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:31:00.068 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:31:00.098 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:31:00.113 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:31:00.123 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:31:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:31:00.139 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2024-09-12T01:31:00.151 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2024-09-12T01:31:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: ntpd: command not found 2024-09-12T01:31:00.166 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:31:00.173 INFO:teuthology.orchestra.run.smithi153.stdout:506 Cannot talk to daemon 2024-09-12T01:31:00.180 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:31:00.187 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:31:00.201 INFO:teuthology.orchestra.run.smithi153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:31:00.236 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:31:00.240 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:31:00.240 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-12T01:31:00.240 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.240 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.240 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.240 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.258 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:31:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:31:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-12T01:31:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.261 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:00.262 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:31:00.271 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:31:00.271 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:31:00.271 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:31:00.271 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:31:00.277 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:31:00.277 INFO:teuthology.task.install:extra packages: [] 2024-09-12T01:31:00.278 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:31:00.278 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:31:00.278 INFO:teuthology.packaging:ref: None 2024-09-12T01:31:00.278 INFO:teuthology.packaging:tag: None 2024-09-12T01:31:00.278 INFO:teuthology.packaging:branch: quincy 2024-09-12T01:31:00.278 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:31:00.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-12T01:31:00.281 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:31:00.281 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:31:00.281 INFO:teuthology.packaging:ref: None 2024-09-12T01:31:00.281 INFO:teuthology.packaging:tag: None 2024-09-12T01:31:00.281 INFO:teuthology.packaging:branch: quincy 2024-09-12T01:31:00.281 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:31:00.281 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-12T01:31:00.504 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/ 2024-09-12T01:31:00.504 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1609.g554ba93e 2024-09-12T01:31:00.537 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/ 2024-09-12T01:31:00.538 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1609.g554ba93e 2024-09-12T01:31:00.761 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:31:00.761 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:31:00.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:31:00.789 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-12T01:31:00.789 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:31:00.789 INFO:teuthology.packaging:ref: None 2024-09-12T01:31:00.790 INFO:teuthology.packaging:tag: None 2024-09-12T01:31:00.790 INFO:teuthology.packaging:branch: quincy 2024-09-12T01:31:00.790 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:31:00.790 DEBUG:teuthology.orchestra.run.smithi153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:31:00.806 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/quincy/554ba93e80bae18b3c5f0b2f10382dfb620c171f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:31:00.807 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:31:00.807 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:31:00.836 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-12T01:31:00.836 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:31:00.837 INFO:teuthology.packaging:ref: None 2024-09-12T01:31:00.837 INFO:teuthology.packaging:tag: None 2024-09-12T01:31:00.837 INFO:teuthology.packaging:branch: quincy 2024-09-12T01:31:00.837 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:31:00.837 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:31:00.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:31:00.906 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:31:00.933 DEBUG:teuthology.orchestra.run.smithi153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:31:00.984 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:31:00.997 INFO:teuthology.orchestra.run.smithi153.stdout:check_obsoletes = 1 2024-09-12T01:31:00.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum clean all 2024-09-12T01:31:01.050 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2024-09-12T01:31:01.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2024-09-12T01:31:01.231 INFO:teuthology.orchestra.run.smithi153.stdout:45 files removed 2024-09-12T01:31:01.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-radosgw 2024-09-12T01:31:01.298 INFO:teuthology.orchestra.run.smithi066.stdout:45 files removed 2024-09-12T01:31:01.326 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw 2024-09-12T01:31:01.991 INFO:teuthology.orchestra.run.smithi153.stdout:ceph packages for x86_64 173 kB/s | 77 kB 00:00 2024-09-12T01:31:02.061 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 177 kB/s | 77 kB 00:00 2024-09-12T01:31:02.308 INFO:teuthology.orchestra.run.smithi153.stdout:ceph noarch packages 40 kB/s | 11 kB 00:00 2024-09-12T01:31:02.353 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-09-12T01:31:02.583 INFO:teuthology.orchestra.run.smithi153.stdout:ceph source packages 7.6 kB/s | 1.8 kB 00:00 2024-09-12T01:31:02.637 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 7.3 kB/s | 1.8 kB 00:00 2024-09-12T01:31:03.420 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T01:31:03.425 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-12T01:31:05.926 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-12T01:31:10.563 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 20 MB 00:06 2024-09-12T01:31:10.935 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - CRB 5.5 MB/s | 6.5 MB 00:01 2024-09-12T01:31:13.378 INFO:teuthology.orchestra.run.smithi153.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-12T01:31:14.157 INFO:teuthology.orchestra.run.smithi153.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T01:31:16.689 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.5 MB 00:02 2024-09-12T01:31:18.964 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:01 2024-09-12T01:31:19.604 INFO:teuthology.orchestra.run.smithi153.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-12T01:31:19.718 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-12T01:31:21.988 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 14 M 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrading: 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 3.1 M 2024-09-12T01:31:22.007 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 2.9 M 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 5.0 M 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 22 M 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 25 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 637 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 457 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 4.9 M 2024-09-12T01:31:22.008 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 45 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 120 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 156 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 320 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 294 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 99 k 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:22.009 INFO:teuthology.orchestra.run.smithi153.stdout:Install 22 Packages 2024-09-12T01:31:22.010 INFO:teuthology.orchestra.run.smithi153.stdout:Upgrade 2 Packages 2024-09-12T01:31:22.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:22.010 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 58 M 2024-09-12T01:31:22.010 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:31:23.421 INFO:teuthology.orchestra.run.smithi153.stdout:(1/24): ceph-base-17.2.7-1609.g554ba93e.el9.x86 7.3 MB/s | 5.0 MB 00:00 2024-09-12T01:31:23.464 INFO:teuthology.orchestra.run.smithi153.stdout:(2/24): ceph-selinux-17.2.7-1609.g554ba93e.el9. 608 kB/s | 25 kB 00:00 2024-09-12T01:31:23.572 INFO:teuthology.orchestra.run.smithi153.stdout:(3/24): libcephfs2-17.2.7-1609.g554ba93e.el9.x8 5.8 MB/s | 637 kB 00:00 2024-09-12T01:31:23.664 INFO:teuthology.orchestra.run.smithi153.stdout:(4/24): libradosstriper1-17.2.7-1609.g554ba93e. 4.9 MB/s | 457 kB 00:00 2024-09-12T01:31:23.823 INFO:teuthology.orchestra.run.smithi153.stdout:(5/24): ceph-radosgw-17.2.7-1609.g554ba93e.el9. 13 MB/s | 14 MB 00:01 2024-09-12T01:31:23.865 INFO:teuthology.orchestra.run.smithi153.stdout:(6/24): python3-ceph-argparse-17.2.7-1609.g554b 1.1 MB/s | 45 kB 00:00 2024-09-12T01:31:23.948 INFO:teuthology.orchestra.run.smithi153.stdout:(7/24): python3-ceph-common-17.2.7-1609.g554ba9 1.4 MB/s | 120 kB 00:00 2024-09-12T01:31:24.023 INFO:teuthology.orchestra.run.smithi153.stdout:(8/24): librgw2-17.2.7-1609.g554ba93e.el9.x86_6 14 MB/s | 4.9 MB 00:00 2024-09-12T01:31:24.049 INFO:teuthology.orchestra.run.smithi153.stdout:(9/24): python3-cephfs-17.2.7-1609.g554ba93e.el 1.5 MB/s | 156 kB 00:00 2024-09-12T01:31:24.074 INFO:teuthology.orchestra.run.smithi153.stdout:(10/24): python3-rados-17.2.7-1609.g554ba93e.el 6.2 MB/s | 320 kB 00:00 2024-09-12T01:31:24.283 INFO:teuthology.orchestra.run.smithi153.stdout:(11/24): ceph-common-17.2.7-1609.g554ba93e.el9. 15 MB/s | 22 MB 00:01 2024-09-12T01:31:24.308 INFO:teuthology.orchestra.run.smithi153.stdout:(12/24): python3-rbd-17.2.7-1609.g554ba93e.el9. 1.1 MB/s | 294 kB 00:00 2024-09-12T01:31:24.333 INFO:teuthology.orchestra.run.smithi153.stdout:(13/24): python3-rgw-17.2.7-1609.g554ba93e.el9. 384 kB/s | 99 kB 00:00 2024-09-12T01:31:24.467 INFO:teuthology.orchestra.run.smithi153.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 285 kB/s | 45 kB 00:00 2024-09-12T01:31:24.509 INFO:teuthology.orchestra.run.smithi153.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 710 kB/s | 160 kB 00:00 2024-09-12T01:31:24.559 INFO:teuthology.orchestra.run.smithi153.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-12T01:31:24.593 INFO:teuthology.orchestra.run.smithi153.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-12T01:31:24.627 INFO:teuthology.orchestra.run.smithi153.stdout:(18/24): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-12T01:31:24.677 INFO:teuthology.orchestra.run.smithi153.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.6 MB/s | 309 kB 00:00 2024-09-12T01:31:24.694 INFO:teuthology.orchestra.run.smithi153.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 492 kB/s | 49 kB 00:00 2024-09-12T01:31:24.727 INFO:teuthology.orchestra.run.smithi153.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 725 kB/s | 67 kB 00:00 2024-09-12T01:31:24.777 INFO:teuthology.orchestra.run.smithi153.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T01:31:24.894 INFO:teuthology.orchestra.run.smithi153.stdout:(23/24): librados2-17.2.7-1609.g554ba93e.el9.x8 15 MB/s | 3.1 MB 00:00 2024-09-12T01:31:24.961 INFO:teuthology.orchestra.run.smithi153.stdout:(24/24): librbd1-17.2.7-1609.g554ba93e.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-12T01:31:24.966 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:31:24.966 INFO:teuthology.orchestra.run.smithi153.stdout:Total 20 MB/s | 58 MB 00:02 2024-09-12T01:31:25.031 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:31:25.064 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:31:25.064 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:31:25.476 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-12T01:31:25.728 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:31:25.729 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:31:26.979 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:31:27.357 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-12T01:31:27.447 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 2/26 2024-09-12T01:31:27.539 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 2/26 2024-09-12T01:31:27.616 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 3/26 2024-09-12T01:31:27.648 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 4/26 2024-09-12T01:31:27.719 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 4/26 2024-09-12T01:31:27.766 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-12T01:31:27.795 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-12T01:31:27.961 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 14 M 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2024-09-12T01:31:27.969 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 3.1 M 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 2.9 M 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 5.0 M 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 22 M 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 25 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 637 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 457 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:31:27.970 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 4.9 M 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 45 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 120 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 156 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 320 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 294 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 99 k 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:27.971 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:31:27.972 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:31:27.972 INFO:teuthology.orchestra.run.smithi066.stdout:Install 22 Packages 2024-09-12T01:31:27.972 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 2 Packages 2024-09-12T01:31:27.972 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:27.972 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 58 M 2024-09-12T01:31:27.972 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:31:28.232 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-12T01:31:28.259 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 8/26 2024-09-12T01:31:28.322 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 8/26 2024-09-12T01:31:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-12T01:31:28.410 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-argparse-2:17.2.7-1609.g554ba93e.el9. 10/26 2024-09-12T01:31:28.448 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 11/26 2024-09-12T01:31:28.508 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 12/26 2024-09-12T01:31:28.536 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_6 13/26 2024-09-12T01:31:28.602 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_6 13/26 2024-09-12T01:31:28.642 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-12T01:31:28.678 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-09-12T01:31:28.710 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-12T01:31:29.006 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-12T01:31:29.034 INFO:teuthology.orchestra.run.smithi066.stdout:(1/24): ceph-base-17.2.7-1609.g554ba93e.el9.x86 7.1 MB/s | 5.0 MB 00:00 2024-09-12T01:31:29.040 INFO:teuthology.orchestra.run.smithi153.stdout: Upgrading : librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 18/26 2024-09-12T01:31:29.076 INFO:teuthology.orchestra.run.smithi066.stdout:(2/24): ceph-selinux-17.2.7-1609.g554ba93e.el9. 605 kB/s | 25 kB 00:00 2024-09-12T01:31:29.114 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 18/26 2024-09-12T01:31:29.176 INFO:teuthology.orchestra.run.smithi066.stdout:(3/24): libcephfs2-17.2.7-1609.g554ba93e.el9.x8 6.2 MB/s | 637 kB 00:00 2024-09-12T01:31:29.186 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 19/26 2024-09-12T01:31:29.217 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ceph-common-2:17.2.7-1609.g554ba93e.el9.x8 20/26 2024-09-12T01:31:29.235 INFO:teuthology.orchestra.run.smithi066.stdout:(4/24): libradosstriper1-17.2.7-1609.g554ba93e. 7.7 MB/s | 457 kB 00:00 2024-09-12T01:31:29.685 INFO:teuthology.orchestra.run.smithi066.stdout:(5/24): librgw2-17.2.7-1609.g554ba93e.el9.x86_6 11 MB/s | 4.9 MB 00:00 2024-09-12T01:31:29.760 INFO:teuthology.orchestra.run.smithi066.stdout:(6/24): python3-ceph-argparse-17.2.7-1609.g554b 602 kB/s | 45 kB 00:00 2024-09-12T01:31:29.835 INFO:teuthology.orchestra.run.smithi066.stdout:(7/24): python3-ceph-common-17.2.7-1609.g554ba9 1.6 MB/s | 120 kB 00:00 2024-09-12T01:31:29.927 INFO:teuthology.orchestra.run.smithi066.stdout:(8/24): python3-cephfs-17.2.7-1609.g554ba93e.el 1.7 MB/s | 156 kB 00:00 2024-09-12T01:31:30.019 INFO:teuthology.orchestra.run.smithi066.stdout:(9/24): python3-rados-17.2.7-1609.g554ba93e.el9 3.4 MB/s | 320 kB 00:00 2024-09-12T01:31:30.136 INFO:teuthology.orchestra.run.smithi066.stdout:(10/24): python3-rbd-17.2.7-1609.g554ba93e.el9. 2.5 MB/s | 294 kB 00:00 2024-09-12T01:31:30.370 INFO:teuthology.orchestra.run.smithi066.stdout:(11/24): ceph-radosgw-17.2.7-1609.g554ba93e.el9 7.1 MB/s | 14 MB 00:02 2024-09-12T01:31:30.395 INFO:teuthology.orchestra.run.smithi066.stdout:(12/24): python3-rgw-17.2.7-1609.g554ba93e.el9. 384 kB/s | 99 kB 00:00 2024-09-12T01:31:30.662 INFO:teuthology.orchestra.run.smithi066.stdout:(13/24): ceph-common-17.2.7-1609.g554ba93e.el9. 9.7 MB/s | 22 MB 00:02 2024-09-12T01:31:30.688 INFO:teuthology.orchestra.run.smithi066.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 155 kB/s | 45 kB 00:00 2024-09-12T01:31:30.746 INFO:teuthology.orchestra.run.smithi066.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 426 kB/s | 160 kB 00:00 2024-09-12T01:31:30.797 INFO:teuthology.orchestra.run.smithi066.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-09-12T01:31:30.838 INFO:teuthology.orchestra.run.smithi066.stdout:(17/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-12T01:31:30.872 INFO:teuthology.orchestra.run.smithi066.stdout:(18/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 4.0 MB/s | 309 kB 00:00 2024-09-12T01:31:30.897 INFO:teuthology.orchestra.run.smithi066.stdout:(19/24): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-12T01:31:30.922 INFO:teuthology.orchestra.run.smithi066.stdout:(20/24): liboath-2.6.7-2.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-09-12T01:31:30.973 INFO:teuthology.orchestra.run.smithi066.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-12T01:31:31.140 INFO:teuthology.orchestra.run.smithi066.stdout:(22/24): librados2-17.2.7-1609.g554ba93e.el9.x8 14 MB/s | 3.1 MB 00:00 2024-09-12T01:31:31.174 INFO:teuthology.orchestra.run.smithi066.stdout:(23/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-09-12T01:31:31.215 INFO:teuthology.orchestra.run.smithi066.stdout:(24/24): librbd1-17.2.7-1609.g554ba93e.el9.x86_ 12 MB/s | 2.9 MB 00:00 2024-09-12T01:31:31.219 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:31:31.220 INFO:teuthology.orchestra.run.smithi066.stdout:Total 18 MB/s | 58 MB 00:03 2024-09-12T01:31:31.286 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:31:31.323 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:31:31.324 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:31:31.686 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 21/26 2024-09-12T01:31:31.722 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 21/26 2024-09-12T01:31:31.965 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:31:31.965 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:31:32.273 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 21/26 2024-09-12T01:31:32.308 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 22/26 2024-09-12T01:31:32.402 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 22/26 2024-09-12T01:31:32.403 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:31:32.403 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:31:32.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:32.443 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 23/26 2024-09-12T01:31:33.243 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:31:33.610 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-12T01:31:33.709 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 2/26 2024-09-12T01:31:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 2/26 2024-09-12T01:31:33.882 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 3/26 2024-09-12T01:31:33.910 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 4/26 2024-09-12T01:31:33.993 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 4/26 2024-09-12T01:31:34.037 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-12T01:31:34.075 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-12T01:31:34.539 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-12T01:31:34.572 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 8/26 2024-09-12T01:31:34.635 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 8/26 2024-09-12T01:31:34.672 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-12T01:31:34.716 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:17.2.7-1609.g554ba93e.el9. 10/26 2024-09-12T01:31:34.752 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 11/26 2024-09-12T01:31:34.816 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 12/26 2024-09-12T01:31:34.841 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_6 13/26 2024-09-12T01:31:34.908 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_6 13/26 2024-09-12T01:31:34.949 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-12T01:31:34.992 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-09-12T01:31:35.024 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-12T01:31:35.343 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-12T01:31:35.387 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 18/26 2024-09-12T01:31:35.471 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 18/26 2024-09-12T01:31:35.546 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 19/26 2024-09-12T01:31:35.572 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:17.2.7-1609.g554ba93e.el9.x8 20/26 2024-09-12T01:31:38.128 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 21/26 2024-09-12T01:31:38.160 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 21/26 2024-09-12T01:31:38.712 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 21/26 2024-09-12T01:31:38.747 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 22/26 2024-09-12T01:31:38.843 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 22/26 2024-09-12T01:31:38.843 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:31:38.843 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:31:38.843 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:38.873 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 23/26 2024-09-12T01:31:42.285 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 23/26 2024-09-12T01:31:42.285 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /sys 2024-09-12T01:31:42.285 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /proc 2024-09-12T01:31:42.285 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /mnt 2024-09-12T01:31:42.285 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /var/tmp 2024-09-12T01:31:42.286 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /home 2024-09-12T01:31:42.286 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /root 2024-09-12T01:31:42.286 INFO:teuthology.orchestra.run.smithi153.stdout:skipping the directory /tmp 2024-09-12T01:31:42.286 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:43.617 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 24/26 2024-09-12T01:31:43.699 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 24/26 2024-09-12T01:31:43.699 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:31:43.699 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:31:43.699 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:31:43.700 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:31:43.700 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:43.701 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-12T01:31:43.786 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-12T01:31:43.786 INFO:teuthology.orchestra.run.smithi153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-12T01:31:45.089 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 1/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 2/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 3/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 4/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 5/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_6 6/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 7/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1609.g554ba93e.el9. 8/26 2024-09-12T01:31:45.090 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ceph-common-2:17.2.7-1609.g554ba93e.el9.x8 9/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 10/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 11/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 12/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 13/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-12T01:31:45.091 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-09-12T01:31:45.092 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-12T01:31:45.092 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-12T01:31:45.092 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-12T01:31:45.092 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 23/26 2024-09-12T01:31:45.092 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-12T01:31:45.092 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 25/26 2024-09-12T01:31:45.999 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-12T01:31:45.999 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:45.999 INFO:teuthology.orchestra.run.smithi153.stdout:Upgraded: 2024-09-12T01:31:45.999 INFO:teuthology.orchestra.run.smithi153.stdout: librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:45.999 INFO:teuthology.orchestra.run.smithi153.stdout: librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:45.999 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.000 INFO:teuthology.orchestra.run.smithi153.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-argparse-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:46.001 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:31:46.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-test 2024-09-12T01:31:46.896 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:31:47.033 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 48 M 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 163 k 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:31:47.034 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:47.035 INFO:teuthology.orchestra.run.smithi153.stdout:Install 4 Packages 2024-09-12T01:31:47.035 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:47.035 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 48 M 2024-09-12T01:31:47.035 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 193 M 2024-09-12T01:31:47.035 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:31:47.307 INFO:teuthology.orchestra.run.smithi153.stdout:(1/4): libcephsqlite-17.2.7-1609.g554ba93e.el9. 732 kB/s | 163 kB 00:00 2024-09-12T01:31:47.874 INFO:teuthology.orchestra.run.smithi153.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 385 kB/s | 304 kB 00:00 2024-09-12T01:31:47.916 INFO:teuthology.orchestra.run.smithi153.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 106 kB/s | 64 kB 00:00 2024-09-12T01:31:48.583 INFO:teuthology.orchestra.run.smithi153.stdout:(4/4): ceph-test-17.2.7-1609.g554ba93e.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-12T01:31:48.585 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:31:48.586 INFO:teuthology.orchestra.run.smithi153.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-12T01:31:48.613 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:31:48.634 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:31:48.634 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:31:49.011 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:31:49.012 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:31:49.206 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 23/26 2024-09-12T01:31:49.206 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2024-09-12T01:31:49.206 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2024-09-12T01:31:49.207 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2024-09-12T01:31:49.207 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2024-09-12T01:31:49.207 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2024-09-12T01:31:49.207 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2024-09-12T01:31:49.207 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2024-09-12T01:31:49.207 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:49.537 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:31:49.602 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T01:31:49.640 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T01:31:49.668 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 3/4 2024-09-12T01:31:50.572 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 24/26 2024-09-12T01:31:50.666 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 24/26 2024-09-12T01:31:50.666 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:31:50.666 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:31:50.666 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:31:50.667 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:31:50.667 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:50.668 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-12T01:31:50.758 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-12T01:31:50.758 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-12T01:31:52.119 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-12T01:31:52.119 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 1/26 2024-09-12T01:31:52.119 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 2/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 3/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 4/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 5/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_6 6/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 7/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1609.g554ba93e.el9. 8/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:17.2.7-1609.g554ba93e.el9.x8 9/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 10/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 11/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 12/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 13/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-12T01:31:52.120 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 23/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-12T01:31:52.121 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 25/26 2024-09-12T01:31:52.887 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:31:52.888 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:31:52.889 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.890 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.890 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:52.890 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:31:52.890 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:52.890 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:31:53.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-test 2024-09-12T01:31:53.818 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:31:53.963 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 48 M 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 163 k 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:53.964 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:31:53.965 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:31:53.965 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2024-09-12T01:31:53.965 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:31:53.965 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 48 M 2024-09-12T01:31:53.965 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 193 M 2024-09-12T01:31:53.965 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:31:54.087 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 3/4 2024-09-12T01:31:54.157 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 4/4 2024-09-12T01:31:54.206 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-12T01:31:54.248 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-12T01:31:54.290 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): libcephsqlite-17.2.7-1609.g554ba93e.el9. 770 kB/s | 163 kB 00:00 2024-09-12T01:31:55.599 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): ceph-test-17.2.7-1609.g554ba93e.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-12T01:31:55.600 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:31:55.604 INFO:teuthology.orchestra.run.smithi066.stdout:Total 30 MB/s | 48 MB 00:01 2024-09-12T01:31:55.628 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:31:55.648 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:31:55.649 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:31:56.059 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:31:56.059 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:31:56.412 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 4/4 2024-09-12T01:31:56.413 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 1/4 2024-09-12T01:31:56.413 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 2/4 2024-09-12T01:31:56.413 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T01:31:56.611 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:31:56.685 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-12T01:31:56.694 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:56.695 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:31:56.723 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-12T01:31:56.750 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 3/4 2024-09-12T01:31:56.974 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph 2024-09-12T01:31:57.542 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:31:57.678 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:31:57.680 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:57.680 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: ceph x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 6.5 k 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 2.1 M 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 1.4 M 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 240 k 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 3.9 M 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 15 M 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:31:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:31:57.682 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:57.683 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:31:57.684 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:31:57.684 INFO:teuthology.orchestra.run.smithi153.stdout:Install 34 Packages 2024-09-12T01:31:57.684 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:31:57.684 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 27 M 2024-09-12T01:31:57.684 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 96 M 2024-09-12T01:31:57.684 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:31:58.357 INFO:teuthology.orchestra.run.smithi153.stdout:(1/34): ceph-17.2.7-1609.g554ba93e.el9.x86_64.r 53 kB/s | 6.5 kB 00:00 2024-09-12T01:31:58.549 INFO:teuthology.orchestra.run.smithi153.stdout:(2/34): ceph-mgr-17.2.7-1609.g554ba93e.el9.x86_ 4.5 MB/s | 1.4 MB 00:00 2024-09-12T01:31:58.599 INFO:teuthology.orchestra.run.smithi153.stdout:(3/34): ceph-mds-17.2.7-1609.g554ba93e.el9.x86_ 5.7 MB/s | 2.1 MB 00:00 2024-09-12T01:31:58.667 INFO:teuthology.orchestra.run.smithi153.stdout:(4/34): ceph-mon-17.2.7-1609.g554ba93e.el9.x86_ 13 MB/s | 3.9 MB 00:00 2024-09-12T01:31:58.692 INFO:teuthology.orchestra.run.smithi153.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1609.g554b 2.6 MB/s | 240 kB 00:00 2024-09-12T01:31:58.825 INFO:teuthology.orchestra.run.smithi153.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-09-12T01:31:58.867 INFO:teuthology.orchestra.run.smithi153.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-12T01:31:58.909 INFO:teuthology.orchestra.run.smithi153.stdout:(8/34): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-12T01:31:59.060 INFO:teuthology.orchestra.run.smithi153.stdout:(9/34): ceph-osd-17.2.7-1609.g554ba93e.el9.x86_ 30 MB/s | 15 MB 00:00 2024-09-12T01:31:59.094 INFO:teuthology.orchestra.run.smithi153.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 3.1 MB/s | 1.2 MB 00:00 2024-09-12T01:31:59.118 INFO:teuthology.orchestra.run.smithi153.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 598 kB/s | 125 kB 00:00 2024-09-12T01:31:59.219 INFO:teuthology.orchestra.run.smithi153.stdout:(12/34): python3-markupsafe-1.1.1-12.el9.x86_64 348 kB/s | 35 kB 00:00 2024-09-12T01:31:59.244 INFO:teuthology.orchestra.run.smithi153.stdout:(13/34): python3-urllib3-1.26.5-6.el9.noarch.rp 1.1 MB/s | 215 kB 00:00 2024-09-12T01:31:59.294 INFO:teuthology.orchestra.run.smithi153.stdout:(14/34): python3-mako-1.1.4-6.el9.noarch.rpm 983 kB/s | 172 kB 00:00 2024-09-12T01:31:59.319 INFO:teuthology.orchestra.run.smithi153.stdout:(15/34): python3-packaging-20.9-5.el9.noarch.rp 769 kB/s | 77 kB 00:00 2024-09-12T01:31:59.345 INFO:teuthology.orchestra.run.smithi153.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-12T01:31:59.387 INFO:teuthology.orchestra.run.smithi153.stdout:(17/34): python3-pytz-2021.1-5.el9.noarch.rpm 358 kB/s | 51 kB 00:00 2024-09-12T01:31:59.412 INFO:teuthology.orchestra.run.smithi153.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 471 kB/s | 43 kB 00:00 2024-09-12T01:31:59.445 INFO:teuthology.orchestra.run.smithi153.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 418 kB/s | 11 kB 00:00 2024-09-12T01:31:59.471 INFO:teuthology.orchestra.run.smithi153.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 767 kB/s | 18 kB 00:00 2024-09-12T01:31:59.496 INFO:teuthology.orchestra.run.smithi153.stdout:(21/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-12T01:31:59.521 INFO:teuthology.orchestra.run.smithi153.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-12T01:31:59.546 INFO:teuthology.orchestra.run.smithi153.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-09-12T01:31:59.572 INFO:teuthology.orchestra.run.smithi153.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-12T01:31:59.597 INFO:teuthology.orchestra.run.smithi153.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 919 kB/s | 46 kB 00:00 2024-09-12T01:31:59.623 INFO:teuthology.orchestra.run.smithi153.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-12T01:31:59.648 INFO:teuthology.orchestra.run.smithi153.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 664 kB/s | 16 kB 00:00 2024-09-12T01:31:59.683 INFO:teuthology.orchestra.run.smithi153.stdout:(28/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-12T01:31:59.715 INFO:teuthology.orchestra.run.smithi153.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-09-12T01:31:59.740 INFO:teuthology.orchestra.run.smithi153.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 634 kB/s | 36 kB 00:00 2024-09-12T01:31:59.765 INFO:teuthology.orchestra.run.smithi153.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-12T01:31:59.791 INFO:teuthology.orchestra.run.smithi153.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 806 kB/s | 20 kB 00:00 2024-09-12T01:31:59.816 INFO:teuthology.orchestra.run.smithi153.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T01:31:59.841 INFO:teuthology.orchestra.run.smithi153.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-12T01:31:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:31:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:Total 13 MB/s | 27 MB 00:02 2024-09-12T01:31:59.983 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:00.020 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:00.020 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:00.423 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:00.423 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:01.408 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 3/4 2024-09-12T01:32:01.502 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 4/4 2024-09-12T01:32:01.661 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:01.727 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-12T01:32:01.820 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-12T01:32:01.821 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-12T01:32:01.875 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-12T01:32:01.953 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-12T01:32:02.003 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-12T01:32:02.046 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-12T01:32:02.076 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-12T01:32:02.111 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-12T01:32:02.153 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-12T01:32:02.201 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-12T01:32:02.236 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-12T01:32:02.271 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-12T01:32:02.322 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-12T01:32:02.361 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-12T01:32:02.436 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-12T01:32:02.590 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-12T01:32:02.674 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-12T01:32:02.732 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-12T01:32:02.771 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-12T01:32:02.828 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-12T01:32:02.883 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-12T01:32:03.067 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-12T01:32:03.125 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-12T01:32:03.203 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-12T01:32:03.291 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-12T01:32:03.328 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-12T01:32:03.448 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-12T01:32:03.595 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1609.g554ba93e.el9. 29/34 2024-09-12T01:32:03.626 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 30/34 2024-09-12T01:32:03.633 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 4/4 2024-09-12T01:32:03.633 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 1/4 2024-09-12T01:32:03.633 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 2/4 2024-09-12T01:32:03.633 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-12T01:32:03.653 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 30/34 2024-09-12T01:32:03.653 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:03.653 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:32:03.653 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:32:03.653 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:32:03.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:03.955 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-12T01:32:03.955 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:03.955 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:03.955 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:03.955 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:03.956 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:32:03.956 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:32:03.956 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:03.956 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:04.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph 2024-09-12T01:32:04.807 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:04.952 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 31/34 2024-09-12T01:32:04.957 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:04.959 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:04.959 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:04.959 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:04.959 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 6.5 k 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 2.1 M 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 1.4 M 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 240 k 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 3.9 M 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 15 M 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:32:04.960 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:32:04.961 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:32:04.962 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout:Install 34 Packages 2024-09-12T01:32:04.963 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:04.964 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 27 M 2024-09-12T01:32:04.964 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 96 M 2024-09-12T01:32:04.964 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:04.980 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 31/34 2024-09-12T01:32:04.980 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:04.980 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:32:04.980 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:32:04.980 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:32:04.980 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:05.469 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 32/34 2024-09-12T01:32:05.493 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 32/34 2024-09-12T01:32:05.494 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:05.494 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:32:05.494 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:32:05.494 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:32:05.494 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:05.695 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 33/34 2024-09-12T01:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 33/34 2024-09-12T01:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:32:05.719 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:05.784 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 34/34 2024-09-12T01:32:05.790 INFO:teuthology.orchestra.run.smithi066.stdout:(1/34): ceph-17.2.7-1609.g554ba93e.el9.x86_64.r 50 kB/s | 6.5 kB 00:00 2024-09-12T01:32:05.965 INFO:teuthology.orchestra.run.smithi066.stdout:(2/34): ceph-mds-17.2.7-1609.g554ba93e.el9.x86_ 6.8 MB/s | 2.1 MB 00:00 2024-09-12T01:32:06.008 INFO:teuthology.orchestra.run.smithi066.stdout:(3/34): ceph-mgr-17.2.7-1609.g554ba93e.el9.x86_ 4.0 MB/s | 1.4 MB 00:00 2024-09-12T01:32:06.100 INFO:teuthology.orchestra.run.smithi066.stdout:(4/34): ceph-mgr-modules-core-17.2.7-1609.g554b 2.6 MB/s | 240 kB 00:00 2024-09-12T01:32:06.292 INFO:teuthology.orchestra.run.smithi066.stdout:(5/34): ceph-mon-17.2.7-1609.g554ba93e.el9.x86_ 7.8 MB/s | 3.9 MB 00:00 2024-09-12T01:32:06.467 INFO:teuthology.orchestra.run.smithi066.stdout:(6/34): ceph-osd-17.2.7-1609.g554ba93e.el9.x86_ 31 MB/s | 15 MB 00:00 2024-09-12T01:32:07.025 INFO:teuthology.orchestra.run.smithi066.stdout:(7/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 274 kB/s | 253 kB 00:00 2024-09-12T01:32:07.192 INFO:teuthology.orchestra.run.smithi066.stdout:(8/34): python3-ply-3.11-14.el9.noarch.rpm 149 kB/s | 106 kB 00:00 2024-09-12T01:32:07.284 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 34/34 2024-09-12T01:32:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 1/34 2024-09-12T01:32:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 2/34 2024-09-12T01:32:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 3/34 2024-09-12T01:32:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 4/34 2024-09-12T01:32:07.285 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 5/34 2024-09-12T01:32:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1609.g554ba93e.el9. 6/34 2024-09-12T01:32:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-12T01:32:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-12T01:32:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-12T01:32:07.286 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-12T01:32:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-12T01:32:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-12T01:32:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-12T01:32:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-12T01:32:07.287 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-12T01:32:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-12T01:32:07.288 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-12T01:32:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-12T01:32:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-12T01:32:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-12T01:32:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-12T01:32:07.289 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-12T01:32:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-12T01:32:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-12T01:32:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-12T01:32:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-12T01:32:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-12T01:32:07.290 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-12T01:32:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-12T01:32:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-12T01:32:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-12T01:32:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-12T01:32:07.291 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-12T01:32:07.351 INFO:teuthology.orchestra.run.smithi066.stdout:(9/34): python3-cryptography-36.0.1-4.el9.x86_6 1.2 MB/s | 1.2 MB 00:01 2024-09-12T01:32:07.759 INFO:teuthology.orchestra.run.smithi066.stdout:(10/34): python3-pycparser-2.20-6.el9.noarch.rp 184 kB/s | 135 kB 00:00 2024-09-12T01:32:07.901 INFO:teuthology.orchestra.run.smithi066.stdout:(11/34): python3-requests-2.25.1-8.el9.noarch.r 176 kB/s | 125 kB 00:00 2024-09-12T01:32:07.935 INFO:teuthology.orchestra.run.smithi066.stdout:(12/34): python3-mako-1.1.4-6.el9.noarch.rpm 984 kB/s | 172 kB 00:00 2024-09-12T01:32:07.993 INFO:teuthology.orchestra.run.smithi066.stdout:(13/34): python3-packaging-20.9-5.el9.noarch.rp 1.3 MB/s | 77 kB 00:00 2024-09-12T01:32:08.019 INFO:teuthology.orchestra.run.smithi066.stdout:(14/34): python3-markupsafe-1.1.1-12.el9.x86_64 297 kB/s | 35 kB 00:00 2024-09-12T01:32:08.044 INFO:teuthology.orchestra.run.smithi066.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:32:08.077 INFO:teuthology.orchestra.run.smithi066.stdout:(16/34): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-09-12T01:32:08.111 INFO:teuthology.orchestra.run.smithi066.stdout:(17/34): python3-urllib3-1.26.5-6.el9.noarch.rp 283 kB/s | 215 kB 00:00 2024-09-12T01:32:08.137 INFO:teuthology.orchestra.run.smithi066.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2024-09-12T01:32:08.170 INFO:teuthology.orchestra.run.smithi066.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 416 kB/s | 11 kB 00:00 2024-09-12T01:32:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-12T01:32:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:08.195 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:08.195 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:08.196 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:32:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:32:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:32:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:32:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:32:08.197 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:32:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:32:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:32:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:32:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:32:08.198 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:32:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:32:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:32:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:32:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:32:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:32:08.199 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:32:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:32:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:32:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:32:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:32:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:32:08.200 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:32:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:32:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:32:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:32:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:32:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:32:08.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:08.202 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:08.202 INFO:teuthology.orchestra.run.smithi066.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-12T01:32:08.220 INFO:teuthology.orchestra.run.smithi066.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 367 kB/s | 18 kB 00:00 2024-09-12T01:32:08.245 INFO:teuthology.orchestra.run.smithi066.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 938 kB/s | 23 kB 00:00 2024-09-12T01:32:08.271 INFO:teuthology.orchestra.run.smithi066.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 390 kB/s | 19 kB 00:00 2024-09-12T01:32:08.297 INFO:teuthology.orchestra.run.smithi066.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 800 kB/s | 20 kB 00:00 2024-09-12T01:32:08.321 INFO:teuthology.orchestra.run.smithi066.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 930 kB/s | 46 kB 00:00 2024-09-12T01:32:08.347 INFO:teuthology.orchestra.run.smithi066.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-12T01:32:08.372 INFO:teuthology.orchestra.run.smithi066.stdout:(27/34): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-12T01:32:08.405 INFO:teuthology.orchestra.run.smithi066.stdout:(28/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-09-12T01:32:08.431 INFO:teuthology.orchestra.run.smithi066.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-09-12T01:32:08.456 INFO:teuthology.orchestra.run.smithi066.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-12T01:32:08.481 INFO:teuthology.orchestra.run.smithi066.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-12T01:32:08.507 INFO:teuthology.orchestra.run.smithi066.stdout:(32/34): python3-zc-lockfile-2.0-10.el9.noarch. 804 kB/s | 20 kB 00:00 2024-09-12T01:32:08.532 INFO:teuthology.orchestra.run.smithi066.stdout:(33/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-12T01:32:08.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-base 2024-09-12T01:32:08.565 INFO:teuthology.orchestra.run.smithi066.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-12T01:32:08.571 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:08.571 INFO:teuthology.orchestra.run.smithi066.stdout:Total 7.5 MB/s | 27 MB 00:03 2024-09-12T01:32:08.709 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:08.749 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:08.750 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:09.115 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:09.148 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:09.149 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:09.203 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:09.245 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:09.246 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:09.246 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:09.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install cephadm 2024-09-12T01:32:09.883 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:10.017 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 83 k 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:10.018 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:32:10.019 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:10.019 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 83 k 2024-09-12T01:32:10.019 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 375 k 2024-09-12T01:32:10.019 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:10.219 INFO:teuthology.orchestra.run.smithi153.stdout:cephadm-17.2.7-1609.g554ba93e.el9.noarch.rpm 411 kB/s | 83 kB 00:00 2024-09-12T01:32:10.220 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:10.220 INFO:teuthology.orchestra.run.smithi153.stdout:Total 409 kB/s | 83 kB 00:00 2024-09-12T01:32:10.221 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:10.225 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:10.226 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:10.227 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:10.228 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:10.301 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:10.562 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:10.618 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-12T01:32:10.651 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-12T01:32:10.684 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-12T01:32:10.719 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:10.781 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-12T01:32:10.805 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:10.858 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-12T01:32:10.904 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-12T01:32:10.938 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-12T01:32:10.968 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-12T01:32:11.002 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-12T01:32:11.030 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-12T01:32:11.072 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-12T01:32:11.106 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-12T01:32:11.140 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-12T01:32:11.157 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:11.190 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-12T01:32:11.234 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-12T01:32:11.314 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-12T01:32:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:11.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:11.399 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:11.399 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:11.399 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:11.582 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-12T01:32:11.599 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T01:32:11.665 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-12T01:32:11.716 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-12T01:32:11.754 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-12T01:32:11.812 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-12T01:32:11.875 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-12T01:32:12.071 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-12T01:32:12.132 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-12T01:32:12.172 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:12.213 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-12T01:32:12.303 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-12T01:32:12.304 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:12.305 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:12.305 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-12T01:32:12.306 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:12.306 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:12.306 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 137 k 2024-09-12T01:32:12.306 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:12.306 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:12.306 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:12.307 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:32:12.307 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:12.307 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 137 k 2024-09-12T01:32:12.307 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 379 k 2024-09-12T01:32:12.307 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:12.344 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-12T01:32:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-12T01:32:12.526 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-immutable-object-cache-17.2.7-1609.g554ba9 628 kB/s | 137 kB 00:00 2024-09-12T01:32:12.526 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:12.526 INFO:teuthology.orchestra.run.smithi153.stdout:Total 623 kB/s | 137 kB 00:00 2024-09-12T01:32:12.527 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:12.534 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:12.534 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:12.593 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:12.593 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:12.625 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1609.g554ba93e.el9. 29/34 2024-09-12T01:32:12.649 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 30/34 2024-09-12T01:32:12.676 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 30/34 2024-09-12T01:32:12.676 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:12.676 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:32:12.676 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:32:12.677 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:32:12.677 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:12.746 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:12.843 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e. 1/1 2024-09-12T01:32:12.869 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e. 1/1 2024-09-12T01:32:12.869 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:12.869 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:32:12.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:13.772 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e. 1/1 2024-09-12T01:32:13.772 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:13.772 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:13.772 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:13.772 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:13.773 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:13.994 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr 2024-09-12T01:32:14.084 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 31/34 2024-09-12T01:32:14.113 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 31/34 2024-09-12T01:32:14.114 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:14.114 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:32:14.114 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:32:14.114 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:32:14.114 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:14.510 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 32/34 2024-09-12T01:32:14.536 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 32/34 2024-09-12T01:32:14.536 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:14.536 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:32:14.537 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:32:14.537 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:32:14.537 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:14.560 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:14.653 INFO:teuthology.orchestra.run.smithi153.stdout:Package ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:14.694 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:14.695 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:14.695 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:14.751 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 33/34 2024-09-12T01:32:14.766 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T01:32:14.776 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 33/34 2024-09-12T01:32:14.776 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:14.776 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:32:14.777 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:32:14.777 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:32:14.777 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:14.842 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 34/34 2024-09-12T01:32:15.323 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:15.460 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:15.460 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:15.460 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:32:15.460 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:15.460 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 3.4 M 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 24 k 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 15 k 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout:Installing weak dependencies: 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout:Install 7 Packages 2024-09-12T01:32:15.461 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:15.462 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 3.7 M 2024-09-12T01:32:15.462 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 80 M 2024-09-12T01:32:15.462 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:15.770 INFO:teuthology.orchestra.run.smithi153.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1609.g554b 95 kB/s | 15 kB 00:00 2024-09-12T01:32:15.787 INFO:teuthology.orchestra.run.smithi153.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1609.g554 143 kB/s | 24 kB 00:00 2024-09-12T01:32:15.821 INFO:teuthology.orchestra.run.smithi153.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 181 kB/s | 9.0 kB 00:00 2024-09-12T01:32:15.846 INFO:teuthology.orchestra.run.smithi153.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 698 kB/s | 41 kB 00:00 2024-09-12T01:32:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 765 kB/s | 31 kB 00:00 2024-09-12T01:32:15.888 INFO:teuthology.orchestra.run.smithi153.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-12T01:32:16.005 INFO:teuthology.orchestra.run.smithi153.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1609.g554ba93e 8.6 MB/s | 3.4 MB 00:00 2024-09-12T01:32:16.008 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:16.009 INFO:teuthology.orchestra.run.smithi153.stdout:Total 6.7 MB/s | 3.7 MB 00:00 2024-09-12T01:32:16.009 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:16.017 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:16.017 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:16.103 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:16.103 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:16.413 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 34/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 1/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 2/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 3/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 4/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 5/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1609.g554ba93e.el9. 6/34 2024-09-12T01:32:16.419 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-12T01:32:16.420 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-12T01:32:16.421 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-12T01:32:16.481 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-12T01:32:16.516 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-12T01:32:16.570 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-12T01:32:16.602 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-12T01:32:16.631 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1609.g554ba93e.el9.n 5/7 2024-09-12T01:32:17.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:32:17.314 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:32:17.315 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:17.316 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:17.636 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1609.g554ba93e.el9. 6/7 2024-09-12T01:32:17.676 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarc 7/7 2024-09-12T01:32:17.708 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-base 2024-09-12T01:32:18.303 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:18.396 INFO:teuthology.orchestra.run.smithi066.stdout:Package ceph-base-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:18.440 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:18.441 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:32:18.441 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:18.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install cephadm 2024-09-12T01:32:18.760 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarc 7/7 2024-09-12T01:32:18.760 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1609.g554ba93e.el9. 1/7 2024-09-12T01:32:18.760 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarc 2/7 2024-09-12T01:32:18.760 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1609.g554ba93e.el9.n 3/7 2024-09-12T01:32:18.760 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-12T01:32:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-12T01:32:18.761 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-12T01:32:19.041 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-12T01:32:19.041 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:19.041 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:19.041 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-grafana-dashboards-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-prometheus-alerts-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:19.042 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:19.093 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:54 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:19.232 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:19.233 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:19.233 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:19.233 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 83 k 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 83 k 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 375 k 2024-09-12T01:32:19.234 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:19.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T01:32:19.424 INFO:teuthology.orchestra.run.smithi066.stdout:cephadm-17.2.7-1609.g554ba93e.el9.noarch.rpm 435 kB/s | 83 kB 00:00 2024-09-12T01:32:19.425 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:19.425 INFO:teuthology.orchestra.run.smithi066.stdout:Total 431 kB/s | 83 kB 00:00 2024-09-12T01:32:19.425 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:19.431 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:19.431 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:19.433 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:19.434 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:19.510 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:19.833 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:19.943 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:19.966 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:19.967 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-09-12T01:32:19.967 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:32:19.967 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-09-12T01:32:19.967 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:19.967 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 7.4 M 2024-09-12T01:32:19.967 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:32:19.968 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:32:19.969 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:19.969 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:19.969 INFO:teuthology.orchestra.run.smithi153.stdout:======================================================================================= 2024-09-12T01:32:19.969 INFO:teuthology.orchestra.run.smithi153.stdout:Install 12 Packages 2024-09-12T01:32:19.969 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:19.970 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 38 M 2024-09-12T01:32:19.970 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 212 M 2024-09-12T01:32:19.970 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:20.039 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:20.381 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:20.620 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/1 2024-09-12T01:32:20.620 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:20.620 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:20.620 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:20.620 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:20.620 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:20.830 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-immutable-object-cache 2024-09-12T01:32:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:(1/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-12T01:32:21.313 INFO:teuthology.orchestra.run.smithi153.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 235 kB/s | 191 kB 00:00 2024-09-12T01:32:21.421 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:21.513 INFO:teuthology.orchestra.run.smithi153.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-12T01:32:21.555 INFO:teuthology.orchestra.run.smithi153.stdout:(4/12): libgfortran-11.5.0-2.el9.x86_64.rpm 760 kB/s | 801 kB 00:01 2024-09-12T01:32:21.557 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:21.558 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2024-09-12T01:32:21.558 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:21.558 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:21.558 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 137 k 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 137 k 2024-09-12T01:32:21.559 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 379 k 2024-09-12T01:32:21.560 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:21.772 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-immutable-object-cache-17.2.7-1609.g554ba9 650 kB/s | 137 kB 00:00 2024-09-12T01:32:21.772 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:21.772 INFO:teuthology.orchestra.run.smithi066.stdout:Total 644 kB/s | 137 kB 00:00 2024-09-12T01:32:21.773 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:21.781 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:21.781 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:21.841 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:21.841 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:21.996 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:22.039 INFO:teuthology.orchestra.run.smithi153.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 35 kB/s | 18 kB 00:00 2024-09-12T01:32:22.056 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e. 1/1 2024-09-12T01:32:22.083 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e. 1/1 2024-09-12T01:32:22.083 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:22.083 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:32:22.083 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:22.122 INFO:teuthology.orchestra.run.smithi153.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 69 kB/s | 38 kB 00:00 2024-09-12T01:32:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.6 MB/s | 3.0 MB 00:01 2024-09-12T01:32:22.881 INFO:teuthology.orchestra.run.smithi153.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 323 kB/s | 245 kB 00:00 2024-09-12T01:32:22.997 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e. 1/1 2024-09-12T01:32:22.997 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:22.997 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:22.997 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:22.997 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:22.998 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:23.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr 2024-09-12T01:32:23.223 INFO:teuthology.orchestra.run.smithi153.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.2 MB/s | 4.9 MB 00:01 2024-09-12T01:32:23.640 INFO:teuthology.orchestra.run.smithi153.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-12T01:32:23.706 INFO:teuthology.orchestra.run.smithi153.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 304 kB/s | 250 kB 00:00 2024-09-12T01:32:23.789 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:23.896 INFO:teuthology.orchestra.run.smithi066.stdout:Package ceph-mgr-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:23.940 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:23.941 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:32:23.941 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:24.016 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-dashboard 2024-09-12T01:32:24.606 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:24.743 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 3.4 M 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:32:24.744 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 24 k 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 15 k 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout:Install 7 Packages 2024-09-12T01:32:24.745 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:24.746 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 3.7 M 2024-09-12T01:32:24.746 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 80 M 2024-09-12T01:32:24.746 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:24.807 INFO:teuthology.orchestra.run.smithi153.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-09-12T01:32:24.808 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:24.809 INFO:teuthology.orchestra.run.smithi153.stdout:Total 7.9 MB/s | 38 MB 00:04 2024-09-12T01:32:25.074 INFO:teuthology.orchestra.run.smithi066.stdout:(1/7): ceph-prometheus-alerts-17.2.7-1609.g554b 97 kB/s | 15 kB 00:00 2024-09-12T01:32:25.100 INFO:teuthology.orchestra.run.smithi066.stdout:(2/7): ceph-grafana-dashboards-17.2.7-1609.g554 139 kB/s | 24 kB 00:00 2024-09-12T01:32:25.142 INFO:teuthology.orchestra.run.smithi066.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-12T01:32:25.163 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:25.167 INFO:teuthology.orchestra.run.smithi066.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-12T01:32:25.184 INFO:teuthology.orchestra.run.smithi066.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 488 kB/s | 41 kB 00:00 2024-09-12T01:32:25.191 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:25.191 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:25.209 INFO:teuthology.orchestra.run.smithi066.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-12T01:32:25.317 INFO:teuthology.orchestra.run.smithi066.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1609.g554ba93e 8.5 MB/s | 3.4 MB 00:00 2024-09-12T01:32:25.321 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:25.321 INFO:teuthology.orchestra.run.smithi066.stdout:Total 6.3 MB/s | 3.7 MB 00:00 2024-09-12T01:32:25.321 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:25.330 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:25.330 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:25.420 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:25.421 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:25.691 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:25.691 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:25.736 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:25.794 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-12T01:32:25.828 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-12T01:32:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-12T01:32:25.914 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-12T01:32:25.952 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1609.g554ba93e.el9.n 5/7 2024-09-12T01:32:26.455 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:26.533 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T01:32:26.580 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T01:32:26.682 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T01:32:26.723 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T01:32:26.900 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T01:32:26.930 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T01:32:27.012 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1609.g554ba93e.el9. 6/7 2024-09-12T01:32:27.014 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T01:32:27.047 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarc 7/7 2024-09-12T01:32:27.682 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T01:32:27.804 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarc 7/7 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1609.g554ba93e.el9. 1/7 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarc 2/7 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1609.g554ba93e.el9.n 3/7 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-12T01:32:28.130 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:28.416 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:28.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-12T01:32:29.086 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T01:32:29.201 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:29.341 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:29.341 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-12T01:32:29.341 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:29.341 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-12T01:32:29.341 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:29.341 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 7.4 M 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:29.342 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:29.343 INFO:teuthology.orchestra.run.smithi066.stdout:======================================================================================= 2024-09-12T01:32:29.343 INFO:teuthology.orchestra.run.smithi066.stdout:Install 12 Packages 2024-09-12T01:32:29.343 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:29.343 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 38 M 2024-09-12T01:32:29.343 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 212 M 2024-09-12T01:32:29.343 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:29.692 INFO:teuthology.orchestra.run.smithi066.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 914 kB/s | 191 kB 00:00 2024-09-12T01:32:29.734 INFO:teuthology.orchestra.run.smithi066.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 784 kB/s | 33 kB 00:00 2024-09-12T01:32:29.767 INFO:teuthology.orchestra.run.smithi066.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.7 MB/s | 801 kB 00:00 2024-09-12T01:32:29.809 INFO:teuthology.orchestra.run.smithi066.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 438 kB/s | 18 kB 00:00 2024-09-12T01:32:29.934 INFO:teuthology.orchestra.run.smithi066.stdout:(5/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-12T01:32:29.951 INFO:teuthology.orchestra.run.smithi066.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-12T01:32:30.010 INFO:teuthology.orchestra.run.smithi066.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-12T01:32:30.123 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T01:32:30.153 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba 12/12 2024-09-12T01:32:30.160 INFO:teuthology.orchestra.run.smithi066.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 7.0 MB/s | 3.0 MB 00:00 2024-09-12T01:32:30.219 INFO:teuthology.orchestra.run.smithi066.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-12T01:32:30.561 INFO:teuthology.orchestra.run.smithi066.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.3 MB/s | 5.1 MB 00:00 2024-09-12T01:32:30.694 INFO:teuthology.orchestra.run.smithi066.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 6.5 MB/s | 4.9 MB 00:00 2024-09-12T01:32:31.220 INFO:teuthology.orchestra.run.smithi066.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-12T01:32:31.220 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:31.221 INFO:teuthology.orchestra.run.smithi066.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-12T01:32:31.587 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:31.614 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:31.614 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:32.171 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:32.172 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:32.627 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba 12/12 2024-09-12T01:32:32.627 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba 1/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T01:32:32.628 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T01:32:32.956 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:32:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:33.023 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:33.039 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-12T01:32:33.081 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-12T01:32:33.181 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-12T01:32:33.219 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-12T01:32:33.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-rook 2024-09-12T01:32:33.412 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-12T01:32:33.451 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-12T01:32:33.530 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-12T01:32:33.974 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:14 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:34.107 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 47 k 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:32:34.109 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout:Install 13 Packages 2024-09-12T01:32:34.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:34.111 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.2 M 2024-09-12T01:32:34.111 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 26 M 2024-09-12T01:32:34.111 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:34.220 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-12T01:32:34.359 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-12T01:32:34.404 INFO:teuthology.orchestra.run.smithi153.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 289 kB/s | 26 kB 00:00 2024-09-12T01:32:34.420 INFO:teuthology.orchestra.run.smithi153.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 181 kB/s | 19 kB 00:00 2024-09-12T01:32:34.487 INFO:teuthology.orchestra.run.smithi153.stdout:(3/13): ceph-mgr-rook-17.2.7-1609.g554ba93e.el9 275 kB/s | 47 kB 00:00 2024-09-12T01:32:34.538 INFO:teuthology.orchestra.run.smithi153.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-12T01:32:34.563 INFO:teuthology.orchestra.run.smithi153.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-12T01:32:34.588 INFO:teuthology.orchestra.run.smithi153.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-12T01:32:34.630 INFO:teuthology.orchestra.run.smithi153.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-12T01:32:34.655 INFO:teuthology.orchestra.run.smithi153.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 235 kB/s | 14 kB 00:00 2024-09-12T01:32:34.681 INFO:teuthology.orchestra.run.smithi153.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-12T01:32:34.706 INFO:teuthology.orchestra.run.smithi153.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-12T01:32:34.731 INFO:teuthology.orchestra.run.smithi153.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-12T01:32:34.782 INFO:teuthology.orchestra.run.smithi153.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-12T01:32:34.815 INFO:teuthology.orchestra.run.smithi153.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 825 kB/s | 90 kB 00:00 2024-09-12T01:32:34.818 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:34.818 INFO:teuthology.orchestra.run.smithi153.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-12T01:32:34.880 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:34.895 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:34.895 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:34.984 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:34.985 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:35.489 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:35.662 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T01:32:35.670 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T01:32:35.733 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T01:32:35.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T01:32:35.842 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T01:32:35.883 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T01:32:35.986 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T01:32:36.096 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T01:32:36.143 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T01:32:36.747 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-12T01:32:36.783 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba 12/12 2024-09-12T01:32:36.868 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T01:32:36.924 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T01:32:36.958 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T01:32:37.003 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T01:32:37.027 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 13/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 13/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 1/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T01:32:37.778 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T01:32:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T01:32:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T01:32:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T01:32:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T01:32:37.779 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:32:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:38.115 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:38.400 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T01:32:38.970 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:19 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:39.104 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 124 k 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:32:39.105 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout:Install 6 Packages 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 7.0 M 2024-09-12T01:32:39.106 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 33 M 2024-09-12T01:32:39.107 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:39.229 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba 12/12 2024-09-12T01:32:39.229 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba 1/12 2024-09-12T01:32:39.229 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-12T01:32:39.230 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-12T01:32:39.595 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:32:39.596 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:32:39.597 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:32:39.597 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:39.597 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:39.733 INFO:teuthology.orchestra.run.smithi153.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.9 MB/s | 248 kB 00:00 2024-09-12T01:32:39.783 INFO:teuthology.orchestra.run.smithi153.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-12T01:32:39.809 INFO:teuthology.orchestra.run.smithi153.stdout:(3/6): ceph-mgr-cephadm-17.2.7-1609.g554ba93e.e 605 kB/s | 124 kB 00:00 2024-09-12T01:32:39.834 INFO:teuthology.orchestra.run.smithi153.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:32:39.876 INFO:teuthology.orchestra.run.smithi153.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-12T01:32:39.951 INFO:teuthology.orchestra.run.smithi153.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-12T01:32:39.953 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:39.953 INFO:teuthology.orchestra.run.smithi153.stdout:Total 8.2 MB/s | 7.0 MB 00:00 2024-09-12T01:32:39.977 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-rook 2024-09-12T01:32:40.024 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:40.035 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:40.035 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:40.135 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:40.135 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:40.452 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:40.567 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:15 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:40.615 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T01:32:40.669 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T01:32:40.707 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:40.708 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:40.708 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:40.708 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:40.708 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 47 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:32:40.709 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout:Install 13 Packages 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 2.2 M 2024-09-12T01:32:40.710 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 26 M 2024-09-12T01:32:40.711 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:41.189 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T01:32:41.280 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T01:32:41.342 INFO:teuthology.orchestra.run.smithi066.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 233 kB/s | 19 kB 00:00 2024-09-12T01:32:41.343 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T01:32:41.368 INFO:teuthology.orchestra.run.smithi066.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 239 kB/s | 26 kB 00:00 2024-09-12T01:32:41.373 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 6/6 2024-09-12T01:32:41.426 INFO:teuthology.orchestra.run.smithi066.stdout:(3/13): ceph-mgr-rook-17.2.7-1609.g554ba93e.el9 286 kB/s | 47 kB 00:00 2024-09-12T01:32:41.453 INFO:teuthology.orchestra.run.smithi066.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-12T01:32:41.477 INFO:teuthology.orchestra.run.smithi066.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-12T01:32:41.502 INFO:teuthology.orchestra.run.smithi066.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-12T01:32:41.544 INFO:teuthology.orchestra.run.smithi066.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 483 kB/s | 32 kB 00:00 2024-09-12T01:32:41.578 INFO:teuthology.orchestra.run.smithi066.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 188 kB/s | 14 kB 00:00 2024-09-12T01:32:41.603 INFO:teuthology.orchestra.run.smithi066.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-12T01:32:41.637 INFO:teuthology.orchestra.run.smithi066.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-12T01:32:41.662 INFO:teuthology.orchestra.run.smithi066.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.9 MB/s | 90 kB 00:00 2024-09-12T01:32:41.687 INFO:teuthology.orchestra.run.smithi066.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 708 kB/s | 59 kB 00:00 2024-09-12T01:32:41.720 INFO:teuthology.orchestra.run.smithi066.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-12T01:32:41.724 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:41.724 INFO:teuthology.orchestra.run.smithi066.stdout:Total 2.2 MB/s | 2.2 MB 00:01 2024-09-12T01:32:41.795 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:41.812 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:41.812 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:41.909 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:41.910 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 6/6 2024-09-12T01:32:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/6 2024-09-12T01:32:42.204 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T01:32:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T01:32:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T01:32:42.205 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T01:32:42.425 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:42.461 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T01:32:42.461 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:42.461 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:42.461 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:42.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:32:42.461 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:32:42.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:32:42.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:32:42.462 INFO:teuthology.orchestra.run.smithi153.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:32:42.462 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:42.462 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:42.608 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-12T01:32:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-12T01:32:42.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install ceph-fuse 2024-09-12T01:32:42.729 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-12T01:32:42.764 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-12T01:32:42.807 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-12T01:32:42.913 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-12T01:32:43.023 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-12T01:32:43.092 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-12T01:32:43.279 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:24 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:43.411 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repository Size 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 813 k 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout:Installing dependencies: 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:32:43.412 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout:Install 2 Packages 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 893 k 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 2.6 M 2024-09-12T01:32:43.413 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:43.849 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-12T01:32:43.886 INFO:teuthology.orchestra.run.smithi153.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 424 kB/s | 80 kB 00:00 2024-09-12T01:32:43.896 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-12T01:32:43.930 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-12T01:32:43.976 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-12T01:32:43.999 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 13/13 2024-09-12T01:32:44.002 INFO:teuthology.orchestra.run.smithi153.stdout:(2/2): ceph-fuse-17.2.7-1609.g554ba93e.el9.x86_ 2.6 MB/s | 813 kB 00:00 2024-09-12T01:32:44.003 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:44.003 INFO:teuthology.orchestra.run.smithi153.stdout:Total 1.5 MB/s | 893 kB 00:00 2024-09-12T01:32:44.015 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:44.036 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:44.116 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:44.116 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:44.301 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:44.422 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T01:32:44.500 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 2/2 2024-09-12T01:32:44.748 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 13/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 1/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-12T01:32:44.749 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-12T01:32:45.087 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:32:45.088 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:45.089 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:45.220 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 2/2 2024-09-12T01:32:45.220 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/2 2024-09-12T01:32:45.312 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-mgr-cephadm 2024-09-12T01:32:45.503 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T01:32:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:45.504 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T01:32:45.504 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:45.504 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:45.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados-devel 2024-09-12T01:32:45.906 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:20 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:46.045 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:46.046 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:46.046 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:46.046 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:46.046 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:46.046 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1609.g554ba93e.el9 ceph-noarch 124 k 2024-09-12T01:32:46.046 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout:Install 6 Packages 2024-09-12T01:32:46.047 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:46.048 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 7.0 M 2024-09-12T01:32:46.048 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 33 M 2024-09-12T01:32:46.048 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:46.328 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:27 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:46.463 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:46.463 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 126 k 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 126 k 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 448 k 2024-09-12T01:32:46.464 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:46.691 INFO:teuthology.orchestra.run.smithi153.stdout:librados-devel-17.2.7-1609.g554ba93e.el9.x86_64 558 kB/s | 126 kB 00:00 2024-09-12T01:32:46.692 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:46.692 INFO:teuthology.orchestra.run.smithi153.stdout:Total 554 kB/s | 126 kB 00:00 2024-09-12T01:32:46.692 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:46.697 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:46.697 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:46.760 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:46.760 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:46.772 INFO:teuthology.orchestra.run.smithi066.stdout:(1/6): ceph-mgr-cephadm-17.2.7-1609.g554ba93e.e 489 kB/s | 124 kB 00:00 2024-09-12T01:32:46.822 INFO:teuthology.orchestra.run.smithi066.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-12T01:32:46.847 INFO:teuthology.orchestra.run.smithi066.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-12T01:32:46.864 INFO:teuthology.orchestra.run.smithi066.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 4.4 MB/s | 74 kB 00:00 2024-09-12T01:32:46.908 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:47.003 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:47.065 INFO:teuthology.orchestra.run.smithi066.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 454 kB/s | 248 kB 00:00 2024-09-12T01:32:47.429 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:47.673 INFO:teuthology.orchestra.run.smithi066.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-12T01:32:47.675 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:47.675 INFO:teuthology.orchestra.run.smithi066.stdout:Total 4.3 MB/s | 7.0 MB 00:01 2024-09-12T01:32:47.688 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:47.689 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:47.689 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:47.689 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:47.749 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:47.761 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:47.761 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:47.866 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:47.866 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:47.966 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs2 2024-09-12T01:32:48.183 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:48.367 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-12T01:32:48.426 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-12T01:32:48.540 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:29 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:48.632 INFO:teuthology.orchestra.run.smithi153.stdout:Package libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:48.674 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:48.675 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:48.675 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:48.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install libcephfs-devel 2024-09-12T01:32:48.991 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-12T01:32:49.081 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-12T01:32:49.143 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-12T01:32:49.170 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 6/6 2024-09-12T01:32:49.305 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:30 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:49.441 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:49.441 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:49.442 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-12T01:32:49.442 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:49.442 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:49.442 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 25 k 2024-09-12T01:32:49.442 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:49.442 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:49.443 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:49.443 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:32:49.443 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:49.443 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 25 k 2024-09-12T01:32:49.443 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 110 k 2024-09-12T01:32:49.443 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:libcephfs-devel-17.2.7-1609.g554ba93e.el9.x86_6 166 kB/s | 25 kB 00:00 2024-09-12T01:32:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:49.593 INFO:teuthology.orchestra.run.smithi153.stdout:Total 165 kB/s | 25 kB 00:00 2024-09-12T01:32:49.594 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:49.597 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:49.598 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:49.599 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:49.688 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:49.797 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 6/6 2024-09-12T01:32:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 1/6 2024-09-12T01:32:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-12T01:32:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-12T01:32:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-12T01:32:49.921 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-12T01:32:50.173 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:50.195 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-12T01:32:50.195 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:50.195 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:50.195 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:17.2.7-1609.g554ba93e.el9.noarch 2024-09-12T01:32:50.195 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:32:50.196 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:32:50.196 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:32:50.196 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:32:50.196 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:32:50.196 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:50.196 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:50.402 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:50.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:50.402 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:50.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:50.402 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:50.412 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-fuse 2024-09-12T01:32:50.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librados2 2024-09-12T01:32:51.003 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:26 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:51.141 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:51.142 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:51.142 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2024-09-12T01:32:51.142 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:51.142 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:51.142 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 813 k 2024-09-12T01:32:51.142 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout:Install 2 Packages 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 893 k 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 2.6 M 2024-09-12T01:32:51.143 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:51.153 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:32 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:51.246 INFO:teuthology.orchestra.run.smithi153.stdout:Package librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:51.289 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:51.290 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:51.356 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install librbd1 2024-09-12T01:32:51.549 INFO:teuthology.orchestra.run.smithi066.stdout:(1/2): ceph-fuse-17.2.7-1609.g554ba93e.el9.x86_ 2.8 MB/s | 813 kB 00:00 2024-09-12T01:32:51.900 INFO:teuthology.orchestra.run.smithi066.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-12T01:32:51.900 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:51.901 INFO:teuthology.orchestra.run.smithi066.stdout:Total 1.2 MB/s | 893 kB 00:00 2024-09-12T01:32:51.914 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:51.914 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:32 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:51.938 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:51.938 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:52.005 INFO:teuthology.orchestra.run.smithi153.stdout:Package librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:52.025 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:52.026 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:52.047 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:52.048 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:52.049 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:52.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rados 2024-09-12T01:32:52.217 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:52.349 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-12T01:32:52.418 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 2/2 2024-09-12T01:32:52.692 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:33 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:52.781 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:52.824 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:52.825 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:52.826 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:52.901 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rgw 2024-09-12T01:32:53.103 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 2/2 2024-09-12T01:32:53.104 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/2 2024-09-12T01:32:53.369 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-12T01:32:53.369 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:53.369 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:53.369 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-12T01:32:53.369 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:53.369 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:53.464 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:34 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:53.553 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:53.596 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:53.597 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:53.597 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:53.637 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install librados-devel 2024-09-12T01:32:53.668 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-cephfs 2024-09-12T01:32:54.229 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:35 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:54.232 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:29 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:54.319 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:54.362 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:54.363 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:54.363 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 126 k 2024-09-12T01:32:54.370 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 126 k 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 448 k 2024-09-12T01:32:54.371 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:54.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install python3-rbd 2024-09-12T01:32:54.586 INFO:teuthology.orchestra.run.smithi066.stdout:librados-devel-17.2.7-1609.g554ba93e.el9.x86_64 589 kB/s | 126 kB 00:00 2024-09-12T01:32:54.587 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:54.587 INFO:teuthology.orchestra.run.smithi066.stdout:Total 584 kB/s | 126 kB 00:00 2024-09-12T01:32:54.587 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:54.593 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:54.593 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:54.659 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:54.660 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:54.815 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:54.913 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:54.991 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:35 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:55.081 INFO:teuthology.orchestra.run.smithi153.stdout:Package python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:55.123 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:55.124 INFO:teuthology.orchestra.run.smithi153.stdout:Nothing to do. 2024-09-12T01:32:55.124 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:55.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-fuse 2024-09-12T01:32:55.365 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:55.652 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:55.652 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:55.652 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:55.652 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:55.652 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:55.652 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:55.754 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:36 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:55.873 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install libcephfs2 2024-09-12T01:32:55.890 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 82 k 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:55.891 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:55.892 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:32:55.892 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:55.892 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 82 k 2024-09-12T01:32:55.892 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 222 k 2024-09-12T01:32:55.892 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:56.087 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-fuse-17.2.7-1609.g554ba93e.el9.x86_64.rpm 419 kB/s | 82 kB 00:00 2024-09-12T01:32:56.088 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:56.088 INFO:teuthology.orchestra.run.smithi153.stdout:Total 416 kB/s | 82 kB 00:00 2024-09-12T01:32:56.088 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:56.095 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:56.095 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:56.158 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:56.158 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:56.303 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:56.401 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:56.460 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:31 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:56.552 INFO:teuthology.orchestra.run.smithi066.stdout:Package libcephfs2-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:56.598 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:56.600 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:32:56.600 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:56.665 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install libcephfs-devel 2024-09-12T01:32:56.776 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:57.027 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:57.027 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:57.027 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:32:57.028 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:57.028 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:57.028 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:32:57.250 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:32 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:57.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-mirror 2024-09-12T01:32:57.387 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:57.388 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:57.388 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2024-09-12T01:32:57.388 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:57.388 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:32:57.388 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 25 k 2024-09-12T01:32:57.388 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 25 k 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 110 k 2024-09-12T01:32:57.389 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:32:57.540 INFO:teuthology.orchestra.run.smithi066.stdout:libcephfs-devel-17.2.7-1609.g554ba93e.el9.x86_6 165 kB/s | 25 kB 00:00 2024-09-12T01:32:57.540 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:57.540 INFO:teuthology.orchestra.run.smithi066.stdout:Total 164 kB/s | 25 kB 00:00 2024-09-12T01:32:57.541 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:32:57.544 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:32:57.544 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:32:57.546 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:32:57.546 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:32:57.631 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:32:57.740 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:57.861 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:38 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:32:57.999 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout: Package Arch Version Repo Size 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 2.9 M 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:58.000 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:32:58.001 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:32:58.001 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:32:58.001 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:58.001 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 2.9 M 2024-09-12T01:32:58.001 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 12 M 2024-09-12T01:32:58.001 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:32:58.135 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:58.315 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-mirror-17.2.7-1609.g554ba93e.el9.x86_64.rpm 9.3 MB/s | 2.9 MB 00:00 2024-09-12T01:32:58.316 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:32:58.316 INFO:teuthology.orchestra.run.smithi153.stdout:Total 9.3 MB/s | 2.9 MB 00:00 2024-09-12T01:32:58.316 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:32:58.325 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:32:58.325 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:32:58.376 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:58.376 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:58.376 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:32:58.377 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:32:58.377 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:32:58.377 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:58.405 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:32:58.405 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:32:58.531 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install librados2 2024-09-12T01:32:58.829 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:32:58.891 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:58.915 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:32:58.915 INFO:teuthology.orchestra.run.smithi153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:32:58.915 INFO:teuthology.orchestra.run.smithi153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:32:58.915 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:32:58.916 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:32:58.916 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:32:59.119 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:34 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:59.214 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:32:59.259 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:32:59.260 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:32:59.260 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:32:59.320 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install librbd1 2024-09-12T01:32:59.905 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:34 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:32:59.999 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:33:00.033 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:33:00.034 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:33:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:33:00.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:33:00.034 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:33:00.044 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:33:00.045 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:00.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-rados 2024-09-12T01:33:00.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo yum -y install rbd-nbd 2024-09-12T01:33:00.707 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:35 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:00.799 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-rados-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:33:00.845 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:00.846 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:33:00.846 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:00.914 INFO:teuthology.orchestra.run.smithi153.stdout:Last metadata expiration check: 0:01:41 ago on Thu 12 Sep 2024 01:31:19 AM UTC. 2024-09-12T01:33:00.945 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-rgw 2024-09-12T01:33:01.052 INFO:teuthology.orchestra.run.smithi153.stdout:Dependencies resolved. 2024-09-12T01:33:01.052 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:33:01.052 INFO:teuthology.orchestra.run.smithi153.stdout: Package Architecture Version Repository Size 2024-09-12T01:33:01.052 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:Installing: 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 165 k 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction Summary 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:================================================================================ 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:Install 1 Package 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:Total download size: 165 k 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:Installed size: 477 k 2024-09-12T01:33:01.053 INFO:teuthology.orchestra.run.smithi153.stdout:Downloading Packages: 2024-09-12T01:33:01.305 INFO:teuthology.orchestra.run.smithi153.stdout:rbd-nbd-17.2.7-1609.g554ba93e.el9.x86_64.rpm 665 kB/s | 165 kB 00:00 2024-09-12T01:33:01.305 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:01.305 INFO:teuthology.orchestra.run.smithi153.stdout:Total 661 kB/s | 165 kB 00:00 2024-09-12T01:33:01.305 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction check 2024-09-12T01:33:01.311 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction check succeeded. 2024-09-12T01:33:01.311 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction test 2024-09-12T01:33:01.374 INFO:teuthology.orchestra.run.smithi153.stdout:Transaction test succeeded. 2024-09-12T01:33:01.374 INFO:teuthology.orchestra.run.smithi153.stdout:Running transaction 2024-09-12T01:33:01.527 INFO:teuthology.orchestra.run.smithi153.stdout: Preparing : 1/1 2024-09-12T01:33:01.533 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:36 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:01.626 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-rgw-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:33:01.632 INFO:teuthology.orchestra.run.smithi153.stdout: Installing : rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:01.670 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:01.671 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:33:01.672 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:01.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-cephfs 2024-09-12T01:33:02.066 INFO:teuthology.orchestra.run.smithi153.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:02.332 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:37 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:02.343 INFO:teuthology.orchestra.run.smithi153.stdout: Verifying : rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:02.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:33:02.343 INFO:teuthology.orchestra.run.smithi153.stdout:Installed: 2024-09-12T01:33:02.343 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:33:02.343 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:33:02.343 INFO:teuthology.orchestra.run.smithi153.stdout:Complete! 2024-09-12T01:33:02.422 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-cephfs-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:33:02.468 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:02.469 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:33:02.469 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:02.543 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install python3-rbd 2024-09-12T01:33:02.634 DEBUG:teuthology.parallel:result is None 2024-09-12T01:33:03.129 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:38 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:03.221 INFO:teuthology.orchestra.run.smithi066.stdout:Package python3-rbd-2:17.2.7-1609.g554ba93e.el9.x86_64 is already installed. 2024-09-12T01:33:03.266 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:03.267 INFO:teuthology.orchestra.run.smithi066.stdout:Nothing to do. 2024-09-12T01:33:03.267 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:03.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install rbd-fuse 2024-09-12T01:33:03.953 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:38 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:04.091 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:04.091 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:04.091 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 82 k 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 82 k 2024-09-12T01:33:04.092 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 222 k 2024-09-12T01:33:04.093 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:33:04.293 INFO:teuthology.orchestra.run.smithi066.stdout:rbd-fuse-17.2.7-1609.g554ba93e.el9.x86_64.rpm 409 kB/s | 82 kB 00:00 2024-09-12T01:33:04.294 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:04.294 INFO:teuthology.orchestra.run.smithi066.stdout:Total 406 kB/s | 82 kB 00:00 2024-09-12T01:33:04.294 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:33:04.301 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:33:04.301 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:33:04.367 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:33:04.368 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:33:04.524 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:33:04.618 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:04.994 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:05.217 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:05.218 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:05.218 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:33:05.218 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:33:05.218 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:05.218 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:05.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install rbd-mirror 2024-09-12T01:33:06.024 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:41 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:06.163 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:06.163 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:06.163 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repo Size 2024-09-12T01:33:06.163 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 2.9 M 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 2.9 M 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 12 M 2024-09-12T01:33:06.164 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:33:06.496 INFO:teuthology.orchestra.run.smithi066.stdout:rbd-mirror-17.2.7-1609.g554ba93e.el9.x86_64.rpm 8.9 MB/s | 2.9 MB 00:00 2024-09-12T01:33:06.497 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:06.497 INFO:teuthology.orchestra.run.smithi066.stdout:Total 8.8 MB/s | 2.9 MB 00:00 2024-09-12T01:33:06.497 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:33:06.507 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:33:06.507 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:33:06.591 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:33:06.591 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:33:07.026 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:33:07.080 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:07.107 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:07.107 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:33:07.107 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:33:07.107 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:33:07.107 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:33:07.107 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:08.192 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:08.192 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:08.192 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:33:08.192 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:33:08.192 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:08.192 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:08.451 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install rbd-nbd 2024-09-12T01:33:09.039 INFO:teuthology.orchestra.run.smithi066.stdout:Last metadata expiration check: 0:01:44 ago on Thu 12 Sep 2024 01:31:25 AM UTC. 2024-09-12T01:33:09.178 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2024-09-12T01:33:09.179 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:09.179 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2024-09-12T01:33:09.179 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:09.179 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:17.2.7-1609.g554ba93e.el9 ceph 165 k 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout:Install 1 Package 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 165 k 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 477 k 2024-09-12T01:33:09.180 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2024-09-12T01:33:09.374 INFO:teuthology.orchestra.run.smithi066.stdout:rbd-nbd-17.2.7-1609.g554ba93e.el9.x86_64.rpm 852 kB/s | 165 kB 00:00 2024-09-12T01:33:09.375 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:09.375 INFO:teuthology.orchestra.run.smithi066.stdout:Total 844 kB/s | 165 kB 00:00 2024-09-12T01:33:09.375 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2024-09-12T01:33:09.383 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2024-09-12T01:33:09.384 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2024-09-12T01:33:09.450 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2024-09-12T01:33:09.451 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2024-09-12T01:33:09.608 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2024-09-12T01:33:09.699 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:10.150 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:10.408 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 1/1 2024-09-12T01:33:10.408 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:10.408 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2024-09-12T01:33:10.408 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:17.2.7-1609.g554ba93e.el9.x86_64 2024-09-12T01:33:10.409 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:10.409 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2024-09-12T01:33:10.637 DEBUG:teuthology.parallel:result is None 2024-09-12T01:33:10.637 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:33:10.637 INFO:teuthology.packaging:ref: None 2024-09-12T01:33:10.637 INFO:teuthology.packaging:tag: None 2024-09-12T01:33:10.638 INFO:teuthology.packaging:branch: quincy 2024-09-12T01:33:10.638 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:33:10.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-12T01:33:10.885 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:33:10.908 INFO:teuthology.orchestra.run.smithi066.stdout:17.2.7-1609.g554ba93e.el9 2024-09-12T01:33:10.909 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1609.g554ba93e.el9 2024-09-12T01:33:10.909 INFO:teuthology.task.install:The correct ceph version 17.2.7-1609.g554ba93e is installed. 2024-09-12T01:33:10.911 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:33:10.911 INFO:teuthology.packaging:ref: None 2024-09-12T01:33:10.911 INFO:teuthology.packaging:tag: None 2024-09-12T01:33:10.911 INFO:teuthology.packaging:branch: quincy 2024-09-12T01:33:10.912 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:33:10.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-12T01:33:11.152 DEBUG:teuthology.orchestra.run.smithi153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:33:11.179 INFO:teuthology.orchestra.run.smithi153.stdout:17.2.7-1609.g554ba93e.el9 2024-09-12T01:33:11.179 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1609.g554ba93e.el9 2024-09-12T01:33:11.179 INFO:teuthology.task.install:The correct ceph version 17.2.7-1609.g554ba93e is installed. 2024-09-12T01:33:11.181 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:33:11.181 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:33:11.181 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:33:11.212 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:33:11.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:33:11.251 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:33:11.252 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:33:11.252 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:33:11.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:33:11.363 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:33:11.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:33:11.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:33:11.462 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:33:11.463 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:33:11.463 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:33:11.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:33:11.561 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:33:11.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:33:11.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:33:11.657 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:33:11.658 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:33:11.658 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:33:11.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:33:11.753 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:33:11.753 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:33:11.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:33:11.846 INFO:teuthology.run_tasks:Running task print... 2024-09-12T01:33:11.860 INFO:teuthology.task.print:**** done install task... 2024-09-12T01:33:11.860 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-12T01:33:11.960 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:33:11.960 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-12T01:33:11.961 INFO:tasks.cephadm:Cluster fsid is f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:33:11.961 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-12T01:33:11.961 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-12T01:33:11.961 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi066': '172.21.15.66', 'mon.smithi153': '172.21.15.153'} 2024-09-12T01:33:11.961 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-12T01:33:11.961 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname $(hostname -s) 2024-09-12T01:33:11.989 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname $(hostname -s) 2024-09-12T01:33:12.017 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-12T01:33:12.018 DEBUG:teuthology.orchestra.run.smithi066:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:33:12.297 INFO:teuthology.orchestra.run.smithi066.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 12 01:33 /home/ubuntu/cephtest/cephadm 2024-09-12T01:33:12.297 DEBUG:teuthology.orchestra.run.smithi153:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-12T01:33:12.442 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 12 01:33 /home/ubuntu/cephtest/cephadm 2024-09-12T01:33:12.442 DEBUG:teuthology.orchestra.run.smithi066:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:33:12.462 DEBUG:teuthology.orchestra.run.smithi153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-12T01:33:12.489 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-12T01:33:12.489 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-12T01:33:12.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-12T01:33:14.030 INFO:teuthology.orchestra.run.smithi153.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-12T01:33:14.129 INFO:teuthology.orchestra.run.smithi066.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-12T01:33:44.913 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:33:44.913 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)", 2024-09-12T01:33:44.913 INFO:teuthology.orchestra.run.smithi066.stdout: "image_id": "d4c538e492e40a3210996318bb500d6155038e4eb0fa53a9db8f9cbd9ac4e11b", 2024-09-12T01:33:44.913 INFO:teuthology.orchestra.run.smithi066.stdout: "repo_digests": [ 2024-09-12T01:33:44.914 INFO:teuthology.orchestra.run.smithi066.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1" 2024-09-12T01:33:44.914 INFO:teuthology.orchestra.run.smithi066.stdout: ] 2024-09-12T01:33:44.914 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:33:50.843 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-12T01:33:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_version": "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)", 2024-09-12T01:33:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "image_id": "d4c538e492e40a3210996318bb500d6155038e4eb0fa53a9db8f9cbd9ac4e11b", 2024-09-12T01:33:50.843 INFO:teuthology.orchestra.run.smithi153.stdout: "repo_digests": [ 2024-09-12T01:33:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1" 2024-09-12T01:33:50.844 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2024-09-12T01:33:50.844 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-12T01:33:50.862 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph 2024-09-12T01:33:50.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph 2024-09-12T01:33:50.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /etc/ceph 2024-09-12T01:33:50.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /etc/ceph 2024-09-12T01:33:50.993 INFO:tasks.cephadm:Writing seed config... 2024-09-12T01:33:50.994 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-12T01:33:50.994 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-12T01:33:50.994 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-12T01:33:50.995 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-12T01:33:50.996 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-12T01:33:50.997 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-12T01:33:50.998 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:33:50.998 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-12T01:33:51.026 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f9344df4-70a6-11ef-bcea-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-12T01:33:51.027 DEBUG:teuthology.orchestra.run.smithi066:mon.smithi066> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service 2024-09-12T01:33:51.069 INFO:tasks.cephadm:Bootstrapping... 2024-09-12T01:33:51.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid f9344df4-70a6-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.66 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:33:51.281 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:51.282 INFO:teuthology.orchestra.run.smithi066.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', 'f9344df4-70a6-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.66', '--skip-admin-label'] 2024-09-12T01:33:51.306 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:33:51.307 INFO:teuthology.orchestra.run.smithi066.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-12T01:33:51.307 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying podman|docker is present... 2024-09-12T01:33:51.330 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:33:51.330 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying lvm2 is present... 2024-09-12T01:33:51.330 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying time synchronization is in place... 2024-09-12T01:33:51.338 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:33:51.338 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:33:51.345 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:33:51.345 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-12T01:33:51.352 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout enabled 2024-09-12T01:33:51.360 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout active 2024-09-12T01:33:51.361 INFO:teuthology.orchestra.run.smithi066.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:33:51.361 INFO:teuthology.orchestra.run.smithi066.stdout:Repeating the final host check... 2024-09-12T01:33:51.383 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout 5.2.2 2024-09-12T01:33:51.383 INFO:teuthology.orchestra.run.smithi066.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-12T01:33:51.383 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl is present 2024-09-12T01:33:51.383 INFO:teuthology.orchestra.run.smithi066.stdout:lvcreate is present 2024-09-12T01:33:51.390 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-12T01:33:51.390 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-12T01:33:51.397 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-12T01:33:51.397 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-12T01:33:51.404 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout enabled 2024-09-12T01:33:51.411 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout active 2024-09-12T01:33:51.411 INFO:teuthology.orchestra.run.smithi066.stdout:Unit chronyd.service is enabled and running 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Host looks OK 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Cluster fsid: f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Acquiring lock 140422343549280 on /run/cephadm/f9344df4-70a6-11ef-bcea-c7b262605968.lock 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Lock 140422343549280 acquired on /run/cephadm/f9344df4-70a6-11ef-bcea-c7b262605968.lock 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying IP 172.21.15.66 port 3300 ... 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying IP 172.21.15.66 port 6789 ... 2024-09-12T01:33:51.412 INFO:teuthology.orchestra.run.smithi066.stdout:Base mon IP(s) is [172.21.15.66:3300, 172.21.15.66:6789], mon addrv is [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-12T01:33:51.415 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.66 metric 100 2024-09-12T01:33:51.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.66 metric 100 2024-09-12T01:33:51.418 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-12T01:33:51.418 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-12T01:33:51.419 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-12T01:33:51.421 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-12T01:33:51.421 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link noprefixroute 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.0/20` 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:Mon IP `172.21.15.66` is in CIDR network `172.21.0.0/20` 2024-09-12T01:33:51.422 INFO:teuthology.orchestra.run.smithi066.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-12T01:33:51.423 INFO:teuthology.orchestra.run.smithi066.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-12T01:33:51.424 INFO:teuthology.orchestra.run.smithi066.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-12T01:33:51.870 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stdout d4c538e492e40a3210996318bb500d6155038e4eb0fa53a9db8f9cbd9ac4e11b 2024-09-12T01:33:51.870 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-12T01:33:51.871 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Getting image source signatures 2024-09-12T01:33:51.871 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Copying blob sha256:fbefc13570200f6717575ca5e42207537ba0194f0b9aebcd781ed3086fead7f1 2024-09-12T01:33:51.871 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-12T01:33:51.871 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Copying config sha256:d4c538e492e40a3210996318bb500d6155038e4eb0fa53a9db8f9cbd9ac4e11b 2024-09-12T01:33:51.871 INFO:teuthology.orchestra.run.smithi066.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-12T01:33:52.833 INFO:teuthology.orchestra.run.smithi066.stdout:ceph: stdout ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable) 2024-09-12T01:33:52.834 INFO:teuthology.orchestra.run.smithi066.stdout:Ceph version: ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable) 2024-09-12T01:33:52.834 INFO:teuthology.orchestra.run.smithi066.stdout:Extracting ceph user uid/gid from container image... 2024-09-12T01:33:54.048 INFO:teuthology.orchestra.run.smithi066.stdout:stat: stdout 167 167 2024-09-12T01:33:54.048 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial keys... 2024-09-12T01:33:54.830 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQACReJmmZ8kFBAAWW2wbyagIirbQmaa7JAFrw== 2024-09-12T01:33:55.733 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQADReJmjCQaCxAAJUGzJdS/BkN68q7yEx1Oow== 2024-09-12T01:33:56.714 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph-authtool: stdout AQAEReJm8wRxAhAAYFMbMy5rfX8z7OkAK8SVrg== 2024-09-12T01:33:56.715 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial monmap... 2024-09-12T01:33:57.589 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:33:57.589 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:monmaptool for smithi066 [v2:172.21.15.66:3300,v1:172.21.15.66:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:setting min_mon_release = octopus 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: set fsid to f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:33:57.590 INFO:teuthology.orchestra.run.smithi066.stdout:Creating mon... 2024-09-12T01:33:58.576 INFO:teuthology.orchestra.run.smithi066.stdout:create mon.smithi066 on 2024-09-12T01:33:58.844 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-12T01:33:58.985 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-12T01:33:59.140 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f9344df4-70a6-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-f9344df4-70a6-11ef-bcea-c7b262605968.target. 2024-09-12T01:33:59.141 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f9344df4-70a6-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-f9344df4-70a6-11ef-bcea-c7b262605968.target. 2024-09-12T01:33:59.329 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066 2024-09-12T01:33:59.329 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service: Unit ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service not loaded. 2024-09-12T01:33:59.513 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9344df4-70a6-11ef-bcea-c7b262605968.target.wants/ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service → /etc/systemd/system/ceph-f9344df4-70a6-11ef-bcea-c7b262605968@.service. 2024-09-12T01:34:00.034 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:33:59 smithi066 podman[27492]: 2024-09-12 01:33:59.997992149 +0000 UTC m=+0.345293570 container start 00ccaa687889156c601875522e65e1ad6064313f53bc97017a09c6cec03b663d (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=quincy-554ba93, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T01:34:00.035 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:00 smithi066 ceph-mon[27516]: mkfs f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:00.109 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:34:00.109 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-12T01:34:00.117 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:34:00.118 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-12T01:34:00.118 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-12T01:34:00.118 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:34:00.118 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mon to start... 2024-09-12T01:34:00.118 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mon... 2024-09-12T01:34:00.345 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:00 smithi066 ceph-mon[27516]: mon.smithi066 is new leader, mons smithi066 in quorum (ranks 0) 2024-09-12T01:34:00.345 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:00 smithi066 bash[27492]: 00ccaa687889156c601875522e65e1ad6064313f53bc97017a09c6cec03b663d 2024-09-12T01:34:00.345 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:00 smithi066 systemd[1]: Started Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:34:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:01 smithi066 ceph-mon[27516]: mon.smithi066 is new leader, mons smithi066 in quorum (ranks 0) 2024-09-12T01:34:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:01 smithi066 ceph-mon[27516]: monmap e1: 1 mons at {smithi066=[v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-12T01:34:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:01 smithi066 ceph-mon[27516]: fsmap 2024-09-12T01:34:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:01 smithi066 ceph-mon[27516]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:34:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:01 smithi066 ceph-mon[27516]: mgrmap e1: no daemons active 2024-09-12T01:34:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:01 smithi066 ceph-mon[27516]: from='client.? 172.21.15.66:0/1210630809' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-12T01:34:01.188 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout cluster: 2024-09-12T01:34:01.188 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout id: f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:01.188 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-12T01:34:01.188 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:01.188 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout services: 2024-09-12T01:34:01.188 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi066 (age 0.555687s) 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout data: 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout pgs: 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.516+0000 7f98ea23b640 1 Processor -- start 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.516+0000 7f98ea23b640 1 -- start start 2024-09-12T01:34:01.189 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.516+0000 7f98ea23b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e41007b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.516+0000 7f98ea23b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4100cf0 con 0x7f98e41003a0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.516+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e41007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.517+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e41007b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46484/0 (socket says 172.21.15.66:46484) 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.517+0000 7f98e37fe640 1 -- 172.21.15.66:0/2304316624 learned_addr learned my addr 172.21.15.66:0/2304316624 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.517+0000 7f98e37fe640 1 -- 172.21.15.66:0/2304316624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e4100e30 con 0x7f98e41003a0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98e37fe640 1 --2- 172.21.15.66:0/2304316624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e41007b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009840 tx=0x7f98d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a6773ef9260df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98e27fc640 1 -- 172.21.15.66:0/2304316624 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98d4032440 con 0x7f98e41003a0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98e27fc640 1 -- 172.21.15.66:0/2304316624 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40325a0 con 0x7f98e41003a0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98e27fc640 1 -- 172.21.15.66:0/2304316624 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98d40328d0 con 0x7f98e41003a0 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98ea23b640 1 -- 172.21.15.66:0/2304316624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 msgr2=0x7f98e41007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98ea23b640 1 --2- 172.21.15.66:0/2304316624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e41007b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009840 tx=0x7f98d40091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:01.190 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98ea23b640 1 -- 172.21.15.66:0/2304316624 shutdown_connections 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98ea23b640 1 --2- 172.21.15.66:0/2304316624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e41007b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.519+0000 7f98ea23b640 1 -- 172.21.15.66:0/2304316624 >> 172.21.15.66:0/2304316624 conn(0x7f98e40fbdc0 msgr2=0x7f98e40fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.520+0000 7f98ea23b640 1 -- 172.21.15.66:0/2304316624 shutdown_connections 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.520+0000 7f98ea23b640 1 -- 172.21.15.66:0/2304316624 wait complete. 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.520+0000 7f98ea23b640 1 Processor -- start 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.520+0000 7f98ea23b640 1 -- start start 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.520+0000 7f98ea23b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e4110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.520+0000 7f98ea23b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4110ab0 con 0x7f98e41003a0 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e4110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e4110570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46496/0 (socket says 172.21.15.66:46496) 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98e37fe640 1 -- 172.21.15.66:0/1210630809 learned_addr learned my addr 172.21.15.66:0/1210630809 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98e37fe640 1 -- 172.21.15.66:0/1210630809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009450 con 0x7f98e41003a0 2024-09-12T01:34:01.191 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98e37fe640 1 --2- 172.21.15.66:0/1210630809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e4110570 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f98d402a700 tx=0x7f98d4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98d4031be0 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4031d40 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e4110cb0 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98d403b5a0 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e41110c0 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f98d4039040 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.521+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f98d4041030 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.522+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e404b720 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.525+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f98d4037070 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.585+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f98e4109f80 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.585+0000 7f98cbfff640 1 -- 172.21.15.66:0/1210630809 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f98d403bbd0 con 0x7f98e41003a0 2024-09-12T01:34:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 msgr2=0x7f98e4110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 --2- 172.21.15.66:0/1210630809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e4110570 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f98d402a700 tx=0x7f98d4032000 comp rx=0 tx=0).stop 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 shutdown_connections 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 --2- 172.21.15.66:0/1210630809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e41003a0 0x7f98e4110570 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 >> 172.21.15.66:0/1210630809 conn(0x7f98e40fbdc0 msgr2=0x7f98e40fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 shutdown_connections 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:00.586+0000 7f98ea23b640 1 -- 172.21.15.66:0/1210630809 wait complete. 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:mon is available 2024-09-12T01:34:01.193 INFO:teuthology.orchestra.run.smithi066.stdout:Assimilating anything we can from ceph.conf... 2024-09-12T01:34:02.240 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:02 smithi066 ceph-mon[27516]: from='client.? 172.21.15.66:0/1989710355' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:34:02.241 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:02 smithi066 ceph-mon[27516]: from='client.? 172.21.15.66:0/1989710355' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-12T01:34:02.243 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout fsid = f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.66:3300,v1:172.21.15.66:6789] 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:34:02.250 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba6947c640 1 Processor -- start 2024-09-12T01:34:02.251 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba6947c640 1 -- start start 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba6947c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba6947c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba641029c0 con 0x7fba64102070 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46508/0 (socket says 172.21.15.66:46508) 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba62ffd640 1 -- 172.21.15.66:0/3205904659 learned_addr learned my addr 172.21.15.66:0/3205904659 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.611+0000 7fba62ffd640 1 -- 172.21.15.66:0/3205904659 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba64102b00 con 0x7fba64102070 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.612+0000 7fba62ffd640 1 --2- 172.21.15.66:0/3205904659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009e50 tx=0x7fba5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af6b82c8b926cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.612+0000 7fba61ffb640 1 -- 172.21.15.66:0/3205904659 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c031560 con 0x7fba64102070 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.612+0000 7fba61ffb640 1 -- 172.21.15.66:0/3205904659 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c02d050 con 0x7fba64102070 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.612+0000 7fba61ffb640 1 -- 172.21.15.66:0/3205904659 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c031880 con 0x7fba64102070 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 -- 172.21.15.66:0/3205904659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 msgr2=0x7fba64102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:02.252 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 --2- 172.21.15.66:0/3205904659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64102480 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fba5c009e50 tx=0x7fba5c009840 comp rx=0 tx=0).stop 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 -- 172.21.15.66:0/3205904659 shutdown_connections 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 --2- 172.21.15.66:0/3205904659 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64102480 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 -- 172.21.15.66:0/3205904659 >> 172.21.15.66:0/3205904659 conn(0x7fba640fd850 msgr2=0x7fba640ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 -- 172.21.15.66:0/3205904659 shutdown_connections 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.613+0000 7fba6947c640 1 -- 172.21.15.66:0/3205904659 wait complete. 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba6947c640 1 Processor -- start 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba6947c640 1 -- start start 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba6947c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64110540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba6947c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba64110a80 con 0x7fba64102070 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64110540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba62ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64110540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46510/0 (socket says 172.21.15.66:46510) 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba62ffd640 1 -- 172.21.15.66:0/1989710355 learned_addr learned my addr 172.21.15.66:0/1989710355 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.614+0000 7fba62ffd640 1 -- 172.21.15.66:0/1989710355 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c009ae0 con 0x7fba64102070 2024-09-12T01:34:02.253 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba62ffd640 1 --2- 172.21.15.66:0/1989710355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fba5c02ac70 tx=0x7fba5c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c007a10 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5c007b70 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba64110c80 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba5c007e80 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba64111810 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fba5c038070 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.615+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fba5c045c60 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.616+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba641014d0 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.618+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fba5c040070 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.675+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fba64103460 con 0x7fba64102070 2024-09-12T01:34:02.254 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.679+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fba5c045e70 con 0x7fba64102070 2024-09-12T01:34:02.255 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.679+0000 7fba5b7fe640 1 -- 172.21.15.66:0/1989710355 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+465 (secure 0 0 0) 0x7fba64103460 con 0x7fba64102070 2024-09-12T01:34:02.255 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 msgr2=0x7fba64110540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:02.255 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 --2- 172.21.15.66:0/1989710355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64110540 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fba5c02ac70 tx=0x7fba5c036000 comp rx=0 tx=0).stop 2024-09-12T01:34:02.255 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 shutdown_connections 2024-09-12T01:34:02.255 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 --2- 172.21.15.66:0/1989710355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba64102070 0x7fba64110540 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:02.256 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 >> 172.21.15.66:0/1989710355 conn(0x7fba640fd850 msgr2=0x7fba64107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:02.256 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 shutdown_connections 2024-09-12T01:34:02.256 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:01.680+0000 7fba6947c640 1 -- 172.21.15.66:0/1989710355 wait complete. 2024-09-12T01:34:02.256 INFO:teuthology.orchestra.run.smithi066.stdout:Generating new minimal ceph.conf... 2024-09-12T01:34:03.288 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:03 smithi066 ceph-mon[27516]: from='client.? 172.21.15.66:0/2789873737' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:34:03.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f734127f640 1 Processor -- start 2024-09-12T01:34:03.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f734127f640 1 -- start start 2024-09-12T01:34:03.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f734127f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c1039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:03.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f734127f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c070e30 con 0x7f733c1035c0 2024-09-12T01:34:03.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f733affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c1039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:03.295 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f733affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c1039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55246/0 (socket says 172.21.15.66:55246) 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.664+0000 7f733affd640 1 -- 172.21.15.66:0/1491561643 learned_addr learned my addr 172.21.15.66:0/1491561643 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.665+0000 7f733affd640 1 -- 172.21.15.66:0/1491561643 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733c103f10 con 0x7f733c1035c0 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.665+0000 7f733affd640 1 --2- 172.21.15.66:0/1491561643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c1039d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f732c009840 tx=0x7f732c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e8592be6cc0343 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f7339ffb640 1 -- 172.21.15.66:0/1491561643 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f732c032440 con 0x7f733c1035c0 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f7339ffb640 1 -- 172.21.15.66:0/1491561643 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f732c032a00 con 0x7f733c1035c0 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f7339ffb640 1 -- 172.21.15.66:0/1491561643 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f732c0319e0 con 0x7f733c1035c0 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 -- 172.21.15.66:0/1491561643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 msgr2=0x7f733c1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 --2- 172.21.15.66:0/1491561643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c1039d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f732c009840 tx=0x7f732c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 -- 172.21.15.66:0/1491561643 shutdown_connections 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 --2- 172.21.15.66:0/1491561643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c1039d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 -- 172.21.15.66:0/1491561643 >> 172.21.15.66:0/1491561643 conn(0x7f733c0fbdc0 msgr2=0x7f733c0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 -- 172.21.15.66:0/1491561643 shutdown_connections 2024-09-12T01:34:03.296 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.666+0000 7f734127f640 1 -- 172.21.15.66:0/1491561643 wait complete. 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f734127f640 1 Processor -- start 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f734127f640 1 -- start start 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f734127f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f734127f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733c111340 con 0x7f733c1035c0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f733affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f733affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55260/0 (socket says 172.21.15.66:55260) 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.667+0000 7f733affd640 1 -- 172.21.15.66:0/2789873737 learned_addr learned my addr 172.21.15.66:0/2789873737 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f733affd640 1 -- 172.21.15.66:0/2789873737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c009450 con 0x7f733c1035c0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f733affd640 1 --2- 172.21.15.66:0/2789873737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f732c0098a0 tx=0x7f732c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f732c032880 con 0x7f733c1035c0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f732c03d8b0 con 0x7f733c1035c0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733c111540 con 0x7f733c1035c0 2024-09-12T01:34:03.297 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f732c03b910 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733c111f90 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f732c039070 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.668+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f732c0466c0 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.669+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f733c0ffa60 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.671+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f732c0657a0 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.729+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f733c100a20 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.729+0000 7f73237fe640 1 -- 172.21.15.66:0/2789873737 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f732c054030 con 0x7f733c1035c0 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 msgr2=0x7f733c110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 --2- 172.21.15.66:0/2789873737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f732c0098a0 tx=0x7f732c008040 comp rx=0 tx=0).stop 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 shutdown_connections 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 --2- 172.21.15.66:0/2789873737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f733c1035c0 0x7f733c110e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 >> 172.21.15.66:0/2789873737 conn(0x7f733c0fbdc0 msgr2=0x7f733c0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 shutdown_connections 2024-09-12T01:34:03.298 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:02.730+0000 7f734127f640 1 -- 172.21.15.66:0/2789873737 wait complete. 2024-09-12T01:34:03.299 INFO:teuthology.orchestra.run.smithi066.stdout:Restarting the monitor... 2024-09-12T01:34:03.559 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:03 smithi066 systemd[1]: Stopping Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:34:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:03 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[27510]: 2024-09-12T01:34:03.559+0000 7f9ddf57c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi066 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:34:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:03 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[27510]: 2024-09-12T01:34:03.559+0000 7f9ddf57c640 -1 mon.smithi066@0(leader) e1 *** Got Signal Terminated *** 2024-09-12T01:34:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:03 smithi066 podman[27754]: 2024-09-12 01:34:03.722986484 +0000 UTC m=+0.255730283 container died 00ccaa687889156c601875522e65e1ad6064313f53bc97017a09c6cec03b663d (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-554ba93, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-12T01:34:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 podman[27754]: 2024-09-12 01:34:04.000628587 +0000 UTC m=+0.533372384 container cleanup 00ccaa687889156c601875522e65e1ad6064313f53bc97017a09c6cec03b663d (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-554ba93, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-12T01:34:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 bash[27754]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066 2024-09-12T01:34:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 podman[27767]: 2024-09-12 01:34:04.176595482 +0000 UTC m=+0.450635551 container remove 00ccaa687889156c601875522e65e1ad6064313f53bc97017a09c6cec03b663d (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=quincy-554ba93) 2024-09-12T01:34:04.725 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service: Deactivated successfully. 2024-09-12T01:34:04.725 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 systemd[1]: Stopped Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:34:04.725 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 systemd[1]: Starting Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:34:04.725 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 podman[27857]: 2024-09-12 01:34:04.62762281 +0000 UTC m=+0.106464902 container create 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=quincy-554ba93, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:34:04.725 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:04 smithi066 podman[27857]: 2024-09-12 01:34:04.537180111 +0000 UTC m=+0.016022218 image pull d4c538e492e40a3210996318bb500d6155038e4eb0fa53a9db8f9cbd9ac4e11b quay.ceph.io/ceph-ci/ceph:quincy 2024-09-12T01:34:05.168 INFO:teuthology.orchestra.run.smithi066.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-12T01:34:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 podman[27857]: 2024-09-12 01:34:05.081049006 +0000 UTC m=+0.559891098 container init 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=quincy-554ba93, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:34:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 podman[27857]: 2024-09-12 01:34:05.084730369 +0000 UTC m=+0.563572461 container start 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=quincy-554ba93, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T01:34:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:34:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable), process ceph-mon, pid 2 2024-09-12T01:34:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: pidfile_write: ignore empty --pid-file 2024-09-12T01:34:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: load: jerasure load: lrc 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: RocksDB version: 6.15.5 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Compile date Sep 11 2024 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: DB SUMMARY 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: DB Session ID: OGZ8HI28ZSIFOZ86M468 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi066/store.db dir, Total Num: 1, files: 000008.sst 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi066/store.db: 000010.log size: 98120 ; 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:34:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.env: 0x55587e076440 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.fs: Posix File System 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.info_log: 0x55587fac50c0 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.statistics: (nil) 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.use_fsync: 0 2024-09-12T01:34:05.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:34:05.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.db_log_dir: 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi066/store.db 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:34:05.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.write_buffer_manager: 0x55587fb82870 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.unordered_write: 0 2024-09-12T01:34:05.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.row_cache: None 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.wal_filter: None 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.preserve_deletes: 0 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:34:05.396 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:34:05.397 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_open_files: -1 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:34:05.398 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Compression algorithms supported: 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kZSTD supported: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:34:05.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi066/store.db/MANIFEST-000009 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.merge_operator: 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_filter: None 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55587fa6ba38) 2024-09-12T01:34:05.400 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: index_type: 0 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: data_block_index_type: 0 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: index_shortening: 1 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: hash_index_allow_collision: 1 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: checksum: 1 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: no_block_cache: 0 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache: 0x55587faa11f0 2024-09-12T01:34:05.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache_options: 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: capacity : 536870912 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: num_shard_bits : 4 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: strict_capacity_limit : 0 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache_compressed: (nil) 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: persistent_cache: (nil) 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_size: 4096 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_size_deviation: 10 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_restart_interval: 16 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: index_block_restart_interval: 1 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: metadata_block_size: 4096 2024-09-12T01:34:05.402 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: partition_filters: 0 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: use_delta_encoding: 1 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: whole_key_filtering: 1 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: verify_compression: 0 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: format_version: 4 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: enable_index_compression: 1 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_align: 0 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:34:05.403 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression: NoCompression 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.num_levels: 7 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:34:05.404 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:34:05.405 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:34:05.406 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.arena_block_size: 4194304 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:34:05.407 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:34:05.408 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.ttl: 2592000 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:34:05.409 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi066/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726104845111575, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726104845112949, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93352, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91432, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84014, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726104845, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "3f5d120e-4af7-4f9d-9064-afb71cd2223e", "db_session_id": "OGZ8HI28ZSIFOZ86M468"}} 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726104845113486, "job": 1, "event": "recovery_finished"} 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi066/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55587fad4700 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: DB pointer 0x55587faa4000 2024-09-12T01:34:05.410 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** DB Stats ** 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-12T01:34:05.411 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:34:05.412 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative compaction: 0.00 GB write, 17.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval compaction: 0.00 GB write, 17.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:34:05.413 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: L0 2/0 92.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Sum 2/0 92.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 101.3 0.00 0.00 1 0.001 0 0 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:34:05.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative compaction: 0.00 GB write, 17.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: starting mon.smithi066 rank 0 at public addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] at bind addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi066 fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???) e1 preinit fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).mds e1 new map 2024-09-12T01:34:05.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).mds e1 print_map 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: e1 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: legacy client fscid: -1 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: No filesystems configured 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:34:05.416 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 bash[27857]: 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 systemd[1]: Started Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mon.smithi066 is new leader, mons smithi066 in quorum (ranks 0) 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: monmap e1: 1 mons at {smithi066=[v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: fsmap 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: osdmap e1: 0 total, 0 up, 0 in 2024-09-12T01:34:05.417 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:05 smithi066 ceph-mon[27875]: mgrmap e1: no daemons active 2024-09-12T01:34:06.234 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.600+0000 7f5d1b9f2640 1 Processor -- start 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.601+0000 7f5d1b9f2640 1 -- start start 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.601+0000 7f5d1b9f2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d141024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.601+0000 7f5d1b9f2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14102a90 con 0x7f5d141020b0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.601+0000 7f5d1978e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d141024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.601+0000 7f5d1978e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d141024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55270/0 (socket says 172.21.15.66:55270) 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.601+0000 7f5d1978e640 1 -- 172.21.15.66:0/3785447953 learned_addr learned my addr 172.21.15.66:0/3785447953 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.602+0000 7f5d1978e640 1 -- 172.21.15.66:0/3785447953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d14102bd0 con 0x7f5d141020b0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d1978e640 1 --2- 172.21.15.66:0/3785447953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d141024c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009e50 tx=0x7f5d08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab57617b3e5ec2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d07fff640 1 -- 172.21.15.66:0/3785447953 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d08031560 con 0x7f5d141020b0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d07fff640 1 -- 172.21.15.66:0/3785447953 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5d0802d050 con 0x7f5d141020b0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d07fff640 1 -- 172.21.15.66:0/3785447953 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d080079b0 con 0x7f5d141020b0 2024-09-12T01:34:06.235 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/3785447953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 msgr2=0x7f5d141024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:06.236 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d1b9f2640 1 --2- 172.21.15.66:0/3785447953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d141024c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009e50 tx=0x7f5d08009840 comp rx=0 tx=0).stop 2024-09-12T01:34:06.236 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/3785447953 shutdown_connections 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d1b9f2640 1 --2- 172.21.15.66:0/3785447953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d141024c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.604+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/3785447953 >> 172.21.15.66:0/3785447953 conn(0x7f5d140fd850 msgr2=0x7f5d140ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/3785447953 shutdown_connections 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/3785447953 wait complete. 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1b9f2640 1 Processor -- start 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1b9f2640 1 -- start start 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1b9f2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d14078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1b9f2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d14079140 con 0x7f5d141020b0 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1978e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d14078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1978e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d14078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55282/0 (socket says 172.21.15.66:55282) 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.605+0000 7f5d1978e640 1 -- 172.21.15.66:0/2483118262 learned_addr learned my addr 172.21.15.66:0/2483118262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d1978e640 1 -- 172.21.15.66:0/2483118262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d08009ae0 con 0x7f5d141020b0 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d1978e640 1 --2- 172.21.15.66:0/2483118262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d14078c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d08007690 tx=0x7f5d08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d0803a410 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5d0803a9d0 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d140771d0 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5d08042820 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d140776a0 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.606+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f5d08038040 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.607+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5d0804b870 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.607+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14103da0 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.609+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f5d08036070 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.667+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f5d14077b60 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.670+0000 7f5d05ffb640 1 -- 172.21.15.66:0/2483118262 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5d0803ab40 con 0x7f5d141020b0 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 msgr2=0x7f5d14078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 --2- 172.21.15.66:0/2483118262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d14078c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f5d08007690 tx=0x7f5d08009840 comp rx=0 tx=0).stop 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 shutdown_connections 2024-09-12T01:34:06.238 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 --2- 172.21.15.66:0/2483118262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d141020b0 0x7f5d14078c00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 >> 172.21.15.66:0/2483118262 conn(0x7f5d140fd850 msgr2=0x7f5d140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 shutdown_connections 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:05.671+0000 7f5d1b9f2640 1 -- 172.21.15.66:0/2483118262 wait complete. 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:Creating mgr... 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-12T01:34:06.239 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-12T01:34:06.422 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mgr.smithi066.qdwcrh 2024-09-12T01:34:06.422 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mgr.smithi066.qdwcrh.service: Unit ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mgr.smithi066.qdwcrh.service not loaded. 2024-09-12T01:34:06.572 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f9344df4-70a6-11ef-bcea-c7b262605968.target.wants/ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mgr.smithi066.qdwcrh.service → /etc/systemd/system/ceph-f9344df4-70a6-11ef-bcea-c7b262605968@.service. 2024-09-12T01:34:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:06 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2483118262' entity='client.admin' 2024-09-12T01:34:07.120 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:34:07.121 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-12T01:34:07.128 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:34:07.128 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-12T01:34:07.129 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-12T01:34:07.129 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to enable service . firewalld.service is not available 2024-09-12T01:34:07.138 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:34:07.138 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-12T01:34:07.146 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:34:07.146 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-12T01:34:07.146 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-12T01:34:07.146 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-12T01:34:07.146 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr to start... 2024-09-12T01:34:07.146 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr... 2024-09-12T01:34:07.814 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:07 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/988222504' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:34:08.182 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:08.184 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "f9344df4-70a6-11ef-bcea-c7b262605968", 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "smithi066" 2024-09-12T01:34:08.185 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:34:08.186 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:34:08.194 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:34:08.194 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:34:08.194 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:34:08.194 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.194 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:34:00.032148+0000", 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:34:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.571+0000 7f31049a0640 1 Processor -- start 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.571+0000 7f31049a0640 1 -- start start 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.572+0000 7f31049a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100101660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.572+0000 7f31049a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100101ba0 con 0x7f3100101250 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.572+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.572+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100101660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55318/0 (socket says 172.21.15.66:55318) 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.572+0000 7f30ff7fe640 1 -- 172.21.15.66:0/2508639340 learned_addr learned my addr 172.21.15.66:0/2508639340 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.572+0000 7f30ff7fe640 1 -- 172.21.15.66:0/2508639340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100101ce0 con 0x7f3100101250 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.573+0000 7f30ff7fe640 1 --2- 172.21.15.66:0/2508639340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100101660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009840 tx=0x7f30f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32fc459bd4c9b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.573+0000 7f30fe7fc640 1 -- 172.21.15.66:0/2508639340 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f0032440 con 0x7f3100101250 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.573+0000 7f30fe7fc640 1 -- 172.21.15.66:0/2508639340 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f30f0032a00 con 0x7f3100101250 2024-09-12T01:34:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.573+0000 7f30fe7fc640 1 -- 172.21.15.66:0/2508639340 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f00319e0 con 0x7f3100101250 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 -- 172.21.15.66:0/2508639340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 msgr2=0x7f3100101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 --2- 172.21.15.66:0/2508639340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100101660 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009840 tx=0x7f30f00091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 -- 172.21.15.66:0/2508639340 shutdown_connections 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 --2- 172.21.15.66:0/2508639340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100101660 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 -- 172.21.15.66:0/2508639340 >> 172.21.15.66:0/2508639340 conn(0x7f31000fbbc0 msgr2=0x7f31000fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 -- 172.21.15.66:0/2508639340 shutdown_connections 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.574+0000 7f31049a0640 1 -- 172.21.15.66:0/2508639340 wait complete. 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f31049a0640 1 Processor -- start 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f31049a0640 1 -- start start 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f31049a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f31049a0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100113c00 con 0x7f3100101250 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f30ff7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100100a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55332/0 (socket says 172.21.15.66:55332) 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f30ff7fe640 1 -- 172.21.15.66:0/988222504 learned_addr learned my addr 172.21.15.66:0/988222504 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.575+0000 7f30ff7fe640 1 -- 172.21.15.66:0/988222504 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0009450 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f30ff7fe640 1 --2- 172.21.15.66:0/988222504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100100a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f003d450 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3100113d40 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f30f003da10 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f003b8e0 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310010fc60 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f30f0039070 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.576+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f30f0046760 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.577+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310004b720 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.579+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f30f00657a0 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.640+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3100109a70 con 0x7f3100101250 2024-09-12T01:34:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.640+0000 7f30e7fff640 1 -- 172.21.15.66:0/988222504 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f30f0054020 con 0x7f3100101250 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 msgr2=0x7f3100100a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 --2- 172.21.15.66:0/988222504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100100a50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f30f0000c00 tx=0x7f30f0008040 comp rx=0 tx=0).stop 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 shutdown_connections 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 --2- 172.21.15.66:0/988222504 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3100101250 0x7f3100100a50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 >> 172.21.15.66:0/988222504 conn(0x7f31000fbbc0 msgr2=0x7f31000fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 shutdown_connections 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:07.641+0000 7f31049a0640 1 -- 172.21.15.66:0/988222504 wait complete. 2024-09-12T01:34:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:mgr not available, waiting (1/15)... 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: mgrmap e2: smithi066.qdwcrh(active, starting, since 0.00300735s) 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:34:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:11.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:11.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:11 smithi066 ceph-mon[27875]: from='mgr.14100 172.21.15.66:0/1406480344' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:13.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:12 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/4162235013' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:34:13.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:12 smithi066 ceph-mon[27875]: mgrmap e3: smithi066.qdwcrh(active, since 1.0076s) 2024-09-12T01:34:14.941 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:14 smithi066 ceph-mon[27875]: mgrmap e4: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "f9344df4-70a6-11ef-bcea-c7b262605968", 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:34:18.330 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "smithi066" 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:18.331 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:34:18.332 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:34:18.333 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:34:00.032148+0000", 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:34:18.334 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.597+0000 7f45a92f6640 1 Processor -- start 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.597+0000 7f45a92f6640 1 -- start start 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.597+0000 7f45a92f6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.597+0000 7f45a92f6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4076f40 con 0x7f45a4076b30 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.598+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.598+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55340/0 (socket says 172.21.15.66:55340) 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.598+0000 7f45a2ffd640 1 -- 172.21.15.66:0/2973062688 learned_addr learned my addr 172.21.15.66:0/2973062688 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.598+0000 7f45a2ffd640 1 -- 172.21.15.66:0/2973062688 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4105100 con 0x7f45a4076b30 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.599+0000 7f45a2ffd640 1 --2- 172.21.15.66:0/2973062688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4104bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4594009840 tx=0x7f45940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3256e50f8455dbea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.599+0000 7f45a1ffb640 1 -- 172.21.15.66:0/2973062688 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4594032440 con 0x7f45a4076b30 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.599+0000 7f45a1ffb640 1 -- 172.21.15.66:0/2973062688 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f4594032a00 con 0x7f45a4076b30 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.599+0000 7f45a1ffb640 1 -- 172.21.15.66:0/2973062688 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4594031a10 con 0x7f45a4076b30 2024-09-12T01:34:18.335 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 -- 172.21.15.66:0/2973062688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 msgr2=0x7f45a4104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 --2- 172.21.15.66:0/2973062688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4104bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4594009840 tx=0x7f45940091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 -- 172.21.15.66:0/2973062688 shutdown_connections 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 --2- 172.21.15.66:0/2973062688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4104bc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 -- 172.21.15.66:0/2973062688 >> 172.21.15.66:0/2973062688 conn(0x7f45a40fc6d0 msgr2=0x7f45a40feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 -- 172.21.15.66:0/2973062688 shutdown_connections 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 -- 172.21.15.66:0/2973062688 wait complete. 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.600+0000 7f45a92f6640 1 Processor -- start 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a92f6640 1 -- start start 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a92f6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a92f6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a4111340 con 0x7f45a4076b30 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:18.336 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55356/0 (socket says 172.21.15.66:55356) 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a2ffd640 1 -- 172.21.15.66:0/4162235013 learned_addr learned my addr 172.21.15.66:0/4162235013 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a2ffd640 1 -- 172.21.15.66:0/4162235013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594009450 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.601+0000 7f45a2ffd640 1 --2- 172.21.15.66:0/4162235013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4110e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45940098a0 tx=0x7f459402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.602+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f45940327b0 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.602+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a4111540 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.602+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a4111f90 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.602+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f459403b870 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.602+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f459403a550 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.603+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 2) v1 ==== 45263+0+0 (secure 0 0 0) 0x7f4594039040 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.604+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4590005240 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.604+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f459406d3c0 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.606+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f459404c350 con 0x7f45a4076b30 2024-09-12T01:34:18.337 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.672+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f45900054f0 con 0x7f45a4076b30 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.672+0000 7f458b7fe640 1 -- 172.21.15.66:0/4162235013 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f4594037020 con 0x7f45a4076b30 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 msgr2=0x7f45a4110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 --2- 172.21.15.66:0/4162235013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4110e00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f45940098a0 tx=0x7f459402c040 comp rx=0 tx=0).stop 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 shutdown_connections 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 --2- 172.21.15.66:0/4162235013 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45a4076b30 0x7f45a4110e00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 >> 172.21.15.66:0/4162235013 conn(0x7f45a40fc6d0 msgr2=0x7f45a40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 shutdown_connections 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:11.673+0000 7f45a92f6640 1 -- 172.21.15.66:0/4162235013 wait complete. 2024-09-12T01:34:18.338 INFO:teuthology.orchestra.run.smithi066.stdout:mgr not available, waiting (2/15)... 2024-09-12T01:34:22.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:21 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/4034665594' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-12T01:34:22.307 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:22.309 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:34:22.309 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsid": "f9344df4-70a6-11ef-bcea-c7b262605968", 2024-09-12T01:34:22.309 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "health": { 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 0 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "smithi066" 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:22.310 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-12T01:34:22.311 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-12T01:34:22.311 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.311 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-12T01:34:22.311 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:22.311 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-12T01:34:22.311 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-12T01:34:22.319 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-12T01:34:22.320 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "restful" 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ], 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "modified": "2024-09-12T01:34:00.032148+0000", 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout }, 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.588+0000 7f227c69f640 1 Processor -- start 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.588+0000 7f227c69f640 1 -- start start 2024-09-12T01:34:22.321 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.589+0000 7f227c69f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f22741024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.589+0000 7f227c69f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274102a90 con 0x7f22741020b0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.589+0000 7f227a43b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f22741024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.589+0000 7f227a43b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f22741024c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55048/0 (socket says 172.21.15.66:55048) 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.589+0000 7f227a43b640 1 -- 172.21.15.66:0/4274362046 learned_addr learned my addr 172.21.15.66:0/4274362046 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.589+0000 7f227a43b640 1 -- 172.21.15.66:0/4274362046 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2274102bd0 con 0x7f22741020b0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.590+0000 7f227a43b640 1 --2- 172.21.15.66:0/4274362046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f22741024c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2264009e50 tx=0x7f2264009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e3684ea81e1255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.590+0000 7f2279439640 1 -- 172.21.15.66:0/4274362046 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2264031560 con 0x7f22741020b0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.590+0000 7f2279439640 1 -- 172.21.15.66:0/4274362046 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f226402d050 con 0x7f22741020b0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.590+0000 7f2279439640 1 -- 172.21.15.66:0/4274362046 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22640079b0 con 0x7f22741020b0 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 -- 172.21.15.66:0/4274362046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 msgr2=0x7f22741024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 --2- 172.21.15.66:0/4274362046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f22741024c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2264009e50 tx=0x7f2264009840 comp rx=0 tx=0).stop 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 -- 172.21.15.66:0/4274362046 shutdown_connections 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 --2- 172.21.15.66:0/4274362046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f22741024c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.322 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 -- 172.21.15.66:0/4274362046 >> 172.21.15.66:0/4274362046 conn(0x7f22740fd850 msgr2=0x7f22740ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 -- 172.21.15.66:0/4274362046 shutdown_connections 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.591+0000 7f227c69f640 1 -- 172.21.15.66:0/4274362046 wait complete. 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227c69f640 1 Processor -- start 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227c69f640 1 -- start start 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227c69f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f2274110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227c69f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22741113a0 con 0x7f22741020b0 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227a43b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f2274110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227a43b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f2274110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55060/0 (socket says 172.21.15.66:55060) 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227a43b640 1 -- 172.21.15.66:0/4034665594 learned_addr learned my addr 172.21.15.66:0/4034665594 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.592+0000 7f227a43b640 1 -- 172.21.15.66:0/4034665594 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264009ae0 con 0x7f22741020b0 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.593+0000 7f227a43b640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f2274110e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2264007690 tx=0x7f2264009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.593+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f226403a410 con 0x7f22741020b0 2024-09-12T01:34:22.323 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.593+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f226403a9d0 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.593+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22741115a0 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.593+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2264042820 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.593+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2274111ff0 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.594+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2264038040 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.594+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2274101510 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.594+0000 7f2272ffd640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f225c039450 0x7f225c03b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.594+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f226406ced0 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.594+0000 7f2279c3a640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f225c039450 0x7f225c03b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.595+0000 7f2279c3a640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f225c039450 0x7f225c03b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2268006fd0 tx=0x7f2268006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.599+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2264049910 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.826+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f22741124d0 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.827+0000 7f2272ffd640 1 -- 172.21.15.66:0/4034665594 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f2264036030 con 0x7f22741020b0 2024-09-12T01:34:22.324 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f225c039450 msgr2=0x7f225c03b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f225c039450 0x7f225c03b900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2268006fd0 tx=0x7f2268006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 msgr2=0x7f2274110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f2274110e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2264007690 tx=0x7f2264009840 comp rx=0 tx=0).stop 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 shutdown_connections 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f225c039450 0x7f225c03b900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 --2- 172.21.15.66:0/4034665594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22741020b0 0x7f2274110e60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 >> 172.21.15.66:0/4034665594 conn(0x7f22740fd850 msgr2=0x7f22740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 shutdown_connections 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:21.829+0000 7f227c69f640 1 -- 172.21.15.66:0/4034665594 wait complete. 2024-09-12T01:34:22.325 INFO:teuthology.orchestra.run.smithi066.stdout:mgr is available 2024-09-12T01:34:23.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:22 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/864273245' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-12T01:34:23.394 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [global] 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout fsid = f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout [osd] 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-12T01:34:23.395 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.701+0000 7fec2e87a640 1 Processor -- start 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.701+0000 7fec2e87a640 1 -- start start 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.701+0000 7fec2e87a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.701+0000 7fec2e87a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec28078fc0 con 0x7fec28078b20 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.702+0000 7fec27fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.702+0000 7fec27fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51502/0 (socket says 172.21.15.66:51502) 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.702+0000 7fec27fff640 1 -- 172.21.15.66:0/1455932533 learned_addr learned my addr 172.21.15.66:0/1455932533 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.702+0000 7fec27fff640 1 -- 172.21.15.66:0/1455932533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec28079100 con 0x7fec28078b20 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec27fff640 1 --2- 172.21.15.66:0/1455932533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28077230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec18009840 tx=0x7fec180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd49ece38b99f543 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec277fe640 1 -- 172.21.15.66:0/1455932533 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec18032440 con 0x7fec28078b20 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec277fe640 1 -- 172.21.15.66:0/1455932533 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fec18032a00 con 0x7fec28078b20 2024-09-12T01:34:23.396 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec277fe640 1 -- 172.21.15.66:0/1455932533 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec180319e0 con 0x7fec28078b20 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 -- 172.21.15.66:0/1455932533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 msgr2=0x7fec28077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 --2- 172.21.15.66:0/1455932533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28077230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec18009840 tx=0x7fec180091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 -- 172.21.15.66:0/1455932533 shutdown_connections 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 --2- 172.21.15.66:0/1455932533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28077230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 -- 172.21.15.66:0/1455932533 >> 172.21.15.66:0/1455932533 conn(0x7fec280fd850 msgr2=0x7fec280ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 -- 172.21.15.66:0/1455932533 shutdown_connections 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.703+0000 7fec2e87a640 1 -- 172.21.15.66:0/1455932533 wait complete. 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec2e87a640 1 Processor -- start 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec2e87a640 1 -- start start 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec2e87a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec2e87a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec281134c0 con 0x7fec28078b20 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec27fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.397 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec27fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51518/0 (socket says 172.21.15.66:51518) 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.704+0000 7fec27fff640 1 -- 172.21.15.66:0/864273245 learned_addr learned my addr 172.21.15.66:0/864273245 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec27fff640 1 -- 172.21.15.66:0/864273245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18009450 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec27fff640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28112f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec18006f00 tx=0x7fec18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec18032880 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fec1803b8d0 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec281136c0 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec1803a8f0 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.705+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec28113b30 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.706+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fec1803ba40 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.706+0000 7fec257fa640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fec14039450 0x7fec1403b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.706+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2804b720 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.706+0000 7fec1ffff640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fec14039450 0x7fec1403b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.706+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fec1806c960 con 0x7fec28078b20 2024-09-12T01:34:23.398 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.707+0000 7fec1ffff640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fec14039450 0x7fec1403b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec10006fd0 tx=0x7fec10006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.711+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec18045460 con 0x7fec28078b20 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.876+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fec28114250 con 0x7fec28078b20 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.877+0000 7fec257fa640 1 -- 172.21.15.66:0/864273245 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7fec18042310 con 0x7fec28078b20 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fec14039450 msgr2=0x7fec1403b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fec14039450 0x7fec1403b900 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec10006fd0 tx=0x7fec10006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 msgr2=0x7fec28112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28112f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fec18006f00 tx=0x7fec18008040 comp rx=0 tx=0).stop 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 shutdown_connections 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fec14039450 0x7fec1403b900 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 --2- 172.21.15.66:0/864273245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec28078b20 0x7fec28112f80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 >> 172.21.15.66:0/864273245 conn(0x7fec280fd850 msgr2=0x7fec280fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 shutdown_connections 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:22.880+0000 7fec2e87a640 1 -- 172.21.15.66:0/864273245 wait complete. 2024-09-12T01:34:23.399 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling cephadm module... 2024-09-12T01:34:24.333 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:24 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1352705727' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27be1db640 1 Processor -- start 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27be1db640 1 -- start start 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27be1db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27be1db640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b81029c0 con 0x7f27b8102070 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27b77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27b77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51524/0 (socket says 172.21.15.66:51524) 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27b77fe640 1 -- 172.21.15.66:0/3947606695 learned_addr learned my addr 172.21.15.66:0/3947606695 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.799+0000 7f27b77fe640 1 -- 172.21.15.66:0/3947606695 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b8102b00 con 0x7f27b8102070 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.800+0000 7f27b77fe640 1 --2- 172.21.15.66:0/3947606695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8102480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009840 tx=0x7f27a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbffbd4d75e3155 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:24.734 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.800+0000 7f27b67fc640 1 -- 172.21.15.66:0/3947606695 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27a8032440 con 0x7f27b8102070 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.800+0000 7f27b67fc640 1 -- 172.21.15.66:0/3947606695 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f27a8032a00 con 0x7f27b8102070 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.800+0000 7f27b67fc640 1 -- 172.21.15.66:0/3947606695 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27a8031a10 con 0x7f27b8102070 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 -- 172.21.15.66:0/3947606695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 msgr2=0x7f27b8102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 --2- 172.21.15.66:0/3947606695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8102480 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009840 tx=0x7f27a80091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 -- 172.21.15.66:0/3947606695 shutdown_connections 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 --2- 172.21.15.66:0/3947606695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8102480 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 -- 172.21.15.66:0/3947606695 >> 172.21.15.66:0/3947606695 conn(0x7f27b80fd850 msgr2=0x7f27b80ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 -- 172.21.15.66:0/3947606695 shutdown_connections 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 -- 172.21.15.66:0/3947606695 wait complete. 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.801+0000 7f27be1db640 1 Processor -- start 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27be1db640 1 -- start start 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27be1db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27be1db640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b8111310 con 0x7f27b8102070 2024-09-12T01:34:24.735 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27b77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27b77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51528/0 (socket says 172.21.15.66:51528) 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27b77fe640 1 -- 172.21.15.66:0/1352705727 learned_addr learned my addr 172.21.15.66:0/1352705727 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27b77fe640 1 -- 172.21.15.66:0/1352705727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8009450 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27b77fe640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8110dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27a8006a70 tx=0x7f27a802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27a8031d10 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.802+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b8111510 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.803+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b8111f60 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.803+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f27a8031e70 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.803+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27a8047640 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.803+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f27a8039070 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.804+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a4005240 con 0x7f27b8102070 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.804+0000 7f279ffff640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f27a0039450 0x7f27a003b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:24.736 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.804+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f27a806caf0 con 0x7f27b8102070 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.804+0000 7f27b6ffd640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f27a0039450 0x7f27a003b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.804+0000 7f27b6ffd640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f27a0039450 0x7f27a003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27ac006fd0 tx=0x7f27ac006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:23.808+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f27a8039500 con 0x7f27b8102070 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.018+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f27a40054f0 con 0x7f27b8102070 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.071+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f27a803bcc0 con 0x7f27b8102070 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.072+0000 7f279ffff640 1 -- 172.21.15.66:0/1352705727 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f27a8045360 con 0x7f27b8102070 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f27a0039450 msgr2=0x7f27a003b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f27a0039450 0x7f27a003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27ac006fd0 tx=0x7f27ac006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 msgr2=0x7f27b8110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8110dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27a8006a70 tx=0x7f27a802c040 comp rx=0 tx=0).stop 2024-09-12T01:34:24.737 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 shutdown_connections 2024-09-12T01:34:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f27a0039450 0x7f27a003b900 secure :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f27ac006fd0 tx=0x7f27ac006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 --2- 172.21.15.66:0/1352705727 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27b8102070 0x7f27b8110dd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:24.740 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 >> 172.21.15.66:0/1352705727 conn(0x7f27b80fd850 msgr2=0x7f27b80fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 shutdown_connections 2024-09-12T01:34:24.741 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:24.074+0000 7f27be1db640 1 -- 172.21.15.66:0/1352705727 wait complete. 2024-09-12T01:34:25.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:25 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1352705727' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-12T01:34:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:25 smithi066 ceph-mon[27875]: mgrmap e5: smithi066.qdwcrh(active, since 12s) 2024-09-12T01:34:25.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:34:25.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-12T01:34:25.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:34:25.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "active_name": "smithi066.qdwcrh", 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08c1c48640 1 Processor -- start 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08c1c48640 1 -- start start 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08c1c48640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08c1c48640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc076f20 con 0x7f08bc076b10 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51550/0 (socket says 172.21.15.66:51550) 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.113+0000 7f08bb7fe640 1 -- 172.21.15.66:0/923271719 learned_addr learned my addr 172.21.15.66:0/923271719 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.114+0000 7f08bb7fe640 1 -- 172.21.15.66:0/923271719 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc105120 con 0x7f08bc076b10 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.114+0000 7f08bb7fe640 1 --2- 172.21.15.66:0/923271719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc104be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009840 tx=0x7f08ac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b9033b802516d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08ba7fc640 1 -- 172.21.15.66:0/923271719 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08ac032440 con 0x7f08bc076b10 2024-09-12T01:34:25.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08ba7fc640 1 -- 172.21.15.66:0/923271719 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f08ac032a00 con 0x7f08bc076b10 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08ba7fc640 1 -- 172.21.15.66:0/923271719 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08ac031a10 con 0x7f08bc076b10 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 -- 172.21.15.66:0/923271719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 msgr2=0x7f08bc104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 --2- 172.21.15.66:0/923271719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc104be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009840 tx=0x7f08ac0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 -- 172.21.15.66:0/923271719 shutdown_connections 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 --2- 172.21.15.66:0/923271719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc104be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 -- 172.21.15.66:0/923271719 >> 172.21.15.66:0/923271719 conn(0x7f08bc0fc6d0 msgr2=0x7f08bc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 -- 172.21.15.66:0/923271719 shutdown_connections 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.115+0000 7f08c1c48640 1 -- 172.21.15.66:0/923271719 wait complete. 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08c1c48640 1 Processor -- start 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08c1c48640 1 -- start start 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08c1c48640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc10eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08c1c48640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc10f080 con 0x7f08bc076b10 2024-09-12T01:34:25.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc10eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc10eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51556/0 (socket says 172.21.15.66:51556) 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.116+0000 7f08bb7fe640 1 -- 172.21.15.66:0/423798462 learned_addr learned my addr 172.21.15.66:0/423798462 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08bb7fe640 1 -- 172.21.15.66:0/423798462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac009450 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08bb7fe640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc10eb40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0098a0 tx=0x7f08ac02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08ac0327b0 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f08ac03b870 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc10f280 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f08ac03a550 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.117+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc10f6f0 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.118+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f08ac039040 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.118+0000 7f08a3fff640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 0x7f08a403fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.118+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08bc04b720 con 0x7f08bc076b10 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.118+0000 7f08baffd640 1 -- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 msgr2=0x7f08a403fd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/2001799335 2024-09-12T01:34:25.854 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.118+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f08ac06ca20 con 0x7f08bc076b10 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.119+0000 7f08baffd640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 0x7f08a403fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.123+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f08ac03f080 con 0x7f08bc076b10 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.320+0000 7f08baffd640 1 -- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 msgr2=0x7f08a403fd90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/2001799335 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.320+0000 7f08baffd640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 0x7f08a403fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.336+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f08bc10f6f0 con 0x7f08bc076b10 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.336+0000 7f08a3fff640 1 -- 172.21.15.66:0/423798462 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f08ac037070 con 0x7f08bc076b10 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 msgr2=0x7f08a403fd90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 0x7f08a403fd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 msgr2=0x7f08bc10eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc10eb40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0098a0 tx=0x7f08ac02c040 comp rx=0 tx=0).stop 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 shutdown_connections 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7f08a403d8e0 0x7f08a403fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.855 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 --2- 172.21.15.66:0/423798462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08bc076b10 0x7f08bc10eb40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:25.856 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 >> 172.21.15.66:0/423798462 conn(0x7f08bc0fc6d0 msgr2=0x7f08bc102490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:25.856 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 shutdown_connections 2024-09-12T01:34:25.856 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:25.338+0000 7f08c1c48640 1 -- 172.21.15.66:0/423798462 wait complete. 2024-09-12T01:34:25.856 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for the mgr to restart... 2024-09-12T01:34:25.856 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr epoch 5... 2024-09-12T01:34:26.091 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:26 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/423798462' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: Active manager daemon smithi066.qdwcrh restarted 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: osdmap e2: 0 total, 0 up, 0 in 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: mgrmap e6: smithi066.qdwcrh(active, starting, since 0.00347075s) 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:34:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:29.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:29.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:29.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:29.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:34:29.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:28 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:34:29.971 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:29 smithi066 ceph-mon[27875]: Found migration_current of "None". Setting to last migration. 2024-09-12T01:34:29.971 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:29 smithi066 ceph-mon[27875]: mgrmap e7: smithi066.qdwcrh(active, since 1.00498s) 2024-09-12T01:34:30.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:34:30.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa19324e640 1 Processor -- start 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa19324e640 1 -- start start 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa19324e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa19324e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c0790a0 con 0x7fa18c078c90 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa190fea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa190fea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51564/0 (socket says 172.21.15.66:51564) 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.273+0000 7fa190fea640 1 -- 172.21.15.66:0/948037152 learned_addr learned my addr 172.21.15.66:0/948037152 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.274+0000 7fa190fea640 1 -- 172.21.15.66:0/948037152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c077750 con 0x7fa18c078c90 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.274+0000 7fa190fea640 1 --2- 172.21.15.66:0/948037152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c077210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa180009840 tx=0x7fa1800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35197333df4fa2cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.275+0000 7fa18b7fe640 1 -- 172.21.15.66:0/948037152 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa180032440 con 0x7fa18c078c90 2024-09-12T01:34:30.275 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.275+0000 7fa18b7fe640 1 -- 172.21.15.66:0/948037152 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa180032a00 con 0x7fa18c078c90 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.275+0000 7fa18b7fe640 1 -- 172.21.15.66:0/948037152 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1800319e0 con 0x7fa18c078c90 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 -- 172.21.15.66:0/948037152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 msgr2=0x7fa18c077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 --2- 172.21.15.66:0/948037152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c077210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa180009840 tx=0x7fa1800091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 -- 172.21.15.66:0/948037152 shutdown_connections 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 --2- 172.21.15.66:0/948037152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c077210 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 -- 172.21.15.66:0/948037152 >> 172.21.15.66:0/948037152 conn(0x7fa18c0fd6b0 msgr2=0x7fa18c0ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 -- 172.21.15.66:0/948037152 shutdown_connections 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.276+0000 7fa19324e640 1 -- 172.21.15.66:0/948037152 wait complete. 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa19324e640 1 Processor -- start 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa19324e640 1 -- start start 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa19324e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa19324e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c113490 con 0x7fa18c078c90 2024-09-12T01:34:30.276 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa190fea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa190fea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51574/0 (socket says 172.21.15.66:51574) 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.277+0000 7fa190fea640 1 -- 172.21.15.66:0/2531047951 learned_addr learned my addr 172.21.15.66:0/2531047951 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa190fea640 1 -- 172.21.15.66:0/2531047951 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa180009450 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa190fea640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c112f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa180006f00 tx=0x7fa180008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa180031e30 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa18003d8b0 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c113690 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa18003b8f0 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.278+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c113b00 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.280+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa180039070 con 0x7fa18c078c90 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.280+0000 7fa1897fa640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.280+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 --> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa17c03c050 con 0x7fa17c039490 2024-09-12T01:34:30.277 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.280+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa18006cdd0 con 0x7fa18c078c90 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.280+0000 7fa18bfff640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 msgr2=0x7fa17c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/2001799335 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.280+0000 7fa18bfff640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.481+0000 7fa18bfff640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 msgr2=0x7fa17c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/2001799335 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.481+0000 7fa18bfff640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.882+0000 7fa18bfff640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 msgr2=0x7fa17c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/2001799335 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:26.882+0000 7fa18bfff640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:27.683+0000 7fa18bfff640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 msgr2=0x7fa17c03b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/2001799335 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:27.683+0000 7fa18bfff640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:28.667+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7fa18006c2d0 con 0x7fa18c078c90 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:28.668+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 msgr2=0x7fa17c03b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:28.668+0000 7fa1897fa640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.668+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7fa18003ca00 con 0x7fa18c078c90 2024-09-12T01:34:30.278 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.668+0000 7fa1897fa640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fa17c03cdf0 0x7fa17c03f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.668+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa17c03c050 con 0x7fa17c03cdf0 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.669+0000 7fa18bfff640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fa17c03cdf0 0x7fa17c03f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.670+0000 7fa18bfff640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fa17c03cdf0 0x7fa17c03f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa178006fd0 tx=0x7fa178006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.670+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fa17c03c050 con 0x7fa17c03cdf0 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.675+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa18c04b720 con 0x7fa17c03cdf0 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa1897fa640 1 -- 172.21.15.66:0/2531047951 <== mgr.14118 v2:172.21.15.66:6800/3928441794 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa18c04b720 con 0x7fa17c03cdf0 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fa17c03cdf0 msgr2=0x7fa17c03f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fa17c03cdf0 0x7fa17c03f1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa178006fd0 tx=0x7fa178006e10 comp rx=0 tx=0).stop 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 msgr2=0x7fa18c112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c112f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa180006f00 tx=0x7fa180008040 comp rx=0 tx=0).stop 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 shutdown_connections 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fa17c03cdf0 0x7fa17c03f1d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:6800/2001799335,v1:172.21.15.66:6801/2001799335] conn(0x7fa17c039490 0x7fa17c03b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:30.279 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 --2- 172.21.15.66:0/2531047951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa18c078c90 0x7fa18c112f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:30.280 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 >> 172.21.15.66:0/2531047951 conn(0x7fa18c0fd6b0 msgr2=0x7fa18c0fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:30.280 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 shutdown_connections 2024-09-12T01:34:30.280 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:29.676+0000 7fa19324e640 1 -- 172.21.15.66:0/2531047951 wait complete. 2024-09-12T01:34:30.280 INFO:teuthology.orchestra.run.smithi066.stdout:mgr epoch 5 is available 2024-09-12T01:34:30.280 INFO:teuthology.orchestra.run.smithi066.stdout:Setting orchestrator backend to cephadm... 2024-09-12T01:34:30.871 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:30 smithi066 ceph-mon[27875]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:34:30.871 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:30 smithi066 ceph-mon[27875]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56eabb3640 1 Processor -- start 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56eabb3640 1 -- start start 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56eabb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4104c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56eabb3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4076ea0 con 0x7f56e4076a90 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56e894f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56e894f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51652/0 (socket says 172.21.15.66:51652) 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56e894f640 1 -- 172.21.15.66:0/2805204739 learned_addr learned my addr 172.21.15.66:0/2805204739 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.685+0000 7f56e894f640 1 -- 172.21.15.66:0/2805204739 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e41051b0 con 0x7f56e4076a90 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.686+0000 7f56e894f640 1 --2- 172.21.15.66:0/2805204739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4104c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009840 tx=0x7f56d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939081799a08fc87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:31.445 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.686+0000 7f56e37fe640 1 -- 172.21.15.66:0/2805204739 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d8032440 con 0x7f56e4076a90 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.686+0000 7f56e37fe640 1 -- 172.21.15.66:0/2805204739 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f56d8032a00 con 0x7f56e4076a90 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.686+0000 7f56e37fe640 1 -- 172.21.15.66:0/2805204739 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d8031a10 con 0x7f56e4076a90 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 -- 172.21.15.66:0/2805204739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 msgr2=0x7f56e4104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 --2- 172.21.15.66:0/2805204739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4104c70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009840 tx=0x7f56d80091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 -- 172.21.15.66:0/2805204739 shutdown_connections 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 --2- 172.21.15.66:0/2805204739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4104c70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 -- 172.21.15.66:0/2805204739 >> 172.21.15.66:0/2805204739 conn(0x7f56e40fc700 msgr2=0x7f56e40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 -- 172.21.15.66:0/2805204739 shutdown_connections 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.687+0000 7f56eabb3640 1 -- 172.21.15.66:0/2805204739 wait complete. 2024-09-12T01:34:31.446 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56eabb3640 1 Processor -- start 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56eabb3640 1 -- start start 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56eabb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56eabb3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4111390 con 0x7f56e4076a90 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56e894f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56e894f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51656/0 (socket says 172.21.15.66:51656) 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56e894f640 1 -- 172.21.15.66:0/2269148438 learned_addr learned my addr 172.21.15.66:0/2269148438 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.688+0000 7f56e894f640 1 -- 172.21.15.66:0/2269148438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d8009450 con 0x7f56e4076a90 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.689+0000 7f56e894f640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4110e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56d8006a70 tx=0x7f56d802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.689+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d8031c90 con 0x7f56e4076a90 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.689+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f56d8031df0 con 0x7f56e4076a90 2024-09-12T01:34:31.447 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.689+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e41115f0 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.689+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e4111f90 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.689+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f56d803b5e0 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.690+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f56d8039070 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.690+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8005240 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.690+0000 7f56e17fa640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f56d4039380 0x7f56d403b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.690+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f56d806d000 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.690+0000 7f56e3fff640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f56d4039380 0x7f56d403b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.691+0000 7f56e3fff640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f56d4039380 0x7f56d403b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56d0006fd0 tx=0x7f56d0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.695+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f56d809f2a0 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.720+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f56d803da40 con 0x7f56e4076a90 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.870+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f56c8000bf0 con 0x7f56d4039380 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.878+0000 7f56e17fa640 1 -- 172.21.15.66:0/2269148438 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f56c8000bf0 con 0x7f56d4039380 2024-09-12T01:34:31.448 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.880+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f56d4039380 msgr2=0x7f56d403b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.880+0000 7f56eabb3640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f56d4039380 0x7f56d403b830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f56d0006fd0 tx=0x7f56d0006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.880+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 msgr2=0x7f56e4110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.880+0000 7f56eabb3640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4110e50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f56d8006a70 tx=0x7f56d802c040 comp rx=0 tx=0).stop 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.881+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 shutdown_connections 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.881+0000 7f56eabb3640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f56d4039380 0x7f56d403b830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.881+0000 7f56eabb3640 1 --2- 172.21.15.66:0/2269148438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e4076a90 0x7f56e4110e50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.881+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 >> 172.21.15.66:0/2269148438 conn(0x7f56e40fc700 msgr2=0x7f56e40fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.881+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 shutdown_connections 2024-09-12T01:34:31.449 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:30.881+0000 7f56eabb3640 1 -- 172.21.15.66:0/2269148438 wait complete. 2024-09-12T01:34:31.861 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: mgrmap e8: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:34:31.861 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:31.861 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: [12/Sep/2024:01:34:30] ENGINE Bus STARTING 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: [12/Sep/2024:01:34:31] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: [12/Sep/2024:01:34:31] ENGINE Bus STARTED 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: [12/Sep/2024:01:34:31] ENGINE Error in HTTPServer.serve 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Traceback (most recent call last): 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:34:31.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._run(expiration_interval) 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s = self.context.wrap_socket( 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: return self.sslsocket_class._create( 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:34:31.863 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self.do_handshake() 2024-09-12T01:34:31.864 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:34:31.864 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._sslobj.do_handshake() 2024-09-12T01:34:31.864 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:34:31.864 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:31.864 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:31 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f905e757640 1 Processor -- start 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f905e757640 1 -- start start 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f905e757640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f90581039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f905e757640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058070e30 con 0x7f90581035d0 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f9057fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f90581039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f9057fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f90581039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51660/0 (socket says 172.21.15.66:51660) 2024-09-12T01:34:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.860+0000 7f9057fff640 1 -- 172.21.15.66:0/1418258950 learned_addr learned my addr 172.21.15.66:0/1418258950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.861+0000 7f9057fff640 1 -- 172.21.15.66:0/1418258950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058103f20 con 0x7f90581035d0 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.861+0000 7f9057fff640 1 --2- 172.21.15.66:0/1418258950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f90581039e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9048009840 tx=0x7f90480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec7b6da38503014 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f9056ffd640 1 -- 172.21.15.66:0/1418258950 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9048032440 con 0x7f90581035d0 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f9056ffd640 1 -- 172.21.15.66:0/1418258950 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9048032a00 con 0x7f90581035d0 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f9056ffd640 1 -- 172.21.15.66:0/1418258950 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90480319e0 con 0x7f90581035d0 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 -- 172.21.15.66:0/1418258950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 msgr2=0x7f90581039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 --2- 172.21.15.66:0/1418258950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f90581039e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9048009840 tx=0x7f90480091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 -- 172.21.15.66:0/1418258950 shutdown_connections 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 --2- 172.21.15.66:0/1418258950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f90581039e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 -- 172.21.15.66:0/1418258950 >> 172.21.15.66:0/1418258950 conn(0x7f90580fbdd0 msgr2=0x7f90580fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 -- 172.21.15.66:0/1418258950 shutdown_connections 2024-09-12T01:34:32.560 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.862+0000 7f905e757640 1 -- 172.21.15.66:0/1418258950 wait complete. 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f905e757640 1 Processor -- start 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f905e757640 1 -- start start 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f905e757640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f9058110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f905e757640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9058111310 con 0x7f90581035d0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f9057fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f9058110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f9057fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f9058110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51666/0 (socket says 172.21.15.66:51666) 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.863+0000 7f9057fff640 1 -- 172.21.15.66:0/3348100907 learned_addr learned my addr 172.21.15.66:0/3348100907 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f9057fff640 1 -- 172.21.15.66:0/3348100907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9048009450 con 0x7f90581035d0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f9057fff640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f9058110dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90480098a0 tx=0x7f9048008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9048032880 con 0x7f90581035d0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f904803d8b0 con 0x7f90581035d0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9058111510 con 0x7f90581035d0 2024-09-12T01:34:32.561 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f904803b910 con 0x7f90581035d0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.864+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9058111f60 con 0x7f90581035d0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.865+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9048039070 con 0x7f90581035d0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.865+0000 7f9054ff9640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90400394e0 0x7f904003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.865+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90580ffa70 con 0x7f90581035d0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.865+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f904806d3c0 con 0x7f90581035d0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.865+0000 7f90577fe640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90400394e0 0x7f904003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.866+0000 7f90577fe640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90400394e0 0x7f904003b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f904c006fd0 tx=0x7f904c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:31.871+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9048039550 con 0x7f90581035d0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.037+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f90580fcfe0 con 0x7f90400394e0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.037+0000 7f9054ff9640 1 -- 172.21.15.66:0/3348100907 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f90580fcfe0 con 0x7f90400394e0 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.039+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90400394e0 msgr2=0x7f904003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.562 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.039+0000 7f905e757640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90400394e0 0x7f904003b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f904c006fd0 tx=0x7f904c006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.039+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 msgr2=0x7f9058110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.039+0000 7f905e757640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f9058110dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90480098a0 tx=0x7f9048008040 comp rx=0 tx=0).stop 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.040+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 shutdown_connections 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.040+0000 7f905e757640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90400394e0 0x7f904003b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.040+0000 7f905e757640 1 --2- 172.21.15.66:0/3348100907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90581035d0 0x7f9058110dd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.040+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 >> 172.21.15.66:0/3348100907 conn(0x7f90580fbdd0 msgr2=0x7f90580fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.040+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 shutdown_connections 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.040+0000 7f905e757640 1 -- 172.21.15.66:0/3348100907 wait complete. 2024-09-12T01:34:32.563 INFO:teuthology.orchestra.run.smithi066.stdout:Generating ssh key... 2024-09-12T01:34:32.984 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:32 smithi066 ceph-mon[27875]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:34.023 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d02b0c640 1 Processor -- start 2024-09-12T01:34:34.023 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d02b0c640 1 -- start start 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d02b0c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d02b0c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc078f60 con 0x7f9cfc078b50 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d008a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d008a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47102/0 (socket says 172.21.15.66:47102) 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.983+0000 7f9d008a8640 1 -- 172.21.15.66:0/3650774175 learned_addr learned my addr 172.21.15.66:0/3650774175 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.984+0000 7f9d008a8640 1 -- 172.21.15.66:0/3650774175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc0790a0 con 0x7f9cfc078b50 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.984+0000 7f9d008a8640 1 --2- 172.21.15.66:0/3650774175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009840 tx=0x7f9cf00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448d7cb837b9821a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9cfb7fe640 1 -- 172.21.15.66:0/3650774175 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf0032440 con 0x7f9cfc078b50 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9cfb7fe640 1 -- 172.21.15.66:0/3650774175 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9cf0032a00 con 0x7f9cfc078b50 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9cfb7fe640 1 -- 172.21.15.66:0/3650774175 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf0031a10 con 0x7f9cfc078b50 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 -- 172.21.15.66:0/3650774175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 msgr2=0x7f9cfc077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 --2- 172.21.15.66:0/3650774175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009840 tx=0x7f9cf00091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:34.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 -- 172.21.15.66:0/3650774175 shutdown_connections 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 --2- 172.21.15.66:0/3650774175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc077210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 -- 172.21.15.66:0/3650774175 >> 172.21.15.66:0/3650774175 conn(0x7f9cfc0fd850 msgr2=0x7f9cfc0ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 -- 172.21.15.66:0/3650774175 shutdown_connections 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.985+0000 7f9d02b0c640 1 -- 172.21.15.66:0/3650774175 wait complete. 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d02b0c640 1 Processor -- start 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d02b0c640 1 -- start start 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d02b0c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d02b0c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cfc1134a0 con 0x7f9cfc078b50 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d008a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d008a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47110/0 (socket says 172.21.15.66:47110) 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.986+0000 7f9d008a8640 1 -- 172.21.15.66:0/2541991661 learned_addr learned my addr 172.21.15.66:0/2541991661 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9d008a8640 1 -- 172.21.15.66:0/2541991661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009450 con 0x7f9cfc078b50 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9d008a8640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc112f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00329d0 tx=0x7f9cf002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:34.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf0031d10 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f9cf0031e70 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cfc1136a0 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9cf003b670 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.987+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cfc113b10 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.988+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9cf0039070 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.988+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cfc04b720 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.989+0000 7f9cf97fa640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9cec039490 0x7f9cec03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.989+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9cf006d070 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.989+0000 7f9cfbfff640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9cec039490 0x7f9cec03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.989+0000 7f9cfbfff640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9cec039490 0x7f9cec03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8006fd0 tx=0x7f9ce8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:32.993+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9cf004e350 con 0x7f9cfc078b50 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.158+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cfc113b10 con 0x7f9cec039490 2024-09-12T01:34:34.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.429+0000 7f9cf97fa640 1 -- 172.21.15.66:0/2541991661 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9cfc113b10 con 0x7f9cec039490 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9cec039490 msgr2=0x7f9cec03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9cec039490 0x7f9cec03b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8006fd0 tx=0x7f9ce8006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 msgr2=0x7f9cfc112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc112f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00329d0 tx=0x7f9cf002c040 comp rx=0 tx=0).stop 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 shutdown_connections 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9cec039490 0x7f9cec03b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 --2- 172.21.15.66:0/2541991661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cfc078b50 0x7f9cfc112f60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 >> 172.21.15.66:0/2541991661 conn(0x7f9cfc0fd850 msgr2=0x7f9cfc0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 shutdown_connections 2024-09-12T01:34:34.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:33.431+0000 7f9d02b0c640 1 -- 172.21.15.66:0/2541991661 wait complete. 2024-09-12T01:34:34.540 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:34 smithi066 ceph-mon[27875]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:34.540 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:34 smithi066 ceph-mon[27875]: Generating ssh key... 2024-09-12T01:34:34.540 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:34 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:34.540 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:34 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:35.038 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6cILuKyeNQyCYoTOWluu6LLVDBUtDXlgh/dbrU82obQbvTUrtEwYJpPRgf7f4IhrHCvQo0FNOi27FS52XbJGWY5uCiU7zeCTnJQ/XOhLmz0+VKlTVc8+S1WSnJDTch2Pa/n3maJTRMhDiJIVd1edpqM0MoMQS7PPa0Awil15bg+AvTCDLLQbS0ZfwyYmMYvhnJ8FUagC2jowgly9/ow2oaQdMZiHsbxvV4TLYlUTIjOTqS3cyT0Eg71COxLpc9MdBinxymwGOKaNW1jquczzPmPGRNIHNCLRZDGWPRj6LDxNSxUI5TiPFIMgpj8IFstQfuzhfkJxhGxkKtYWknLuk7/8utnpd1mWEkYKsbCX0l9oHo5q9z3p+j1I1Yo099eGeWS3bVjG5svYlu51stuJ0j7oAXusiunpWIWDX7VIPdd9Yiz4EwYPIgho+PO+m9q6H10vuevwnmnD8+XuRZthwDU4OsVj7F1Rvndd67juQ0czyFuBysEJ0KexX0nl8qJ0= ceph-f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd702f18640 1 Processor -- start 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd702f18640 1 -- start start 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd702f18640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc1039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd702f18640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc070e30 con 0x7fd6fc1035c0 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd700cb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc1039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd700cb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc1039d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47124/0 (socket says 172.21.15.66:47124) 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd700cb4640 1 -- 172.21.15.66:0/3930272724 learned_addr learned my addr 172.21.15.66:0/3930272724 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.365+0000 7fd700cb4640 1 -- 172.21.15.66:0/3930272724 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc103f10 con 0x7fd6fc1035c0 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.366+0000 7fd700cb4640 1 --2- 172.21.15.66:0/3930272724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc1039d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009840 tx=0x7fd6f00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d83dafa215ffaf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:35.039 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.366+0000 7fd6fb7fe640 1 -- 172.21.15.66:0/3930272724 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6f0032440 con 0x7fd6fc1035c0 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.366+0000 7fd6fb7fe640 1 -- 172.21.15.66:0/3930272724 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd6f0032a00 con 0x7fd6fc1035c0 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.366+0000 7fd6fb7fe640 1 -- 172.21.15.66:0/3930272724 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6f00319e0 con 0x7fd6fc1035c0 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 -- 172.21.15.66:0/3930272724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 msgr2=0x7fd6fc1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 --2- 172.21.15.66:0/3930272724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc1039d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009840 tx=0x7fd6f00091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 -- 172.21.15.66:0/3930272724 shutdown_connections 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 --2- 172.21.15.66:0/3930272724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc1039d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 -- 172.21.15.66:0/3930272724 >> 172.21.15.66:0/3930272724 conn(0x7fd6fc0fbdc0 msgr2=0x7fd6fc0fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 -- 172.21.15.66:0/3930272724 shutdown_connections 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 -- 172.21.15.66:0/3930272724 wait complete. 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 Processor -- start 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.367+0000 7fd702f18640 1 -- start start 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd702f18640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:35.040 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd702f18640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc111340 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd700cb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd700cb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47130/0 (socket says 172.21.15.66:47130) 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd700cb4640 1 -- 172.21.15.66:0/3480453294 learned_addr learned my addr 172.21.15.66:0/3480453294 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd700cb4640 1 -- 172.21.15.66:0/3480453294 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f0009450 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd700cb4640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc110e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0000c00 tx=0x7fd6f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.368+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6f003d450 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.369+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd6f003da10 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.369+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc111540 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.369+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6f003b8a0 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.369+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc111f90 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.370+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd6f0039070 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.370+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc0ffa60 con 0x7fd6fc1035c0 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.370+0000 7fd6f97fa640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fd6ec039490 0x7fd6ec03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:35.041 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.370+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd6f006d400 con 0x7fd6fc1035c0 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.370+0000 7fd6fbfff640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fd6ec039490 0x7fd6ec03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.370+0000 7fd6fbfff640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fd6ec039490 0x7fd6ec03b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8006fd0 tx=0x7fd6e8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.374+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd6f0039320 con 0x7fd6fc1035c0 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.539+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6fc0fd050 con 0x7fd6ec039490 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.540+0000 7fd6f97fa640 1 -- 172.21.15.66:0/3480453294 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fd6fc0fd050 con 0x7fd6ec039490 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fd6ec039490 msgr2=0x7fd6ec03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fd6ec039490 0x7fd6ec03b940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8006fd0 tx=0x7fd6e8006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 msgr2=0x7fd6fc110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc110e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0000c00 tx=0x7fd6f0008040 comp rx=0 tx=0).stop 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 shutdown_connections 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fd6ec039490 0x7fd6ec03b940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 --2- 172.21.15.66:0/3480453294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6fc1035c0 0x7fd6fc110e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 >> 172.21.15.66:0/3480453294 conn(0x7fd6fc0fbdc0 msgr2=0x7fd6fc0fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:35.042 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 shutdown_connections 2024-09-12T01:34:35.043 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:34.542+0000 7fd702f18640 1 -- 172.21.15.66:0/3480453294 wait complete. 2024-09-12T01:34:35.043 INFO:teuthology.orchestra.run.smithi066.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:34:35.043 INFO:teuthology.orchestra.run.smithi066.stdout:Adding key to root@localhost authorized_keys... 2024-09-12T01:34:35.046 INFO:teuthology.orchestra.run.smithi066.stdout:Adding host smithi066... 2024-09-12T01:34:35.635 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:35 smithi066 ceph-mon[27875]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:36.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:36 smithi066 ceph-mon[27875]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi066", "addr": "172.21.15.66", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:37.534 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:37 smithi066 ceph-mon[27875]: Deploying cephadm binary to smithi066 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Added host 'smithi066' with addr '172.21.15.66' 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.455+0000 7fec47f32640 1 Processor -- start 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.455+0000 7fec47f32640 1 -- start start 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.455+0000 7fec47f32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec401024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.455+0000 7fec47f32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec401029e0 con 0x7fec40102090 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.456+0000 7fec45cce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec401024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.456+0000 7fec45cce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec401024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47134/0 (socket says 172.21.15.66:47134) 2024-09-12T01:34:39.530 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.456+0000 7fec45cce640 1 -- 172.21.15.66:0/3205202897 learned_addr learned my addr 172.21.15.66:0/3205202897 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.456+0000 7fec45cce640 1 -- 172.21.15.66:0/3205202897 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40102b20 con 0x7fec40102090 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec45cce640 1 --2- 172.21.15.66:0/3205202897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec401024a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fec38009840 tx=0x7fec380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d255f687ca04438e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec44ccc640 1 -- 172.21.15.66:0/3205202897 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec38032440 con 0x7fec40102090 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec44ccc640 1 -- 172.21.15.66:0/3205202897 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fec38032a00 con 0x7fec40102090 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec44ccc640 1 -- 172.21.15.66:0/3205202897 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec38031a10 con 0x7fec40102090 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec47f32640 1 -- 172.21.15.66:0/3205202897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 msgr2=0x7fec401024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec47f32640 1 --2- 172.21.15.66:0/3205202897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec401024a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fec38009840 tx=0x7fec380091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.457+0000 7fec47f32640 1 -- 172.21.15.66:0/3205202897 shutdown_connections 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 --2- 172.21.15.66:0/3205202897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec401024a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 -- 172.21.15.66:0/3205202897 >> 172.21.15.66:0/3205202897 conn(0x7fec400fd850 msgr2=0x7fec400ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 -- 172.21.15.66:0/3205202897 shutdown_connections 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 -- 172.21.15.66:0/3205202897 wait complete. 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 Processor -- start 2024-09-12T01:34:39.531 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 -- start start 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec40110dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec47f32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40111310 con 0x7fec40102090 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.458+0000 7fec45cce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec40110dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec45cce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec40110dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47146/0 (socket says 172.21.15.66:47146) 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec45cce640 1 -- 172.21.15.66:0/235502482 learned_addr learned my addr 172.21.15.66:0/235502482 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec45cce640 1 -- 172.21.15.66:0/235502482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38009450 con 0x7fec40102090 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec45cce640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec40110dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec38006a70 tx=0x7fec3802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec38031d10 con 0x7fec40102090 2024-09-12T01:34:39.532 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fec38031e70 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec3803b6f0 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec40111510 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.459+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec40111f60 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.460+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fec38039070 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.460+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec401014f0 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.460+0000 7fec3e7fc640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fec28039490 0x7fec2803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.461+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fec3806cf70 con 0x7fec40102090 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.461+0000 7fec454cd640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fec28039490 0x7fec2803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.461+0000 7fec454cd640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fec28039490 0x7fec2803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec34006fd0 tx=0x7fec34006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:39.533 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.465+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec3809f2a0 con 0x7fec40102090 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:35.635+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi066", "addr": "172.21.15.66", "target": ["mon-mgr", ""]}) v1 -- 0x7fec400feb00 con 0x7fec28039490 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.967+0000 7fec3e7fc640 1 -- 172.21.15.66:0/235502482 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fec400feb00 con 0x7fec28039490 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.969+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fec28039490 msgr2=0x7fec2803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.969+0000 7fec47f32640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fec28039490 0x7fec2803b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fec34006fd0 tx=0x7fec34006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 msgr2=0x7fec40110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec40110dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec38006a70 tx=0x7fec3802c040 comp rx=0 tx=0).stop 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 shutdown_connections 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fec28039490 0x7fec2803b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 --2- 172.21.15.66:0/235502482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec40102090 0x7fec40110dd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 >> 172.21.15.66:0/235502482 conn(0x7fec400fd850 msgr2=0x7fec400fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 shutdown_connections 2024-09-12T01:34:39.534 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:38.970+0000 7fec47f32640 1 -- 172.21.15.66:0/235502482 wait complete. 2024-09-12T01:34:39.535 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying mon service with default placement... 2024-09-12T01:34:40.245 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:39 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:40.245 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:39 smithi066 ceph-mon[27875]: Added host smithi066 2024-09-12T01:34:40.245 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:39 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f579698a640 1 Processor -- start 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f579698a640 1 -- start start 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f579698a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790107020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f579698a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5790076dd0 con 0x7f57900769c0 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f578ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790107020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f578ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790107020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47162/0 (socket says 172.21.15.66:47162) 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.946+0000 7f578ffff640 1 -- 172.21.15.66:0/353044810 learned_addr learned my addr 172.21.15.66:0/353044810 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.947+0000 7f578ffff640 1 -- 172.21.15.66:0/353044810 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790076f10 con 0x7f57900769c0 2024-09-12T01:34:40.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.947+0000 7f578ffff640 1 --2- 172.21.15.66:0/353044810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790107020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5780009840 tx=0x7f57800091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbf7c394bedc173 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f578effd640 1 -- 172.21.15.66:0/353044810 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5780032440 con 0x7f57900769c0 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f578effd640 1 -- 172.21.15.66:0/353044810 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5780032a00 con 0x7f57900769c0 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f578effd640 1 -- 172.21.15.66:0/353044810 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5780031a10 con 0x7f57900769c0 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 -- 172.21.15.66:0/353044810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 msgr2=0x7f5790107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 --2- 172.21.15.66:0/353044810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790107020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5780009840 tx=0x7f57800091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 -- 172.21.15.66:0/353044810 shutdown_connections 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 --2- 172.21.15.66:0/353044810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790107020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 -- 172.21.15.66:0/353044810 >> 172.21.15.66:0/353044810 conn(0x7f57900fc6d0 msgr2=0x7f57900feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 -- 172.21.15.66:0/353044810 shutdown_connections 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.948+0000 7f579698a640 1 -- 172.21.15.66:0/353044810 wait complete. 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f579698a640 1 Processor -- start 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f579698a640 1 -- start start 2024-09-12T01:34:40.789 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f579698a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f579698a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57901134c0 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f578ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f578ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47168/0 (socket says 172.21.15.66:47168) 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.949+0000 7f578ffff640 1 -- 172.21.15.66:0/1832407146 learned_addr learned my addr 172.21.15.66:0/1832407146 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f578ffff640 1 -- 172.21.15.66:0/1832407146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009450 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f578ffff640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790112f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5780006a70 tx=0x7f578002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5780031d10 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5780031e70 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57901136c0 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f578003b6f0 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.950+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5790113b30 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.951+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5780039070 con 0x7f57900769c0 2024-09-12T01:34:40.790 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.951+0000 7f578cff9640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5778039490 0x7f577803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.951+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f578006cdd0 con 0x7f57900769c0 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.951+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57901002f0 con 0x7f57900769c0 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.951+0000 7f578f7fe640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5778039490 0x7f577803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.952+0000 7f578f7fe640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5778039490 0x7f577803b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5784006fd0 tx=0x7f5784006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:39.956+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5780037030 con 0x7f57900769c0 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.131+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f57900fdb80 con 0x7f5778039490 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.137+0000 7f578cff9640 1 -- 172.21.15.66:0/1832407146 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f57900fdb80 con 0x7f5778039490 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5778039490 msgr2=0x7f577803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5778039490 0x7f577803b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5784006fd0 tx=0x7f5784006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 msgr2=0x7f5790112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790112f80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5780006a70 tx=0x7f578002c040 comp rx=0 tx=0).stop 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 shutdown_connections 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5778039490 0x7f577803b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:40.791 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 --2- 172.21.15.66:0/1832407146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57900769c0 0x7f5790112f80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:40.792 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.139+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 >> 172.21.15.66:0/1832407146 conn(0x7f57900fc6d0 msgr2=0x7f57900fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:40.792 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.140+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 shutdown_connections 2024-09-12T01:34:40.792 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:40.140+0000 7f579698a640 1 -- 172.21.15.66:0/1832407146 wait complete. 2024-09-12T01:34:40.792 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying mgr service with default placement... 2024-09-12T01:34:41.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:41 smithi066 ceph-mon[27875]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:41.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:41 smithi066 ceph-mon[27875]: Saving service mon spec with placement count:5 2024-09-12T01:34:41.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:41 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:42.510 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:42 smithi066 ceph-mon[27875]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:42.510 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:42 smithi066 ceph-mon[27875]: Saving service mgr spec with placement count:2 2024-09-12T01:34:42.510 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:42 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:42.510 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:42 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:42.784 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-12T01:34:42.784 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.216+0000 7f5a6215e640 1 Processor -- start 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.216+0000 7f5a6215e640 1 -- start start 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.216+0000 7f5a6215e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.216+0000 7f5a6215e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1017e0 con 0x7f5a5c100e90 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.217+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.217+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47184/0 (socket says 172.21.15.66:47184) 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.217+0000 7f5a5b7fe640 1 -- 172.21.15.66:0/1286649723 learned_addr learned my addr 172.21.15.66:0/1286649723 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.217+0000 7f5a5b7fe640 1 -- 172.21.15.66:0/1286649723 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c101920 con 0x7f5a5c100e90 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.218+0000 7f5a5b7fe640 1 --2- 172.21.15.66:0/1286649723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c1012a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009e50 tx=0x7f5a4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df4061ec7ad6b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.218+0000 7f5a5a7fc640 1 -- 172.21.15.66:0/1286649723 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a4c031560 con 0x7f5a5c100e90 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.218+0000 7f5a5a7fc640 1 -- 172.21.15.66:0/1286649723 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5a4c02d050 con 0x7f5a5c100e90 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.218+0000 7f5a5a7fc640 1 -- 172.21.15.66:0/1286649723 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a4c0079b0 con 0x7f5a5c100e90 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.218+0000 7f5a6215e640 1 -- 172.21.15.66:0/1286649723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 msgr2=0x7f5a5c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:42.785 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.218+0000 7f5a6215e640 1 --2- 172.21.15.66:0/1286649723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c1012a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009e50 tx=0x7f5a4c009840 comp rx=0 tx=0).stop 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 -- 172.21.15.66:0/1286649723 shutdown_connections 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 --2- 172.21.15.66:0/1286649723 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c1012a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 -- 172.21.15.66:0/1286649723 >> 172.21.15.66:0/1286649723 conn(0x7f5a5c0fc6d0 msgr2=0x7f5a5c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 -- 172.21.15.66:0/1286649723 shutdown_connections 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 -- 172.21.15.66:0/1286649723 wait complete. 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 Processor -- start 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 -- start start 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.219+0000 7f5a6215e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a6215e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c110180 con 0x7f5a5c100e90 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a5b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47194/0 (socket says 172.21.15.66:47194) 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a5b7fe640 1 -- 172.21.15.66:0/4221809664 learned_addr learned my addr 172.21.15.66:0/4221809664 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a5b7fe640 1 -- 172.21.15.66:0/4221809664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c009ae0 con 0x7f5a5c100e90 2024-09-12T01:34:42.786 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a5b7fe640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c10fc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c007030 tx=0x7f5a4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a4c045430 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f5a4c0459f0 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c110380 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a4c03a8f0 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.220+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c1107f0 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.221+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5a4c038040 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.221+0000 7f5a53fff640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5a480394e0 0x7f5a4803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.221+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c1107f0 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.221+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5a4c040030 con 0x7f5a5c100e90 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.221+0000 7f5a5affd640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5a480394e0 0x7f5a4803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.222+0000 7f5a5affd640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5a480394e0 0x7f5a4803b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a44006fd0 tx=0x7f5a44006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:42.787 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.226+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5a5c1107f0 con 0x7f5a5c100e90 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.402+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a5c1107f0 con 0x7f5a480394e0 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.409+0000 7f5a53fff640 1 -- 172.21.15.66:0/4221809664 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5a5c1107f0 con 0x7f5a480394e0 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5a480394e0 msgr2=0x7f5a4803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5a480394e0 0x7f5a4803b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a44006fd0 tx=0x7f5a44006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 msgr2=0x7f5a5c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c10fc40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c007030 tx=0x7f5a4c009840 comp rx=0 tx=0).stop 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 shutdown_connections 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5a480394e0 0x7f5a4803b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 --2- 172.21.15.66:0/4221809664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a5c100e90 0x7f5a5c10fc40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 >> 172.21.15.66:0/4221809664 conn(0x7f5a5c0fc6d0 msgr2=0x7f5a5c0fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 shutdown_connections 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:41.411+0000 7f5a6215e640 1 -- 172.21.15.66:0/4221809664 wait complete. 2024-09-12T01:34:42.788 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying crash service with default placement... 2024-09-12T01:34:44.127 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:43 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:44.127 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:43 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0f00369640 1 Processor -- start 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0f00369640 1 -- start start 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0f00369640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef81023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0f00369640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef81028e0 con 0x7f0ef8101f90 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0efe105640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef81023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0efe105640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef81023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33662/0 (socket says 172.21.15.66:33662) 2024-09-12T01:34:44.134 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0efe105640 1 -- 172.21.15.66:0/3910704448 learned_addr learned my addr 172.21.15.66:0/3910704448 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.190+0000 7f0efe105640 1 -- 172.21.15.66:0/3910704448 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8102a20 con 0x7f0ef8101f90 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.191+0000 7f0efe105640 1 --2- 172.21.15.66:0/3910704448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef81023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009840 tx=0x7f0ef40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912951721aa6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.191+0000 7f0efd103640 1 -- 172.21.15.66:0/3910704448 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef4032440 con 0x7f0ef8101f90 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.191+0000 7f0efd103640 1 -- 172.21.15.66:0/3910704448 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ef4032a40 con 0x7f0ef8101f90 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.191+0000 7f0efd103640 1 -- 172.21.15.66:0/3910704448 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef4031a70 con 0x7f0ef8101f90 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 -- 172.21.15.66:0/3910704448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 msgr2=0x7f0ef81023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 --2- 172.21.15.66:0/3910704448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef81023a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009840 tx=0x7f0ef40091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 -- 172.21.15.66:0/3910704448 shutdown_connections 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 --2- 172.21.15.66:0/3910704448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef81023a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 -- 172.21.15.66:0/3910704448 >> 172.21.15.66:0/3910704448 conn(0x7f0ef80fd710 msgr2=0x7f0ef80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 -- 172.21.15.66:0/3910704448 shutdown_connections 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 -- 172.21.15.66:0/3910704448 wait complete. 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 Processor -- start 2024-09-12T01:34:44.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.192+0000 7f0f00369640 1 -- start start 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0f00369640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef8110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0f00369640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8111260 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0efe105640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef8110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0efe105640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef8110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33666/0 (socket says 172.21.15.66:33666) 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0efe105640 1 -- 172.21.15.66:0/849860193 learned_addr learned my addr 172.21.15.66:0/849860193 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0efe105640 1 -- 172.21.15.66:0/849860193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009450 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0efe105640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef8110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009810 tx=0x7f0ef40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef403c400 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef8111460 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ef403ca00 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0ef403a870 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.193+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef81118d0 con 0x7f0ef8101f90 2024-09-12T01:34:44.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.194+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0ef403cb70 con 0x7f0ef8101f90 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.194+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef804b720 con 0x7f0ef8101f90 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.194+0000 7f0eeaffd640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0ee4039490 0x7f0ee403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.195+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0ef406cd00 con 0x7f0ef8101f90 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.195+0000 7f0efd904640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0ee4039490 0x7f0ee403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.195+0000 7f0efd904640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0ee4039490 0x7f0ee403b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00ad90 tx=0x7f0eec009410 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.199+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0ef403ce20 con 0x7f0ef8101f90 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.379+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ef81118d0 con 0x7f0ee4039490 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.385+0000 7f0eeaffd640 1 -- 172.21.15.66:0/849860193 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f0ef81118d0 con 0x7f0ee4039490 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0ee4039490 msgr2=0x7f0ee403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0ee4039490 0x7f0ee403b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00ad90 tx=0x7f0eec009410 comp rx=0 tx=0).stop 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 msgr2=0x7f0ef8110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef8110d20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009810 tx=0x7f0ef40091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:44.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 shutdown_connections 2024-09-12T01:34:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0ee4039490 0x7f0ee403b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 --2- 172.21.15.66:0/849860193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ef8101f90 0x7f0ef8110d20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 >> 172.21.15.66:0/849860193 conn(0x7f0ef80fd710 msgr2=0x7f0ef80fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 shutdown_connections 2024-09-12T01:34:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:43.387+0000 7f0f00369640 1 -- 172.21.15.66:0/849860193 wait complete. 2024-09-12T01:34:44.138 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying prometheus service with default placement... 2024-09-12T01:34:45.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:44 smithi066 ceph-mon[27875]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:45.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:44 smithi066 ceph-mon[27875]: Saving service crash spec with placement * 2024-09-12T01:34:45.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:44 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.583+0000 7f9f444e4640 1 Processor -- start 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.583+0000 7f9f444e4640 1 -- start start 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.583+0000 7f9f444e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c1012e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.583+0000 7f9f444e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c101820 con 0x7f9f3c100ed0 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.583+0000 7f9f42280640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c1012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.584+0000 7f9f42280640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c1012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33672/0 (socket says 172.21.15.66:33672) 2024-09-12T01:34:45.635 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.584+0000 7f9f42280640 1 -- 172.21.15.66:0/3023480364 learned_addr learned my addr 172.21.15.66:0/3023480364 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.584+0000 7f9f42280640 1 -- 172.21.15.66:0/3023480364 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c101960 con 0x7f9f3c100ed0 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.584+0000 7f9f42280640 1 --2- 172.21.15.66:0/3023480364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c1012e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009840 tx=0x7f9f2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d75ad029b8ea6de server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f4127e640 1 -- 172.21.15.66:0/3023480364 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c032440 con 0x7f9f3c100ed0 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f4127e640 1 -- 172.21.15.66:0/3023480364 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f2c032a40 con 0x7f9f3c100ed0 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f4127e640 1 -- 172.21.15.66:0/3023480364 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c031a70 con 0x7f9f3c100ed0 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 -- 172.21.15.66:0/3023480364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 msgr2=0x7f9f3c1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 --2- 172.21.15.66:0/3023480364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c1012e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009840 tx=0x7f9f2c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 -- 172.21.15.66:0/3023480364 shutdown_connections 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 --2- 172.21.15.66:0/3023480364 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c1012e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 -- 172.21.15.66:0/3023480364 >> 172.21.15.66:0/3023480364 conn(0x7f9f3c0fc6d0 msgr2=0x7f9f3c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 -- 172.21.15.66:0/3023480364 shutdown_connections 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.585+0000 7f9f444e4640 1 -- 172.21.15.66:0/3023480364 wait complete. 2024-09-12T01:34:45.636 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f444e4640 1 Processor -- start 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f444e4640 1 -- start start 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f444e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f444e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c111870 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f42280640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f42280640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33682/0 (socket says 172.21.15.66:33682) 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f42280640 1 -- 172.21.15.66:0/3513459166 learned_addr learned my addr 172.21.15.66:0/3513459166 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.586+0000 7f9f42280640 1 -- 172.21.15.66:0/3513459166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c009450 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.587+0000 7f9f42280640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c076ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c006a70 tx=0x7f9f2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.587+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c03c400 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.587+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f2c03ca00 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.587+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c115e80 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.587+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f2c03a9a0 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.587+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c1161b0 con 0x7f9f3c100ed0 2024-09-12T01:34:45.637 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.588+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9f2c03abd0 con 0x7f9f3c100ed0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.588+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c04b720 con 0x7f9f3c100ed0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.588+0000 7f9f32ffd640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9f280394e0 0x7f9f2803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.588+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9f2c06cdf0 con 0x7f9f3c100ed0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.588+0000 7f9f41a7f640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9f280394e0 0x7f9f2803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.588+0000 7f9f41a7f640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9f280394e0 0x7f9f2803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9f38006fd0 tx=0x7f9f38006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.592+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9f2c03b940 con 0x7f9f3c100ed0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.768+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f3c0fda80 con 0x7f9f280394e0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.772+0000 7f9f32ffd640 1 -- 172.21.15.66:0/3513459166 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9f3c0fda80 con 0x7f9f280394e0 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9f280394e0 msgr2=0x7f9f2803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9f280394e0 0x7f9f2803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9f38006fd0 tx=0x7f9f38006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 msgr2=0x7f9f3c076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c076ae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c006a70 tx=0x7f9f2c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 shutdown_connections 2024-09-12T01:34:45.638 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f9f280394e0 0x7f9f2803b990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:45.639 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 --2- 172.21.15.66:0/3513459166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f3c100ed0 0x7f9f3c076ae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:45.639 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 >> 172.21.15.66:0/3513459166 conn(0x7f9f3c0fc6d0 msgr2=0x7f9f3c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:45.639 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 shutdown_connections 2024-09-12T01:34:45.639 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:44.774+0000 7f9f444e4640 1 -- 172.21.15.66:0/3513459166 wait complete. 2024-09-12T01:34:45.639 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying grafana service with default placement... 2024-09-12T01:34:46.075 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:45 smithi066 ceph-mon[27875]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:46.076 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:45 smithi066 ceph-mon[27875]: Saving service prometheus spec with placement count:1 2024-09-12T01:34:46.076 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:45 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:46.849 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.075+0000 7faf9ac80640 1 Processor -- start 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.075+0000 7faf9ac80640 1 -- start start 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.075+0000 7faf9ac80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94104b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.075+0000 7faf9ac80640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf941050b0 con 0x7faf94076c40 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.075+0000 7faf98a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94104b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.076+0000 7faf98a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94104b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33694/0 (socket says 172.21.15.66:33694) 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.076+0000 7faf98a1c640 1 -- 172.21.15.66:0/1586175940 learned_addr learned my addr 172.21.15.66:0/1586175940 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.076+0000 7faf98a1c640 1 -- 172.21.15.66:0/1586175940 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf941051f0 con 0x7faf94076c40 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf98a1c640 1 --2- 172.21.15.66:0/1586175940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94104b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faf88009840 tx=0x7faf880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb60ae06a31cd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf937fe640 1 -- 172.21.15.66:0/1586175940 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf88032440 con 0x7faf94076c40 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf937fe640 1 -- 172.21.15.66:0/1586175940 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf88032a40 con 0x7faf94076c40 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf937fe640 1 -- 172.21.15.66:0/1586175940 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf88031a70 con 0x7faf94076c40 2024-09-12T01:34:46.850 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf9ac80640 1 -- 172.21.15.66:0/1586175940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 msgr2=0x7faf94104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf9ac80640 1 --2- 172.21.15.66:0/1586175940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94104b70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faf88009840 tx=0x7faf880091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.077+0000 7faf9ac80640 1 -- 172.21.15.66:0/1586175940 shutdown_connections 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.078+0000 7faf9ac80640 1 --2- 172.21.15.66:0/1586175940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94104b70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.078+0000 7faf9ac80640 1 -- 172.21.15.66:0/1586175940 >> 172.21.15.66:0/1586175940 conn(0x7faf940fc620 msgr2=0x7faf940fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.078+0000 7faf9ac80640 1 -- 172.21.15.66:0/1586175940 shutdown_connections 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.078+0000 7faf9ac80640 1 -- 172.21.15.66:0/1586175940 wait complete. 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.078+0000 7faf9ac80640 1 Processor -- start 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.078+0000 7faf9ac80640 1 -- start start 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf9ac80640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf9ac80640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf94111370 con 0x7faf94076c40 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf98a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf98a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33706/0 (socket says 172.21.15.66:33706) 2024-09-12T01:34:46.851 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf98a1c640 1 -- 172.21.15.66:0/4058853941 learned_addr learned my addr 172.21.15.66:0/4058853941 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf98a1c640 1 -- 172.21.15.66:0/4058853941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf88009450 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf98a1c640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94110e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf88009420 tx=0x7faf880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf8803c400 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf8803ca00 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf94111570 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faf8803a920 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.079+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf94112050 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.081+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7faf8803ab90 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.081+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf941002a0 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.081+0000 7faf917fa640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7faf84039490 0x7faf8403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.081+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faf8806cfd0 con 0x7faf94076c40 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.081+0000 7faf93fff640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7faf84039490 0x7faf8403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.081+0000 7faf93fff640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7faf84039490 0x7faf8403b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faf80006fd0 tx=0x7faf80006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:46.852 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.086+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faf880453c0 con 0x7faf94076c40 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.259+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7faf940fd9c0 con 0x7faf84039490 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.266+0000 7faf917fa640 1 -- 172.21.15.66:0/4058853941 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7faf940fd9c0 con 0x7faf84039490 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7faf84039490 msgr2=0x7faf8403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7faf84039490 0x7faf8403b940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faf80006fd0 tx=0x7faf80006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 msgr2=0x7faf94110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94110e30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf88009420 tx=0x7faf880091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 shutdown_connections 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7faf84039490 0x7faf8403b940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 --2- 172.21.15.66:0/4058853941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf94076c40 0x7faf94110e30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 >> 172.21.15.66:0/4058853941 conn(0x7faf940fc620 msgr2=0x7faf940fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 shutdown_connections 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:46.268+0000 7faf9ac80640 1 -- 172.21.15.66:0/4058853941 wait complete. 2024-09-12T01:34:46.853 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying node-exporter service with default placement... 2024-09-12T01:34:47.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:47 smithi066 ceph-mon[27875]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:47 smithi066 ceph-mon[27875]: Saving service grafana spec with placement count:1 2024-09-12T01:34:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:47 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:47 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.300+0000 7f14bcd2f640 1 Processor -- start 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14bcd2f640 1 -- start start 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14bcd2f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8101910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14bcd2f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8101e50 con 0x7f14b8101500 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14b659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8101910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:48.086 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14b659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8101910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33722/0 (socket says 172.21.15.66:33722) 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14b659c640 1 -- 172.21.15.66:0/2852953674 learned_addr learned my addr 172.21.15.66:0/2852953674 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.301+0000 7f14b659c640 1 -- 172.21.15.66:0/2852953674 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b8101f90 con 0x7f14b8101500 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.302+0000 7f14b659c640 1 --2- 172.21.15.66:0/2852953674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8101910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009840 tx=0x7f14a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b676da0f0ff37db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.302+0000 7f14b559a640 1 -- 172.21.15.66:0/2852953674 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14a8032440 con 0x7f14b8101500 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.302+0000 7f14b559a640 1 -- 172.21.15.66:0/2852953674 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14a8032a40 con 0x7f14b8101500 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.302+0000 7f14b559a640 1 -- 172.21.15.66:0/2852953674 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14a8031a70 con 0x7f14b8101500 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 -- 172.21.15.66:0/2852953674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 msgr2=0x7f14b8101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 --2- 172.21.15.66:0/2852953674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8101910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009840 tx=0x7f14a80091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 -- 172.21.15.66:0/2852953674 shutdown_connections 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 --2- 172.21.15.66:0/2852953674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8101910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 -- 172.21.15.66:0/2852953674 >> 172.21.15.66:0/2852953674 conn(0x7f14b80fbdd0 msgr2=0x7f14b80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:48.087 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 -- 172.21.15.66:0/2852953674 shutdown_connections 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.303+0000 7f14bcd2f640 1 -- 172.21.15.66:0/2852953674 wait complete. 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14bcd2f640 1 Processor -- start 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14bcd2f640 1 -- start start 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14bcd2f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8110fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14bcd2f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b8111510 con 0x7f14b8101500 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14b659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8110fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14b659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8110fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33728/0 (socket says 172.21.15.66:33728) 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14b659c640 1 -- 172.21.15.66:0/3781797175 learned_addr learned my addr 172.21.15.66:0/3781797175 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14b659c640 1 -- 172.21.15.66:0/3781797175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009450 con 0x7f14b8101500 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14b659c640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8110fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14a8031750 tx=0x7f14a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.304+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14a803c400 con 0x7f14b8101500 2024-09-12T01:34:48.088 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.305+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f14a803ca00 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.305+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8111710 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.305+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f14a803a880 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.305+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b8111b20 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.305+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f14a803c560 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.306+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b804b720 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.306+0000 7f14aeffd640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f14a4039490 0x7f14a403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.306+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f14a806cfd0 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.306+0000 7f14b5d9b640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f14a4039490 0x7f14a403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.306+0000 7f14b5d9b640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f14a4039490 0x7f14a403b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006fd0 tx=0x7f14a0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.310+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f14a8046460 con 0x7f14b8101500 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.489+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f14b80fd190 con 0x7f14a4039490 2024-09-12T01:34:48.089 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.496+0000 7f14aeffd640 1 -- 172.21.15.66:0/3781797175 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f14b80fd190 con 0x7f14a4039490 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f14a4039490 msgr2=0x7f14a403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f14a4039490 0x7f14a403b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006fd0 tx=0x7f14a0006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 msgr2=0x7f14b8110fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8110fd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f14a8031750 tx=0x7f14a80091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 shutdown_connections 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f14a4039490 0x7f14a403b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 --2- 172.21.15.66:0/3781797175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14b8101500 0x7f14b8110fd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 >> 172.21.15.66:0/3781797175 conn(0x7f14b80fbdd0 msgr2=0x7f14b80fc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 shutdown_connections 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:47.498+0000 7f14bcd2f640 1 -- 172.21.15.66:0/3781797175 wait complete. 2024-09-12T01:34:48.090 INFO:teuthology.orchestra.run.smithi066.stdout:Deploying alertmanager service with default placement... 2024-09-12T01:34:48.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:48 smithi066 ceph-mon[27875]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:48.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:48 smithi066 ceph-mon[27875]: Saving service node-exporter spec with placement * 2024-09-12T01:34:48.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:48 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:49.972 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:49 smithi066 ceph-mon[27875]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:34:49.972 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:49 smithi066 ceph-mon[27875]: from='mgr.14118 172.21.15.66:0/3172008972' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:34:49.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-12T01:34:49.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.062+0000 7f5c2b6ac640 1 Processor -- start 2024-09-12T01:34:49.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c2b6ac640 1 -- start start 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c2b6ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c24100a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c2b6ac640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c24100f60 con 0x7f5c24100610 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c29448640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c24100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c29448640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c24100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33740/0 (socket says 172.21.15.66:33740) 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c29448640 1 -- 172.21.15.66:0/1559000121 learned_addr learned my addr 172.21.15.66:0/1559000121 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.063+0000 7f5c29448640 1 -- 172.21.15.66:0/1559000121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c241010a0 con 0x7f5c24100610 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.064+0000 7f5c29448640 1 --2- 172.21.15.66:0/1559000121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c24100a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400af60 tx=0x7f5c1400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa112f93f459600 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.064+0000 7f5c23fff640 1 -- 172.21.15.66:0/1559000121 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c14008510 con 0x7f5c24100610 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.064+0000 7f5c23fff640 1 -- 172.21.15.66:0/1559000121 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c14008b10 con 0x7f5c24100610 2024-09-12T01:34:49.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.064+0000 7f5c23fff640 1 -- 172.21.15.66:0/1559000121 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c14033c10 con 0x7f5c24100610 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/1559000121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 msgr2=0x7f5c24100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 --2- 172.21.15.66:0/1559000121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c24100a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400af60 tx=0x7f5c1400a950 comp rx=0 tx=0).stop 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/1559000121 shutdown_connections 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 --2- 172.21.15.66:0/1559000121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c24100a20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/1559000121 >> 172.21.15.66:0/1559000121 conn(0x7f5c240fbdd0 msgr2=0x7f5c240fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/1559000121 shutdown_connections 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.065+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/1559000121 wait complete. 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c2b6ac640 1 Processor -- start 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c2b6ac640 1 -- start start 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c2b6ac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c241045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:49.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c2b6ac640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c24104af0 con 0x7f5c24100610 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c29448640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c241045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c29448640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c241045b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33756/0 (socket says 172.21.15.66:33756) 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c29448640 1 -- 172.21.15.66:0/899027372 learned_addr learned my addr 172.21.15.66:0/899027372 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.066+0000 7f5c29448640 1 -- 172.21.15.66:0/899027372 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1400abf0 con 0x7f5c24100610 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.067+0000 7f5c29448640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c241045b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007030 tx=0x7f5c1400a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.067+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c14008880 con 0x7f5c24100610 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.067+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5c1403e8c0 con 0x7f5c24100610 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.067+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c24102b80 con 0x7f5c24100610 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.067+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c1403c6f0 con 0x7f5c24100610 2024-09-12T01:34:49.983 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.067+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c24103050 con 0x7f5c24100610 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.068+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f5c1403a040 con 0x7f5c24100610 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.068+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2404b720 con 0x7f5c24100610 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.068+0000 7f5c21ffb640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5c0c0394e0 0x7f5c0c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.068+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5c1406d4b0 con 0x7f5c24100610 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.068+0000 7f5c28c47640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5c0c0394e0 0x7f5c0c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.069+0000 7f5c28c47640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5c0c0394e0 0x7f5c0c03b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c18006fd0 tx=0x7f5c18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.073+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5c1403ea30 con 0x7f5c24100610 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.247+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c2410a590 con 0x7f5c0c0394e0 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.251+0000 7f5c21ffb640 1 -- 172.21.15.66:0/899027372 <== mgr.14118 v2:172.21.15.66:6800/3928441794 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f5c2410a590 con 0x7f5c0c0394e0 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5c0c0394e0 msgr2=0x7f5c0c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:49.984 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5c0c0394e0 0x7f5c0c03b990 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c18006fd0 tx=0x7f5c18006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 msgr2=0x7f5c241045b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c241045b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007030 tx=0x7f5c1400a950 comp rx=0 tx=0).stop 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 shutdown_connections 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f5c0c0394e0 0x7f5c0c03b990 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 --2- 172.21.15.66:0/899027372 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c24100610 0x7f5c241045b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 >> 172.21.15.66:0/899027372 conn(0x7f5c240fbdd0 msgr2=0x7f5c24105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 shutdown_connections 2024-09-12T01:34:49.985 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:49.254+0000 7f5c2b6ac640 1 -- 172.21.15.66:0/899027372 wait complete. 2024-09-12T01:34:50.888 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:50 smithi066 ceph-mon[27875]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:34:50.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:50 smithi066 ceph-mon[27875]: Saving service alertmanager spec with placement count:1 2024-09-12T01:34:50.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:50 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1236900335' entity='client.admin' 2024-09-12T01:34:51.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.437+0000 7f90ace0e640 1 Processor -- start 2024-09-12T01:34:51.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.437+0000 7f90ace0e640 1 -- start start 2024-09-12T01:34:51.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.438+0000 7f90ace0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:51.135 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.438+0000 7f90ace0e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8076f20 con 0x7f90a8076b10 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.438+0000 7f90a659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.438+0000 7f90a659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33766/0 (socket says 172.21.15.66:33766) 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.438+0000 7f90a659c640 1 -- 172.21.15.66:0/2361234637 learned_addr learned my addr 172.21.15.66:0/2361234637 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.438+0000 7f90a659c640 1 -- 172.21.15.66:0/2361234637 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8105120 con 0x7f90a8076b10 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.439+0000 7f90a659c640 1 --2- 172.21.15.66:0/2361234637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8104be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009840 tx=0x7f90a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908c91fe37598d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.439+0000 7f90a559a640 1 -- 172.21.15.66:0/2361234637 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a0032440 con 0x7f90a8076b10 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.439+0000 7f90a559a640 1 -- 172.21.15.66:0/2361234637 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90a0032a40 con 0x7f90a8076b10 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.439+0000 7f90a559a640 1 -- 172.21.15.66:0/2361234637 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a0031aa0 con 0x7f90a8076b10 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 -- 172.21.15.66:0/2361234637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 msgr2=0x7f90a8104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 --2- 172.21.15.66:0/2361234637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8104be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009840 tx=0x7f90a00091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 -- 172.21.15.66:0/2361234637 shutdown_connections 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 --2- 172.21.15.66:0/2361234637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8104be0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:51.136 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 -- 172.21.15.66:0/2361234637 >> 172.21.15.66:0/2361234637 conn(0x7f90a80fc6d0 msgr2=0x7f90a80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 -- 172.21.15.66:0/2361234637 shutdown_connections 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.440+0000 7f90ace0e640 1 -- 172.21.15.66:0/2361234637 wait complete. 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90ace0e640 1 Processor -- start 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90ace0e640 1 -- start start 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90ace0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8110e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90ace0e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8111360 con 0x7f90a8076b10 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90a659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8110e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90a659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8110e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33774/0 (socket says 172.21.15.66:33774) 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90a659c640 1 -- 172.21.15.66:0/1236900335 learned_addr learned my addr 172.21.15.66:0/1236900335 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90a659c640 1 -- 172.21.15.66:0/1236900335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009450 con 0x7f90a8076b10 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.441+0000 7f90a659c640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8110e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90a0006a70 tx=0x7f90a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.442+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a0031d20 con 0x7f90a8076b10 2024-09-12T01:34:51.137 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.442+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90a0031e80 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.442+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a8111560 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.442+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f90a003a750 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.442+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a8111fb0 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.443+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f90a0039040 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.443+0000 7f909effd640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90940394e0 0x7f909403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.443+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a81002f0 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.443+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f90a006cae0 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.443+0000 7f90a5d9b640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90940394e0 0x7f909403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.444+0000 7f90a5d9b640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90940394e0 0x7f909403b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9090006fd0 tx=0x7f9090006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.448+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f90a004b6c0 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.614+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f90a804b720 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.618+0000 7f909effd640 1 -- 172.21.15.66:0/1236900335 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f90a003f070 con 0x7f90a8076b10 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90940394e0 msgr2=0x7f909403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:51.138 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90940394e0 0x7f909403b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9090006fd0 tx=0x7f9090006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 msgr2=0x7f90a8110e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8110e20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90a0006a70 tx=0x7f90a00091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 shutdown_connections 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f90940394e0 0x7f909403b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 --2- 172.21.15.66:0/1236900335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90a8076b10 0x7f90a8110e20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 >> 172.21.15.66:0/1236900335 conn(0x7f90a80fc6d0 msgr2=0x7f90a80fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 shutdown_connections 2024-09-12T01:34:51.139 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:50.620+0000 7f90ace0e640 1 -- 172.21.15.66:0/1236900335 wait complete. 2024-09-12T01:34:52.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:51 smithi066 ceph-mon[27875]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:34:52.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:51 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3487918818' entity='client.admin' 2024-09-12T01:34:52.175 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.506+0000 7fbfeeb23640 1 Processor -- start 2024-09-12T01:34:52.175 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.506+0000 7fbfeeb23640 1 -- start start 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.507+0000 7fbfeeb23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.507+0000 7fbfeeb23640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81028d0 con 0x7fbfe8101f80 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.507+0000 7fbfec8bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.507+0000 7fbfec8bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33784/0 (socket says 172.21.15.66:33784) 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.507+0000 7fbfec8bf640 1 -- 172.21.15.66:0/4132943591 learned_addr learned my addr 172.21.15.66:0/4132943591 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.507+0000 7fbfec8bf640 1 -- 172.21.15.66:0/4132943591 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe8102a10 con 0x7fbfe8101f80 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfec8bf640 1 --2- 172.21.15.66:0/4132943591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8102390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009840 tx=0x7fbfdc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f11e940e58a73c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfe77fe640 1 -- 172.21.15.66:0/4132943591 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfdc032440 con 0x7fbfe8101f80 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfe77fe640 1 -- 172.21.15.66:0/4132943591 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfdc032a40 con 0x7fbfe8101f80 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfe77fe640 1 -- 172.21.15.66:0/4132943591 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfdc031a70 con 0x7fbfe8101f80 2024-09-12T01:34:52.176 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfeeb23640 1 -- 172.21.15.66:0/4132943591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 msgr2=0x7fbfe8102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:52.177 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfeeb23640 1 --2- 172.21.15.66:0/4132943591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8102390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009840 tx=0x7fbfdc0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:52.177 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfeeb23640 1 -- 172.21.15.66:0/4132943591 shutdown_connections 2024-09-12T01:34:52.177 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfeeb23640 1 --2- 172.21.15.66:0/4132943591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8102390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:52.177 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.508+0000 7fbfeeb23640 1 -- 172.21.15.66:0/4132943591 >> 172.21.15.66:0/4132943591 conn(0x7fbfe80fd7a0 msgr2=0x7fbfe80ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:52.177 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfeeb23640 1 -- 172.21.15.66:0/4132943591 shutdown_connections 2024-09-12T01:34:52.177 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfeeb23640 1 -- 172.21.15.66:0/4132943591 wait complete. 2024-09-12T01:34:52.178 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfeeb23640 1 Processor -- start 2024-09-12T01:34:52.178 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfeeb23640 1 -- start start 2024-09-12T01:34:52.178 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfeeb23640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8110e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:52.178 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfeeb23640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe81113b0 con 0x7fbfe8101f80 2024-09-12T01:34:52.178 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.509+0000 7fbfec8bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8110e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:52.178 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfec8bf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8110e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33800/0 (socket says 172.21.15.66:33800) 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfec8bf640 1 -- 172.21.15.66:0/3487918818 learned_addr learned my addr 172.21.15.66:0/3487918818 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfec8bf640 1 -- 172.21.15.66:0/3487918818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009450 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfec8bf640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8110e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009420 tx=0x7fbfdc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfdc03c400 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe81115b0 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfdc03ca00 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfdc03a850 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.510+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe8112090 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.511+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fbfdc03aad0 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.511+0000 7fbfe57fa640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fbfd8039490 0x7fbfd803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.511+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fbfdc06cea0 con 0x7fbfe8101f80 2024-09-12T01:34:52.179 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.511+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe81013e0 con 0x7fbfe8101f80 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.511+0000 7fbfe7fff640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fbfd8039490 0x7fbfd803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.512+0000 7fbfe7fff640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fbfd8039490 0x7fbfd803b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4006fd0 tx=0x7fbfd4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.516+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbfdc037070 con 0x7fbfe8101f80 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.679+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fbfe804b720 con 0x7fbfe8101f80 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.682+0000 7fbfe57fa640 1 -- 172.21.15.66:0/3487918818 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fbfdc030570 con 0x7fbfe8101f80 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.684+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fbfd8039490 msgr2=0x7fbfd803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.684+0000 7fbfeeb23640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fbfd8039490 0x7fbfd803b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4006fd0 tx=0x7fbfd4006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.684+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 msgr2=0x7fbfe8110e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.684+0000 7fbfeeb23640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8110e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc009420 tx=0x7fbfdc0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.685+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 shutdown_connections 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.685+0000 7fbfeeb23640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7fbfd8039490 0x7fbfd803b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:52.180 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.685+0000 7fbfeeb23640 1 --2- 172.21.15.66:0/3487918818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfe8101f80 0x7fbfe8110e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:52.181 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.685+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 >> 172.21.15.66:0/3487918818 conn(0x7fbfe80fd7a0 msgr2=0x7fbfe80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:52.181 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.685+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 shutdown_connections 2024-09-12T01:34:52.181 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:51.685+0000 7fbfeeb23640 1 -- 172.21.15.66:0/3487918818 wait complete. 2024-09-12T01:34:52.181 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling the dashboard module... 2024-09-12T01:34:53.965 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:53 smithi066 ceph-mon[27875]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:34:53.965 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:53 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/4025371681' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f5777963640 1 Processor -- start 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f5777963640 1 -- start start 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f5777963640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770077230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f5777963640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770079070 con 0x7f5770078c60 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f57756ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770077230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f57756ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770077230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45662/0 (socket says 172.21.15.66:45662) 2024-09-12T01:34:54.382 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.557+0000 7f57756ff640 1 -- 172.21.15.66:0/1785596134 learned_addr learned my addr 172.21.15.66:0/1785596134 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.558+0000 7f57756ff640 1 -- 172.21.15.66:0/1785596134 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770077770 con 0x7f5770078c60 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.558+0000 7f57756ff640 1 --2- 172.21.15.66:0/1785596134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770077230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f576c009840 tx=0x7f576c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f03ab451fb41de41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5767fff640 1 -- 172.21.15.66:0/1785596134 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f576c032440 con 0x7f5770078c60 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5767fff640 1 -- 172.21.15.66:0/1785596134 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f576c032a40 con 0x7f5770078c60 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5767fff640 1 -- 172.21.15.66:0/1785596134 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f576c031a70 con 0x7f5770078c60 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 -- 172.21.15.66:0/1785596134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 msgr2=0x7f5770077230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 --2- 172.21.15.66:0/1785596134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770077230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f576c009840 tx=0x7f576c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 -- 172.21.15.66:0/1785596134 shutdown_connections 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 --2- 172.21.15.66:0/1785596134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770077230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 -- 172.21.15.66:0/1785596134 >> 172.21.15.66:0/1785596134 conn(0x7f57700fd6e0 msgr2=0x7f57700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 -- 172.21.15.66:0/1785596134 shutdown_connections 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.559+0000 7f5777963640 1 -- 172.21.15.66:0/1785596134 wait complete. 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f5777963640 1 Processor -- start 2024-09-12T01:34:54.383 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f5777963640 1 -- start start 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f5777963640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770112f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f5777963640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770113450 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f57756ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770112f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f57756ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770112f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45666/0 (socket says 172.21.15.66:45666) 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.560+0000 7f57756ff640 1 -- 172.21.15.66:0/4025371681 learned_addr learned my addr 172.21.15.66:0/4025371681 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f57756ff640 1 -- 172.21.15.66:0/4025371681 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c009450 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f57756ff640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770112f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f576c009420 tx=0x7f576c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f576c03c400 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f576c03ca00 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5770113650 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f576c03a920 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.561+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5770113ac0 con 0x7f5770078c60 2024-09-12T01:34:54.384 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.562+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f576c03ab90 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.562+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577004b720 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.563+0000 7f5765ffb640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f575c039490 0x7f575c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.563+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f576c06ccb0 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.563+0000 7f5774efe640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f575c039490 0x7f575c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.563+0000 7f5774efe640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f575c039490 0x7f575c03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5760006fd0 tx=0x7f5760006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.567+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f576c03cb70 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:52.774+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f57701080f0 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.690+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f576c00a040 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.691+0000 7f5765ffb640 1 -- 172.21.15.66:0/4025371681 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f576c02fb20 con 0x7f5770078c60 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f575c039490 msgr2=0x7f575c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f575c039490 0x7f575c03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5760006fd0 tx=0x7f5760006db0 comp rx=0 tx=0).stop 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 msgr2=0x7f5770112f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:54.385 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770112f10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f576c009420 tx=0x7f576c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:54.386 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 shutdown_connections 2024-09-12T01:34:54.386 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f575c039490 0x7f575c03b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:54.386 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 --2- 172.21.15.66:0/4025371681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5770078c60 0x7f5770112f10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:54.386 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 >> 172.21.15.66:0/4025371681 conn(0x7f57700fd6e0 msgr2=0x7f57700fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:54.386 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 shutdown_connections 2024-09-12T01:34:54.386 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:53.695+0000 7f5777963640 1 -- 172.21.15.66:0/4025371681 wait complete. 2024-09-12T01:34:54.758 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:54 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/4025371681' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-12T01:34:54.758 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:54 smithi066 ceph-mon[27875]: mgrmap e9: smithi066.qdwcrh(active, since 25s) 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "active_name": "smithi066.qdwcrh", 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.763+0000 7f39860fa640 1 Processor -- start 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.763+0000 7f39860fa640 1 -- start start 2024-09-12T01:34:55.564 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.763+0000 7f39860fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980107000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.763+0000 7f39860fa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3980076df0 con 0x7f39800769e0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.764+0000 7f397f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980107000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.764+0000 7f397f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980107000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45690/0 (socket says 172.21.15.66:45690) 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.764+0000 7f397f7fe640 1 -- 172.21.15.66:0/2471672760 learned_addr learned my addr 172.21.15.66:0/2471672760 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.764+0000 7f397f7fe640 1 -- 172.21.15.66:0/2471672760 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980107540 con 0x7f39800769e0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.765+0000 7f397f7fe640 1 --2- 172.21.15.66:0/2471672760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980107000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3970009840 tx=0x7f39700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b169fe4e05c82fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.765+0000 7f397e7fc640 1 -- 172.21.15.66:0/2471672760 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3970032440 con 0x7f39800769e0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.765+0000 7f397e7fc640 1 -- 172.21.15.66:0/2471672760 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3970032a40 con 0x7f39800769e0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.765+0000 7f397e7fc640 1 -- 172.21.15.66:0/2471672760 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3970031aa0 con 0x7f39800769e0 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 -- 172.21.15.66:0/2471672760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 msgr2=0x7f3980107000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 --2- 172.21.15.66:0/2471672760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980107000 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3970009840 tx=0x7f39700091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 -- 172.21.15.66:0/2471672760 shutdown_connections 2024-09-12T01:34:55.565 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 --2- 172.21.15.66:0/2471672760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980107000 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 -- 172.21.15.66:0/2471672760 >> 172.21.15.66:0/2471672760 conn(0x7f39800fc6d0 msgr2=0x7f39800feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 -- 172.21.15.66:0/2471672760 shutdown_connections 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 -- 172.21.15.66:0/2471672760 wait complete. 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 Processor -- start 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.766+0000 7f39860fa640 1 -- start start 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f39860fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980112f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f39860fa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801134d0 con 0x7f39800769e0 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f397f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980112f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f397f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980112f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45696/0 (socket says 172.21.15.66:45696) 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f397f7fe640 1 -- 172.21.15.66:0/2486927258 learned_addr learned my addr 172.21.15.66:0/2486927258 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f397f7fe640 1 -- 172.21.15.66:0/2486927258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970009450 con 0x7f39800769e0 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.767+0000 7f397f7fe640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980112f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3970006a70 tx=0x7f39700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.768+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3970031d20 con 0x7f39800769e0 2024-09-12T01:34:55.566 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.768+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3970031e80 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.768+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39801136d0 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.768+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f397003a750 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.768+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3980113b40 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.769+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f3970039040 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.769+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398004b720 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.769+0000 7f3967fff640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 0x7f396803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.769+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f397006cb50 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.769+0000 7f397effd640 1 -- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 msgr2=0x7f396803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/3928441794 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.769+0000 7f397effd640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 0x7f396803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.773+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f397004bae0 con 0x7f39800769e0 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.970+0000 7f397effd640 1 -- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 msgr2=0x7f396803b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/3928441794 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.970+0000 7f397effd640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 0x7f396803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:34:55.567 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.980+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f3980108150 con 0x7f39800769e0 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.981+0000 7f3967fff640 1 -- 172.21.15.66:0/2486927258 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f397003f030 con 0x7f39800769e0 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 msgr2=0x7f396803b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 0x7f396803b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 msgr2=0x7f3980112f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980112f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3970006a70 tx=0x7f39700091d0 comp rx=0 tx=0).stop 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 shutdown_connections 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f39680394e0 0x7f396803b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 --2- 172.21.15.66:0/2486927258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39800769e0 0x7f3980112f90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 >> 172.21.15.66:0/2486927258 conn(0x7f39800fc6d0 msgr2=0x7f39800fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 shutdown_connections 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:54.983+0000 7f39860fa640 1 -- 172.21.15.66:0/2486927258 wait complete. 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for the mgr to restart... 2024-09-12T01:34:55.568 INFO:teuthology.orchestra.run.smithi066.stdout:Waiting for mgr epoch 9... 2024-09-12T01:34:55.808 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:55 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2486927258' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-12T01:34:58.564 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: Active manager daemon smithi066.qdwcrh restarted 2024-09-12T01:34:58.564 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:34:58.564 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: osdmap e3: 0 total, 0 up, 0 in 2024-09-12T01:34:58.564 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: mgrmap e10: smithi066.qdwcrh(active, starting, since 0.00341846s) 2024-09-12T01:34:58.564 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:34:58.564 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:34:58.565 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:34:58 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:35:00.023 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout { 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout } 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cd4a8f640 1 Processor -- start 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cd4a8f640 1 -- start start 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cd4a8f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cd4a8f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd01050c0 con 0x7f0cd0076b70 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45706/0 (socket says 172.21.15.66:45706) 2024-09-12T01:35:00.024 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cce59c640 1 -- 172.21.15.66:0/864967432 learned_addr learned my addr 172.21.15.66:0/864967432 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.970+0000 7f0cce59c640 1 -- 172.21.15.66:0/864967432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0105200 con 0x7f0cd0076b70 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.971+0000 7f0cce59c640 1 --2- 172.21.15.66:0/864967432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0104b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009840 tx=0x7f0cc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c263e5cb4f9c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.971+0000 7f0ccdd9b640 1 -- 172.21.15.66:0/864967432 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cc0032440 con 0x7f0cd0076b70 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.971+0000 7f0ccdd9b640 1 -- 172.21.15.66:0/864967432 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cc0032a40 con 0x7f0cd0076b70 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.971+0000 7f0ccdd9b640 1 -- 172.21.15.66:0/864967432 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cc0031aa0 con 0x7f0cd0076b70 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.972+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/864967432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 msgr2=0x7f0cd0104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.972+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/864967432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0104b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009840 tx=0x7f0cc00091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.972+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/864967432 shutdown_connections 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.972+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/864967432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0104b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.972+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/864967432 >> 172.21.15.66:0/864967432 conn(0x7f0cd00fc6d0 msgr2=0x7f0cd00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.973+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/864967432 shutdown_connections 2024-09-12T01:35:00.025 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.973+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/864967432 wait complete. 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.973+0000 7f0cd4a8f640 1 Processor -- start 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.973+0000 7f0cd4a8f640 1 -- start start 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.973+0000 7f0cd4a8f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.973+0000 7f0cd4a8f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0111370 con 0x7f0cd0076b70 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cce59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45710/0 (socket says 172.21.15.66:45710) 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cce59c640 1 -- 172.21.15.66:0/4032447156 learned_addr learned my addr 172.21.15.66:0/4032447156 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cce59c640 1 -- 172.21.15.66:0/4032447156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0009450 con 0x7f0cd0076b70 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cce59c640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0110e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0006a70 tx=0x7f0cc00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:00.026 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cc0031d20 con 0x7f0cd0076b70 2024-09-12T01:35:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd0111570 con 0x7f0cd0076b70 2024-09-12T01:35:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cc0031e80 con 0x7f0cd0076b70 2024-09-12T01:35:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0cc003a750 con 0x7f0cd0076b70 2024-09-12T01:35:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.974+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd0111fc0 con 0x7f0cd0076b70 2024-09-12T01:35:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.975+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f0cc0039040 con 0x7f0cd0076b70 2024-09-12T01:35:00.027 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.976+0000 7f0cc6ffd640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:00.028 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.976+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 --> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cbc03c0f0 con 0x7f0cbc039530 2024-09-12T01:35:00.028 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.976+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0cc006cdc0 con 0x7f0cd0076b70 2024-09-12T01:35:00.028 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.976+0000 7f0cc7fff640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 msgr2=0x7f0cbc03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/3928441794 2024-09-12T01:35:00.028 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:55.976+0000 7f0cc7fff640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:00.028 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:56.177+0000 7f0cc7fff640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 msgr2=0x7f0cbc03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/3928441794 2024-09-12T01:35:00.029 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:56.177+0000 7f0cc7fff640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:35:00.029 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:56.578+0000 7f0cc7fff640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 msgr2=0x7f0cbc03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/3928441794 2024-09-12T01:35:00.029 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:56.578+0000 7f0cc7fff640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:35:00.029 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:57.379+0000 7f0cc7fff640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 msgr2=0x7f0cbc03b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/3928441794 2024-09-12T01:35:00.029 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:57.379+0000 7f0cc7fff640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:35:00.030 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:58.307+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f0cc003bc80 con 0x7f0cd0076b70 2024-09-12T01:35:00.030 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:58.307+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 msgr2=0x7f0cbc03b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:00.030 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:58.307+0000 7f0cc6ffd640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.030 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.308+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f0cc003a9a0 con 0x7f0cd0076b70 2024-09-12T01:35:00.030 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.308+0000 7f0cc6ffd640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f0cbc03cfd0 0x7f0cbc03f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:00.030 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.308+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0cbc03c0f0 con 0x7f0cbc03cfd0 2024-09-12T01:35:00.031 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.309+0000 7f0cc7fff640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f0cbc03cfd0 0x7f0cbc03f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:00.031 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.310+0000 7f0cc7fff640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f0cbc03cfd0 0x7f0cbc03f3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8003940 tx=0x7f0cb8009350 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:00.031 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.310+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f0cbc03c0f0 con 0x7f0cbc03cfd0 2024-09-12T01:35:00.031 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.319+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0cd01002f0 con 0x7f0cbc03cfd0 2024-09-12T01:35:00.031 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.319+0000 7f0cc6ffd640 1 -- 172.21.15.66:0/4032447156 <== mgr.14160 v2:172.21.15.66:6800/151382692 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f0cd01002f0 con 0x7f0cbc03cfd0 2024-09-12T01:35:00.032 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f0cbc03cfd0 msgr2=0x7f0cbc03f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:00.032 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f0cbc03cfd0 0x7f0cbc03f3b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8003940 tx=0x7f0cb8009350 comp rx=0 tx=0).stop 2024-09-12T01:35:00.032 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 msgr2=0x7f0cd0110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:00.032 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0110e30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0006a70 tx=0x7f0cc00091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.032 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 shutdown_connections 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f0cbc03cfd0 0x7f0cbc03f3b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:6800/3928441794,v1:172.21.15.66:6801/3928441794] conn(0x7f0cbc039530 0x7f0cbc03b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 --2- 172.21.15.66:0/4032447156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0cd0076b70 0x7f0cd0110e30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 >> 172.21.15.66:0/4032447156 conn(0x7f0cd00fc6d0 msgr2=0x7f0cd00fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 shutdown_connections 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:34:59.320+0000 7f0cd4a8f640 1 -- 172.21.15.66:0/4032447156 wait complete. 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:mgr epoch 9 is available 2024-09-12T01:35:00.033 INFO:teuthology.orchestra.run.smithi066.stdout:Generating a dashboard self-signed certificate... 2024-09-12T01:35:00.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:00 smithi066 ceph-mon[27875]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-12T01:35:00.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:00 smithi066 ceph-mon[27875]: mgrmap e11: smithi066.qdwcrh(active, since 1.00613s) 2024-09-12T01:35:00.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:00 smithi066 ceph-mon[27875]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-12T01:35:00.401 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:00 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe724a77640 1 Processor -- start 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe724a77640 1 -- start start 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe724a77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe724a77640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7201028d0 con 0x7fe720101f80 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe71e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe71e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45802/0 (socket says 172.21.15.66:45802) 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.412+0000 7fe71e59c640 1 -- 172.21.15.66:0/121159040 learned_addr learned my addr 172.21.15.66:0/121159040 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:01.270 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.413+0000 7fe71e59c640 1 -- 172.21.15.66:0/121159040 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe720102a10 con 0x7fe720101f80 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.413+0000 7fe71e59c640 1 --2- 172.21.15.66:0/121159040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720102390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe710009840 tx=0x7fe7100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d58384bc04f9a22 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe71d59a640 1 -- 172.21.15.66:0/121159040 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe710032440 con 0x7fe720101f80 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe71d59a640 1 -- 172.21.15.66:0/121159040 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe710032a40 con 0x7fe720101f80 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe71d59a640 1 -- 172.21.15.66:0/121159040 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe710031a70 con 0x7fe720101f80 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 -- 172.21.15.66:0/121159040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 msgr2=0x7fe720102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 --2- 172.21.15.66:0/121159040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720102390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe710009840 tx=0x7fe7100091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 -- 172.21.15.66:0/121159040 shutdown_connections 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 --2- 172.21.15.66:0/121159040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720102390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 -- 172.21.15.66:0/121159040 >> 172.21.15.66:0/121159040 conn(0x7fe7200fd7a0 msgr2=0x7fe7200ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 -- 172.21.15.66:0/121159040 shutdown_connections 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.414+0000 7fe724a77640 1 -- 172.21.15.66:0/121159040 wait complete. 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.415+0000 7fe724a77640 1 Processor -- start 2024-09-12T01:35:01.271 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.415+0000 7fe724a77640 1 -- start start 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.415+0000 7fe724a77640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720110e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.415+0000 7fe724a77640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7201113b0 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.415+0000 7fe71e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720110e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.415+0000 7fe71e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720110e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45818/0 (socket says 172.21.15.66:45818) 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe71e59c640 1 -- 172.21.15.66:0/1504173996 learned_addr learned my addr 172.21.15.66:0/1504173996 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe71e59c640 1 -- 172.21.15.66:0/1504173996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710009450 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe71e59c640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720110e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe710031670 tx=0x7fe7100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe71003c400 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7201115b0 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe71003ca00 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe71003a910 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.416+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe720112090 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.417+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7fe71003cb70 con 0x7fe720101f80 2024-09-12T01:35:01.272 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.417+0000 7fe70effd640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fe7080393d0 0x7fe70803b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.418+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fe71006ce10 con 0x7fe720101f80 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.418+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7201013e0 con 0x7fe720101f80 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.418+0000 7fe71dd9b640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fe7080393d0 0x7fe70803b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.418+0000 7fe71dd9b640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fe7080393d0 0x7fe70803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe714006fd0 tx=0x7fe714006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.424+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe710037030 con 0x7fe720101f80 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.599+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7200fec00 con 0x7fe7080393d0 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.667+0000 7fe70effd640 1 -- 172.21.15.66:0/1504173996 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fe7200fec00 con 0x7fe7080393d0 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fe7080393d0 msgr2=0x7fe70803b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fe7080393d0 0x7fe70803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe714006fd0 tx=0x7fe714006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 msgr2=0x7fe720110e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720110e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe710031670 tx=0x7fe7100091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 shutdown_connections 2024-09-12T01:35:01.273 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fe7080393d0 0x7fe70803b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:01.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 --2- 172.21.15.66:0/1504173996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe720101f80 0x7fe720110e70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:01.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 >> 172.21.15.66:0/1504173996 conn(0x7fe7200fd7a0 msgr2=0x7fe7200fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:01.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 shutdown_connections 2024-09-12T01:35:01.274 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:00.670+0000 7fe724a77640 1 -- 172.21.15.66:0/1504173996 wait complete. 2024-09-12T01:35:01.274 INFO:teuthology.orchestra.run.smithi066.stdout:Creating initial admin user... 2024-09-12T01:35:01.857 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:01 smithi066 ceph-mon[27875]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:35:01.857 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:01 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:01.857 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:01 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:01.857 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:01 smithi066 ceph-mon[27875]: mgrmap e12: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:35:02.876 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$tCAQL8wem5qjafKrwxckguV0YfxYX1I/jG9lBpt2f0h5x58m3C4.q", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726104902, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-12T01:35:02.876 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feab23fe640 1 Processor -- start 2024-09-12T01:35:02.876 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feab23fe640 1 -- start start 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feab23fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac104b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feab23fe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1050c0 con 0x7feaac076b70 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feaabfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac104b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feaabfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac104b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45832/0 (socket says 172.21.15.66:45832) 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feaabfff640 1 -- 172.21.15.66:0/2731644724 learned_addr learned my addr 172.21.15.66:0/2731644724 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.655+0000 7feaabfff640 1 -- 172.21.15.66:0/2731644724 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac105200 con 0x7feaac076b70 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.656+0000 7feaabfff640 1 --2- 172.21.15.66:0/2731644724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac104b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009840 tx=0x7fea9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17eb9e9c7c790f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.656+0000 7feaaaffd640 1 -- 172.21.15.66:0/2731644724 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea9c032440 con 0x7feaac076b70 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.656+0000 7feaaaffd640 1 -- 172.21.15.66:0/2731644724 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea9c032a40 con 0x7feaac076b70 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.656+0000 7feaaaffd640 1 -- 172.21.15.66:0/2731644724 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea9c031aa0 con 0x7feaac076b70 2024-09-12T01:35:02.877 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 -- 172.21.15.66:0/2731644724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 msgr2=0x7feaac104b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:02.883 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 --2- 172.21.15.66:0/2731644724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac104b80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009840 tx=0x7fea9c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:02.883 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 -- 172.21.15.66:0/2731644724 shutdown_connections 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 --2- 172.21.15.66:0/2731644724 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac104b80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 -- 172.21.15.66:0/2731644724 >> 172.21.15.66:0/2731644724 conn(0x7feaac0fc6d0 msgr2=0x7feaac0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 -- 172.21.15.66:0/2731644724 shutdown_connections 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.657+0000 7feab23fe640 1 -- 172.21.15.66:0/2731644724 wait complete. 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feab23fe640 1 Processor -- start 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feab23fe640 1 -- start start 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feab23fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac110e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feab23fe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac111370 con 0x7feaac076b70 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feaabfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac110e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feaabfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac110e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45848/0 (socket says 172.21.15.66:45848) 2024-09-12T01:35:02.884 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feaabfff640 1 -- 172.21.15.66:0/3197010606 learned_addr learned my addr 172.21.15.66:0/3197010606 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.658+0000 7feaabfff640 1 -- 172.21.15.66:0/3197010606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009450 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.659+0000 7feaabfff640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac110e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009810 tx=0x7fea9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.659+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea9c0327b0 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.659+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fea9c03b8d0 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.659+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac111570 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.659+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fea9c03a6f0 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.659+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac111fc0 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.660+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fea9c039040 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.660+0000 7feaa8ff9640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fea940394e0 0x7fea9403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.660+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fea9c06cc30 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.660+0000 7feaab7fe640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fea940394e0 0x7fea9403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.660+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac1002f0 con 0x7feaac076b70 2024-09-12T01:35:02.885 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.661+0000 7feaab7fe640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fea940394e0 0x7fea9403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feaa0006fd0 tx=0x7feaa0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.665+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fea9c037020 con 0x7feaac076b70 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:01.882+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7feaac04b720 con 0x7fea940394e0 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.133+0000 7feaa8ff9640 1 -- 172.21.15.66:0/3197010606 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7feaac04b720 con 0x7fea940394e0 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fea940394e0 msgr2=0x7fea9403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fea940394e0 0x7fea9403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feaa0006fd0 tx=0x7feaa0006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 msgr2=0x7feaac110e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac110e30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009810 tx=0x7fea9c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 shutdown_connections 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fea940394e0 0x7fea9403b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 --2- 172.21.15.66:0/3197010606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaac076b70 0x7feaac110e30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.135+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 >> 172.21.15.66:0/3197010606 conn(0x7feaac0fc6d0 msgr2=0x7feaac0fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.136+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 shutdown_connections 2024-09-12T01:35:02.886 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:02.136+0000 7feab23fe640 1 -- 172.21.15.66:0/3197010606 wait complete. 2024-09-12T01:35:02.887 INFO:teuthology.orchestra.run.smithi066.stdout:Fetching dashboard port number... 2024-09-12T01:35:02.983 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:02 smithi066 ceph-mon[27875]: [12/Sep/2024:01:35:01] ENGINE Bus STARTING 2024-09-12T01:35:02.983 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:02 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:02.984 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:02 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:02.984 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:02 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:03 smithi066 ceph-mon[27875]: [12/Sep/2024:01:35:01] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:03 smithi066 ceph-mon[27875]: [12/Sep/2024:01:35:01] ENGINE Bus STARTED 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:03 smithi066 ceph-mon[27875]: [12/Sep/2024:01:35:01] ENGINE Error in HTTPServer.serve 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Traceback (most recent call last): 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._run(expiration_interval) 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:35:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s = self.context.wrap_socket( 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: return self.sslsocket_class._create( 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self.do_handshake() 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._sslobj.do_handshake() 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:03 smithi066 ceph-mon[27875]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:35:03.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:03 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3334455851' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-12T01:35:04.666 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stdout 8443 2024-09-12T01:35:04.666 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.255+0000 7f05d3aa8640 1 Processor -- start 2024-09-12T01:35:04.666 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d3aa8640 1 -- start start 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d3aa8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc107010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d3aa8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc076df0 con 0x7f05cc0769e0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d1844640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d1844640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56856/0 (socket says 172.21.15.66:56856) 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d1844640 1 -- 172.21.15.66:0/2245036463 learned_addr learned my addr 172.21.15.66:0/2245036463 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.256+0000 7f05d1844640 1 -- 172.21.15.66:0/2245036463 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc107550 con 0x7f05cc0769e0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.257+0000 7f05d1844640 1 --2- 172.21.15.66:0/2245036463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc107010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7ccb65a22bd3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.257+0000 7f05d0842640 1 -- 172.21.15.66:0/2245036463 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05c8032440 con 0x7f05cc0769e0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.257+0000 7f05d0842640 1 -- 172.21.15.66:0/2245036463 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05c8032a40 con 0x7f05cc0769e0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.257+0000 7f05d0842640 1 -- 172.21.15.66:0/2245036463 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05c8031aa0 con 0x7f05cc0769e0 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 -- 172.21.15.66:0/2245036463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 msgr2=0x7f05cc107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 --2- 172.21.15.66:0/2245036463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc107010 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009840 tx=0x7f05c80091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 -- 172.21.15.66:0/2245036463 shutdown_connections 2024-09-12T01:35:04.667 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 --2- 172.21.15.66:0/2245036463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc107010 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 -- 172.21.15.66:0/2245036463 >> 172.21.15.66:0/2245036463 conn(0x7f05cc0fc700 msgr2=0x7f05cc0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 -- 172.21.15.66:0/2245036463 shutdown_connections 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.258+0000 7f05d3aa8640 1 -- 172.21.15.66:0/2245036463 wait complete. 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d3aa8640 1 Processor -- start 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d3aa8640 1 -- start start 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d3aa8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d3aa8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc113530 con 0x7f05cc0769e0 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d1844640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d1844640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc112ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56870/0 (socket says 172.21.15.66:56870) 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d1844640 1 -- 172.21.15.66:0/3334455851 learned_addr learned my addr 172.21.15.66:0/3334455851 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.259+0000 7f05d1844640 1 -- 172.21.15.66:0/3334455851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8009450 con 0x7f05cc0769e0 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.260+0000 7f05d1844640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc112ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009420 tx=0x7f05c80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.668 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.260+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05c8031d20 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.260+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f05c8031e80 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.260+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc113730 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.260+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f05c803a670 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.260+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc113ba0 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.261+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f05c8039040 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.261+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc04b720 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.261+0000 7f05c27fc640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f05b8039530 0x7f05b803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.261+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f05c806c990 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.261+0000 7f05d1043640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f05b8039530 0x7f05b803b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.262+0000 7f05d1043640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f05b8039530 0x7f05b803b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05bc006fd0 tx=0x7f05bc006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.266+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f05c8030ae0 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.438+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f05cc1145c0 con 0x7f05cc0769e0 2024-09-12T01:35:04.669 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.439+0000 7f05c27fc640 1 -- 172.21.15.66:0/3334455851 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f05c803f0b0 con 0x7f05cc0769e0 2024-09-12T01:35:04.670 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f05b8039530 msgr2=0x7f05b803b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.670 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f05b8039530 0x7f05b803b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f05bc006fd0 tx=0x7f05bc006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.670 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 msgr2=0x7f05cc112ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:04.671 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc112ff0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009420 tx=0x7f05c80091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 shutdown_connections 2024-09-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f05b8039530 0x7f05b803b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 --2- 172.21.15.66:0/3334455851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05cc0769e0 0x7f05cc112ff0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 >> 172.21.15.66:0/3334455851 conn(0x7f05cc0fc700 msgr2=0x7f05cc0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.442+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 shutdown_connections 2024-09-12T01:35:04.672 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:03.443+0000 7f05d3aa8640 1 -- 172.21.15.66:0/3334455851 wait complete. 2024-09-12T01:35:04.679 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-12T01:35:04.679 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout disabled 2024-09-12T01:35:04.688 INFO:teuthology.orchestra.run.smithi066.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-12T01:35:04.688 INFO:teuthology.orchestra.run.smithi066.stdout:systemctl: stdout inactive 2024-09-12T01:35:04.688 INFO:teuthology.orchestra.run.smithi066.stdout:firewalld.service is not enabled 2024-09-12T01:35:04.688 INFO:teuthology.orchestra.run.smithi066.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-12T01:35:04.690 INFO:teuthology.orchestra.run.smithi066.stdout:Ceph Dashboard is now available at: 2024-09-12T01:35:04.690 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:04.690 INFO:teuthology.orchestra.run.smithi066.stdout: URL: https://smithi066.front.sepia.ceph.com:8443/ 2024-09-12T01:35:04.690 INFO:teuthology.orchestra.run.smithi066.stdout: User: admin 2024-09-12T01:35:04.691 INFO:teuthology.orchestra.run.smithi066.stdout: Password: fczof44o4e 2024-09-12T01:35:04.691 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:04.691 INFO:teuthology.orchestra.run.smithi066.stdout:Saving cluster configuration to /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config directory 2024-09-12T01:35:04.692 INFO:teuthology.orchestra.run.smithi066.stdout:Enabling autotune for osd_memory_target 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.071+0000 7ff59c06e640 1 Processor -- start 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.071+0000 7ff59c06e640 1 -- start start 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.071+0000 7ff59c06e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.071+0000 7ff59c06e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594078f60 con 0x7ff594078b50 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.072+0000 7ff599e0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.072+0000 7ff599e0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56880/0 (socket says 172.21.15.66:56880) 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.072+0000 7ff599e0a640 1 -- 172.21.15.66:0/3092935666 learned_addr learned my addr 172.21.15.66:0/3092935666 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.072+0000 7ff599e0a640 1 -- 172.21.15.66:0/3092935666 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940790a0 con 0x7ff594078b50 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.073+0000 7ff599e0a640 1 --2- 172.21.15.66:0/3092935666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594077210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff590009840 tx=0x7ff5900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4cf4eed99579cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:05.797 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.073+0000 7ff598e08640 1 -- 172.21.15.66:0/3092935666 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff590032440 con 0x7ff594078b50 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.073+0000 7ff598e08640 1 -- 172.21.15.66:0/3092935666 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff590032a40 con 0x7ff594078b50 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.073+0000 7ff598e08640 1 -- 172.21.15.66:0/3092935666 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff590031aa0 con 0x7ff594078b50 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 -- 172.21.15.66:0/3092935666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 msgr2=0x7ff594077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 --2- 172.21.15.66:0/3092935666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594077210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff590009840 tx=0x7ff5900091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 -- 172.21.15.66:0/3092935666 shutdown_connections 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 --2- 172.21.15.66:0/3092935666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594077210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 -- 172.21.15.66:0/3092935666 >> 172.21.15.66:0/3092935666 conn(0x7ff5940fd850 msgr2=0x7ff5940ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 -- 172.21.15.66:0/3092935666 shutdown_connections 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 -- 172.21.15.66:0/3092935666 wait complete. 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 Processor -- start 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.074+0000 7ff59c06e640 1 -- start start 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff59c06e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594112f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:05.798 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff59c06e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5941134a0 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff599e0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594112f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff599e0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594112f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56894/0 (socket says 172.21.15.66:56894) 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff599e0a640 1 -- 172.21.15.66:0/2511747804 learned_addr learned my addr 172.21.15.66:0/2511747804 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff599e0a640 1 -- 172.21.15.66:0/2511747804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009450 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff599e0a640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594112f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff590031780 tx=0x7ff5900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5900327b0 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff59003b8d0 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5941136a0 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.075+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff59003a790 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.076+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff594113b10 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.076+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff590039040 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.076+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59404b720 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.077+0000 7ff58a7fc640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff5800395d0 0x7ff58003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.077+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff59006cae0 con 0x7ff594078b50 2024-09-12T01:35:05.799 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.077+0000 7ff599609640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff5800395d0 0x7ff58003ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.077+0000 7ff599609640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff5800395d0 0x7ff58003ba80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff584006fd0 tx=0x7ff584006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.081+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff59003a8f0 con 0x7ff594078b50 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.250+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff594114530 con 0x7ff594078b50 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.250+0000 7ff58a7fc640 1 -- 172.21.15.66:0/2511747804 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff59003f0c0 con 0x7ff594078b50 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff5800395d0 msgr2=0x7ff58003ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff5800395d0 0x7ff58003ba80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff584006fd0 tx=0x7ff584006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 msgr2=0x7ff594112f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594112f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff590031780 tx=0x7ff5900091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 shutdown_connections 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff5800395d0 0x7ff58003ba80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 --2- 172.21.15.66:0/2511747804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff594078b50 0x7ff594112f60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 >> 172.21.15.66:0/2511747804 conn(0x7ff5940fd850 msgr2=0x7ff5940fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 shutdown_connections 2024-09-12T01:35:05.800 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:05.252+0000 7ff59c06e640 1 -- 172.21.15.66:0/2511747804 wait complete. 2024-09-12T01:35:05.888 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:05 smithi066 ceph-mon[27875]: mgrmap e13: smithi066.qdwcrh(active, since 6s) 2024-09-12T01:35:06.978 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.171+0000 7fc00262e640 1 Processor -- start 2024-09-12T01:35:06.978 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.171+0000 7fc00262e640 1 -- start start 2024-09-12T01:35:06.978 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.172+0000 7fc00262e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc104b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.172+0000 7fc00262e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc1050d0 con 0x7fbffc076b70 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.172+0000 7fbffbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc104b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.172+0000 7fbffbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc104b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56904/0 (socket says 172.21.15.66:56904) 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.172+0000 7fbffbfff640 1 -- 172.21.15.66:0/662723699 learned_addr learned my addr 172.21.15.66:0/662723699 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.172+0000 7fbffbfff640 1 -- 172.21.15.66:0/662723699 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc105210 con 0x7fbffc076b70 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.173+0000 7fbffbfff640 1 --2- 172.21.15.66:0/662723699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc104b90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009840 tx=0x7fbfec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a993b2f3994d794 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.173+0000 7fbffaffd640 1 -- 172.21.15.66:0/662723699 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfec032440 con 0x7fbffc076b70 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.173+0000 7fbffaffd640 1 -- 172.21.15.66:0/662723699 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfec032a40 con 0x7fbffc076b70 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.173+0000 7fbffaffd640 1 -- 172.21.15.66:0/662723699 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfec031aa0 con 0x7fbffc076b70 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 -- 172.21.15.66:0/662723699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 msgr2=0x7fbffc104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 --2- 172.21.15.66:0/662723699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc104b90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009840 tx=0x7fbfec0091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 -- 172.21.15.66:0/662723699 shutdown_connections 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 --2- 172.21.15.66:0/662723699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc104b90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.979 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 -- 172.21.15.66:0/662723699 >> 172.21.15.66:0/662723699 conn(0x7fbffc0fc700 msgr2=0x7fbffc0feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 -- 172.21.15.66:0/662723699 shutdown_connections 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 -- 172.21.15.66:0/662723699 wait complete. 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 Processor -- start 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.174+0000 7fc00262e640 1 -- start start 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fc00262e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc110e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fc00262e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc111380 con 0x7fbffc076b70 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fbffbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc110e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fbffbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc110e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56908/0 (socket says 172.21.15.66:56908) 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fbffbfff640 1 -- 172.21.15.66:0/3287163335 learned_addr learned my addr 172.21.15.66:0/3287163335 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fbffbfff640 1 -- 172.21.15.66:0/3287163335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec009450 con 0x7fbffc076b70 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fbffbfff640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc110e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009420 tx=0x7fbfec0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.175+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfec031d20 con 0x7fbffc076b70 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.176+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc111580 con 0x7fbffc076b70 2024-09-12T01:35:06.980 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.176+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbfec031e80 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.176+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbfec03a670 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.176+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc112060 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.177+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fbfec039040 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.177+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc100300 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.177+0000 7fbff8ff9640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fbfe4039580 0x7fbfe403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.177+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbfec06cc40 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.177+0000 7fbffb7fe640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fbfe4039580 0x7fbfe403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.178+0000 7fbffb7fe640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fbfe4039580 0x7fbfe403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006fd0 tx=0x7fbff0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.181+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbfec04bae0 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.435+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fbffc04b720 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.437+0000 7fbff8ff9640 1 -- 172.21.15.66:0/3287163335 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fbfec03f070 con 0x7fbffc076b70 2024-09-12T01:35:06.981 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fbfe4039580 msgr2=0x7fbfe403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fbfe4039580 0x7fbfe403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006fd0 tx=0x7fbff0006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 msgr2=0x7fbffc110e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc110e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbfec009420 tx=0x7fbfec0091d0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 shutdown_connections 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fbfe4039580 0x7fbfe403ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 --2- 172.21.15.66:0/3287163335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbffc076b70 0x7fbffc110e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.439+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 >> 172.21.15.66:0/3287163335 conn(0x7fbffc0fc700 msgr2=0x7fbffc0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.440+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 shutdown_connections 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:/usr/bin/ceph: stderr 2024-09-12T01:35:06.440+0000 7fc00262e640 1 -- 172.21.15.66:0/3287163335 wait complete. 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:35:06.982 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout:Or, if you are only running a single cluster on this host: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: ceph telemetry on 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout:For more information see: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:06.983 INFO:teuthology.orchestra.run.smithi066.stdout:Bootstrap complete. 2024-09-12T01:35:07.017 INFO:tasks.cephadm:Fetching config... 2024-09-12T01:35:07.018 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:35:07.018 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-12T01:35:07.035 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-12T01:35:07.036 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:35:07.036 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-12T01:35:07.092 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-12T01:35:07.092 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:35:07.092 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/keyring of=/dev/stdout 2024-09-12T01:35:07.158 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-12T01:35:07.159 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:35:07.159 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-12T01:35:07.214 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-12T01:35:07.215 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6cILuKyeNQyCYoTOWluu6LLVDBUtDXlgh/dbrU82obQbvTUrtEwYJpPRgf7f4IhrHCvQo0FNOi27FS52XbJGWY5uCiU7zeCTnJQ/XOhLmz0+VKlTVc8+S1WSnJDTch2Pa/n3maJTRMhDiJIVd1edpqM0MoMQS7PPa0Awil15bg+AvTCDLLQbS0ZfwyYmMYvhnJ8FUagC2jowgly9/ow2oaQdMZiHsbxvV4TLYlUTIjOTqS3cyT0Eg71COxLpc9MdBinxymwGOKaNW1jquczzPmPGRNIHNCLRZDGWPRj6LDxNSxUI5TiPFIMgpj8IFstQfuzhfkJxhGxkKtYWknLuk7/8utnpd1mWEkYKsbCX0l9oHo5q9z3p+j1I1Yo099eGeWS3bVjG5svYlu51stuJ0j7oAXusiunpWIWDX7VIPdd9Yiz4EwYPIgho+PO+m9q6H10vuevwnmnD8+XuRZthwDU4OsVj7F1Rvndd67juQ0czyFuBysEJ0KexX0nl8qJ0= ceph-f9344df4-70a6-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:35:07.301 INFO:teuthology.orchestra.run.smithi066.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6cILuKyeNQyCYoTOWluu6LLVDBUtDXlgh/dbrU82obQbvTUrtEwYJpPRgf7f4IhrHCvQo0FNOi27FS52XbJGWY5uCiU7zeCTnJQ/XOhLmz0+VKlTVc8+S1WSnJDTch2Pa/n3maJTRMhDiJIVd1edpqM0MoMQS7PPa0Awil15bg+AvTCDLLQbS0ZfwyYmMYvhnJ8FUagC2jowgly9/ow2oaQdMZiHsbxvV4TLYlUTIjOTqS3cyT0Eg71COxLpc9MdBinxymwGOKaNW1jquczzPmPGRNIHNCLRZDGWPRj6LDxNSxUI5TiPFIMgpj8IFstQfuzhfkJxhGxkKtYWknLuk7/8utnpd1mWEkYKsbCX0l9oHo5q9z3p+j1I1Yo099eGeWS3bVjG5svYlu51stuJ0j7oAXusiunpWIWDX7VIPdd9Yiz4EwYPIgho+PO+m9q6H10vuevwnmnD8+XuRZthwDU4OsVj7F1Rvndd67juQ0czyFuBysEJ0KexX0nl8qJ0= ceph-f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:35:07.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6cILuKyeNQyCYoTOWluu6LLVDBUtDXlgh/dbrU82obQbvTUrtEwYJpPRgf7f4IhrHCvQo0FNOi27FS52XbJGWY5uCiU7zeCTnJQ/XOhLmz0+VKlTVc8+S1WSnJDTch2Pa/n3maJTRMhDiJIVd1edpqM0MoMQS7PPa0Awil15bg+AvTCDLLQbS0ZfwyYmMYvhnJ8FUagC2jowgly9/ow2oaQdMZiHsbxvV4TLYlUTIjOTqS3cyT0Eg71COxLpc9MdBinxymwGOKaNW1jquczzPmPGRNIHNCLRZDGWPRj6LDxNSxUI5TiPFIMgpj8IFstQfuzhfkJxhGxkKtYWknLuk7/8utnpd1mWEkYKsbCX0l9oHo5q9z3p+j1I1Yo099eGeWS3bVjG5svYlu51stuJ0j7oAXusiunpWIWDX7VIPdd9Yiz4EwYPIgho+PO+m9q6H10vuevwnmnD8+XuRZthwDU4OsVj7F1Rvndd67juQ0czyFuBysEJ0KexX0nl8qJ0= ceph-f9344df4-70a6-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-12T01:35:07.372 INFO:teuthology.orchestra.run.smithi153.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6cILuKyeNQyCYoTOWluu6LLVDBUtDXlgh/dbrU82obQbvTUrtEwYJpPRgf7f4IhrHCvQo0FNOi27FS52XbJGWY5uCiU7zeCTnJQ/XOhLmz0+VKlTVc8+S1WSnJDTch2Pa/n3maJTRMhDiJIVd1edpqM0MoMQS7PPa0Awil15bg+AvTCDLLQbS0ZfwyYmMYvhnJ8FUagC2jowgly9/ow2oaQdMZiHsbxvV4TLYlUTIjOTqS3cyT0Eg71COxLpc9MdBinxymwGOKaNW1jquczzPmPGRNIHNCLRZDGWPRj6LDxNSxUI5TiPFIMgpj8IFstQfuzhfkJxhGxkKtYWknLuk7/8utnpd1mWEkYKsbCX0l9oHo5q9z3p+j1I1Yo099eGeWS3bVjG5svYlu51stuJ0j7oAXusiunpWIWDX7VIPdd9Yiz4EwYPIgho+PO+m9q6H10vuevwnmnD8+XuRZthwDU4OsVj7F1Rvndd67juQ0czyFuBysEJ0KexX0nl8qJ0= ceph-f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:35:07.385 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-12T01:35:07.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:07 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3287163335' entity='client.admin' 2024-09-12T01:35:07.640 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 -- 172.21.15.66:0/4184962868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 msgr2=0x7f25280ff050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 --2- 172.21.15.66:0/4184962868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f25280ff050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2524004850 tx=0x7f2524009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 -- 172.21.15.66:0/4184962868 shutdown_connections 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 --2- 172.21.15.66:0/4184962868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f25280ff050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 -- 172.21.15.66:0/4184962868 >> 172.21.15.66:0/4184962868 conn(0x7f25280f6ac0 msgr2=0x7f25280f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 -- 172.21.15.66:0/4184962868 shutdown_connections 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.732+0000 7f252f4cc640 1 -- 172.21.15.66:0/4184962868 wait complete. 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252f4cc640 1 Processor -- start 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252f4cc640 1 -- start start 2024-09-12T01:35:09.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252f4cc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f252810c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252f4cc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252810cea0 con 0x7f25280655f0 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252d268640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f252810c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252d268640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f252810c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56928/0 (socket says 172.21.15.66:56928) 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.733+0000 7f252d268640 1 -- 172.21.15.66:0/2061912993 learned_addr learned my addr 172.21.15.66:0/2061912993 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f252d268640 1 -- 172.21.15.66:0/2061912993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2524005040 con 0x7f25280655f0 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f252d268640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f252810c960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2524003040 tx=0x7f2524009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f252403d460 con 0x7f25280655f0 2024-09-12T01:35:09.735 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f252403da60 con 0x7f25280655f0 2024-09-12T01:35:09.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252810d0a0 con 0x7f25280655f0 2024-09-12T01:35:09.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f25240329f0 con 0x7f25280655f0 2024-09-12T01:35:09.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.734+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252810d490 con 0x7f25280655f0 2024-09-12T01:35:09.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.736+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f2524030020 con 0x7f25280655f0 2024-09-12T01:35:09.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.736+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252805ed70 con 0x7f25280655f0 2024-09-12T01:35:09.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.736+0000 7f2519ffb640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f25140395d0 0x7f251403ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:09.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.736+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f252406c2e0 con 0x7f25280655f0 2024-09-12T01:35:09.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.737+0000 7f252ca67640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f25140395d0 0x7f251403ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:09.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.737+0000 7f252ca67640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f25140395d0 0x7f251403ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f251c006fd0 tx=0x7f251c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:09.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.742+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2524032b50 con 0x7f25280655f0 2024-09-12T01:35:09.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.908+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f252804b720 con 0x7f25280655f0 2024-09-12T01:35:09.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.911+0000 7f2519ffb640 1 -- 172.21.15.66:0/2061912993 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2524045340 con 0x7f25280655f0 2024-09-12T01:35:09.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f25140395d0 msgr2=0x7f251403ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f25140395d0 0x7f251403ba80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f251c006fd0 tx=0x7f251c006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 msgr2=0x7f252810c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:09.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f252810c960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2524003040 tx=0x7f2524009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 shutdown_connections 2024-09-12T01:35:09.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f25140395d0 0x7f251403ba80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 --2- 172.21.15.66:0/2061912993 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25280655f0 0x7f252810c960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:09.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.913+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 >> 172.21.15.66:0/2061912993 conn(0x7f25280f6ac0 msgr2=0x7f25280f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:09.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.914+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 shutdown_connections 2024-09-12T01:35:09.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:09.914+0000 7f252f4cc640 1 -- 172.21.15.66:0/2061912993 wait complete. 2024-09-12T01:35:10.469 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-12T01:35:10.469 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-12T01:35:10.611 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:10.611 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:10.611 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:35:10.611 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:10.611 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:35:10.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-12T01:35:10.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:35:10.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: Deploying daemon crash.smithi066 on smithi066 2024-09-12T01:35:10.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:10 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2061912993' entity='client.admin' 2024-09-12T01:35:10.801 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- 172.21.15.66:0/409208720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 msgr2=0x7f763c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 --2- 172.21.15.66:0/409208720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c0fc5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f762c004850 tx=0x7f762c009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- 172.21.15.66:0/409208720 shutdown_connections 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 --2- 172.21.15.66:0/409208720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c0fc5e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- 172.21.15.66:0/409208720 >> 172.21.15.66:0/409208720 conn(0x7f763c0f79b0 msgr2=0x7f763c0f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- 172.21.15.66:0/409208720 shutdown_connections 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- 172.21.15.66:0/409208720 wait complete. 2024-09-12T01:35:12.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 Processor -- start 2024-09-12T01:35:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- start start 2024-09-12T01:35:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c10c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.892+0000 7f76408d0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c10cc10 con 0x7f763c0fc1d0 2024-09-12T01:35:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f763a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c10c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f763a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c10c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33528/0 (socket says 172.21.15.66:33528) 2024-09-12T01:35:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f763a59c640 1 -- 172.21.15.66:0/2597180668 learned_addr learned my addr 172.21.15.66:0/2597180668 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f763a59c640 1 -- 172.21.15.66:0/2597180668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c005040 con 0x7f763c0fc1d0 2024-09-12T01:35:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f763a59c640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c10c6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f762c009920 tx=0x7f762c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f762c033630 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f762c033c30 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c10ce10 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f762c03dc40 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.893+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c10d280 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.894+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f762c030020 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.894+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c05ed70 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.894+0000 7f7632ffd640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f76280395d0 0x7f762803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.895+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f762c06c7c0 con 0x7f763c0fc1d0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.895+0000 7f7633fff640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f76280395d0 0x7f762803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:12.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.895+0000 7f7633fff640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f76280395d0 0x7f762803ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7624006fd0 tx=0x7f7624006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:12.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:12.899+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f762c033da0 con 0x7f763c0fc1d0 2024-09-12T01:35:13.076 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.076+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f763c10d280 con 0x7f76280395d0 2024-09-12T01:35:13.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.079+0000 7f7632ffd640 1 -- 172.21.15.66:0/2597180668 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f763c10d280 con 0x7f76280395d0 2024-09-12T01:35:13.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f76280395d0 msgr2=0x7f762803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f76280395d0 0x7f762803ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7624006fd0 tx=0x7f7624006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 msgr2=0x7f763c10c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:13.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c10c6d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f762c009920 tx=0x7f762c009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 shutdown_connections 2024-09-12T01:35:13.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f76280395d0 0x7f762803ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 --2- 172.21.15.66:0/2597180668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f763c0fc1d0 0x7f763c10c6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:13.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 >> 172.21.15.66:0/2597180668 conn(0x7f763c0f79b0 msgr2=0x7f763c0f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:13.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.081+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 shutdown_connections 2024-09-12T01:35:13.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:13.082+0000 7f76408d0640 1 -- 172.21.15.66:0/2597180668 wait complete. 2024-09-12T01:35:13.725 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi153 2024-09-12T01:35:13.725 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:35:13.726 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.conf 2024-09-12T01:35:13.747 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:35:13.747 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:35:13.804 INFO:tasks.cephadm:Adding host smithi153 to orchestrator... 2024-09-12T01:35:13.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch host add smithi153 2024-09-12T01:35:14.334 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:14 smithi066 ceph-mon[27875]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:35:14.334 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:14 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:14.679 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 -- 172.21.15.66:0/1948649615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 msgr2=0x7f72280fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 --2- 172.21.15.66:0/1948649615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f72280fc5e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7218004850 tx=0x7f7218009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 -- 172.21.15.66:0/1948649615 shutdown_connections 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 --2- 172.21.15.66:0/1948649615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f72280fc5e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 -- 172.21.15.66:0/1948649615 >> 172.21.15.66:0/1948649615 conn(0x7f72280f79b0 msgr2=0x7f72280f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 -- 172.21.15.66:0/1948649615 shutdown_connections 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.335+0000 7f722c8b4640 1 -- 172.21.15.66:0/1948649615 wait complete. 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722c8b4640 1 Processor -- start 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722c8b4640 1 -- start start 2024-09-12T01:35:16.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722c8b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f722810c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722c8b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f722810cc10 con 0x7f72280fc1d0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f722810c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f722810c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33546/0 (socket says 172.21.15.66:33546) 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.336+0000 7f722659c640 1 -- 172.21.15.66:0/782614491 learned_addr learned my addr 172.21.15.66:0/782614491 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f722659c640 1 -- 172.21.15.66:0/782614491 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7218005040 con 0x7f72280fc1d0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f722659c640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f722810c6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7218009920 tx=0x7f7218009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7218033630 con 0x7f72280fc1d0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7218033c30 con 0x7f72280fc1d0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f722810ce10 con 0x7f72280fc1d0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721803dc40 con 0x7f72280fc1d0 2024-09-12T01:35:16.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.337+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722810d280 con 0x7f72280fc1d0 2024-09-12T01:35:16.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.338+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f7218030020 con 0x7f72280fc1d0 2024-09-12T01:35:16.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.338+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722805ed70 con 0x7f72280fc1d0 2024-09-12T01:35:16.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.338+0000 7f7216ffd640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7210039580 0x7f721003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:16.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.338+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f721806c9c0 con 0x7f72280fc1d0 2024-09-12T01:35:16.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.338+0000 7f7225d9b640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7210039580 0x7f721003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:16.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.339+0000 7f7225d9b640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7210039580 0x7f721003ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f721c006fd0 tx=0x7f721c006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:16.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.343+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f721803bb50 con 0x7f72280fc1d0 2024-09-12T01:35:16.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:16.521+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}) v1 -- 0x7f722810d280 con 0x7f7210039580 2024-09-12T01:35:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:17 smithi066 ceph-mon[27875]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:35:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:17 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:17 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:17 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:17 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:17 smithi066 ceph-mon[27875]: Deploying daemon node-exporter.smithi066 on smithi066 2024-09-12T01:35:18.888 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:18 smithi066 ceph-mon[27875]: Deploying cephadm binary to smithi153 2024-09-12T01:35:18.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:18 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:19.865 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:19 smithi066 ceph-mon[27875]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:19.961 INFO:teuthology.orchestra.run.smithi066.stdout:Added host 'smithi153' with addr '172.21.15.153' 2024-09-12T01:35:19.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.960+0000 7f7216ffd640 1 -- 172.21.15.66:0/782614491 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f722810d280 con 0x7f7210039580 2024-09-12T01:35:19.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7210039580 msgr2=0x7f721003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:19.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7210039580 0x7f721003ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f721c006fd0 tx=0x7f721c006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:19.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 msgr2=0x7f722810c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:19.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f722810c6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7218009920 tx=0x7f7218009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:19.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 shutdown_connections 2024-09-12T01:35:19.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7210039580 0x7f721003ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 --2- 172.21.15.66:0/782614491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72280fc1d0 0x7f722810c6d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 >> 172.21.15.66:0/782614491 conn(0x7f72280f79b0 msgr2=0x7f72280f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 shutdown_connections 2024-09-12T01:35:19.963 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:19.962+0000 7f722c8b4640 1 -- 172.21.15.66:0/782614491 wait complete. 2024-09-12T01:35:20.545 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-12T01:35:20.803 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: Deploying daemon alertmanager.smithi066 on smithi066 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: Added host smithi153 2024-09-12T01:35:21.248 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:20 smithi066 ceph-mon[27875]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:23.454 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:23 smithi066 ceph-mon[27875]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:23.454 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:23 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2726235393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 msgr2=0x7f7fb80fb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 --2- 172.21.15.66:0/2726235393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80fb500 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8004850 tx=0x7f7fa8009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2726235393 shutdown_connections 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 --2- 172.21.15.66:0/2726235393 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80fb500 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2726235393 >> 172.21.15.66:0/2726235393 conn(0x7f7fb80f68b0 msgr2=0x7f7fb80f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2726235393 shutdown_connections 2024-09-12T01:35:23.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2726235393 wait complete. 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 Processor -- start 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.454+0000 7f7fbdd21640 1 -- start start 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fbdd21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80f8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fbdd21640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb80f8d60 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80f8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80f8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42256/0 (socket says 172.21.15.66:42256) 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fb77fe640 1 -- 172.21.15.66:0/2042718265 learned_addr learned my addr 172.21.15.66:0/2042718265 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fb77fe640 1 -- 172.21.15.66:0/2042718265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8005040 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fb77fe640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80f8820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802a6d0 tx=0x7f7fa8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa8033630 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7fa8033c30 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb80f6df0 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7fa803dc00 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.455+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb80f7260 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.456+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f7fa8030020 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.456+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb805ed70 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.456+0000 7f7f9ffff640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7fa0039580 0x7f7fa003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.457+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f7fa806cb20 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.457+0000 7f7fb6ffd640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7fa0039580 0x7f7fa003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.457+0000 7f7fb6ffd640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7fa0039580 0x7f7fa003ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7fac006fd0 tx=0x7f7fac006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:23.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.461+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7fa8045800 con 0x7f7fb80fb0f0 2024-09-12T01:35:23.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.672+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fb8065b90 con 0x7f7fa0039580 2024-09-12T01:35:23.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.673+0000 7f7f9ffff640 1 -- 172.21.15.66:0/2042718265 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f7fb8065b90 con 0x7f7fa0039580 2024-09-12T01:35:23.673 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:35:23.673 INFO:teuthology.orchestra.run.smithi066.stdout:[{"addr": "172.21.15.66", "hostname": "smithi066", "labels": [], "status": ""}, {"addr": "172.21.15.153", "hostname": "smithi153", "labels": [], "status": ""}] 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.675+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7fa0039580 msgr2=0x7f7fa003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.675+0000 7f7fbdd21640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7fa0039580 0x7f7fa003ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7fac006fd0 tx=0x7f7fac006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.675+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 msgr2=0x7f7fb80f8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.675+0000 7f7fbdd21640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80f8820 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802a6d0 tx=0x7f7fa8009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.676+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 shutdown_connections 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.676+0000 7f7fbdd21640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7fa0039580 0x7f7fa003ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.676+0000 7f7fbdd21640 1 --2- 172.21.15.66:0/2042718265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fb80fb0f0 0x7f7fb80f8820 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.676+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 >> 172.21.15.66:0/2042718265 conn(0x7f7fb80f68b0 msgr2=0x7f7fb8065480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.676+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 shutdown_connections 2024-09-12T01:35:23.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:23.676+0000 7f7fbdd21640 1 -- 172.21.15.66:0/2042718265 wait complete. 2024-09-12T01:35:24.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:24 smithi066 ceph-mon[27875]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:35:24.708 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-12T01:35:24.708 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-12T01:35:24.958 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:35:25.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:25 smithi066 ceph-mon[27875]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:27 smithi066 ceph-mon[27875]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:29.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 -- 172.21.15.66:0/589044661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 msgr2=0x7ff1e00fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:29.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 --2- 172.21.15.66:0/589044661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e00fc5e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc004850 tx=0x7ff1dc009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:29.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 -- 172.21.15.66:0/589044661 shutdown_connections 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 --2- 172.21.15.66:0/589044661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e00fc5e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 -- 172.21.15.66:0/589044661 >> 172.21.15.66:0/589044661 conn(0x7ff1e00f79b0 msgr2=0x7ff1e00f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 -- 172.21.15.66:0/589044661 shutdown_connections 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 -- 172.21.15.66:0/589044661 wait complete. 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 Processor -- start 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.200+0000 7ff1e7a71640 1 -- start start 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e7a71640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e010c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e7a71640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e010cc10 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e580d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e010c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e580d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e010c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42266/0 (socket says 172.21.15.66:42266) 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e580d640 1 -- 172.21.15.66:0/2756713195 learned_addr learned my addr 172.21.15.66:0/2756713195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e580d640 1 -- 172.21.15.66:0/2756713195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc005040 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.219 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e580d640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e010c6d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc02a6d0 tx=0x7ff1dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1dc033630 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1dc033c30 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e010ce10 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.201+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff1dc03dc00 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.202+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e010d280 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.202+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff1dc030020 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.202+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e005ed70 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.203+0000 7ff1d67fc640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff1cc039580 0x7ff1cc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.203+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff1dc06c8a0 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.203+0000 7ff1e500c640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff1cc039580 0x7ff1cc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.203+0000 7ff1e500c640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff1cc039580 0x7ff1cc03ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0006fd0 tx=0x7ff1d0006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:29.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.207+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff1dc033790 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.395 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:29.395+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff1e004b720 con 0x7ff1e00fc1d0 2024-09-12T01:35:29.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:29 smithi066 ceph-mon[27875]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:30.385 INFO:teuthology.orchestra.run.smithi066.stderr:adjusted tunables profile to default 2024-09-12T01:35:30.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.384+0000 7ff1d67fc640 1 -- 172.21.15.66:0/2756713195 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff1dc045800 con 0x7ff1e00fc1d0 2024-09-12T01:35:30.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff1cc039580 msgr2=0x7ff1cc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:30.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff1cc039580 0x7ff1cc03ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0006fd0 tx=0x7ff1d0006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:30.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 msgr2=0x7ff1e010c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:30.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e010c6d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff1dc02a6d0 tx=0x7ff1dc009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:30.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 shutdown_connections 2024-09-12T01:35:30.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7ff1cc039580 0x7ff1cc03ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:30.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 --2- 172.21.15.66:0/2756713195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1e00fc1d0 0x7ff1e010c6d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:30.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 >> 172.21.15.66:0/2756713195 conn(0x7ff1e00f79b0 msgr2=0x7ff1e00f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:30.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 shutdown_connections 2024-09-12T01:35:30.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:35:30.387+0000 7ff1e7a71640 1 -- 172.21.15.66:0/2756713195 wait complete. 2024-09-12T01:35:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2756713195' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:35:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-12T01:35:30.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:30 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:30.977 INFO:tasks.cephadm:Adding mon.smithi066 on smithi066 2024-09-12T01:35:30.977 INFO:tasks.cephadm:Adding mon.smithi153 on smithi153 2024-09-12T01:35:30.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch apply mon '2;smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153' 2024-09-12T01:35:31.235 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:31.280 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:31.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:31 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-12T01:35:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:31 smithi066 ceph-mon[27875]: Deploying daemon grafana.smithi066 on smithi066 2024-09-12T01:35:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:31 smithi066 ceph-mon[27875]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:31 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2756713195' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:35:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:31 smithi066 ceph-mon[27875]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:35:32.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 -- 172.21.15.153:0/3343960311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 msgr2=0x7f44140fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 --2- 172.21.15.153:0/3343960311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f44140fc5e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4404004850 tx=0x7f4404009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 -- 172.21.15.153:0/3343960311 shutdown_connections 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 --2- 172.21.15.153:0/3343960311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f44140fc5e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 -- 172.21.15.153:0/3343960311 >> 172.21.15.153:0/3343960311 conn(0x7f44140f79b0 msgr2=0x7f44140f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 -- 172.21.15.153:0/3343960311 shutdown_connections 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.827+0000 7f4419a38640 1 -- 172.21.15.153:0/3343960311 wait complete. 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4419a38640 1 Processor -- start 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4419a38640 1 -- start start 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4419a38640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f441410c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4419a38640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441410cc10 con 0x7f44140fc1d0 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f441410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4412ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f441410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:45042/0 (socket says 172.21.15.153:45042) 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4412ffd640 1 -- 172.21.15.153:0/1335915231 learned_addr learned my addr 172.21.15.153:0/1335915231 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.828+0000 7f4412ffd640 1 -- 172.21.15.153:0/1335915231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4404005040 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.829+0000 7f4412ffd640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f441410c6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f440402a6d0 tx=0x7f4404009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.829+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4404033630 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.829+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4404033c30 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.829+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f440403dc00 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.829+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f441410ce10 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.829+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441410d280 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.830+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f441405ed70 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.830+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f4404030020 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.830+0000 7f43fb7fe640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f43fc039580 0x7f43fc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.830+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f440406c920 con 0x7f44140fc1d0 2024-09-12T01:35:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.831+0000 7f44127fc640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f43fc039580 0x7f43fc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.831+0000 7f44127fc640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f43fc039580 0x7f43fc03ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4408006fd0 tx=0x7f4408006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:32.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.837+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4404033790 con 0x7f44140fc1d0 2024-09-12T01:35:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:32.998+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 --> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153", "target": ["mon-mgr", ""]}) v1 -- 0x7f4414106520 con 0x7f43fc039580 2024-09-12T01:35:33.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.004+0000 7f43fb7fe640 1 -- 172.21.15.153:0/1335915231 <== mgr.14160 v2:172.21.15.66:6800/151382692 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4414106520 con 0x7f43fc039580 2024-09-12T01:35:33.006 INFO:teuthology.orchestra.run.smithi153.stdout:Scheduled mon update... 2024-09-12T01:35:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f43fc039580 msgr2=0x7f43fc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f43fc039580 0x7f43fc03ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4408006fd0 tx=0x7f4408006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 msgr2=0x7f441410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f441410c6d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f440402a6d0 tx=0x7f4404009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 shutdown_connections 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f43fc039580 0x7f43fc03ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 --2- 172.21.15.153:0/1335915231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140fc1d0 0x7f441410c6d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 >> 172.21.15.153:0/1335915231 conn(0x7f44140f79b0 msgr2=0x7f44140f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 shutdown_connections 2024-09-12T01:35:33.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:33.006+0000 7f4419a38640 1 -- 172.21.15.153:0/1335915231 wait complete. 2024-09-12T01:35:33.584 DEBUG:teuthology.orchestra.run.smithi153:mon.smithi153> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi153.service 2024-09-12T01:35:33.587 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:33.587 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:33.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:33 smithi066 ceph-mon[27875]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:33.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:33 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:33.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:33 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:33.858 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:33.903 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:34.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:34 smithi066 ceph-mon[27875]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:35:34.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:34 smithi066 ceph-mon[27875]: Saving service mon spec with placement smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153;count:2 2024-09-12T01:35:35.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.159+0000 7f4928291640 1 -- 172.21.15.153:0/1042500691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 msgr2=0x7f49200fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.159+0000 7f4928291640 1 --2- 172.21.15.153:0/1042500691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fede0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f491c004850 tx=0x7f491c009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 -- 172.21.15.153:0/1042500691 shutdown_connections 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 --2- 172.21.15.153:0/1042500691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fede0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 -- 172.21.15.153:0/1042500691 >> 172.21.15.153:0/1042500691 conn(0x7f49200f6890 msgr2=0x7f49200f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 -- 172.21.15.153:0/1042500691 shutdown_connections 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 -- 172.21.15.153:0/1042500691 wait complete. 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 Processor -- start 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 -- start start 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f4928291640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49200fcc50 con 0x7f49200661a0 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f492602d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f492602d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:39882/0 (socket says 172.21.15.153:39882) 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.160+0000 7f492602d640 1 -- 172.21.15.153:0/2003871250 learned_addr learned my addr 172.21.15.153:0/2003871250 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f492602d640 1 -- 172.21.15.153:0/2003871250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c005040 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f492602d640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fc710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f491c02a6d0 tx=0x7f491c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f491c033630 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f491c033c30 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49200face0 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f491c03dc30 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.161+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49200fb150 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.162+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49201025f0 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.162+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f491c030020 con 0x7f49200661a0 2024-09-12T01:35:35.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.162+0000 7f4916ffd640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f490c039580 0x7f490c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.162+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f491c06ca60 con 0x7f49200661a0 2024-09-12T01:35:35.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.163+0000 7f492582c640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f490c039580 0x7f490c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.163+0000 7f492582c640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f490c039580 0x7f490c03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4910006fd0 tx=0x7f4910006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:35.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.168+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f491c045d90 con 0x7f49200661a0 2024-09-12T01:35:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.379+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f492005ed70 con 0x7f49200661a0 2024-09-12T01:35:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.380+0000 7f4916ffd640 1 -- 172.21.15.153:0/2003871250 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f491c045800 con 0x7f49200661a0 2024-09-12T01:35:35.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:35.382 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f490c039580 msgr2=0x7f490c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f490c039580 0x7f490c03ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4910006fd0 tx=0x7f4910006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 msgr2=0x7f49200fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fc710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f491c02a6d0 tx=0x7f491c009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 shutdown_connections 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f490c039580 0x7f490c03ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 --2- 172.21.15.153:0/2003871250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49200661a0 0x7f49200fc710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 >> 172.21.15.153:0/2003871250 conn(0x7f49200f6890 msgr2=0x7f49200f7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 shutdown_connections 2024-09-12T01:35:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:35.382+0000 7f4928291640 1 -- 172.21.15.153:0/2003871250 wait complete. 2024-09-12T01:35:35.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:35 smithi066 ceph-mon[27875]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:35.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:35 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2003871250' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:36.922 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:36.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:37.214 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:37.696 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:37 smithi066 ceph-mon[27875]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:38.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 -- 172.21.15.153:0/2358952960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 msgr2=0x7f65100fac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:38.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 --2- 172.21.15.153:0/2358952960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f65100fac70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6500004940 tx=0x7f650000aeb0 comp rx=0 tx=0).stop 2024-09-12T01:35:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 -- 172.21.15.153:0/2358952960 shutdown_connections 2024-09-12T01:35:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 --2- 172.21.15.153:0/2358952960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f65100fac70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 -- 172.21.15.153:0/2358952960 >> 172.21.15.153:0/2358952960 conn(0x7f65100f6040 msgr2=0x7f65100f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 -- 172.21.15.153:0/2358952960 shutdown_connections 2024-09-12T01:35:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 -- 172.21.15.153:0/2358952960 wait complete. 2024-09-12T01:35:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 Processor -- start 2024-09-12T01:35:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.724+0000 7f6515a10640 1 -- start start 2024-09-12T01:35:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f6515a10640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f651010e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f6515a10640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651010eed0 con 0x7f65100fa860 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f650effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f651010e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f650effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f651010e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:39908/0 (socket says 172.21.15.153:39908) 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f650effd640 1 -- 172.21.15.153:0/2398548892 learned_addr learned my addr 172.21.15.153:0/2398548892 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f650effd640 1 -- 172.21.15.153:0/2398548892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6500005040 con 0x7f65100fa860 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f650effd640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f651010e990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6500033430 tx=0x7f650000aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f650000a8c0 con 0x7f65100fa860 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6500033970 con 0x7f65100fa860 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6500034ad0 con 0x7f65100fa860 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.725+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651010f0d0 con 0x7f65100fa860 2024-09-12T01:35:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.726+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651010fc60 con 0x7f65100fa860 2024-09-12T01:35:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.727+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f6500031020 con 0x7f65100fa860 2024-09-12T01:35:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.727+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65101003f0 con 0x7f65100fa860 2024-09-12T01:35:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.727+0000 7f64f77fe640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f64f8039580 0x7f64f803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.727+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f650006c4e0 con 0x7f65100fa860 2024-09-12T01:35:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.727+0000 7f650e7fc640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f64f8039580 0x7f64f803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:38.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.728+0000 7f650e7fc640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f64f8039580 0x7f64f803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6504006fd0 tx=0x7f6504006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:38.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.731+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6500045340 con 0x7f65100fa860 2024-09-12T01:35:38.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.950+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6510110660 con 0x7f65100fa860 2024-09-12T01:35:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.951+0000 7f64f77fe640 1 -- 172.21.15.153:0/2398548892 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6500045340 con 0x7f65100fa860 2024-09-12T01:35:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:38.951 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:38.951 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f64f8039580 msgr2=0x7f64f803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f64f8039580 0x7f64f803ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6504006fd0 tx=0x7f6504006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 msgr2=0x7f651010e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f651010e990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6500033430 tx=0x7f650000aeb0 comp rx=0 tx=0).stop 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 shutdown_connections 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f64f8039580 0x7f64f803ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 --2- 172.21.15.153:0/2398548892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65100fa860 0x7f651010e990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 >> 172.21.15.153:0/2398548892 conn(0x7f65100f6040 msgr2=0x7f65100f6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 shutdown_connections 2024-09-12T01:35:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:38.953+0000 7f6515a10640 1 -- 172.21.15.153:0/2398548892 wait complete. 2024-09-12T01:35:39.785 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:39 smithi066 ceph-mon[27875]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:39.785 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:39 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2398548892' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:40.550 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:40.550 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:40.792 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:40.838 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:41.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:41 smithi066 ceph-mon[27875]: Deploying daemon prometheus.smithi066 on smithi066 2024-09-12T01:35:42.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- 172.21.15.153:0/1198524463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 msgr2=0x7f10d00fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:42.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 --2- 172.21.15.153:0/1198524463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d00fc5c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10c0004850 tx=0x7f10c0009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:42.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- 172.21.15.153:0/1198524463 shutdown_connections 2024-09-12T01:35:42.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 --2- 172.21.15.153:0/1198524463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d00fc5c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:42.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- 172.21.15.153:0/1198524463 >> 172.21.15.153:0/1198524463 conn(0x7f10d00f7990 msgr2=0x7f10d00f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:42.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- 172.21.15.153:0/1198524463 shutdown_connections 2024-09-12T01:35:42.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- 172.21.15.153:0/1198524463 wait complete. 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 Processor -- start 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- start start 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d0071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.094+0000 7f10d66b9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00719d0 con 0x7f10d00fc1b0 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d0071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d0071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:39926/0 (socket says 172.21.15.153:39926) 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cffff640 1 -- 172.21.15.153:0/1100657396 learned_addr learned my addr 172.21.15.153:0/1100657396 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:42.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cffff640 1 -- 172.21.15.153:0/1100657396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0005040 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cffff640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d0071490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009920 tx=0x7f10c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10c0033630 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f10c0033c30 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d006fa60 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10c003dc40 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.095+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d006fed0 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.096+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f10c0030020 con 0x7f10d00fc1b0 2024-09-12T01:35:42.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.096+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d01025d0 con 0x7f10d00fc1b0 2024-09-12T01:35:42.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.096+0000 7f10cd7fa640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f10bc039580 0x7f10bc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:42.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.097+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f10c006cb00 con 0x7f10d00fc1b0 2024-09-12T01:35:42.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.097+0000 7f10c7fff640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f10bc039580 0x7f10bc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:42.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.097+0000 7f10c7fff640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f10bc039580 0x7f10bc03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10b8006fd0 tx=0x7f10b8006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:42.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.101+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f10c006ee60 con 0x7f10d00fc1b0 2024-09-12T01:35:42.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.321+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f10d005ed70 con 0x7f10d00fc1b0 2024-09-12T01:35:42.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.321+0000 7f10cd7fa640 1 -- 172.21.15.153:0/1100657396 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f10c003b930 con 0x7f10d00fc1b0 2024-09-12T01:35:42.322 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:42.322 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f10bc039580 msgr2=0x7f10bc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f10bc039580 0x7f10bc03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10b8006fd0 tx=0x7f10b8006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 msgr2=0x7f10d0071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d0071490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009920 tx=0x7f10c0009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 shutdown_connections 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f10bc039580 0x7f10bc03ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 --2- 172.21.15.153:0/1100657396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10d00fc1b0 0x7f10d0071490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 >> 172.21.15.153:0/1100657396 conn(0x7f10d00f7990 msgr2=0x7f10d00f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 shutdown_connections 2024-09-12T01:35:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:42.324+0000 7f10d66b9640 1 -- 172.21.15.153:0/1100657396 wait complete. 2024-09-12T01:35:42.888 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:42 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1100657396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:43.888 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:43 smithi066 ceph-mon[27875]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:43.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:43 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:44.004 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:44.005 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:44.261 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:44.317 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 -- 172.21.15.153:0/1911594904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 msgr2=0x7f75680fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 --2- 172.21.15.153:0/1911594904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f75680fdc20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7558009bd0 tx=0x7f7558004d10 comp rx=0 tx=0).stop 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 -- 172.21.15.153:0/1911594904 shutdown_connections 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 --2- 172.21.15.153:0/1911594904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f75680fdc20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 -- 172.21.15.153:0/1911594904 >> 172.21.15.153:0/1911594904 conn(0x7f75680f6010 msgr2=0x7f75680f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 -- 172.21.15.153:0/1911594904 shutdown_connections 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.639+0000 7f756dcfe640 1 -- 172.21.15.153:0/1911594904 wait complete. 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f756dcfe640 1 Processor -- start 2024-09-12T01:35:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f756dcfe640 1 -- start start 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f756dcfe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f756810c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f756dcfe640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756810cc70 con 0x7f75680fd810 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f75677fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f756810c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f75677fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f756810c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:52820/0 (socket says 172.21.15.153:52820) 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f75677fe640 1 -- 172.21.15.153:0/1843952738 learned_addr learned my addr 172.21.15.153:0/1843952738 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.640+0000 7f75677fe640 1 -- 172.21.15.153:0/1843952738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580098b0 con 0x7f75680fd810 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.641+0000 7f75677fe640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f756810c730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7558009ba0 tx=0x7f7558004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.641+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7558032910 con 0x7f75680fd810 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.641+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756810ce70 con 0x7f75680fd810 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.641+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f755803d420 con 0x7f75680fd810 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.641+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756810da00 con 0x7f75680fd810 2024-09-12T01:35:45.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.641+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7558046560 con 0x7f75680fd810 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.642+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75681025f0 con 0x7f75680fd810 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.642+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f755802f030 con 0x7f75680fd810 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.642+0000 7f755ffff640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7554039580 0x7f755403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.642+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f755806d850 con 0x7f75680fd810 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.642+0000 7f7566ffd640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7554039580 0x7f755403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.643+0000 7f7566ffd640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7554039580 0x7f755403ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7550006fd0 tx=0x7f7550006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:45.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.647+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f755804eb30 con 0x7f75680fd810 2024-09-12T01:35:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.861+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f756810e350 con 0x7f75680fd810 2024-09-12T01:35:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.861+0000 7f755ffff640 1 -- 172.21.15.153:0/1843952738 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7558041020 con 0x7f75680fd810 2024-09-12T01:35:45.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:45.862 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7554039580 msgr2=0x7f755403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7554039580 0x7f755403ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7550006fd0 tx=0x7f7550006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 msgr2=0x7f756810c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f756810c730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7558009ba0 tx=0x7f7558004d10 comp rx=0 tx=0).stop 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 shutdown_connections 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f7554039580 0x7f755403ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 --2- 172.21.15.153:0/1843952738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75680fd810 0x7f756810c730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 >> 172.21.15.153:0/1843952738 conn(0x7f75680f6010 msgr2=0x7f75680f68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 shutdown_connections 2024-09-12T01:35:45.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:45.863+0000 7f756dcfe640 1 -- 172.21.15.153:0/1843952738 wait complete. 2024-09-12T01:35:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:45 smithi066 ceph-mon[27875]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:46.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:46 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1843952738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:47.509 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:47.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:47.752 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:47.797 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:47.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:47 smithi066 ceph-mon[27875]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:49.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.267+0000 7f66078c6640 1 -- 172.21.15.153:0/2319402115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 msgr2=0x7f66000fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.267+0000 7f66078c6640 1 --2- 172.21.15.153:0/2319402115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f66000fc5c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65f0009bd0 tx=0x7f65f0004d10 comp rx=0 tx=0).stop 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.267+0000 7f66078c6640 1 -- 172.21.15.153:0/2319402115 shutdown_connections 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.267+0000 7f66078c6640 1 --2- 172.21.15.153:0/2319402115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f66000fc5c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.267+0000 7f66078c6640 1 -- 172.21.15.153:0/2319402115 >> 172.21.15.153:0/2319402115 conn(0x7f66000f7990 msgr2=0x7f66000f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f66078c6640 1 -- 172.21.15.153:0/2319402115 shutdown_connections 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f66078c6640 1 -- 172.21.15.153:0/2319402115 wait complete. 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f66078c6640 1 Processor -- start 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f66078c6640 1 -- start start 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f66078c6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f660010c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f66078c6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660010cc30 con 0x7f66000fc1b0 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.268+0000 7f6605662640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f660010c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f6605662640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f660010c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:52830/0 (socket says 172.21.15.153:52830) 2024-09-12T01:35:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f6605662640 1 -- 172.21.15.153:0/2442978566 learned_addr learned my addr 172.21.15.153:0/2442978566 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:49.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f6605662640 1 -- 172.21.15.153:0/2442978566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00098b0 con 0x7f66000fc1b0 2024-09-12T01:35:49.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f6605662640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f660010c6f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65f0003400 tx=0x7f65f0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65f0032910 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660010ce30 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65f003d420 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.269+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65f0031590 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.270+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660010d9c0 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.270+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660010d300 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.271+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f65f002f030 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.271+0000 7f65fdffb640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f65e8039580 0x7f65e803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.271+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f65f006d6e0 con 0x7f66000fc1b0 2024-09-12T01:35:49.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.271+0000 7f6604e61640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f65e8039580 0x7f65e803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:49.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.272+0000 7f6604e61640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f65e8039580 0x7f65e803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f65f4006fd0 tx=0x7f65f4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:49.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.276+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f660010d300 con 0x7f66000fc1b0 2024-09-12T01:35:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.495+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f66001025d0 con 0x7f66000fc1b0 2024-09-12T01:35:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.496+0000 7f65fdffb640 1 -- 172.21.15.153:0/2442978566 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f65f004e530 con 0x7f66000fc1b0 2024-09-12T01:35:49.497 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:49.497 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:49.497 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f65e8039580 msgr2=0x7f65e803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f65e8039580 0x7f65e803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f65f4006fd0 tx=0x7f65f4006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 msgr2=0x7f660010c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f660010c6f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65f0003400 tx=0x7f65f0004d10 comp rx=0 tx=0).stop 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 shutdown_connections 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f65e8039580 0x7f65e803ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 --2- 172.21.15.153:0/2442978566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66000fc1b0 0x7f660010c6f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 >> 172.21.15.153:0/2442978566 conn(0x7f66000f7990 msgr2=0x7f66000f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 shutdown_connections 2024-09-12T01:35:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:49.498+0000 7f66078c6640 1 -- 172.21.15.153:0/2442978566 wait complete. 2024-09-12T01:35:49.861 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:49 smithi066 ceph-mon[27875]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:49.861 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:49 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2442978566' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:51.097 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:51.097 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:51.385 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:51.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:51 smithi066 ceph-mon[27875]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:52.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 -- 172.21.15.153:0/2990120891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 msgr2=0x7f73e00fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 --2- 172.21.15.153:0/2990120891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e00fc5e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f73d0004850 tx=0x7f73d0009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 -- 172.21.15.153:0/2990120891 shutdown_connections 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 --2- 172.21.15.153:0/2990120891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e00fc5e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 -- 172.21.15.153:0/2990120891 >> 172.21.15.153:0/2990120891 conn(0x7f73e00f79b0 msgr2=0x7f73e00f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 -- 172.21.15.153:0/2990120891 shutdown_connections 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 -- 172.21.15.153:0/2990120891 wait complete. 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.893+0000 7f73e60fc640 1 Processor -- start 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73e60fc640 1 -- start start 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73e60fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e0071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73e60fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e00719d0 con 0x7f73e00fc1d0 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73df7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e0071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73df7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e0071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:52850/0 (socket says 172.21.15.153:52850) 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73df7fe640 1 -- 172.21.15.153:0/1958666154 learned_addr learned my addr 172.21.15.153:0/1958666154 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.894+0000 7f73df7fe640 1 -- 172.21.15.153:0/1958666154 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0005040 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.895+0000 7f73df7fe640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e0071490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73d002a6d0 tx=0x7f73d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.895+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73d0033630 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.895+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f73d0033c30 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.895+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73d003dc00 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.895+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e006fa60 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.895+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e006fed0 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.896+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e01025f0 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.896+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f73d0030020 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.896+0000 7f73c7fff640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f73c80395d0 0x7f73c803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.896+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f73d006cad0 con 0x7f73e00fc1d0 2024-09-12T01:35:52.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.897+0000 7f73deffd640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f73c80395d0 0x7f73c803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.897+0000 7f73deffd640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f73c80395d0 0x7f73c803ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006fd0 tx=0x7f73d4006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:52.901+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f73d0045800 con 0x7f73e00fc1d0 2024-09-12T01:35:53.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.116+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f73e005ed70 con 0x7f73e00fc1d0 2024-09-12T01:35:53.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.117+0000 7f73c7fff640 1 -- 172.21.15.153:0/1958666154 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f73d0042210 con 0x7f73e00fc1d0 2024-09-12T01:35:53.117 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:53.117 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:53.117 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f73c80395d0 msgr2=0x7f73c803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f73c80395d0 0x7f73c803ba80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006fd0 tx=0x7f73d4006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 msgr2=0x7f73e0071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e0071490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f73d002a6d0 tx=0x7f73d0009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 shutdown_connections 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f73c80395d0 0x7f73c803ba80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 --2- 172.21.15.153:0/1958666154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73e00fc1d0 0x7f73e0071490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 >> 172.21.15.153:0/1958666154 conn(0x7f73e00f79b0 msgr2=0x7f73e00f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 shutdown_connections 2024-09-12T01:35:53.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:53.119+0000 7f73e60fc640 1 -- 172.21.15.153:0/1958666154 wait complete. 2024-09-12T01:35:53.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:53 smithi066 ceph-mon[27875]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:53.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:53 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1958666154' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:54.692 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:54.693 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:54.937 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:54.989 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:55.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:55 smithi066 ceph-mon[27875]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:56.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/4194872627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 msgr2=0x7fcf740fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 --2- 172.21.15.153:0/4194872627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf740fc5e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf64004850 tx=0x7fcf64009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/4194872627 shutdown_connections 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 --2- 172.21.15.153:0/4194872627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf740fc5e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/4194872627 >> 172.21.15.153:0/4194872627 conn(0x7fcf740f79b0 msgr2=0x7fcf740f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/4194872627 shutdown_connections 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/4194872627 wait complete. 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 Processor -- start 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.344+0000 7fcf7a8ae640 1 -- start start 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf7a8ae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf7410c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf7a8ae640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7410cc10 con 0x7fcf740fc1d0 2024-09-12T01:35:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf7410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf73fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf7410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:44140/0 (socket says 172.21.15.153:44140) 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf73fff640 1 -- 172.21.15.153:0/2983954587 learned_addr learned my addr 172.21.15.153:0/2983954587 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf73fff640 1 -- 172.21.15.153:0/2983954587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64005040 con 0x7fcf740fc1d0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.345+0000 7fcf73fff640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf7410c6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402a6d0 tx=0x7fcf64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.346+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf64033630 con 0x7fcf740fc1d0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.346+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7410ce10 con 0x7fcf740fc1d0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.346+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf64033c30 con 0x7fcf740fc1d0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.346+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf6403dc00 con 0x7fcf740fc1d0 2024-09-12T01:35:56.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.346+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7410d280 con 0x7fcf740fc1d0 2024-09-12T01:35:56.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.347+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fcf64030020 con 0x7fcf740fc1d0 2024-09-12T01:35:56.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.347+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7405ed70 con 0x7fcf740fc1d0 2024-09-12T01:35:56.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.347+0000 7fcf70ff9640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fcf5c0395d0 0x7fcf5c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.347+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcf6406c870 con 0x7fcf740fc1d0 2024-09-12T01:35:56.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.347+0000 7fcf737fe640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fcf5c0395d0 0x7fcf5c03ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.348+0000 7fcf737fe640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fcf5c0395d0 0x7fcf5c03ba80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf68006fd0 tx=0x7fcf68006db0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.352+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcf64033790 con 0x7fcf740fc1d0 2024-09-12T01:35:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.564+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcf7404b720 con 0x7fcf740fc1d0 2024-09-12T01:35:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.564+0000 7fcf70ff9640 1 -- 172.21.15.153:0/2983954587 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fcf64042210 con 0x7fcf740fc1d0 2024-09-12T01:35:56.564 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:35:56.564 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:35:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fcf5c0395d0 msgr2=0x7fcf5c03ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fcf5c0395d0 0x7fcf5c03ba80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcf68006fd0 tx=0x7fcf68006db0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 msgr2=0x7fcf7410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf7410c6d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcf6402a6d0 tx=0x7fcf64009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 shutdown_connections 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7fcf5c0395d0 0x7fcf5c03ba80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 --2- 172.21.15.153:0/2983954587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf740fc1d0 0x7fcf7410c6d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 >> 172.21.15.153:0/2983954587 conn(0x7fcf740f79b0 msgr2=0x7fcf740f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.566+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 shutdown_connections 2024-09-12T01:35:56.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:56.567+0000 7fcf7a8ae640 1 -- 172.21.15.153:0/2983954587 wait complete. 2024-09-12T01:35:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:56 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2983954587' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:35:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:57 smithi066 ceph-mon[27875]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:35:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:57 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:57 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:57 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:35:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:57 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-12T01:35:58.137 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:35:58.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:35:58.389 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:58.434 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:35:59.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:59 smithi066 ceph-mon[27875]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-12T01:35:59.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:35:59 smithi066 ceph-mon[27875]: mgrmap e14: smithi066.qdwcrh(active, since 59s) 2024-09-12T01:35:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/339739075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 msgr2=0x7f8f440fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 --2- 172.21.15.153:0/339739075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f440fc5c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8f38004850 tx=0x7f8f38009da0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/339739075 shutdown_connections 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 --2- 172.21.15.153:0/339739075 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f440fc5c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/339739075 >> 172.21.15.153:0/339739075 conn(0x7f8f440f7990 msgr2=0x7f8f440f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/339739075 shutdown_connections 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.866+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/339739075 wait complete. 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f4b4ed640 1 Processor -- start 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f4b4ed640 1 -- start start 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f4b4ed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f4410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f4b4ed640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4410cc30 con 0x7f8f440fc1b0 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f49289640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f4410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f49289640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f4410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:44160/0 (socket says 172.21.15.153:44160) 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f49289640 1 -- 172.21.15.153:0/965489213 learned_addr learned my addr 172.21.15.153:0/965489213 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:35:59.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.867+0000 7f8f49289640 1 -- 172.21.15.153:0/965489213 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38005040 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.868+0000 7f8f49289640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f4410c6f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f3802a6d0 tx=0x7f8f38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.868+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f38033630 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.868+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f38033c30 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.868+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4410ce30 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.868+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8f3803dc00 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.868+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4410d2a0 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.869+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7f8f38030020 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.869+0000 7f8f35ffb640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 0x7f8f3003ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.869+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8f3806ca00 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.869+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f441025d0 con 0x7f8f440fc1b0 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.869+0000 7f8f48a88640 1 -- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 msgr2=0x7f8f3003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/151382692 2024-09-12T01:35:59.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.869+0000 7f8f48a88640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 0x7f8f3003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:59.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:35:59.874+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8f3803bb50 con 0x7f8f440fc1b0 2024-09-12T01:36:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.070+0000 7f8f48a88640 1 -- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 msgr2=0x7f8f3003ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.66:6800/151382692 2024-09-12T01:36:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.070+0000 7f8f48a88640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 0x7f8f3003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:36:00.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.087+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8f4404b720 con 0x7f8f440fc1b0 2024-09-12T01:36:00.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.088+0000 7f8f35ffb640 1 -- 172.21.15.153:0/965489213 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8f3803b370 con 0x7f8f440fc1b0 2024-09-12T01:36:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:36:00.088 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:36:00.088 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 msgr2=0x7f8f3003ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 0x7f8f3003ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 msgr2=0x7f8f4410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f4410c6f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f3802a6d0 tx=0x7f8f38009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 shutdown_connections 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:6800/151382692,v1:172.21.15.66:6801/151382692] conn(0x7f8f300395d0 0x7f8f3003ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 --2- 172.21.15.153:0/965489213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f440fc1b0 0x7f8f4410c6f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 >> 172.21.15.153:0/965489213 conn(0x7f8f440f7990 msgr2=0x7f8f440f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 shutdown_connections 2024-09-12T01:36:00.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:00.090+0000 7f8f4b4ed640 1 -- 172.21.15.153:0/965489213 wait complete. 2024-09-12T01:36:00.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:00 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/965489213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:01.691 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:36:01.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:36:01.936 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:36:01.981 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:36:03.122 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: Active manager daemon smithi066.qdwcrh restarted 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: osdmap e5: 0 total, 0 up, 0 in 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: mgrmap e15: smithi066.qdwcrh(active, starting, since 0.00336885s) 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:03.123 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 -- 172.21.15.153:0/1326214256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 msgr2=0x7ff5780fdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 --2- 172.21.15.153:0/1326214256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff5780fdc20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff574004850 tx=0x7ff574009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 -- 172.21.15.153:0/1326214256 shutdown_connections 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 --2- 172.21.15.153:0/1326214256 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff5780fdc20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 -- 172.21.15.153:0/1326214256 >> 172.21.15.153:0/1326214256 conn(0x7ff5780f6010 msgr2=0x7ff5780f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 -- 172.21.15.153:0/1326214256 shutdown_connections 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.405+0000 7ff57f949640 1 -- 172.21.15.153:0/1326214256 wait complete. 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57f949640 1 Processor -- start 2024-09-12T01:36:03.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57f949640 1 -- start start 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57f949640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff57810e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57f949640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57810ee80 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57d6e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff57810e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57d6e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff57810e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:33106/0 (socket says 172.21.15.153:33106) 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57d6e5640 1 -- 172.21.15.153:0/4016753161 learned_addr learned my addr 172.21.15.153:0/4016753161 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.406+0000 7ff57d6e5640 1 -- 172.21.15.153:0/4016753161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574005040 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.407+0000 7ff57d6e5640 1 --2- 172.21.15.153:0/4016753161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff57810e940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff57402a6d0 tx=0x7ff574009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.407+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff574033630 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.407+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57810f080 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.407+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff574033c30 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.407+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff57403dc30 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.407+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57810f4f0 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.408+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 15) v1 ==== 45301+0+0 (secure 0 0 0) 0x7ff574030020 con 0x7ff5780fd810 2024-09-12T01:36:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.408+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57805ed70 con 0x7ff5780fd810 2024-09-12T01:36:03.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.408+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7ff57406c5a0 con 0x7ff5780fd810 2024-09-12T01:36:03.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.413+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff57403bb50 con 0x7ff5780fd810 2024-09-12T01:36:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.638+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff57804b720 con 0x7ff5780fd810 2024-09-12T01:36:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.639+0000 7ff56dffb640 1 -- 172.21.15.153:0/4016753161 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff574042210 con 0x7ff5780fd810 2024-09-12T01:36:03.639 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:36:03.639 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:36:03.639 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:36:03.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 msgr2=0x7ff57810e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:03.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 --2- 172.21.15.153:0/4016753161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff57810e940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff57402a6d0 tx=0x7ff574009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 shutdown_connections 2024-09-12T01:36:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 --2- 172.21.15.153:0/4016753161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5780fd810 0x7ff57810e940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 >> 172.21.15.153:0/4016753161 conn(0x7ff5780f6010 msgr2=0x7ff5780f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 shutdown_connections 2024-09-12T01:36:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:03.641+0000 7ff57f949640 1 -- 172.21.15.153:0/4016753161 wait complete. 2024-09-12T01:36:04.113 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:36:04.113 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:36:04.113 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:04.114 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:03 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/4016753161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:04.114 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:03 smithi066 ceph-mon[27875]: mgrmap e16: smithi066.qdwcrh(active, since 1.00545s) 2024-09-12T01:36:05.204 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:36:05.204 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:36:05.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:36:06.153 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-12T01:36:06.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:06 smithi066 ceph-mon[27875]: [12/Sep/2024:01:36:04] ENGINE Bus STARTING 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:06 smithi066 ceph-mon[27875]: [12/Sep/2024:01:36:05] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:06 smithi066 ceph-mon[27875]: [12/Sep/2024:01:36:05] ENGINE Bus STARTED 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:06 smithi066 ceph-mon[27875]: [12/Sep/2024:01:36:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Traceback (most recent call last): 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._run(expiration_interval) 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:36:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s = self.context.wrap_socket( 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: return self.sslsocket_class._create( 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self.do_handshake() 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._sslobj.do_handshake() 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:36:06.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:06 smithi066 ceph-mon[27875]: mgrmap e17: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:36:08.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.893+0000 7fe6193a6640 1 -- 172.21.15.153:0/270407025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 msgr2=0x7fe6141025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.893+0000 7fe6193a6640 1 --2- 172.21.15.153:0/270407025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141025b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe604004850 tx=0x7fe604009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 -- 172.21.15.153:0/270407025 shutdown_connections 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 --2- 172.21.15.153:0/270407025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141025b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 -- 172.21.15.153:0/270407025 >> 172.21.15.153:0/270407025 conn(0x7fe6140710b0 msgr2=0x7fe6140714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 -- 172.21.15.153:0/270407025 shutdown_connections 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 -- 172.21.15.153:0/270407025 wait complete. 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 Processor -- start 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.894+0000 7fe6193a6640 1 -- start start 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.895+0000 7fe6193a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141149b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.895+0000 7fe6193a6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614114ef0 con 0x7fe6141021e0 2024-09-12T01:36:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.895+0000 7fe612ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141149b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.895+0000 7fe612ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141149b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:33128/0 (socket says 172.21.15.153:33128) 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.895+0000 7fe612ffd640 1 -- 172.21.15.153:0/1011247469 learned_addr learned my addr 172.21.15.153:0/1011247469 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe612ffd640 1 -- 172.21.15.153:0/1011247469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604005040 con 0x7fe6141021e0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe612ffd640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141149b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe60402a6d0 tx=0x7fe604009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe60402cf10 con 0x7fe6141021e0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6141150f0 con 0x7fe6141021e0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6141155c0 con 0x7fe6141021e0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe604033ad0 con 0x7fe6141021e0 2024-09-12T01:36:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.896+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe60403ebb0 con 0x7fe6141021e0 2024-09-12T01:36:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.897+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fe604030020 con 0x7fe6141021e0 2024-09-12T01:36:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.897+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6140fd950 con 0x7fe6141021e0 2024-09-12T01:36:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.898+0000 7fe5fb7fe640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe5fc0396c0 0x7fe5fc03bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.898+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fe60406d570 con 0x7fe6141021e0 2024-09-12T01:36:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.898+0000 7fe6127fc640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe5fc0396c0 0x7fe5fc03bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.898+0000 7fe6127fc640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe5fc0396c0 0x7fe5fc03bb70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe608006fd0 tx=0x7fe608006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:08.902+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe60403c930 con 0x7fe6141021e0 2024-09-12T01:36:09.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.140+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe6141155c0 con 0x7fe6141021e0 2024-09-12T01:36:09.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.140+0000 7fe5fb7fe640 1 -- 172.21.15.153:0/1011247469 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fe6141155c0 con 0x7fe6141021e0 2024-09-12T01:36:09.140 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:36:09.140 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:36:09.141 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:36:09.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe5fc0396c0 msgr2=0x7fe5fc03bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe5fc0396c0 0x7fe5fc03bb70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe608006fd0 tx=0x7fe608006db0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 msgr2=0x7fe6141149b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141149b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe60402a6d0 tx=0x7fe604009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 shutdown_connections 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe5fc0396c0 0x7fe5fc03bb70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 --2- 172.21.15.153:0/1011247469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6141021e0 0x7fe6141149b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.142+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 >> 172.21.15.153:0/1011247469 conn(0x7fe6140710b0 msgr2=0x7fe6140f9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.143+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 shutdown_connections 2024-09-12T01:36:09.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:09.143+0000 7fe6193a6640 1 -- 172.21.15.153:0/1011247469 wait complete. 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:36:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-12T01:36:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:09 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1011247469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:10.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:10 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:36:10.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:10 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:36:10.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:10 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:36:10.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:10 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:36:10.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:10 smithi066 ceph-mon[27875]: Deploying daemon crash.smithi153 on smithi153 2024-09-12T01:36:11.483 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:36:11.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:36:11.749 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:12 smithi066 ceph-mon[27875]: Deploying daemon node-exporter.smithi153 on smithi153 2024-09-12T01:36:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 -- 172.21.15.153:0/3635171982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 msgr2=0x7f3c64102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 --2- 172.21.15.153:0/3635171982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c64102630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3c60004850 tx=0x7f3c60009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 -- 172.21.15.153:0/3635171982 shutdown_connections 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 --2- 172.21.15.153:0/3635171982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c64102630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 -- 172.21.15.153:0/3635171982 >> 172.21.15.153:0/3635171982 conn(0x7f3c64071790 msgr2=0x7f3c64071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 -- 172.21.15.153:0/3635171982 shutdown_connections 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.124+0000 7f3c6b50c640 1 -- 172.21.15.153:0/3635171982 wait complete. 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c6b50c640 1 Processor -- start 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c6b50c640 1 -- start start 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c6b50c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c640fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c6b50c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640fbf70 con 0x7f3c64102260 2024-09-12T01:36:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c692a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c640fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c692a8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c640fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:33138/0 (socket says 172.21.15.153:33138) 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.125+0000 7f3c692a8640 1 -- 172.21.15.153:0/343244338 learned_addr learned my addr 172.21.15.153:0/343244338 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c692a8640 1 -- 172.21.15.153:0/343244338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60005040 con 0x7f3c64102260 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c692a8640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c640fba30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c600048b0 tx=0x7f3c60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c60033700 con 0x7f3c64102260 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c60033d00 con 0x7f3c64102260 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c640fc170 con 0x7f3c64102260 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3c6003dd50 con 0x7f3c64102260 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.126+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c640fc560 con 0x7f3c64102260 2024-09-12T01:36:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.127+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6405ed70 con 0x7f3c64102260 2024-09-12T01:36:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.127+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f3c60030020 con 0x7f3c64102260 2024-09-12T01:36:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.127+0000 7f3c59ffb640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c50039670 0x7f3c5003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.128+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3c6006cc40 con 0x7f3c64102260 2024-09-12T01:36:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.128+0000 7f3c68aa7640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c50039670 0x7f3c5003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.128+0000 7f3c68aa7640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c50039670 0x7f3c5003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006fd0 tx=0x7f3c54006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.132+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c6003b580 con 0x7f3c64102260 2024-09-12T01:36:13.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.356+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3c64106460 con 0x7f3c64102260 2024-09-12T01:36:13.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.356+0000 7f3c59ffb640 1 -- 172.21.15.153:0/343244338 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3c60045b40 con 0x7f3c64102260 2024-09-12T01:36:13.356 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:36:13.357 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:36:13.357 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:36:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c50039670 msgr2=0x7f3c5003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c50039670 0x7f3c5003bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3c54006fd0 tx=0x7f3c54006db0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 msgr2=0x7f3c640fba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c640fba30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c600048b0 tx=0x7f3c60009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 shutdown_connections 2024-09-12T01:36:13.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c50039670 0x7f3c5003bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 --2- 172.21.15.153:0/343244338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c64102260 0x7f3c640fba30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 >> 172.21.15.153:0/343244338 conn(0x7f3c64071790 msgr2=0x7f3c64102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 shutdown_connections 2024-09-12T01:36:13.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:13.358+0000 7f3c6b50c640 1 -- 172.21.15.153:0/343244338 wait complete. 2024-09-12T01:36:14.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:13 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:14.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:13 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/343244338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:15.069 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:36:15.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:36:15.542 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:17 smithi066 ceph-mon[27875]: Deploying daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:36:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 -- 172.21.15.153:0/3797668856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 msgr2=0x7fde381014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 --2- 172.21.15.153:0/3797668856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde381014b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde28004850 tx=0x7fde28009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 -- 172.21.15.153:0/3797668856 shutdown_connections 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 --2- 172.21.15.153:0/3797668856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde381014b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 -- 172.21.15.153:0/3797668856 >> 172.21.15.153:0/3797668856 conn(0x7fde380710b0 msgr2=0x7fde380714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 -- 172.21.15.153:0/3797668856 shutdown_connections 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.566+0000 7fde3d841640 1 -- 172.21.15.153:0/3797668856 wait complete. 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde3d841640 1 Processor -- start 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde3d841640 1 -- start start 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde3d841640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde38111700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde3d841640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde38111c40 con 0x7fde381010e0 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde36ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde38111700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde36ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde38111700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:35884/0 (socket says 172.21.15.153:35884) 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.567+0000 7fde36ffd640 1 -- 172.21.15.153:0/416275562 learned_addr learned my addr 172.21.15.153:0/416275562 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:36:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde36ffd640 1 -- 172.21.15.153:0/416275562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde28005040 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde36ffd640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde38111700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde28004820 tx=0x7fde28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde28009440 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde28033420 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fde280455b0 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde38111e40 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.568+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde38112230 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.569+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7fde28030020 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.569+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde380fc850 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.569+0000 7fde1f7fe640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fde200396c0 0x7fde2003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.570+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fde28075220 con 0x7fde381010e0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.570+0000 7fde367fc640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fde200396c0 0x7fde2003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.570+0000 7fde367fc640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fde200396c0 0x7fde2003bb70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde2c006fd0 tx=0x7fde2c006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.574+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fde2804f4e0 con 0x7fde381010e0 2024-09-12T01:36:18.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.799+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde3810cd60 con 0x7fde381010e0 2024-09-12T01:36:18.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.800+0000 7fde1f7fe640 1 -- 172.21.15.153:0/416275562 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fde2804ce60 con 0x7fde381010e0 2024-09-12T01:36:18.799 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:36:18.799 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":1,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:33:57.049610Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-12T01:36:18.800 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 1 2024-09-12T01:36:18.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fde200396c0 msgr2=0x7fde2003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fde200396c0 0x7fde2003bb70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde2c006fd0 tx=0x7fde2c006db0 comp rx=0 tx=0).stop 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 msgr2=0x7fde38111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde38111700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fde28004820 tx=0x7fde28009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 shutdown_connections 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fde200396c0 0x7fde2003bb70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 --2- 172.21.15.153:0/416275562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde381010e0 0x7fde38111700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 >> 172.21.15.153:0/416275562 conn(0x7fde380710b0 msgr2=0x7fde38102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 shutdown_connections 2024-09-12T01:36:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:18.802+0000 7fde3d841640 1 -- 172.21.15.153:0/416275562 wait complete. 2024-09-12T01:36:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:19 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/416275562' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:20.507 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-12T01:36:20.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-12T01:36:20.995 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:20 smithi066 ceph-mon[27875]: Deploying daemon mon.smithi153 on smithi153 2024-09-12T01:36:23.346 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:23 smithi153 systemd[1]: Starting Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:36:24.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:23 smithi066 ceph-mon[27875]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.211 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:23 smithi153 podman[34674]: 2024-09-12 01:36:23.841615297 +0000 UTC m=+0.017613878 image pull d4c538e492e40a3210996318bb500d6155038e4eb0fa53a9db8f9cbd9ac4e11b quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1 2024-09-12T01:36:24.211 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:23 smithi153 podman[34674]: 2024-09-12 01:36:23.941876968 +0000 UTC m=+0.117875548 container create ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=quincy-554ba93, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-12T01:36:24.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 -- 172.21.15.153:0/2378642713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 msgr2=0x7f179c102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 --2- 172.21.15.153:0/2378642713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c102490 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f178c004850 tx=0x7f178c009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 -- 172.21.15.153:0/2378642713 shutdown_connections 2024-09-12T01:36:24.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 --2- 172.21.15.153:0/2378642713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c102490 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 -- 172.21.15.153:0/2378642713 >> 172.21.15.153:0/2378642713 conn(0x7f179c0f62b0 msgr2=0x7f179c0f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:24.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 -- 172.21.15.153:0/2378642713 shutdown_connections 2024-09-12T01:36:24.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.215+0000 7f17a1200640 1 -- 172.21.15.153:0/2378642713 wait complete. 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.216+0000 7f17a1200640 1 Processor -- start 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.216+0000 7f17a1200640 1 -- start start 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.216+0000 7f17a1200640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c112670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.216+0000 7f17a1200640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c112bb0 con 0x7f179c1020c0 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.217+0000 7f179ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c112670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.217+0000 7f179ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c112670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.153:55286/0 (socket says 172.21.15.153:55286) 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.217+0000 7f179ad9d640 1 -- 172.21.15.153:0/2071802975 learned_addr learned my addr 172.21.15.153:0/2071802975 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.217+0000 7f179ad9d640 1 -- 172.21.15.153:0/2071802975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c005040 con 0x7f179c1020c0 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.217+0000 7f179ad9d640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c112670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f178c004820 tx=0x7f178c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.217+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f178c033700 con 0x7f179c1020c0 2024-09-12T01:36:24.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.218+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f178c033d00 con 0x7f179c1020c0 2024-09-12T01:36:24.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.218+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c112db0 con 0x7f179c1020c0 2024-09-12T01:36:24.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.218+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f178c03ed20 con 0x7f179c1020c0 2024-09-12T01:36:24.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.218+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c113200 con 0x7f179c1020c0 2024-09-12T01:36:24.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.219+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f178c030020 con 0x7f179c1020c0 2024-09-12T01:36:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.219+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c0fd8a0 con 0x7f179c1020c0 2024-09-12T01:36:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.219+0000 7f17837fe640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1784039670 0x7f178403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.219+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f178c06c830 con 0x7f179c1020c0 2024-09-12T01:36:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.219+0000 7f179a59c640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1784039670 0x7f178403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.220+0000 7f179a59c640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1784039670 0x7f178403bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1790006fd0 tx=0x7f1790006db0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.224+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f178c0473f0 con 0x7f179c1020c0 2024-09-12T01:36:24.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.402+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f178c03ced0 con 0x7f179c1020c0 2024-09-12T01:36:24.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:24.450+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f179c04b720 con 0x7f179c1020c0 2024-09-12T01:36:24.526 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 podman[34674]: 2024-09-12 01:36:24.345655225 +0000 UTC m=+0.521653815 container init ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-554ba93, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 podman[34674]: 2024-09-12 01:36:24.348953641 +0000 UTC m=+0.524952229 container start ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-554ba93, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable), process ceph-mon, pid 2 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pidfile_write: ignore empty --pid-file 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: load: jerasure load: lrc 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: RocksDB version: 6.15.5 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-12T01:36:24.527 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Compile date Sep 11 2024 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: DB SUMMARY 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: DB Session ID: TNVH971OJ7RMMNTSMFM9 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi153/store.db dir, Total Num: 0, files: 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi153/store.db: 000004.log size: 511 ; 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:36:24.528 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.env: 0x55f9d4c8e440 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.fs: Posix File System 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.info_log: 0x55f9d5c770c0 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.statistics: (nil) 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.use_fsync: 0 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:36:24.529 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:36:24.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.db_log_dir: 2024-09-12T01:36:24.531 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi153/store.db 2024-09-12T01:36:24.531 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:36:24.531 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:36:24.531 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:36:24.531 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:36:24.531 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.write_buffer_manager: 0x55f9d5d34870 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:36:24.532 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.unordered_write: 0 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.row_cache: None 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.wal_filter: None 2024-09-12T01:36:24.533 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:36:24.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:36:24.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.preserve_deletes: 0 2024-09-12T01:36:24.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:36:24.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:36:24.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:36:24.536 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:36:24.537 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_open_files: -1 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:36:24.538 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Compression algorithms supported: 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kZSTD supported: 0 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:36:24.539 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000003 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.merge_operator: 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_filter: None 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f9d5c1da38) 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:36:24.540 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_type: 0 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_index_type: 0 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_shortening: 1 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: hash_index_allow_collision: 1 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: checksum: 1 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: no_block_cache: 0 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache: 0x55f9d5c531f0 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:36:24.541 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_options: 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: capacity : 536870912 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_shard_bits : 4 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: strict_capacity_limit : 0 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_compressed: (nil) 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: persistent_cache: (nil) 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size: 4096 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size_deviation: 10 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_restart_interval: 16 2024-09-12T01:36:24.542 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_block_restart_interval: 1 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: metadata_block_size: 4096 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: partition_filters: 0 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: use_delta_encoding: 1 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: whole_key_filtering: 1 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: verify_compression: 0 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: format_version: 4 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_index_compression: 1 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_align: 0 2024-09-12T01:36:24.543 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression: NoCompression 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.num_levels: 7 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:36:24.544 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:36:24.545 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:36:24.545 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:36:24.545 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:36:24.545 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:36:24.545 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:36:24.545 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:36:24.546 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.arena_block_size: 4194304 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:36:24.547 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:36:24.548 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.ttl: 2592000 2024-09-12T01:36:24.549 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726104984373433, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726104984373875, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1571, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726104984, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "5a121ed2-6b20-4994-b832-212aabf72530", "db_session_id": "TNVH971OJ7RMMNTSMFM9"}} 2024-09-12T01:36:24.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726104984374309, "job": 1, "event": "recovery_finished"} 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi153/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55f9d5c86700 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: DB pointer 0x55f9d5c56000 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** DB Stats ** 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:36:24.551 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.552 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:36:24.553 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:36:24.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative compaction: 0.00 GB write, 0.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153 does not exist in monmap, will attempt to join an existing cluster 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: using public_addr v2:172.21.15.153:0/0 -> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: starting mon.smithi153 rank -1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi153 fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:36:24.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(???) e0 preinit fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).mds e1 new map 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).mds e1 print_map 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: e1 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: legacy client fscid: -1 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: No filesystems configured 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-12T01:36:24.557 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.558 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon alertmanager.smithi066 on smithi066 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Added host smithi153 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.559 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2756713195' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.560 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon grafana.smithi066 on smithi066 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2756713195' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: osdmap e4: 0 total, 0 up, 0 in 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.561 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Saving service mon spec with placement smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153;count:2 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2003871250' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2398548892' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.562 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon prometheus.smithi066 on smithi066 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1100657396' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1843952738' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.563 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2442978566' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1958666154' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2983954587' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14160 172.21.15.66:0/3515198664' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-12T01:36:24.564 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mgrmap e14: smithi066.qdwcrh(active, since 59s) 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/965489213' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Active manager daemon smithi066.qdwcrh restarted 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: osdmap e5: 0 total, 0 up, 0 in 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mgrmap e15: smithi066.qdwcrh(active, starting, since 0.00336885s) 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.565 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/4016753161' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mgrmap e16: smithi066.qdwcrh(active, since 1.00545s) 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: [12/Sep/2024:01:36:04] ENGINE Bus STARTING 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: [12/Sep/2024:01:36:05] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: [12/Sep/2024:01:36:05] ENGINE Bus STARTED 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: [12/Sep/2024:01:36:05] ENGINE Error in HTTPServer.serve 2024-09-12T01:36:24.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Traceback (most recent call last): 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._run(expiration_interval) 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s = self.context.wrap_socket( 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: return self.sslsocket_class._create( 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:36:24.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self.do_handshake() 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._sslobj.do_handshake() 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mgrmap e17: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi066", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd/host:smithi153", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:24.568 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1011247469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:36:24.569 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon crash.smithi153 on smithi153 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon node-exporter.smithi153 on smithi153 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/343244338' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.570 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/416275562' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:36:24.571 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:24.572 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: Deploying daemon mon.smithi153 on smithi153 2024-09-12T01:36:24.572 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:24.572 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:24.572 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 ceph-mon[34713]: mon.smithi153@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-09-12T01:36:24.572 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 bash[34674]: ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 2024-09-12T01:36:24.572 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:24 smithi153 systemd[1]: Started Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:36:29.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.416+0000 7f17837fe640 1 -- 172.21.15.153:0/2071802975 <== mon.0 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f178c03b320 con 0x7f179c1020c0 2024-09-12T01:36:29.417 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:36:29.418 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":2,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","modified":"2024-09-12T01:36:24.402578Z","created":"2024-09-12T01:33:57.049610Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi066","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi153","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:3300","nonce":0},{"type":"v1","addr":"172.21.15.153:6789","nonce":0}]},"addr":"172.21.15.153:6789/0","public_addr":"172.21.15.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-12T01:36:29.418 INFO:teuthology.orchestra.run.smithi153.stderr:dumped monmap epoch 2 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1784039670 msgr2=0x7f178403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1784039670 0x7f178403bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1790006fd0 tx=0x7f1790006db0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 msgr2=0x7f179c112670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c112670 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f178c004820 tx=0x7f178c009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 shutdown_connections 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1784039670 0x7f178403bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 --2- 172.21.15.153:0/2071802975 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f179c1020c0 0x7f179c112670 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 >> 172.21.15.153:0/2071802975 conn(0x7f179c0f62b0 msgr2=0x7f179c0f7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 shutdown_connections 2024-09-12T01:36:29.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:36:29.419+0000 7f17a1200640 1 -- 172.21.15.153:0/2071802975 wait complete. 2024-09-12T01:36:29.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:36:29.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: mon.smithi066 calling monitor election 2024-09-12T01:36:29.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:36:29.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2071802975' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:29.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: mon.smithi153 calling monitor election 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: mon.smithi066 is new leader, mons smithi066,smithi153 in quorum (ranks 0,1) 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: monmap e2: 2 mons at {smithi066=[v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: fsmap 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: osdmap e5: 0 total, 0 up, 0 in 2024-09-12T01:36:29.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: mgrmap e17: smithi066.qdwcrh(active, since 26s) 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: overall HEALTH_OK 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.866 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:36:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: mon.smithi066 calling monitor election 2024-09-12T01:36:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:36:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2071802975' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: mon.smithi153 calling monitor election 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: mon.smithi066 is new leader, mons smithi066,smithi153 in quorum (ranks 0,1) 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: monmap e2: 2 mons at {smithi066=[v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0],smithi153=[v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: fsmap 2024-09-12T01:36:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: osdmap e5: 0 total, 0 up, 0 in 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: mgrmap e17: smithi066.qdwcrh(active, since 26s) 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: overall HEALTH_OK 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1708344176' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:29.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:30.184 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-12T01:36:30.185 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-12T01:36:30.454 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:36:30.780 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:30 smithi066 ceph-mon[27875]: mgrmap e18: smithi066.qdwcrh(active, since 26s), standbys: smithi153.jpnqza 2024-09-12T01:36:30.780 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:30 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:36:30.780 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:30 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:30.780 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:30 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:30.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:30 smithi153 ceph-mon[34713]: mgrmap e18: smithi066.qdwcrh(active, since 26s), standbys: smithi153.jpnqza 2024-09-12T01:36:30.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:30 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:36:30.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:30 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:36:30.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:30 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:36:31.851 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:31 smithi066 ceph-mon[27875]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:31.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:31 smithi153 ceph-mon[34713]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:32.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 -- 172.21.15.66:0/2909553271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38102010 msgr2=0x7f4c381023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/2909553271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38102010 0x7f4c381023e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4c20004850 tx=0x7f4c20009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 -- 172.21.15.66:0/2909553271 shutdown_connections 2024-09-12T01:36:32.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/2909553271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38102010 0x7f4c381023e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 -- 172.21.15.66:0/2909553271 >> 172.21.15.66:0/2909553271 conn(0x7f4c380f7bc0 msgr2=0x7f4c380f9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 -- 172.21.15.66:0/2909553271 shutdown_connections 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 -- 172.21.15.66:0/2909553271 wait complete. 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.078+0000 7f4c3cda2640 1 Processor -- start 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c3cda2640 1 -- start start 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c3cda2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38102010 0x7f4c381126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c3cda2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 0x7f4c3810c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c3cda2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38113200 con 0x7f4c38112bf0 2024-09-12T01:36:32.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c3cda2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38113340 con 0x7f4c38102010 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c36ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 0x7f4c3810c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c36ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 0x7f4c3810c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49530/0 (socket says 172.21.15.66:49530) 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c36ffd640 1 -- 172.21.15.66:0/1525366152 learned_addr learned my addr 172.21.15.66:0/1525366152 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c36ffd640 1 -- 172.21.15.66:0/1525366152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38102010 msgr2=0x7f4c381126b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c377fe640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38102010 0x7f4c381126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c36ffd640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38102010 0x7f4c381126b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.079+0000 7f4c36ffd640 1 -- 172.21.15.66:0/1525366152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20005040 con 0x7f4c38112bf0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.080+0000 7f4c36ffd640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 0x7f4c3810c670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800b790 tx=0x7f4c280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.080+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c2800c700 con 0x7f4c38112bf0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.080+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4c2800cd00 con 0x7f4c38112bf0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.080+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3810cc70 con 0x7f4c38112bf0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.080+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c280133a0 con 0x7f4c38112bf0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.080+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3810d190 con 0x7f4c38112bf0 2024-09-12T01:36:32.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.081+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3810d470 con 0x7f4c38112bf0 2024-09-12T01:36:32.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.082+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f4c280146f0 con 0x7f4c38112bf0 2024-09-12T01:36:32.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.082+0000 7f4c2ffff640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4c2406ee20 0x7f4c240712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.082+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4c2808c8c0 con 0x7f4c38112bf0 2024-09-12T01:36:32.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.082+0000 7f4c377fe640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4c2406ee20 0x7f4c240712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.083+0000 7f4c377fe640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4c2406ee20 0x7f4c240712d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000b020 tx=0x7f4c20009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.087+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4c2804d2a0 con 0x7f4c38112bf0 2024-09-12T01:36:32.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.263+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f4c380fd780 con 0x7f4c38112bf0 2024-09-12T01:36:32.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.263+0000 7f4c2ffff640 1 -- 172.21.15.66:0/1525366152 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f4c2805ab70 con 0x7f4c38112bf0 2024-09-12T01:36:32.263 INFO:teuthology.orchestra.run.smithi066.stdout:# minimal ceph.conf for f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:36:32.263 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2024-09-12T01:36:32.263 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:36:32.263 INFO:teuthology.orchestra.run.smithi066.stdout: mon_host = [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-12T01:36:32.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4c2406ee20 msgr2=0x7f4c240712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4c2406ee20 0x7f4c240712d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000b020 tx=0x7f4c20009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 msgr2=0x7f4c3810c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 0x7f4c3810c670 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800b790 tx=0x7f4c280091d0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 shutdown_connections 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4c2406ee20 0x7f4c240712d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c38112bf0 0x7f4c3810c670 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 --2- 172.21.15.66:0/1525366152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c38102010 0x7f4c381126b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.265+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 >> 172.21.15.66:0/1525366152 conn(0x7f4c380f7bc0 msgr2=0x7f4c380f97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.266+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 shutdown_connections 2024-09-12T01:36:32.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:32.266+0000 7f4c3cda2640 1 -- 172.21.15.66:0/1525366152 wait complete. 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:32.728 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: Reconfiguring mon.smithi066 (unknown last config time)... 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: Reconfiguring daemon mon.smithi066 on smithi066 2024-09-12T01:36:32.729 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:32 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1525366152' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:32.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:32.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: Reconfiguring mon.smithi066 (unknown last config time)... 2024-09-12T01:36:32.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:36:32.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:36:32.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:32.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: Reconfiguring daemon mon.smithi066 on smithi066 2024-09-12T01:36:32.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:32 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1525366152' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:32.925 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-12T01:36:32.925 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:36:32.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:36:32.953 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:36:32.954 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:36:33.020 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:36:33.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.conf 2024-09-12T01:36:33.049 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:36:33.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:36:33.115 INFO:tasks.cephadm:Deploying OSDs... 2024-09-12T01:36:33.116 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:36:33.116 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:36:33.133 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:36:33.133 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2024-09-12T01:36:33.188 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:36:33.188 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:33.188 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-12T01:36:33.188 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:33.188 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:33.188 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 01:35:55.522193705 +0000 2024-09-12T01:36:33.189 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 01:30:39.290043651 +0000 2024-09-12T01:36:33.189 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 01:30:39.290043651 +0000 2024-09-12T01:36:33.189 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-12 01:30:39.290043651 +0000 2024-09-12T01:36:33.189 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:36:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T01:36:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T01:36:33.255 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000254351 s, 2.0 MB/s 2024-09-12T01:36:33.256 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:36:33.314 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 01:35:55.522193705 +0000 2024-09-12T01:36:33.370 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 01:30:39.636041166 +0000 2024-09-12T01:36:33.371 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 01:30:39.636041166 +0000 2024-09-12T01:36:33.371 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-12 01:30:39.636041166 +0000 2024-09-12T01:36:33.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:36:33.437 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T01:36:33.437 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T01:36:33.437 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000202449 s, 2.5 MB/s 2024-09-12T01:36:33.438 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:36:33.495 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2024-09-12T01:36:33.552 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:36:33.552 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:33.552 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T01:36:33.553 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:33.553 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:33.553 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 01:35:55.522193705 +0000 2024-09-12T01:36:33.553 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 01:30:39.997038575 +0000 2024-09-12T01:36:33.553 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 01:30:39.997038575 +0000 2024-09-12T01:36:33.553 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-12 01:30:39.997038575 +0000 2024-09-12T01:36:33.554 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:36:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T01:36:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T01:36:33.616 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000227742 s, 2.2 MB/s 2024-09-12T01:36:33.618 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:36:33.674 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2024-09-12T01:36:33.730 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:36:33.730 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-12T01:36:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2024-09-12 01:35:55.523193697 +0000 2024-09-12T01:36:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 01:30:40.346036069 +0000 2024-09-12T01:36:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 01:30:40.346036069 +0000 2024-09-12T01:36:33.731 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-12 01:30:40.346036069 +0000 2024-09-12T01:36:33.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:36:33.795 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2024-09-12T01:36:33.795 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2024-09-12T01:36:33.795 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000190057 s, 2.7 MB/s 2024-09-12T01:36:33.797 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:36:33.855 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:36:33.855 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:36:33.874 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:36:33.875 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-12T01:36:33.888 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:33 smithi066 ceph-mon[27875]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:33.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:33.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:33 smithi153 ceph-mon[34713]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:33.922 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:36:33.922 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:33.922 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T01:36:33.922 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:33.922 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:33.923 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 01:36:23.244206833 +0000 2024-09-12T01:36:33.923 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 01:30:39.108458419 +0000 2024-09-12T01:36:33.923 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 01:30:39.108458419 +0000 2024-09-12T01:36:33.923 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 01:30:39.108458419 +0000 2024-09-12T01:36:33.923 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:36:33.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T01:36:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T01:36:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000241695 s, 2.1 MB/s 2024-09-12T01:36:33.992 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:36:34.052 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-12T01:36:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:36:34.111 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:34.111 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T01:36:34.111 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:34.112 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:34.112 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 01:36:23.245206814 +0000 2024-09-12T01:36:34.112 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 01:30:39.446452336 +0000 2024-09-12T01:36:34.112 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 01:30:39.446452336 +0000 2024-09-12T01:36:34.112 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 01:30:39.446452336 +0000 2024-09-12T01:36:34.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:36:34.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T01:36:34.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T01:36:34.179 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000259748 s, 2.0 MB/s 2024-09-12T01:36:34.180 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:36:34.239 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-12T01:36:34.296 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 01:36:23.245206814 +0000 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 01:30:39.766446576 +0000 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 01:30:39.766446576 +0000 2024-09-12T01:36:34.297 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 01:30:39.766446576 +0000 2024-09-12T01:36:34.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:36:34.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T01:36:34.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T01:36:34.363 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000246275 s, 2.1 MB/s 2024-09-12T01:36:34.364 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:36:34.428 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-12 01:36:23.246206796 +0000 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 01:30:40.099440583 +0000 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 01:30:40.099440583 +0000 2024-09-12T01:36:34.535 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 01:30:40.099440583 +0000 2024-09-12T01:36:34.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:36:34.604 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-12T01:36:34.604 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-12T01:36:34.604 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000231676 s, 2.2 MB/s 2024-09-12T01:36:34.605 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:36:34.665 INFO:tasks.cephadm:Deploying osd.0 on smithi066 with /dev/vg_nvme/lv_4... 2024-09-12T01:36:34.665 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: Reconfiguring mgr.smithi066.qdwcrh (unknown last config time)... 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:35.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:35 smithi066 ceph-mon[27875]: Reconfiguring daemon mgr.smithi066.qdwcrh on smithi066 2024-09-12T01:36:35.536 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:36:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: Reconfiguring mgr.smithi066.qdwcrh (unknown last config time)... 2024-09-12T01:36:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:36:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:36:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:35 smithi153 ceph-mon[34713]: Reconfiguring daemon mgr.smithi066.qdwcrh on smithi066 2024-09-12T01:36:36.431 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:36 smithi066 ceph-mon[27875]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:36.431 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:36.431 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:36.431 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:36:36.431 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:36 smithi153 ceph-mon[34713]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:36.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:36.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:36:36.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:37.555 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:37 smithi153 ceph-mon[34713]: Reconfiguring crash.smithi066 (monmap changed)... 2024-09-12T01:36:37.556 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:37 smithi153 ceph-mon[34713]: Reconfiguring daemon crash.smithi066 on smithi066 2024-09-12T01:36:37.593 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:37 smithi066 ceph-mon[27875]: Reconfiguring crash.smithi066 (monmap changed)... 2024-09-12T01:36:37.593 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:37 smithi066 ceph-mon[27875]: Reconfiguring daemon crash.smithi066 on smithi066 2024-09-12T01:36:38.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:38 smithi066 ceph-mon[27875]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:38.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:38.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:38.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:38 smithi153 ceph-mon[34713]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:38.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:38.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:38.958 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:36:38.977 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_4 2024-09-12T01:36:39.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:39 smithi066 ceph-mon[27875]: Reconfiguring alertmanager.smithi066 (dependencies changed)... 2024-09-12T01:36:39.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:39 smithi066 ceph-mon[27875]: Reconfiguring daemon alertmanager.smithi066 on smithi066 2024-09-12T01:36:39.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:39 smithi153 ceph-mon[34713]: Reconfiguring alertmanager.smithi066 (dependencies changed)... 2024-09-12T01:36:39.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:39 smithi153 ceph-mon[34713]: Reconfiguring daemon alertmanager.smithi066 on smithi066 2024-09-12T01:36:40.342 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:40 smithi066 ceph-mon[27875]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:40.384 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:36:40.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:40 smithi153 ceph-mon[34713]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:42.229 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:42 smithi066 ceph-mon[27875]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:42.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:42 smithi153 ceph-mon[34713]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:43.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 -- 172.21.15.66:0/2346791967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 msgr2=0x7fc71c0ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:43.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 --2- 172.21.15.66:0/2346791967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0ff1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc70c0048d0 tx=0x7fc70c009da0 comp rx=0 tx=0).stop 2024-09-12T01:36:43.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 -- 172.21.15.66:0/2346791967 shutdown_connections 2024-09-12T01:36:43.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 --2- 172.21.15.66:0/2346791967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c0ff6e0 0x7fc71c101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:43.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 --2- 172.21.15.66:0/2346791967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0ff1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 -- 172.21.15.66:0/2346791967 >> 172.21.15.66:0/2346791967 conn(0x7fc71c0f6c10 msgr2=0x7fc71c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 -- 172.21.15.66:0/2346791967 shutdown_connections 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 -- 172.21.15.66:0/2346791967 wait complete. 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 Processor -- start 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.168+0000 7fc721c2d640 1 -- start start 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc721c2d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0fcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc721c2d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c0ff6e0 0x7fc71c0fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc721c2d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0fb5e0 con 0x7fc71c065be0 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc721c2d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71c0fb750 con 0x7fc71c0ff6e0 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0fcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0fcaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45700/0 (socket says 172.21.15.66:45700) 2024-09-12T01:36:43.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 -- 172.21.15.66:0/33653115 learned_addr learned my addr 172.21.15.66:0/33653115 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc713fff640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c0ff6e0 0x7fc71c0fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 -- 172.21.15.66:0/33653115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c0ff6e0 msgr2=0x7fc71c0fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c0ff6e0 0x7fc71c0fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 -- 172.21.15.66:0/33653115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c005040 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc71b7fe640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0fcaf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc70c000c00 tx=0x7fc70c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70c038070 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc70c032d30 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71c0fb9d0 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.169+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc70c03dcc0 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.170+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c0fbe90 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.171+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71c0fa890 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.171+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fc70c030020 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.171+0000 7fc718ff9640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fc70806ecc0 0x7fc708071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.171+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fc70c0adbb0 con 0x7fc71c065be0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.172+0000 7fc713fff640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fc70806ecc0 0x7fc708071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:43.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.172+0000 7fc713fff640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fc70806ecc0 0x7fc708071170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc70400a900 tx=0x7fc704008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:43.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.176+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc70c07be30 con 0x7fc71c065be0 2024-09-12T01:36:43.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:36:43.354+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc71c0f8700 con 0x7fc70806ecc0 2024-09-12T01:36:44.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:44 smithi066 ceph-mon[27875]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:44.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:44 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:36:44.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:44 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:36:44.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:44 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:44 smithi153 ceph-mon[34713]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:44 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:36:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:44 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:36:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:44 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:45.229 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:45 smithi066 ceph-mon[27875]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:36:45.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:45 smithi153 ceph-mon[34713]: from='client.14236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:36:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:46 smithi066 ceph-mon[27875]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:46 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:46 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:46.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:46 smithi153 ceph-mon[34713]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:46.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:46 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:46.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:46 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:47.414 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:47 smithi066 ceph-mon[27875]: Reconfiguring grafana.smithi066 (dependencies changed)... 2024-09-12T01:36:47.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:47 smithi066 ceph-mon[27875]: Reconfiguring daemon grafana.smithi066 on smithi066 2024-09-12T01:36:47.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:47 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3362506067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edc79b5e-a9ef-40b7-8782-b0fa04f78cf4"}]: dispatch 2024-09-12T01:36:47.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:47 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3362506067' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edc79b5e-a9ef-40b7-8782-b0fa04f78cf4"}]': finished 2024-09-12T01:36:47.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:47 smithi066 ceph-mon[27875]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:36:47.415 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:47 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:36:47.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:47 smithi153 ceph-mon[34713]: Reconfiguring grafana.smithi066 (dependencies changed)... 2024-09-12T01:36:47.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:47 smithi153 ceph-mon[34713]: Reconfiguring daemon grafana.smithi066 on smithi066 2024-09-12T01:36:47.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:47 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3362506067' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "edc79b5e-a9ef-40b7-8782-b0fa04f78cf4"}]: dispatch 2024-09-12T01:36:47.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:47 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3362506067' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "edc79b5e-a9ef-40b7-8782-b0fa04f78cf4"}]': finished 2024-09-12T01:36:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:47 smithi153 ceph-mon[34713]: osdmap e6: 1 total, 0 up, 1 in 2024-09-12T01:36:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:47 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:36:48.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:48 smithi066 ceph-mon[27875]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:48.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:48 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1941999333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:36:48.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:48.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:48 smithi153 ceph-mon[34713]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:48.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:48 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1941999333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:36:48.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:36:50.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:50 smithi066 ceph-mon[27875]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:50.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:50 smithi153 ceph-mon[34713]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:52.447 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:52 smithi066 ceph-mon[27875]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:52.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:52 smithi153 ceph-mon[34713]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:54.376 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:54 smithi066 ceph-mon[27875]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:54.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:54 smithi153 ceph-mon[34713]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:56.376 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:56 smithi066 ceph-mon[27875]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:56.376 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:56 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:56.376 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:56 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:56 smithi153 ceph-mon[34713]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:56 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:56 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:36:57.333 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:57 smithi066 ceph-mon[27875]: Reconfiguring prometheus.smithi066 (dependencies changed)... 2024-09-12T01:36:57.333 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:57 smithi066 ceph-mon[27875]: Reconfiguring daemon prometheus.smithi066 on smithi066 2024-09-12T01:36:57.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:57 smithi153 ceph-mon[34713]: Reconfiguring prometheus.smithi066 (dependencies changed)... 2024-09-12T01:36:57.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:57 smithi153 ceph-mon[34713]: Reconfiguring daemon prometheus.smithi066 on smithi066 2024-09-12T01:36:58.479 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:58 smithi066 ceph-mon[27875]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:58.479 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:58 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:36:58.479 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:58 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:58 smithi153 ceph-mon[34713]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:36:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:58 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:36:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:58 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:36:59.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:36:59 smithi066 ceph-mon[27875]: Deploying daemon osd.0 on smithi066 2024-09-12T01:36:59.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:36:59 smithi153 ceph-mon[34713]: Deploying daemon osd.0 on smithi066 2024-09-12T01:37:00.509 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:00 smithi066 ceph-mon[27875]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:00.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:00 smithi153 ceph-mon[34713]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:02 smithi066 ceph-mon[27875]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:37:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:02.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:02 smithi153 ceph-mon[34713]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:02.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:02.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:02.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:37:02.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:03.373 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: Reconfiguring crash.smithi153 (monmap changed)... 2024-09-12T01:37:03.373 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: Reconfiguring daemon crash.smithi153 on smithi153 2024-09-12T01:37:03.373 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:03.373 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:03.374 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:03.374 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:37:03.374 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:37:03.374 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:03.493 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: Reconfiguring crash.smithi153 (monmap changed)... 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: Reconfiguring daemon crash.smithi153 on smithi153 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:37:03.494 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:04.288 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:04 smithi153 ceph-mon[34713]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:04.288 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:04 smithi153 ceph-mon[34713]: Reconfiguring mgr.smithi153.jpnqza (monmap changed)... 2024-09-12T01:37:04.288 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:04 smithi153 ceph-mon[34713]: Reconfiguring daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:37:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:04 smithi066 ceph-mon[27875]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:04 smithi066 ceph-mon[27875]: Reconfiguring mgr.smithi153.jpnqza (monmap changed)... 2024-09-12T01:37:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:04 smithi066 ceph-mon[27875]: Reconfiguring daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:37:05.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:05.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:05.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: Reconfiguring mon.smithi153 (monmap changed)... 2024-09-12T01:37:05.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:37:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:37:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: Reconfiguring daemon mon.smithi153 on smithi153 2024-09-12T01:37:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:05 smithi066 ceph-mon[27875]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: Reconfiguring mon.smithi153 (monmap changed)... 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: Reconfiguring daemon mon.smithi153 on smithi153 2024-09-12T01:37:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:05 smithi153 ceph-mon[34713]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi066.front.sepia.ceph.com:9093"}]: dispatch 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi066.front.sepia.ceph.com:9093"}]: dispatch 2024-09-12T01:37:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi066.front.sepia.ceph.com:3000"}]: dispatch 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi066.front.sepia.ceph.com:3000"}]: dispatch 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:37:06.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi066.front.sepia.ceph.com:9095"}]: dispatch 2024-09-12T01:37:06.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi066.front.sepia.ceph.com:9095"}]: dispatch 2024-09-12T01:37:06.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:06.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.999 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.999 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:06.999 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:37:06.999 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:37:06.999 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi066.front.sepia.ceph.com:9093"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi066.front.sepia.ceph.com:9093"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi066.front.sepia.ceph.com:3000"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi066.front.sepia.ceph.com:3000"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi066.front.sepia.ceph.com:9095"}]: dispatch 2024-09-12T01:37:07.000 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi066.front.sepia.ceph.com:9095"}]: dispatch 2024-09-12T01:37:07.001 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.001 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:07.001 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.001 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.819 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:07 smithi153 ceph-mon[34713]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:07.819 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.819 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:07 smithi066 ceph-mon[27875]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:07.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:07.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:09.956 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:09 smithi066 ceph-mon[27875]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:10.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:09 smithi153 ceph-mon[34713]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:10.795 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 0 on host 'smithi066' 2024-09-12T01:37:10.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.795+0000 7fc718ff9640 1 -- 172.21.15.66:0/33653115 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc71c0f8700 con 0x7fc70806ecc0 2024-09-12T01:37:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fc70806ecc0 msgr2=0x7fc708071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fc70806ecc0 0x7fc708071170 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc70400a900 tx=0x7fc704008040 comp rx=0 tx=0).stop 2024-09-12T01:37:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 msgr2=0x7fc71c0fcaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0fcaf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc70c000c00 tx=0x7fc70c009da0 comp rx=0 tx=0).stop 2024-09-12T01:37:10.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 shutdown_connections 2024-09-12T01:37:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fc70806ecc0 0x7fc708071170 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc71c0ff6e0 0x7fc71c0fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 --2- 172.21.15.66:0/33653115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc71c065be0 0x7fc71c0fcaf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 >> 172.21.15.66:0/33653115 conn(0x7fc71c0f6c10 msgr2=0x7fc71c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 shutdown_connections 2024-09-12T01:37:10.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:10.797+0000 7fc721c2d640 1 -- 172.21.15.66:0/33653115 wait complete. 2024-09-12T01:37:11.099 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:10 smithi066 ceph-mon[27875]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:37:11.099 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:10 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:11.099 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:10 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:11.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:10 smithi153 ceph-mon[34713]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:37:11.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:10 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:11.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:10 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:11.390 DEBUG:teuthology.orchestra.run.smithi066:osd.0> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.0.service 2024-09-12T01:37:11.393 INFO:tasks.cephadm:Deploying osd.1 on smithi066 with /dev/vg_nvme/lv_3... 2024-09-12T01:37:11.393 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:37:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-mon[27875]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-mon[27875]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:37:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-mon[27875]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:37:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:11.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-mon[27875]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:37:11.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[46067]: 2024-09-12T01:37:11.857+0000 7f3d86c6e640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:37:11.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:37:11 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[46067]: 2024-09-12T01:37:11.861+0000 7f3d7faa1640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:37:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:11 smithi153 ceph-mon[34713]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:11 smithi153 ceph-mon[34713]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:37:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:11 smithi153 ceph-mon[34713]: osdmap e7: 1 total, 0 up, 1 in 2024-09-12T01:37:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:11 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:11 smithi153 ceph-mon[34713]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:37:12.561 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:37:13.015 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:12 smithi066 ceph-mon[27875]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-12T01:37:13.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:12 smithi066 ceph-mon[27875]: osdmap e8: 1 total, 0 up, 1 in 2024-09-12T01:37:13.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:13.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:13.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:13.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:13.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:12 smithi153 ceph-mon[34713]: from='osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-12T01:37:13.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:12 smithi153 ceph-mon[34713]: osdmap e8: 1 total, 0 up, 1 in 2024-09-12T01:37:13.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:13.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:13.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:13.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: purged_snaps scrub starts 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: purged_snaps scrub ok 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] boot 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:37:13.980 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:13 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:14.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: purged_snaps scrub starts 2024-09-12T01:37:14.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: purged_snaps scrub ok 2024-09-12T01:37:14.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-12T01:37:14.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:14.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: osd.0 [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] boot 2024-09-12T01:37:14.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: osdmap e9: 1 total, 1 up, 1 in 2024-09-12T01:37:14.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:13 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:37:15.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:14 smithi066 ceph-mon[27875]: osdmap e10: 1 total, 1 up, 1 in 2024-09-12T01:37:15.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:14 smithi153 ceph-mon[34713]: osdmap e10: 1 total, 1 up, 1 in 2024-09-12T01:37:15.412 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:37:15.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_3 2024-09-12T01:37:16.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:15 smithi066 ceph-mon[27875]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:16.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:15 smithi153 ceph-mon[34713]: pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:16.307 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:37:18.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:18.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:37:18.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:18.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:18.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:18.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:18.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:18.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:18.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:18.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:18.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 -- 172.21.15.66:0/1749672978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 msgr2=0x7f01180fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 --2- 172.21.15.66:0/1749672978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f01180fb840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f01140048d0 tx=0x7f0114009da0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 -- 172.21.15.66:0/1749672978 shutdown_connections 2024-09-12T01:37:18.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 --2- 172.21.15.66:0/1749672978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180fc700 0x7f01180fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 --2- 172.21.15.66:0/1749672978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f01180fb840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 -- 172.21.15.66:0/1749672978 >> 172.21.15.66:0/1749672978 conn(0x7f01180f6c10 msgr2=0x7f01180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 -- 172.21.15.66:0/1749672978 shutdown_connections 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 -- 172.21.15.66:0/1749672978 wait complete. 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 Processor -- start 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.459+0000 7f012008b640 1 -- start start 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f012008b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f011810fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f012008b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180fc700 0x7f01181122b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f012008b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118065cc0 con 0x7f01180fb430 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f012008b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0118065e30 con 0x7f01180fc700 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f011810fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f011810fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39570/0 (socket says 172.21.15.66:39570) 2024-09-12T01:37:18.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 -- 172.21.15.66:0/3124082115 learned_addr learned my addr 172.21.15.66:0/3124082115 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011d626640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180fc700 0x7f01181122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 -- 172.21.15.66:0/3124082115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180fc700 msgr2=0x7f01181122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180fc700 0x7f01181122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 -- 172.21.15.66:0/3124082115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0114005040 con 0x7f01180fb430 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.460+0000 7f011de27640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f011810fd60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01140043d0 tx=0x7f0114009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.461+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0114038070 con 0x7f01180fb430 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.461+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0118112850 con 0x7f01180fb430 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.461+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f011402ae90 con 0x7f01180fb430 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.461+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f011403e670 con 0x7f01180fb430 2024-09-12T01:37:18.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.461+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0118112dc0 con 0x7f01180fb430 2024-09-12T01:37:18.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.462+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f0114030020 con 0x7f01180fb430 2024-09-12T01:37:18.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.462+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01180fa890 con 0x7f01180fb430 2024-09-12T01:37:18.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.463+0000 7f010e7fc640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f010406ecc0 0x7f0104071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:18.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.463+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f01140ad4e0 con 0x7f01180fb430 2024-09-12T01:37:18.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.463+0000 7f011d626640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f010406ecc0 0x7f0104071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:18.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.463+0000 7f011d626640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f010406ecc0 0x7f0104071170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0108004ed0 tx=0x7f010800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:18.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.467+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f011407b530 con 0x7f01180fb430 2024-09-12T01:37:18.690 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:18.690+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0118100b60 con 0x7f010406ecc0 2024-09-12T01:37:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:18 smithi066 ceph-mon[27875]: Detected new or changed devices on smithi066 2024-09-12T01:37:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:18 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi066 to 12864M 2024-09-12T01:37:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:37:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:37:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:19.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:18 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi066 2024-09-12T01:37:19.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:18 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi066 to 12864M 2024-09-12T01:37:19.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:37:19.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:37:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:19 smithi066 ceph-mon[27875]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:37:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:19 smithi066 ceph-mon[27875]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:19 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:19 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:20.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:19 smithi153 ceph-mon[34713]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:37:20.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:19 smithi153 ceph-mon[34713]: pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:20.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:19 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:20.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:19 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:21 smithi066 ceph-mon[27875]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:21 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1415539306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e607715a-e1aa-4f1e-967a-9a7fbd0663e2"}]: dispatch 2024-09-12T01:37:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:21 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1415539306' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e607715a-e1aa-4f1e-967a-9a7fbd0663e2"}]': finished 2024-09-12T01:37:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:21 smithi066 ceph-mon[27875]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:37:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:21 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:21 smithi153 ceph-mon[34713]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:21 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1415539306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e607715a-e1aa-4f1e-967a-9a7fbd0663e2"}]: dispatch 2024-09-12T01:37:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:21 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1415539306' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e607715a-e1aa-4f1e-967a-9a7fbd0663e2"}]': finished 2024-09-12T01:37:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:21 smithi153 ceph-mon[34713]: osdmap e11: 2 total, 1 up, 2 in 2024-09-12T01:37:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:21 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:23.189 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:22 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2630563353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:37:23.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:22 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2630563353' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:37:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:23 smithi066 ceph-mon[27875]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:24.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:23 smithi153 ceph-mon[34713]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:24.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:24.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:26.264 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:25 smithi066 ceph-mon[27875]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:25 smithi153 ceph-mon[34713]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:28.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:27 smithi066 ceph-mon[27875]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:28.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:27 smithi153 ceph-mon[34713]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:29 smithi066 ceph-mon[27875]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:37:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:29 smithi066 ceph-mon[27875]: Deploying daemon osd.1 on smithi066 2024-09-12T01:37:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:29 smithi153 ceph-mon[34713]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:37:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:29 smithi153 ceph-mon[34713]: Deploying daemon osd.1 on smithi066 2024-09-12T01:37:32.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:31 smithi066 ceph-mon[27875]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:32.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:31 smithi153 ceph-mon[34713]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:33.282 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:34.298 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:33 smithi066 ceph-mon[27875]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:34.298 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:34.298 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:34.298 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:33 smithi153 ceph-mon[34713]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:34.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:35.982 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:35 smithi066 ceph-mon[27875]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:35.983 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:35.983 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:35 smithi153 ceph-mon[34713]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:37.925 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.925+0000 7f010e7fc640 1 -- 172.21.15.66:0/3124082115 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0118100b60 con 0x7f010406ecc0 2024-09-12T01:37:37.926 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 1 on host 'smithi066' 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f010406ecc0 msgr2=0x7f0104071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f010406ecc0 0x7f0104071170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0108004ed0 tx=0x7f010800b040 comp rx=0 tx=0).stop 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 msgr2=0x7f011810fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f011810fd60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f01140043d0 tx=0x7f0114009da0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 shutdown_connections 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f010406ecc0 0x7f0104071170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01180fc700 0x7f01181122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.927+0000 7f012008b640 1 --2- 172.21.15.66:0/3124082115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01180fb430 0x7f011810fd60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.928+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 >> 172.21.15.66:0/3124082115 conn(0x7f01180f6c10 msgr2=0x7f01180f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.928+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 shutdown_connections 2024-09-12T01:37:37.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:37.928+0000 7f012008b640 1 -- 172.21.15.66:0/3124082115 wait complete. 2024-09-12T01:37:38.206 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:37 smithi153 ceph-mon[34713]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:38.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:37 smithi153 ceph-mon[34713]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:37:38.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:37 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:38.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:37 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:38.223 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:37 smithi066 ceph-mon[27875]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:38.223 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:37 smithi066 ceph-mon[27875]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:37:38.223 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:37 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:38.223 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:37 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:39.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:37:39.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:37:39.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:39.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:37:39.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-12T01:37:39.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: osdmap e13: 2 total, 1 up, 2 in 2024-09-12T01:37:39.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:39.085 DEBUG:teuthology.orchestra.run.smithi066:osd.1> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.1.service 2024-09-12T01:37:39.087 INFO:tasks.cephadm:Deploying osd.2 on smithi066 with /dev/vg_nvme/lv_2... 2024-09-12T01:37:39.087 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:37:39.218 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:37:39.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: osdmap e12: 2 total, 1 up, 2 in 2024-09-12T01:37:39.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:39.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:37:39.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: from='osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-12T01:37:39.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: osdmap e13: 2 total, 1 up, 2 in 2024-09-12T01:37:39.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:40.242 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:37:40.253 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:39 smithi066 ceph-mon[27875]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:40.253 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:39 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:40.253 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:39 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:39 smithi153 ceph-mon[34713]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:39 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:39 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:41.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:40 smithi066 ceph-mon[27875]: purged_snaps scrub starts 2024-09-12T01:37:41.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:40 smithi066 ceph-mon[27875]: purged_snaps scrub ok 2024-09-12T01:37:41.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:40 smithi066 ceph-mon[27875]: osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] boot 2024-09-12T01:37:41.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:40 smithi066 ceph-mon[27875]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:37:41.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:40 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:41.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:40 smithi153 ceph-mon[34713]: purged_snaps scrub starts 2024-09-12T01:37:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:40 smithi153 ceph-mon[34713]: purged_snaps scrub ok 2024-09-12T01:37:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:40 smithi153 ceph-mon[34713]: osd.1 [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] boot 2024-09-12T01:37:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:40 smithi153 ceph-mon[34713]: osdmap e14: 2 total, 2 up, 2 in 2024-09-12T01:37:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:40 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:37:42.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:41 smithi066 ceph-mon[27875]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:42.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:41 smithi066 ceph-mon[27875]: osdmap e15: 2 total, 2 up, 2 in 2024-09-12T01:37:42.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:42.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:41 smithi153 ceph-mon[34713]: pgmap v51: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-12T01:37:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:41 smithi153 ceph-mon[34713]: osdmap e15: 2 total, 2 up, 2 in 2024-09-12T01:37:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:43.807 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:37:43.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi066:vg_nvme/lv_2 2024-09-12T01:37:44.091 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:43 smithi066 ceph-mon[27875]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:44.332 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:37:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:43 smithi153 ceph-mon[34713]: pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.635+0000 7f4a8851a640 1 -- 172.21.15.66:0/2241481803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 msgr2=0x7f4a800fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.635+0000 7f4a8851a640 1 --2- 172.21.15.66:0/2241481803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a800fcb70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4a700048d0 tx=0x7f4a70009da0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.635+0000 7f4a8851a640 1 -- 172.21.15.66:0/2241481803 shutdown_connections 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.635+0000 7f4a8851a640 1 --2- 172.21.15.66:0/2241481803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a800fcb70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.635+0000 7f4a8851a640 1 --2- 172.21.15.66:0/2241481803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a800fb430 0x7f4a800fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.635+0000 7f4a8851a640 1 -- 172.21.15.66:0/2241481803 >> 172.21.15.66:0/2241481803 conn(0x7f4a800f6c10 msgr2=0x7f4a800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 -- 172.21.15.66:0/2241481803 shutdown_connections 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 -- 172.21.15.66:0/2241481803 wait complete. 2024-09-12T01:37:46.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 Processor -- start 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 -- start start 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a800fb430 0x7f4a8010fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a801122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80065c60 con 0x7f4a800fc700 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a8851a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a80065dd0 con 0x7f4a800fb430 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a85ab5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a801122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.636+0000 7f4a85ab5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a801122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53344/0 (socket says 172.21.15.66:53344) 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a85ab5640 1 -- 172.21.15.66:0/1944066319 learned_addr learned my addr 172.21.15.66:0/1944066319 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a862b6640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a800fb430 0x7f4a8010fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a85ab5640 1 -- 172.21.15.66:0/1944066319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a800fb430 msgr2=0x7f4a8010fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a85ab5640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a800fb430 0x7f4a8010fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a85ab5640 1 -- 172.21.15.66:0/1944066319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70005040 con 0x7f4a800fc700 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a85ab5640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a801122d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4a700043d0 tx=0x7f4a70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a70038070 con 0x7f4a800fc700 2024-09-12T01:37:46.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a80112810 con 0x7f4a800fc700 2024-09-12T01:37:46.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4a70009800 con 0x7f4a800fc700 2024-09-12T01:37:46.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a80112d80 con 0x7f4a800fc700 2024-09-12T01:37:46.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.637+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a7003e670 con 0x7f4a800fc700 2024-09-12T01:37:46.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.639+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a800fa890 con 0x7f4a800fc700 2024-09-12T01:37:46.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.639+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f4a70030020 con 0x7f4a800fc700 2024-09-12T01:37:46.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.639+0000 7f4a76ffd640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4a6c06ecc0 0x7f4a6c071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.640+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f4a700ad670 con 0x7f4a800fc700 2024-09-12T01:37:46.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.640+0000 7f4a862b6640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4a6c06ecc0 0x7f4a6c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.640+0000 7f4a862b6640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4a6c06ecc0 0x7f4a6c071170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a80065950 tx=0x7f4a7c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.644+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4a7007b510 con 0x7f4a800fc700 2024-09-12T01:37:46.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:37:46.827+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a80100bb0 con 0x7f4a6c06ecc0 2024-09-12T01:37:47.105 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:46 smithi066 ceph-mon[27875]: Detected new or changed devices on smithi066 2024-09-12T01:37:47.105 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:46 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi066 to 6432M 2024-09-12T01:37:47.105 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:46 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:37:47.106 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:46 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:37:47.106 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:46 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:46 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi066 2024-09-12T01:37:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:46 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi066 to 6432M 2024-09-12T01:37:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:46 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:37:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:46 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:37:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:46 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:47 smithi066 ceph-mon[27875]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:47 smithi066 ceph-mon[27875]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:37:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:47 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:47 smithi153 ceph-mon[34713]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:47 smithi153 ceph-mon[34713]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi066:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:37:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:47 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:37:50.237 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:49 smithi066 ceph-mon[27875]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:50.238 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:49 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/509413753' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef7fccb5-01e7-467b-951f-d4ba9425c78d"}]: dispatch 2024-09-12T01:37:50.238 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:49 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/509413753' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef7fccb5-01e7-467b-951f-d4ba9425c78d"}]': finished 2024-09-12T01:37:50.238 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:49 smithi066 ceph-mon[27875]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:37:50.238 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:49 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:37:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:49 smithi153 ceph-mon[34713]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:49 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/509413753' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef7fccb5-01e7-467b-951f-d4ba9425c78d"}]: dispatch 2024-09-12T01:37:50.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:49 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/509413753' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef7fccb5-01e7-467b-951f-d4ba9425c78d"}]': finished 2024-09-12T01:37:50.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:49 smithi153 ceph-mon[34713]: osdmap e16: 3 total, 2 up, 3 in 2024-09-12T01:37:50.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:49 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:37:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:50 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/341658920' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:37:51.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:50 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/341658920' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:37:52.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:51 smithi066 ceph-mon[27875]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:52.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:51 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:52.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:51 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:52.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:51 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:52.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:51 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:52.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:51 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:51 smithi153 ceph-mon[34713]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:51 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:51 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:51 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:51 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:37:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:51 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:37:54.374 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:53 smithi066 ceph-mon[27875]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:54.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:53 smithi153 ceph-mon[34713]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:56.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:55 smithi066 ceph-mon[27875]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:56.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:55 smithi153 ceph-mon[34713]: pgmap v60: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:57.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:57 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:37:57.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:57 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:57.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:57 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:37:57.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:57 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:37:58.351 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:58 smithi066 ceph-mon[27875]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:58.351 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:37:58 smithi066 ceph-mon[27875]: Deploying daemon osd.2 on smithi066 2024-09-12T01:37:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:58 smithi153 ceph-mon[34713]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:37:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:37:58 smithi153 ceph-mon[34713]: Deploying daemon osd.2 on smithi066 2024-09-12T01:38:00.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:00 smithi066 ceph-mon[27875]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:00.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:00 smithi153 ceph-mon[34713]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:02.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:02 smithi066 ceph-mon[27875]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:02 smithi153 ceph-mon[34713]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:02.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:02.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:03.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:04.340 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:04 smithi066 ceph-mon[27875]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:04 smithi153 ceph-mon[34713]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:05.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.317+0000 7f4a76ffd640 1 -- 172.21.15.66:0/1944066319 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4a80100bb0 con 0x7f4a6c06ecc0 2024-09-12T01:38:05.317 INFO:teuthology.orchestra.run.smithi066.stdout:Created osd(s) 2 on host 'smithi066' 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4a6c06ecc0 msgr2=0x7f4a6c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4a6c06ecc0 0x7f4a6c071170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a80065950 tx=0x7f4a7c00b040 comp rx=0 tx=0).stop 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 msgr2=0x7f4a801122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a801122d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4a700043d0 tx=0x7f4a70009da0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 shutdown_connections 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4a6c06ecc0 0x7f4a6c071170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a800fc700 0x7f4a801122d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 --2- 172.21.15.66:0/1944066319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a800fb430 0x7f4a8010fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 >> 172.21.15.66:0/1944066319 conn(0x7f4a800f6c10 msgr2=0x7f4a800f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 shutdown_connections 2024-09-12T01:38:05.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:38:05.319+0000 7f4a8851a640 1 -- 172.21.15.66:0/1944066319 wait complete. 2024-09-12T01:38:05.950 DEBUG:teuthology.orchestra.run.smithi066:osd.2> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.2.service 2024-09-12T01:38:05.953 INFO:tasks.cephadm:Deploying osd.3 on smithi153 with /dev/vg_nvme/lv_4... 2024-09-12T01:38:05.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-12T01:38:06.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:06 smithi066 ceph-mon[27875]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:06.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:06.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:06.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:06 smithi066 ceph-mon[27875]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:38:06.210 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:38:06.326 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:06 smithi153 ceph-mon[34713]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:06.326 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:06.326 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:06.326 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:06 smithi153 ceph-mon[34713]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:38:07.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:07 smithi153 ceph-mon[34713]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:38:07.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:07 smithi153 ceph-mon[34713]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:38:07.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:07.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:07 smithi153 ceph-mon[34713]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:38:07.530 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:07 smithi153 ceph-mon[34713]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-mon[27875]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:38:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-mon[27875]: osdmap e17: 3 total, 2 up, 3 in 2024-09-12T01:38:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-mon[27875]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:38:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-mon[27875]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:07.640 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[61261]: 2024-09-12T01:38:07.323+0000 7f1dc4dd8640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:38:07.640 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:07 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[61261]: 2024-09-12T01:38:07.329+0000 7f1dbfbed640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:38:08.483 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:08 smithi153 ceph-mon[34713]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-12T01:38:08.483 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:08 smithi153 ceph-mon[34713]: osdmap e18: 3 total, 2 up, 3 in 2024-09-12T01:38:08.483 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:08 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:08.483 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:08 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:08.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:38:08.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_4 2024-09-12T01:38:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:08 smithi066 ceph-mon[27875]: from='osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]': finished 2024-09-12T01:38:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:08 smithi066 ceph-mon[27875]: osdmap e18: 3 total, 2 up, 3 in 2024-09-12T01:38:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:08 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:08.824 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: purged_snaps scrub starts 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: purged_snaps scrub ok 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] boot 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:09.578 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:09 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: purged_snaps scrub starts 2024-09-12T01:38:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: purged_snaps scrub ok 2024-09-12T01:38:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: osd.2 [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] boot 2024-09-12T01:38:09.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: osdmap e19: 3 total, 3 up, 3 in 2024-09-12T01:38:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:38:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-12T01:38:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-12T01:38:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:09.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:09 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 -- 172.21.15.153:0/1047085729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fc6f0 msgr2=0x7f75a80fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/1047085729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fc6f0 0x7f75a80fcb60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f75900048d0 tx=0x7f7590009da0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 -- 172.21.15.153:0/1047085729 shutdown_connections 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/1047085729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fc6f0 0x7f75a80fcb60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/1047085729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fb420 0x7f75a80fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 -- 172.21.15.153:0/1047085729 >> 172.21.15.153:0/1047085729 conn(0x7f75a80f6c00 msgr2=0x7f75a80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 -- 172.21.15.153:0/1047085729 shutdown_connections 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.326+0000 7f75ae5dd640 1 -- 172.21.15.153:0/1047085729 wait complete. 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75ae5dd640 1 Processor -- start 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75ae5dd640 1 -- start start 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75ae5dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 0x7f75a810d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75ae5dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fc6f0 0x7f75a810d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75ae5dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a810dbe0 con 0x7f75a80fc6f0 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75ae5dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a810e400 con 0x7f75a80fb420 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 0x7f75a810d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 0x7f75a810d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56142/0 (socket says 172.21.15.153:56142) 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 -- 172.21.15.153:0/2920685751 learned_addr learned my addr 172.21.15.153:0/2920685751 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f759ffff640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fc6f0 0x7f75a810d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 -- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fc6f0 msgr2=0x7f75a810d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fc6f0 0x7f75a810d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 -- 172.21.15.153:0/2920685751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590005040 con 0x7f75a80fb420 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f759ffff640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fc6f0 0x7f75a810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.327+0000 7f75a7fff640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 0x7f75a810d050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f759800eb70 tx=0x7f759800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.328+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7598007c30 con 0x7f75a80fb420 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.328+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f759800f040 con 0x7f75a80fb420 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.328+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a810e630 con 0x7f75a80fb420 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.328+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75980094e0 con 0x7f75a80fb420 2024-09-12T01:38:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.328+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a810ebd0 con 0x7f75a80fb420 2024-09-12T01:38:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.329+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80fa880 con 0x7f75a80fb420 2024-09-12T01:38:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.329+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f7598009660 con 0x7f75a80fb420 2024-09-12T01:38:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.330+0000 7f75a57fa640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f759406ecc0 0x7f7594071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.330+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f759808d4e0 con 0x7f75a80fb420 2024-09-12T01:38:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.330+0000 7f759ffff640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f759406ecc0 0x7f7594071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.331+0000 7f759ffff640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f759406ecc0 0x7f7594071170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f759000b020 tx=0x7f7590009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.334+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f759805afa0 con 0x7f75a80fb420 2024-09-12T01:38:10.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:10 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-12T01:38:10.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:10 smithi153 ceph-mon[34713]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T01:38:10.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:10 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:38:10.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:10.499+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f75a8103ff0 con 0x7f759406ecc0 2024-09-12T01:38:10.636 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:10 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-12T01:38:10.636 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:10 smithi066 ceph-mon[27875]: osdmap e20: 3 total, 3 up, 3 in 2024-09-12T01:38:10.636 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:10 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-12T01:38:10.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:10 smithi066 sudo[63088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:38:10.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:10 smithi066 sudo[63088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:10.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:10 smithi066 sudo[63088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:10.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:10 smithi066 sudo[63088]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:11.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:11.350+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7598057500 con 0x7f75a80fb420 2024-09-12T01:38:11.484 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:38:11.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T01:38:11.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:11.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:38:11.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:38:11.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:11.485 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:11 smithi153 ceph-mon[34713]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:11.639 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[63112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:38:11.639 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[63112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:11.639 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[63112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:11.639 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[63112]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: osdmap e21: 3 total, 3 up, 3 in 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:11 smithi066 ceph-mon[27875]: pgmap v73: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:12.048 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[65788]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:38:12.048 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[65788]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:12.048 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[65788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:12.048 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:11 smithi066 sudo[65788]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:12.339 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65795]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:38:12.339 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65795]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:12.339 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:12.339 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65795]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:12.453 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:12 smithi153 ceph-mon[34713]: mgrmap e19: smithi066.qdwcrh(active, since 2m), standbys: smithi153.jpnqza 2024-09-12T01:38:12.453 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:12 smithi153 ceph-mon[34713]: osdmap e22: 3 total, 3 up, 3 in 2024-09-12T01:38:12.453 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:12 smithi066 ceph-mon[27875]: mgrmap e19: smithi066.qdwcrh(active, since 2m), standbys: smithi153.jpnqza 2024-09-12T01:38:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:12 smithi066 ceph-mon[27875]: osdmap e22: 3 total, 3 up, 3 in 2024-09-12T01:38:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:13.042 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65908]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:38:13.043 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65908]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:13.043 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:13.043 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:12 smithi066 sudo[65908]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:13.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66002]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:38:13.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66002]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:13.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:13.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66002]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:13.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66081]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:38:13.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66081]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:13.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:13.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:13 smithi066 sudo[66081]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:14.335 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.335 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2790257697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a62ea4ad-82e8-4dd6-8211-efa1e65af2f3"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a62ea4ad-82e8-4dd6-8211-efa1e65af2f3"}]: dispatch 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a62ea4ad-82e8-4dd6-8211-efa1e65af2f3"}]': finished 2024-09-12T01:38:14.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:38:14.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:14.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/2563757330' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:38:14.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 ceph-mon[34713]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:38:14.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38442]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-12T01:38:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 sudo[66112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:38:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 sudo[66112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 sudo[66112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 sudo[66112]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2790257697' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a62ea4ad-82e8-4dd6-8211-efa1e65af2f3"}]: dispatch 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a62ea4ad-82e8-4dd6-8211-efa1e65af2f3"}]: dispatch 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a62ea4ad-82e8-4dd6-8211-efa1e65af2f3"}]': finished 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: osdmap e23: 4 total, 3 up, 4 in 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/2563757330' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:38:14.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:14 smithi066 ceph-mon[27875]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:38:14.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38442]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:14.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:14.589 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38442]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38446]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-12T01:38:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38446]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-12T01:38:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-12T01:38:14.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:14 smithi153 sudo[38446]: pam_unix(sudo:session): session closed for user root 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: Detected new or changed devices on smithi066 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi066 to 4288M 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: pgmap v76: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:38:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:38:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:38:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:38:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:15.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi066 2024-09-12T01:38:15.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi066 to 4288M 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: pgmap v76: 1 pgs: 1 active+clean; 320 KiB data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-12T01:38:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:16.369 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:16 smithi153 ceph-mon[34713]: pgmap v77: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:16 smithi066 ceph-mon[27875]: pgmap v77: 1 pgs: 1 active+clean; 320 KiB data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:17.840 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:17.840 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:17.840 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:17 smithi153 ceph-mon[34713]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.9 KiB/s rd, 239 KiB/s wr, 16 op/s 2024-09-12T01:38:17.840 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:17.840 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:17.840 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:17 smithi066 ceph-mon[27875]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 4.9 KiB/s rd, 239 KiB/s wr, 16 op/s 2024-09-12T01:38:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:17.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:18.719 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:19 smithi153 ceph-mon[34713]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.6 KiB/s rd, 175 KiB/s wr, 12 op/s 2024-09-12T01:38:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:19 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:38:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:19 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:19 smithi066 ceph-mon[27875]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 3.6 KiB/s rd, 175 KiB/s wr, 12 op/s 2024-09-12T01:38:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:19 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:38:20.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:19 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:20.997 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:20 smithi153 ceph-mon[34713]: Deploying daemon osd.3 on smithi153 2024-09-12T01:38:21.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:20 smithi066 ceph-mon[27875]: Deploying daemon osd.3 on smithi153 2024-09-12T01:38:22.077 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:21 smithi153 ceph-mon[34713]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-09-12T01:38:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:21 smithi066 ceph-mon[27875]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.9 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-09-12T01:38:23.944 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:23 smithi153 ceph-mon[34713]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.6 KiB/s rd, 128 KiB/s wr, 8 op/s 2024-09-12T01:38:24.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:23 smithi066 ceph-mon[27875]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.6 KiB/s rd, 128 KiB/s wr, 8 op/s 2024-09-12T01:38:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:25.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:25.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:25.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:26.059 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:25 smithi153 ceph-mon[34713]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-12T01:38:26.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:25 smithi066 ceph-mon[27875]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-12T01:38:27.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.555+0000 7f75a57fa640 1 -- 172.21.15.153:0/2920685751 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f759002aa80 con 0x7f759406ecc0 2024-09-12T01:38:27.556 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 3 on host 'smithi153' 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f759406ecc0 msgr2=0x7f7594071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f759406ecc0 0x7f7594071170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f759000b020 tx=0x7f7590009da0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 msgr2=0x7f75a810d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 0x7f75a810d050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f759800eb70 tx=0x7f759800b040 comp rx=0 tx=0).stop 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 shutdown_connections 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f759406ecc0 0x7f7594071170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a80fc6f0 0x7f75a810d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 --2- 172.21.15.153:0/2920685751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75a80fb420 0x7f75a810d050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 >> 172.21.15.153:0/2920685751 conn(0x7f75a80f6c00 msgr2=0x7f75a8065ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:27.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 shutdown_connections 2024-09-12T01:38:27.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:27.557+0000 7f75ae5dd640 1 -- 172.21.15.153:0/2920685751 wait complete. 2024-09-12T01:38:28.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:27 smithi066 ceph-mon[27875]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-12T01:38:28.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:27 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:28.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:27 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:28.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:27 smithi153 ceph-mon[34713]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-09-12T01:38:28.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:27 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:28.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:27 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:28.902 DEBUG:teuthology.orchestra.run.smithi153:osd.3> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.3.service 2024-09-12T01:38:28.904 INFO:tasks.cephadm:Deploying osd.4 on smithi153 with /dev/vg_nvme/lv_3... 2024-09-12T01:38:28.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-12T01:38:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:28 smithi066 ceph-mon[27875]: from='osd.3 [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:38:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:28 smithi066 ceph-mon[27875]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:38:29.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:28 smithi153 ceph-mon[34713]: from='osd.3 [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:38:29.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:28 smithi153 ceph-mon[34713]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:38:29.196 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: from='osd.3 [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:29 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:30.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:30.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:38:30.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: osdmap e24: 4 total, 3 up, 4 in 2024-09-12T01:38:30.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:30.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: from='osd.3 [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:30.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:30.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:30.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:30.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[40055]: 2024-09-12T01:38:29.883+0000 7fb322a24640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:38:30.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:38:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[40055]: 2024-09-12T01:38:29.891+0000 7fb31a032640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: osd.3 [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] boot 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:38:31.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:30 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:31.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-12T01:38:31.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: osdmap e25: 4 total, 3 up, 4 in 2024-09-12T01:38:31.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:31.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:31.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: osd.3 [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] boot 2024-09-12T01:38:31.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: osdmap e26: 4 total, 4 up, 4 in 2024-09-12T01:38:31.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:30 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:38:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:32 smithi153 ceph-mon[34713]: purged_snaps scrub starts 2024-09-12T01:38:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:32 smithi153 ceph-mon[34713]: purged_snaps scrub ok 2024-09-12T01:38:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:32 smithi153 ceph-mon[34713]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:32 smithi153 ceph-mon[34713]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T01:38:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:32 smithi066 ceph-mon[27875]: purged_snaps scrub starts 2024-09-12T01:38:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:32 smithi066 ceph-mon[27875]: purged_snaps scrub ok 2024-09-12T01:38:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:32 smithi066 ceph-mon[27875]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-12T01:38:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:32 smithi066 ceph-mon[27875]: osdmap e27: 4 total, 4 up, 4 in 2024-09-12T01:38:32.731 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:38:32.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_3 2024-09-12T01:38:33.299 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:38:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:33 smithi153 ceph-mon[34713]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T01:38:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:33.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:33 smithi066 ceph-mon[27875]: osdmap e28: 4 total, 4 up, 4 in 2024-09-12T01:38:33.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:34.319 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:34 smithi153 ceph-mon[34713]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:34.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:34 smithi066 ceph-mon[27875]: pgmap v91: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:35.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 -- 172.21.15.153:0/1969045511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fc560 msgr2=0x7f49a40fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 --2- 172.21.15.153:0/1969045511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fc560 0x7f49a40fc970 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4994009c50 tx=0x7f4994004d10 comp rx=0 tx=0).stop 2024-09-12T01:38:35.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 -- 172.21.15.153:0/1969045511 shutdown_connections 2024-09-12T01:38:35.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 --2- 172.21.15.153:0/1969045511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a40fd830 0x7f49a40fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 --2- 172.21.15.153:0/1969045511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fc560 0x7f49a40fc970 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 -- 172.21.15.153:0/1969045511 >> 172.21.15.153:0/1969045511 conn(0x7f49a40f7d20 msgr2=0x7f49a40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 -- 172.21.15.153:0/1969045511 shutdown_connections 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.478+0000 7f49a9211640 1 -- 172.21.15.153:0/1969045511 wait complete. 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a9211640 1 Processor -- start 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a9211640 1 -- start start 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a9211640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a40fc560 0x7f49a410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a9211640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 0x7f49a410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a9211640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a410dbd0 con 0x7f49a40fc560 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a9211640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a410e3f0 con 0x7f49a40fd830 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.479+0000 7f49a259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 0x7f49a410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a259c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 0x7f49a410d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55900/0 (socket says 172.21.15.153:55900) 2024-09-12T01:38:35.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a259c640 1 -- 172.21.15.153:0/477185718 learned_addr learned my addr 172.21.15.153:0/477185718 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a2d9d640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a40fc560 0x7f49a410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a259c640 1 -- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a40fc560 msgr2=0x7f49a410d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a259c640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a40fc560 0x7f49a410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a259c640 1 -- 172.21.15.153:0/477185718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940098b0 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a259c640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 0x7f49a410d580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f499800c810 tx=0x7f49980043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f499800a820 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f499800ae20 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a410e680 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49980115c0 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.480+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a410ec20 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.481+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a40fb9c0 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.482+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4998012840 con 0x7f49a40fd830 2024-09-12T01:38:35.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.482+0000 7f498b7fe640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f498c06ed60 0x7f498c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.482+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f499808dfc0 con 0x7f49a40fd830 2024-09-12T01:38:35.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.483+0000 7f49a2d9d640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f498c06ed60 0x7f498c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.483+0000 7f49a2d9d640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f498c06ed60 0x7f498c071210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f499402a8b0 tx=0x7f4994004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:35.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.487+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f499805b380 con 0x7f49a40fd830 2024-09-12T01:38:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:35.650+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f49a410f060 con 0x7f498c06ed60 2024-09-12T01:38:35.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi153 2024-09-12T01:38:35.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi153 to 15936M 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:35 smithi153 ceph-mon[34713]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: Detected new or changed devices on smithi153 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi153 to 15936M 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:36.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:35 smithi066 ceph-mon[27875]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:36.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:36 smithi153 ceph-mon[34713]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:36.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:38:36.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:38:36.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:36 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:36 smithi066 ceph-mon[27875]: from='client.24155 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:38:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:38:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:38:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:36 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:37.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:37 smithi066 ceph-mon[27875]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T01:38:37.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:37 smithi153 ceph-mon[34713]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-12T01:38:39.037 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:38 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1500959900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "672bb0ec-7a4e-4673-b73d-f0a110c47e3e"}]: dispatch 2024-09-12T01:38:39.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:38 smithi153 ceph-mon[34713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "672bb0ec-7a4e-4673-b73d-f0a110c47e3e"}]: dispatch 2024-09-12T01:38:39.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:38 smithi153 ceph-mon[34713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "672bb0ec-7a4e-4673-b73d-f0a110c47e3e"}]': finished 2024-09-12T01:38:39.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:38 smithi153 ceph-mon[34713]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:38:39.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:39.038 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:38 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1261852450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:38:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:38 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1500959900' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "672bb0ec-7a4e-4673-b73d-f0a110c47e3e"}]: dispatch 2024-09-12T01:38:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:38 smithi066 ceph-mon[27875]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "672bb0ec-7a4e-4673-b73d-f0a110c47e3e"}]: dispatch 2024-09-12T01:38:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:38 smithi066 ceph-mon[27875]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "672bb0ec-7a4e-4673-b73d-f0a110c47e3e"}]': finished 2024-09-12T01:38:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:38 smithi066 ceph-mon[27875]: osdmap e29: 5 total, 4 up, 5 in 2024-09-12T01:38:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:38 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1261852450' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:38:40.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:39 smithi066 ceph-mon[27875]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-12T01:38:40.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:39 smithi153 ceph-mon[34713]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-12T01:38:42.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:41 smithi066 ceph-mon[27875]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T01:38:42.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:41 smithi153 ceph-mon[34713]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-12T01:38:43.948 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:43 smithi153 ceph-mon[34713]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:38:44.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:43 smithi066 ceph-mon[27875]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:38:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:45 smithi066 ceph-mon[27875]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:38:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:38:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:45 smithi066 ceph-mon[27875]: Deploying daemon osd.4 on smithi153 2024-09-12T01:38:46.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:45 smithi153 ceph-mon[34713]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-12T01:38:46.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:38:46.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:38:46.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:45 smithi153 ceph-mon[34713]: Deploying daemon osd.4 on smithi153 2024-09-12T01:38:48.068 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:47 smithi153 ceph-mon[34713]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:48.068 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:47 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:48.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:47 smithi066 ceph-mon[27875]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:48.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:47 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:38:50.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:49 smithi066 ceph-mon[27875]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:50.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:49 smithi153 ceph-mon[34713]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:51.090 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:50 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:51.090 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:50 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:51.090 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:50 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:51.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:50 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:38:51.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:50 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:51.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:50 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:52.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:52 smithi066 ceph-mon[27875]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:52 smithi153 ceph-mon[34713]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:53.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.378+0000 7f498b7fe640 1 -- 172.21.15.153:0/477185718 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f49a410f060 con 0x7f498c06ed60 2024-09-12T01:38:53.379 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 4 on host 'smithi153' 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f498c06ed60 msgr2=0x7f498c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f498c06ed60 0x7f498c071210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f499402a8b0 tx=0x7f4994004d10 comp rx=0 tx=0).stop 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 msgr2=0x7f49a410d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 0x7f49a410d580 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f499800c810 tx=0x7f49980043c0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 shutdown_connections 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f498c06ed60 0x7f498c071210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49a40fd830 0x7f49a410d580 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 --2- 172.21.15.153:0/477185718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49a40fc560 0x7f49a410d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 >> 172.21.15.153:0/477185718 conn(0x7f49a40f7d20 msgr2=0x7f49a40f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 shutdown_connections 2024-09-12T01:38:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:38:53.381+0000 7f49a9211640 1 -- 172.21.15.153:0/477185718 wait complete. 2024-09-12T01:38:53.986 DEBUG:teuthology.orchestra.run.smithi153:osd.4> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.4.service 2024-09-12T01:38:53.988 INFO:tasks.cephadm:Deploying osd.5 on smithi153 with /dev/vg_nvme/lv_2... 2024-09-12T01:38:53.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-12T01:38:54.224 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:54 smithi153 ceph-mon[34713]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:54.224 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:54 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:54.225 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:54 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:54.225 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:54 smithi153 ceph-mon[34713]: from='osd.4 [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:38:54.225 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:54 smithi153 ceph-mon[34713]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:38:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:54 smithi066 ceph-mon[27875]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:54 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:54 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:54 smithi066 ceph-mon[27875]: from='osd.4 [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:38:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:54 smithi066 ceph-mon[27875]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:38:54.713 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:38:55.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-mon[34713]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:38:55.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-mon[34713]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:38:55.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:55.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-mon[34713]: from='osd.4 [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:55.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-mon[34713]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:55.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-mon[34713]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:55.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[46829]: 2024-09-12T01:38:55.387+0000 7f5b24718640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:38:55.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:38:55 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[46829]: 2024-09-12T01:38:55.394+0000 7f5b20d52640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:38:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:55 smithi066 ceph-mon[27875]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:38:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:55 smithi066 ceph-mon[27875]: osdmap e30: 5 total, 4 up, 5 in 2024-09-12T01:38:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:55 smithi066 ceph-mon[27875]: from='osd.4 [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:55 smithi066 ceph-mon[27875]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:38:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:55 smithi066 ceph-mon[27875]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-12T01:38:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:56 smithi066 ceph-mon[27875]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-12T01:38:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:56 smithi066 ceph-mon[27875]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:38:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:56 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:56 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:56 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:56.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:56 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:56 smithi153 ceph-mon[34713]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-12T01:38:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:56 smithi153 ceph-mon[34713]: osdmap e31: 5 total, 4 up, 5 in 2024-09-12T01:38:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:56 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:56 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:56 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:56 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:38:57.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:57 smithi153 ceph-mon[34713]: purged_snaps scrub starts 2024-09-12T01:38:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:57 smithi153 ceph-mon[34713]: purged_snaps scrub ok 2024-09-12T01:38:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:57 smithi153 ceph-mon[34713]: osd.4 [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] boot 2024-09-12T01:38:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:57 smithi153 ceph-mon[34713]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T01:38:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:57 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:57 smithi153 ceph-mon[34713]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:38:57.681 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-12T01:38:57.703 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi153:vg_nvme/lv_2 2024-09-12T01:38:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:57 smithi066 ceph-mon[27875]: purged_snaps scrub starts 2024-09-12T01:38:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:57 smithi066 ceph-mon[27875]: purged_snaps scrub ok 2024-09-12T01:38:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:57 smithi066 ceph-mon[27875]: osd.4 [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] boot 2024-09-12T01:38:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:57 smithi066 ceph-mon[27875]: osdmap e32: 5 total, 5 up, 5 in 2024-09-12T01:38:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:57 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:38:57.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:57 smithi066 ceph-mon[27875]: pgmap v107: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:38:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:38:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:58 smithi153 ceph-mon[34713]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:38:58.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:58 smithi066 ceph-mon[27875]: osdmap e33: 5 total, 5 up, 5 in 2024-09-12T01:38:59.604 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:38:59 smithi153 ceph-mon[34713]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:38:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:38:59 smithi066 ceph-mon[27875]: pgmap v109: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:00.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.840+0000 7f9390033640 1 -- 172.21.15.153:0/3419515825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fc720 msgr2=0x7f93880fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.840+0000 7f9390033640 1 --2- 172.21.15.153:0/3419515825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fc720 0x7f93880fcb90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f93780048d0 tx=0x7f9378009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.840+0000 7f9390033640 1 -- 172.21.15.153:0/3419515825 shutdown_connections 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.840+0000 7f9390033640 1 --2- 172.21.15.153:0/3419515825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fc720 0x7f93880fcb90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.840+0000 7f9390033640 1 --2- 172.21.15.153:0/3419515825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93880fb450 0x7f93880fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.840+0000 7f9390033640 1 -- 172.21.15.153:0/3419515825 >> 172.21.15.153:0/3419515825 conn(0x7f93880f6c10 msgr2=0x7f93880f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 -- 172.21.15.153:0/3419515825 shutdown_connections 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 -- 172.21.15.153:0/3419515825 wait complete. 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 Processor -- start 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 -- start start 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 0x7f938810d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93880fc720 0x7f938810d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938810dd20 con 0x7f93880fc720 2024-09-12T01:39:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.841+0000 7f9390033640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938810e4f0 con 0x7f93880fb450 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 0x7f938810d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 0x7f938810d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47270/0 (socket says 172.21.15.153:47270) 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 -- 172.21.15.153:0/882406631 learned_addr learned my addr 172.21.15.153:0/882406631 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938d5ce640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93880fc720 0x7f938810d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 -- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93880fc720 msgr2=0x7f938810d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93880fc720 0x7f938810d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 -- 172.21.15.153:0/882406631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9378005040 con 0x7f93880fb450 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f938ddcf640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 0x7f938810d190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f938400fe60 tx=0x7f9384004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9384014070 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9384004e50 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9384018650 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938810e720 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.842+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938810ecc0 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.843+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93880fa8b0 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.844+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9384007a20 con 0x7f93880fb450 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.844+0000 7f937e7fc640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f937406ed60 0x7f9374071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.844+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f93840919e0 con 0x7f93880fb450 2024-09-12T01:39:00.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.844+0000 7f938d5ce640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f937406ed60 0x7f9374071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.845+0000 7f938d5ce640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f937406ed60 0x7f9374071210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f938810cf40 tx=0x7f9378035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:00.848+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f93840512a0 con 0x7f93880fb450 2024-09-12T01:39:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:01.013+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f938802ab50 con 0x7f937406ed60 2024-09-12T01:39:01.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: Detected new or changed devices on smithi153 2024-09-12T01:39:01.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi153 to 7968M 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:39:01.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:39:01.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:39:01.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:01.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi153 2024-09-12T01:39:01.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi153 to 7968M 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: pgmap v110: 1 pgs: 1 peering; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:01.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='client.24173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:39:01.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-12T01:39:01.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-12T01:39:01.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:03.067 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:03.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:03.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:03 smithi153 ceph-mon[34713]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:03.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:03 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/3136686471' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216a8552-eab1-4684-bdd5-3a660212926a"}]: dispatch 2024-09-12T01:39:03.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:03 smithi153 ceph-mon[34713]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216a8552-eab1-4684-bdd5-3a660212926a"}]: dispatch 2024-09-12T01:39:03.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:03 smithi153 ceph-mon[34713]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "216a8552-eab1-4684-bdd5-3a660212926a"}]': finished 2024-09-12T01:39:03.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:03 smithi153 ceph-mon[34713]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:39:03.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:03 smithi066 ceph-mon[27875]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:03 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/3136686471' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216a8552-eab1-4684-bdd5-3a660212926a"}]: dispatch 2024-09-12T01:39:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:03 smithi066 ceph-mon[27875]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "216a8552-eab1-4684-bdd5-3a660212926a"}]: dispatch 2024-09-12T01:39:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:03 smithi066 ceph-mon[27875]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "216a8552-eab1-4684-bdd5-3a660212926a"}]': finished 2024-09-12T01:39:04.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:03 smithi066 ceph-mon[27875]: osdmap e34: 6 total, 5 up, 6 in 2024-09-12T01:39:04.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:05.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:04 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/1059418019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:39:05.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:04 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/1059418019' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-12T01:39:06.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:05 smithi153 ceph-mon[34713]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:05 smithi066 ceph-mon[27875]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:08.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:07 smithi153 ceph-mon[34713]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:07 smithi066 ceph-mon[27875]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:09 smithi153 ceph-mon[34713]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:10.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:09 smithi066 ceph-mon[27875]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:11.095 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:10 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:39:11.095 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:10 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:10 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:39:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:10 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:11 smithi153 ceph-mon[34713]: Deploying daemon osd.5 on smithi153 2024-09-12T01:39:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:11 smithi153 ceph-mon[34713]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:12.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:11 smithi066 ceph-mon[27875]: Deploying daemon osd.5 on smithi153 2024-09-12T01:39:12.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:11 smithi066 ceph-mon[27875]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:14.088 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:13 smithi153 ceph-mon[34713]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:13 smithi066 ceph-mon[27875]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:16.139 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:15 smithi153 ceph-mon[34713]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:16.139 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:39:16.140 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:16.140 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:15 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:15 smithi066 ceph-mon[27875]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:39:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:15 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:18.376 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:17 smithi153 ceph-mon[34713]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:18.376 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:17 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:17 smithi066 ceph-mon[27875]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:17 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:18.744 INFO:teuthology.orchestra.run.smithi153.stdout:Created osd(s) 5 on host 'smithi153' 2024-09-12T01:39:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.744+0000 7f937e7fc640 1 -- 172.21.15.153:0/882406631 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f938802ab50 con 0x7f937406ed60 2024-09-12T01:39:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f937406ed60 msgr2=0x7f9374071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f937406ed60 0x7f9374071210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f938810cf40 tx=0x7f9378035040 comp rx=0 tx=0).stop 2024-09-12T01:39:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 msgr2=0x7f938810d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 0x7f938810d190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f938400fe60 tx=0x7f9384004600 comp rx=0 tx=0).stop 2024-09-12T01:39:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 shutdown_connections 2024-09-12T01:39:18.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f937406ed60 0x7f9374071210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93880fc720 0x7f938810d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 --2- 172.21.15.153:0/882406631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93880fb450 0x7f938810d190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 >> 172.21.15.153:0/882406631 conn(0x7f93880f6c10 msgr2=0x7f9388066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 shutdown_connections 2024-09-12T01:39:18.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:18.746+0000 7f9390033640 1 -- 172.21.15.153:0/882406631 wait complete. 2024-09-12T01:39:19.399 DEBUG:teuthology.orchestra.run.smithi153:osd.5> sudo journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.5.service 2024-09-12T01:39:19.401 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-12T01:39:19.402 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:39:19.671 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:19 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:19 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:19.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:19 smithi153 ceph-mon[34713]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:19.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:19 smithi153 ceph-mon[34713]: from='osd.5 [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:39:19.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:19 smithi153 ceph-mon[34713]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:39:20.003 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:19 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:20.003 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:19 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:20.003 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:19 smithi066 ceph-mon[27875]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:20.003 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:19 smithi066 ceph-mon[27875]: from='osd.5 [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:39:20.003 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:19 smithi066 ceph-mon[27875]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:39:21.043 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:39:21.044 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:39:21.044 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:21.044 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: from='osd.5 [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:39:21.044 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:39:21.044 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:21.044 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:20 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: osdmap e35: 6 total, 5 up, 6 in 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: from='osd.5 [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:21.045 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:21.046 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[53245]: 2024-09-12T01:39:20.756+0000 7feaca735640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:39:21.046 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:39:20 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[53245]: 2024-09-12T01:39:20.763+0000 7feac4d6b640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:39:21.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 -- 172.21.15.66:0/4245629600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fb480 msgr2=0x7f4b240fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/4245629600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fb480 0x7f4b240fb890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4b140048d0 tx=0x7f4b14009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 -- 172.21.15.66:0/4245629600 shutdown_connections 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/4245629600 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b240fc750 0x7f4b240fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/4245629600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fb480 0x7f4b240fb890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 -- 172.21.15.66:0/4245629600 >> 172.21.15.66:0/4245629600 conn(0x7f4b240f6c40 msgr2=0x7f4b240f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 -- 172.21.15.66:0/4245629600 shutdown_connections 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 -- 172.21.15.66:0/4245629600 wait complete. 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 Processor -- start 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.250+0000 7f4b28e8d640 1 -- start start 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b28e8d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b240fb480 0x7f4b2410c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b28e8d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 0x7f4b2410c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b28e8d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2410d3f0 con 0x7f4b240fc750 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b28e8d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2410d560 con 0x7f4b240fb480 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 0x7f4b2410c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 0x7f4b2410c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58730/0 (socket says 172.21.15.66:58730) 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 -- 172.21.15.66:0/1587172720 learned_addr learned my addr 172.21.15.66:0/1587172720 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b2259c640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b240fb480 0x7f4b2410c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 -- 172.21.15.66:0/1587172720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b240fb480 msgr2=0x7f4b2410c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b240fb480 0x7f4b2410c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 -- 172.21.15.66:0/1587172720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b14005040 con 0x7f4b240fc750 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b21d9b640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 0x7f4b2410c580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b790 tx=0x7f4b180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1800c700 con 0x7f4b240fc750 2024-09-12T01:39:21.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b1800cd00 con 0x7f4b240fc750 2024-09-12T01:39:21.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2410d840 con 0x7f4b240fc750 2024-09-12T01:39:21.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b18015e80 con 0x7f4b240fc750 2024-09-12T01:39:21.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.251+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2410dd60 con 0x7f4b240fc750 2024-09-12T01:39:21.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.252+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b240fa8e0 con 0x7f4b240fc750 2024-09-12T01:39:21.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.253+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4b18012070 con 0x7f4b240fc750 2024-09-12T01:39:21.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.253+0000 7f4b12ffd640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b0c06ed60 0x7f4b0c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.254+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f4b1808d4c0 con 0x7f4b240fc750 2024-09-12T01:39:21.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.254+0000 7f4b2259c640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b0c06ed60 0x7f4b0c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.254+0000 7f4b2259c640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b0c06ed60 0x7f4b0c071210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000c00 tx=0x7f4b14035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.258+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4b1805aab0 con 0x7f4b240fc750 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.422+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f4b2404b720 con 0x7f4b240fc750 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.422+0000 7f4b12ffd640 1 -- 172.21.15.66:0/1587172720 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f4b1805a450 con 0x7f4b240fc750 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:39:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b0c06ed60 msgr2=0x7f4b0c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b0c06ed60 0x7f4b0c071210 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b14000c00 tx=0x7f4b14035040 comp rx=0 tx=0).stop 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 msgr2=0x7f4b2410c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 0x7f4b2410c580 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b790 tx=0x7f4b180091d0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 shutdown_connections 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b0c06ed60 0x7f4b0c071210 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b240fc750 0x7f4b2410c580 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 --2- 172.21.15.66:0/1587172720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b240fb480 0x7f4b2410c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 >> 172.21.15.66:0/1587172720 conn(0x7f4b240f6c40 msgr2=0x7f4b240f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 shutdown_connections 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:21.424+0000 7f4b28e8d640 1 -- 172.21.15.66:0/1587172720 wait complete. 2024-09-12T01:39:22.073 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:21 smithi066 ceph-mon[27875]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-12T01:39:22.073 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:21 smithi066 ceph-mon[27875]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:39:22.073 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:21 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:22.073 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:21 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:22.073 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:21 smithi066 ceph-mon[27875]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:22.073 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:21 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1587172720' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:39:22.087 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:21 smithi153 ceph-mon[34713]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]': finished 2024-09-12T01:39:22.087 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:21 smithi153 ceph-mon[34713]: osdmap e36: 6 total, 5 up, 6 in 2024-09-12T01:39:22.087 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:21 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:22.087 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:21 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:22.087 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:21 smithi153 ceph-mon[34713]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-12T01:39:22.088 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:21 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1587172720' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:39:22.099 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726105136,"num_in_osds":6,"osd_in_since":1726105143,"num_remapped_pgs":0} 2024-09-12T01:39:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:22 smithi153 ceph-mon[34713]: purged_snaps scrub starts 2024-09-12T01:39:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:22 smithi153 ceph-mon[34713]: purged_snaps scrub ok 2024-09-12T01:39:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:22 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:22 smithi153 ceph-mon[34713]: osd.5 [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] boot 2024-09-12T01:39:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:22 smithi153 ceph-mon[34713]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:39:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:22 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:23.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-12T01:39:23.126 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:22 smithi066 ceph-mon[27875]: purged_snaps scrub starts 2024-09-12T01:39:23.126 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:22 smithi066 ceph-mon[27875]: purged_snaps scrub ok 2024-09-12T01:39:23.126 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:22 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:23.126 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:22 smithi066 ceph-mon[27875]: osd.5 [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] boot 2024-09-12T01:39:23.126 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:22 smithi066 ceph-mon[27875]: osdmap e37: 6 total, 6 up, 6 in 2024-09-12T01:39:23.126 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:22 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:39:23.371 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:24.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:23 smithi066 ceph-mon[27875]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:39:24.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:23 smithi066 ceph-mon[27875]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:24.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:23 smithi153 ceph-mon[34713]: osdmap e38: 6 total, 6 up, 6 in 2024-09-12T01:39:24.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:23 smithi153 ceph-mon[34713]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 -- 172.21.15.66:0/3616900639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 msgr2=0x7f43c00fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/3616900639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c00fdfb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f43b00048d0 tx=0x7f43b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 -- 172.21.15.66:0/3616900639 shutdown_connections 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/3616900639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c00fe4f0 0x7f43c00fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/3616900639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c00fdfb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 -- 172.21.15.66:0/3616900639 >> 172.21.15.66:0/3616900639 conn(0x7f43c00f63a0 msgr2=0x7f43c00f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 -- 172.21.15.66:0/3616900639 shutdown_connections 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.040+0000 7f43c5b9f640 1 -- 172.21.15.66:0/3616900639 wait complete. 2024-09-12T01:39:25.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43c5b9f640 1 Processor -- start 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43c5b9f640 1 -- start start 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43c5b9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43c5b9f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c00fe4f0 0x7f43c010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43c5b9f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c010dc20 con 0x7f43c00fdba0 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43c5b9f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c010e440 con 0x7f43c00fe4f0 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43bf7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57430/0 (socket says 172.21.15.66:57430) 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43bf7fe640 1 -- 172.21.15.66:0/1265579573 learned_addr learned my addr 172.21.15.66:0/1265579573 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.041+0000 7f43beffd640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c00fe4f0 0x7f43c010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43bf7fe640 1 -- 172.21.15.66:0/1265579573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c00fe4f0 msgr2=0x7f43c010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43bf7fe640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c00fe4f0 0x7f43c010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43bf7fe640 1 -- 172.21.15.66:0/1265579573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0005040 con 0x7f43c00fdba0 2024-09-12T01:39:25.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43bf7fe640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c010d090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f43b00043d0 tx=0x7f43b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b0038070 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c010e670 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43b002ae90 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b003e670 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.042+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c010ec10 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.043+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c00fa040 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.044+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f43b0030020 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.044+0000 7f43a7fff640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f43a806ed60 0x7f43a8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.044+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f43b00ae110 con 0x7f43c00fdba0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.044+0000 7f43beffd640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f43a806ed60 0x7f43a8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.045+0000 7f43beffd640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f43a806ed60 0x7f43a8071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009fd0 tx=0x7f43b4009e50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.048+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f43b007b570 con 0x7f43c00fdba0 2024-09-12T01:39:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: Detected new or changed devices on smithi153 2024-09-12T01:39:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:25.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi153 to 5312M 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:25.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:24 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.213+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f43c004b720 con 0x7f43c00fdba0 2024-09-12T01:39:25.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.214+0000 7f43a7fff640 1 -- 172.21.15.66:0/1265579573 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f43b007af10 con 0x7f43c00fdba0 2024-09-12T01:39:25.214 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:39:25.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.215+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f43a806ed60 msgr2=0x7f43a8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.215+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f43a806ed60 0x7f43a8071210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009fd0 tx=0x7f43b4009e50 comp rx=0 tx=0).stop 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.215+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 msgr2=0x7f43c010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.215+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c010d090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f43b00043d0 tx=0x7f43b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.215+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 shutdown_connections 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.216+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f43a806ed60 0x7f43a8071210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.216+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c00fe4f0 0x7f43c010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.216+0000 7f43c5b9f640 1 --2- 172.21.15.66:0/1265579573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c00fdba0 0x7f43c010d090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.216+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 >> 172.21.15.66:0/1265579573 conn(0x7f43c00f63a0 msgr2=0x7f43c00f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.216+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 shutdown_connections 2024-09-12T01:39:25.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:25.216+0000 7f43c5b9f640 1 -- 172.21.15.66:0/1265579573 wait complete. 2024-09-12T01:39:25.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi153 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi153 to 5312M 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:39:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:39:25.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:39:25.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:24 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:39:25.930 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726105161,"num_in_osds":6,"osd_in_since":1726105143,"num_remapped_pgs":0} 2024-09-12T01:39:25.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:39:26.236 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:26.358 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:25 smithi066 ceph-mon[27875]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:26.358 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:25 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1265579573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:39:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:25 smithi153 ceph-mon[34713]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:25 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1265579573' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-12T01:39:27.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 -- 172.21.15.66:0/735062857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102540 msgr2=0x7fdf90102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 --2- 172.21.15.66:0/735062857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102540 0x7fdf90102910 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdf800048d0 tx=0x7fdf80009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 -- 172.21.15.66:0/735062857 shutdown_connections 2024-09-12T01:39:27.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 --2- 172.21.15.66:0/735062857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf90102ee0 0x7fdf900fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 --2- 172.21.15.66:0/735062857 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102540 0x7fdf90102910 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 -- 172.21.15.66:0/735062857 >> 172.21.15.66:0/735062857 conn(0x7fdf900f8120 msgr2=0x7fdf900fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 -- 172.21.15.66:0/735062857 shutdown_connections 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 -- 172.21.15.66:0/735062857 wait complete. 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 Processor -- start 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.791+0000 7fdf96363640 1 -- start start 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf96363640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf90102540 0x7fdf901131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf96363640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 0x7fdf90113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf96363640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90113d20 con 0x7fdf90102ee0 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf96363640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9010d160 con 0x7fdf90102540 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 0x7fdf90113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 0x7fdf90113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57442/0 (socket says 172.21.15.66:57442) 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 -- 172.21.15.66:0/2395344400 learned_addr learned my addr 172.21.15.66:0/2395344400 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:27.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8ffff640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf90102540 0x7fdf901131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 -- 172.21.15.66:0/2395344400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf90102540 msgr2=0x7fdf901131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf90102540 0x7fdf901131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 -- 172.21.15.66:0/2395344400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80005040 con 0x7fdf90102ee0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.792+0000 7fdf8f7fe640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 0x7fdf90113720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf84002840 tx=0x7fdf84004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.793+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf84007c30 con 0x7fdf90102ee0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.793+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9010d440 con 0x7fdf90102ee0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.793+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf8400f040 con 0x7fdf90102ee0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.793+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf8400d990 con 0x7fdf90102ee0 2024-09-12T01:39:27.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.793+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9010d9e0 con 0x7fdf90102ee0 2024-09-12T01:39:27.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.794+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf900fdcc0 con 0x7fdf90102ee0 2024-09-12T01:39:27.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.794+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdf84009600 con 0x7fdf90102ee0 2024-09-12T01:39:27.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.795+0000 7fdf8cff9640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf7806ed60 0x7fdf78071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.795+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdf8408d580 con 0x7fdf90102ee0 2024-09-12T01:39:27.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.795+0000 7fdf8ffff640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf7806ed60 0x7fdf78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.795+0000 7fdf8ffff640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf7806ed60 0x7fdf78071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009ac0 tx=0x7fdf80035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.799+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdf8404d2a0 con 0x7fdf90102ee0 2024-09-12T01:39:27.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.965+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf901095b0 con 0x7fdf90102ee0 2024-09-12T01:39:27.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.966+0000 7fdf8cff9640 1 -- 172.21.15.66:0/2395344400 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11079 (secure 0 0 0) 0x7fdf8405a610 con 0x7fdf90102ee0 2024-09-12T01:39:27.966 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:39:27.966 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":38,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","created":"2024-09-12T01:34:00.031708+0000","modified":"2024-09-12T01:39:22.761770+0000","last_up_change":"2024-09-12T01:39:21.754471+0000","last_in_change":"2024-09-12T01:39:03.358557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:38:09.276324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"edc79b5e-a9ef-40b7-8782-b0fa04f78cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6803","nonce":2436938389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6805","nonce":2436938389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6809","nonce":2436938389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6807","nonce":2436938389}]},"public_addr":"172.21.15.66:6803/2436938389","cluster_addr":"172.21.15.66:6805/2436938389","heartbeat_back_addr":"172.21.15.66:6809/2436938389","heartbeat_front_addr":"172.21.15.66:6807/2436938389","state":["exists","up"]},{"osd":1,"uuid":"e607715a-e1aa-4f1e-967a-9a7fbd0663e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6811","nonce":4197000140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6813","nonce":4197000140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6817","nonce":4197000140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6815","nonce":4197000140}]},"public_addr":"172.21.15.66:6811/4197000140","cluster_addr":"172.21.15.66:6813/4197000140","heartbeat_back_addr":"172.21.15.66:6817/4197000140","heartbeat_front_addr":"172.21.15.66:6815/4197000140","state":["exists","up"]},{"osd":2,"uuid":"ef7fccb5-01e7-467b-951f-d4ba9425c78d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6819","nonce":2925426172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6821","nonce":2925426172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6825","nonce":2925426172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6823","nonce":2925426172}]},"public_addr":"172.21.15.66:6819/2925426172","cluster_addr":"172.21.15.66:6821/2925426172","heartbeat_back_addr":"172.21.15.66:6825/2925426172","heartbeat_front_addr":"172.21.15.66:6823/2925426172","state":["exists","up"]},{"osd":3,"uuid":"a62ea4ad-82e8-4dd6-8211-efa1e65af2f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6801","nonce":2866587131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6803","nonce":2866587131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6807","nonce":2866587131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6805","nonce":2866587131}]},"public_addr":"172.21.15.153:6801/2866587131","cluster_addr":"172.21.15.153:6803/2866587131","heartbeat_back_addr":"172.21.15.153:6807/2866587131","heartbeat_front_addr":"172.21.15.153:6805/2866587131","state":["exists","up"]},{"osd":4,"uuid":"672bb0ec-7a4e-4673-b73d-f0a110c47e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6809","nonce":2609916870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6811","nonce":2609916870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6815","nonce":2609916870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6813","nonce":2609916870}]},"public_addr":"172.21.15.153:6809/2609916870","cluster_addr":"172.21.15.153:6811/2609916870","heartbeat_back_addr":"172.21.15.153:6815/2609916870","heartbeat_front_addr":"172.21.15.153:6813/2609916870","state":["exists","up"]},{"osd":5,"uuid":"216a8552-eab1-4684-bdd5-3a660212926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6817","nonce":873059570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6819","nonce":873059570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6823","nonce":873059570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6821","nonce":873059570}]},"public_addr":"172.21.15.153:6817/873059570","cluster_addr":"172.21.15.153:6819/873059570","heartbeat_back_addr":"172.21.15.153:6823/873059570","heartbeat_front_addr":"172.21.15.153:6821/873059570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:37:11.338198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:37:38.743153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:06.877247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:29.422586+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:54.963969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:39:20.453430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3969880503":"2024-09-13T01:36:02.780216+0000","172.21.15.66:0/1197929559":"2024-09-13T01:34:28.667247+0000","172.21.15.66:6801/151382692":"2024-09-13T01:36:02.780216+0000","172.21.15.66:6800/3928441794":"2024-09-13T01:34:58.305660+0000","172.21.15.66:6800/2001799335":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/2113754837":"2024-09-13T01:34:28.667247+0000","172.21.15.66:6801/3928441794":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/2635713227":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/671152596":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/109517485":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/532912125":"2024-09-13T01:34:58.305660+0000","172.21.15.66:6801/2001799335":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/201526823":"2024-09-13T01:36:02.780216+0000","172.21.15.66:0/2691404876":"2024-09-13T01:36:02.780216+0000","172.21.15.66:6800/151382692":"2024-09-13T01:36:02.780216+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf7806ed60 msgr2=0x7fdf78071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf7806ed60 0x7fdf78071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009ac0 tx=0x7fdf80035040 comp rx=0 tx=0).stop 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 msgr2=0x7fdf90113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 0x7fdf90113720 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdf84002840 tx=0x7fdf84004570 comp rx=0 tx=0).stop 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 shutdown_connections 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf7806ed60 0x7fdf78071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf90102ee0 0x7fdf90113720 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 --2- 172.21.15.66:0/2395344400 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf90102540 0x7fdf901131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 >> 172.21.15.66:0/2395344400 conn(0x7fdf900f8120 msgr2=0x7fdf900f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:27.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 shutdown_connections 2024-09-12T01:39:27.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:27.968+0000 7fdf96363640 1 -- 172.21.15.66:0/2395344400 wait complete. 2024-09-12T01:39:28.329 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:27 smithi066 ceph-mon[27875]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:28.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:27 smithi153 ceph-mon[34713]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:28.623 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:38:09.276324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-12T01:39:28.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-12T01:39:28.882 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:29.208 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:28 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2395344400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:39:29.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:28 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2395344400' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:39:30.192 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:29 smithi066 ceph-mon[27875]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:29 smithi153 ceph-mon[34713]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.523+0000 7f347a2ca640 1 -- 172.21.15.66:0/3250013779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34740fe460 msgr2=0x7f34740fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.523+0000 7f347a2ca640 1 --2- 172.21.15.66:0/3250013779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34740fe460 0x7f34740fe830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f34640048d0 tx=0x7f3464009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.523+0000 7f347a2ca640 1 -- 172.21.15.66:0/3250013779 shutdown_connections 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.523+0000 7f347a2ca640 1 --2- 172.21.15.66:0/3250013779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3474064fc0 0x7f3474065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.523+0000 7f347a2ca640 1 --2- 172.21.15.66:0/3250013779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34740fe460 0x7f34740fe830 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.523+0000 7f347a2ca640 1 -- 172.21.15.66:0/3250013779 >> 172.21.15.66:0/3250013779 conn(0x7f34740723b0 msgr2=0x7f34740727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 -- 172.21.15.66:0/3250013779 shutdown_connections 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 -- 172.21.15.66:0/3250013779 wait complete. 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 Processor -- start 2024-09-12T01:39:30.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 -- start start 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 0x7f3474113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34740fe460 0x7f3474113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3474113dd0 con 0x7f3474064fc0 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.524+0000 7f347a2ca640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347410d180 con 0x7f34740fe460 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 0x7f3474113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 0x7f3474113200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57464/0 (socket says 172.21.15.66:57464) 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 -- 172.21.15.66:0/1186116748 learned_addr learned my addr 172.21.15.66:0/1186116748 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f34737fe640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34740fe460 0x7f3474113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 -- 172.21.15.66:0/1186116748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34740fe460 msgr2=0x7f3474113740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34740fe460 0x7f3474113740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 -- 172.21.15.66:0/1186116748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464005040 con 0x7f3474064fc0 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f34737fe640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34740fe460 0x7f3474113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:30.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3473fff640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 0x7f3474113200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3464003080 tx=0x7f3464009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3464038070 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f346402ade0 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f347410d400 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f346402c880 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.525+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347410d860 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.526+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34740fdcf0 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.527+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3464030020 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.527+0000 7f3470ff9640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f345c06ed50 0x7f345c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.528+0000 7f34737fe640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f345c06ed50 0x7f345c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.528+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f34640ade60 con 0x7f3474064fc0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.528+0000 7f34737fe640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f345c06ed50 0x7f345c071200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3468006fd0 tx=0x7f3468008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:30.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.532+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f346407b340 con 0x7f3474064fc0 2024-09-12T01:39:30.694 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.694+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3474072ec0 con 0x7f3474064fc0 2024-09-12T01:39:30.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.695+0000 7f3470ff9640 1 -- 172.21.15.66:0/1186116748 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f346407ace0 con 0x7f3474064fc0 2024-09-12T01:39:30.695 INFO:teuthology.orchestra.run.smithi066.stdout:pg_num: 1 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f345c06ed50 msgr2=0x7f345c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f345c06ed50 0x7f345c071200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3468006fd0 tx=0x7f3468008040 comp rx=0 tx=0).stop 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 msgr2=0x7f3474113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 0x7f3474113200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3464003080 tx=0x7f3464009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 shutdown_connections 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f345c06ed50 0x7f345c071200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f34740fe460 0x7f3474113740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 --2- 172.21.15.66:0/1186116748 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3474064fc0 0x7f3474113200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 >> 172.21.15.66:0/1186116748 conn(0x7f34740723b0 msgr2=0x7f3474105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 shutdown_connections 2024-09-12T01:39:30.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:30.697+0000 7f347a2ca640 1 -- 172.21.15.66:0/1186116748 wait complete. 2024-09-12T01:39:31.025 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:30 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1186116748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:39:31.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:30 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1186116748' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-12T01:39:31.435 INFO:tasks.cephadm:Setting up client nodes... 2024-09-12T01:39:31.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T01:39:31.697 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:32.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:31 smithi066 ceph-mon[27875]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:32.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:31 smithi153 ceph-mon[34713]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:33.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 -- 172.21.15.66:0/339385055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 msgr2=0x7f01340fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 --2- 172.21.15.66:0/339385055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f01340fc940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f012c0048d0 tx=0x7f012c009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 -- 172.21.15.66:0/339385055 shutdown_connections 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 --2- 172.21.15.66:0/339385055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01340fd800 0x7f01340fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 --2- 172.21.15.66:0/339385055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f01340fc940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 -- 172.21.15.66:0/339385055 >> 172.21.15.66:0/339385055 conn(0x7f01340f7d10 msgr2=0x7f01340fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 -- 172.21.15.66:0/339385055 shutdown_connections 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 -- 172.21.15.66:0/339385055 wait complete. 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 Processor -- start 2024-09-12T01:39:33.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.354+0000 7f013aefd640 1 -- start start 2024-09-12T01:39:33.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f013aefd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f0134071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f013aefd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01340fd800 0x7f013406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f013aefd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0134070080 con 0x7f01340fc530 2024-09-12T01:39:33.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f013aefd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01340701c0 con 0x7f01340fd800 2024-09-12T01:39:33.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f0134071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f0134071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56630/0 (socket says 172.21.15.66:56630) 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 -- 172.21.15.66:0/2835201180 learned_addr learned my addr 172.21.15.66:0/2835201180 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 -- 172.21.15.66:0/2835201180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01340fd800 msgr2=0x7f013406fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01340fd800 0x7f013406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 -- 172.21.15.66:0/2835201180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c005040 con 0x7f01340fc530 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f0138c99640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f0134071570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f012c003080 tx=0x7f012c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012c038070 con 0x7f01340fc530 2024-09-12T01:39:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f012c02abd0 con 0x7f01340fc530 2024-09-12T01:39:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0134070440 con 0x7f01340fc530 2024-09-12T01:39:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.355+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f012c03e670 con 0x7f01340fc530 2024-09-12T01:39:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.356+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0134115120 con 0x7f01340fc530 2024-09-12T01:39:33.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.356+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01340fb990 con 0x7f01340fc530 2024-09-12T01:39:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.357+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f012c030020 con 0x7f01340fc530 2024-09-12T01:39:33.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.357+0000 7f01317fa640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f012006ed60 0x7f0120071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.358+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f012c0ae250 con 0x7f01340fc530 2024-09-12T01:39:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.358+0000 7f0133fff640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f012006ed60 0x7f0120071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.358+0000 7f0133fff640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f012006ed60 0x7f0120071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f011c0097e0 tx=0x7f011c006d20 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.362 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.362+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f012c07b6b0 con 0x7f01340fc530 2024-09-12T01:39:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:33.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.590+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f013404b720 con 0x7f01340fc530 2024-09-12T01:39:33.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.594+0000 7f01317fa640 1 -- 172.21.15.66:0/2835201180 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f012c07b050 con 0x7f01340fc530 2024-09-12T01:39:33.594 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2024-09-12T01:39:33.594 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQBVRuJm+x5CIxAARFvQMuix5WDgLJZAfQ5CJg== 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f012006ed60 msgr2=0x7f0120071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f012006ed60 0x7f0120071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f011c0097e0 tx=0x7f011c006d20 comp rx=0 tx=0).stop 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 msgr2=0x7f0134071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f0134071570 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f012c003080 tx=0x7f012c009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 shutdown_connections 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f012006ed60 0x7f0120071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01340fd800 0x7f013406fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 --2- 172.21.15.66:0/2835201180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01340fc530 0x7f0134071570 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 >> 172.21.15.66:0/2835201180 conn(0x7f01340f7d10 msgr2=0x7f01340f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:33.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 shutdown_connections 2024-09-12T01:39:33.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:33.596+0000 7f013aefd640 1 -- 172.21.15.66:0/2835201180 wait complete. 2024-09-12T01:39:34.271 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:33 smithi066 ceph-mon[27875]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:34.271 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:33 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2835201180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:39:34.271 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:33 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2835201180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:39:34.299 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:39:34.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-12T01:39:34.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:39:34.340 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-12T01:39:34.368 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:33 smithi153 ceph-mon[34713]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:34.368 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:33 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2835201180' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:39:34.368 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:33 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2835201180' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:39:34.599 INFO:teuthology.orchestra.run.smithi153.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi153/config 2024-09-12T01:39:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.152+0000 7f6b79698640 1 -- 172.21.15.153:0/3404308440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 msgr2=0x7f6b74101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.152+0000 7f6b79698640 1 --2- 172.21.15.153:0/3404308440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b74101a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0048d0 tx=0x7f6b5c009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- 172.21.15.153:0/3404308440 shutdown_connections 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 --2- 172.21.15.153:0/3404308440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b74101a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 --2- 172.21.15.153:0/3404308440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74065c40 0x7f6b740ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- 172.21.15.153:0/3404308440 >> 172.21.15.153:0/3404308440 conn(0x7f6b740f6bf0 msgr2=0x7f6b740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- 172.21.15.153:0/3404308440 shutdown_connections 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- 172.21.15.153:0/3404308440 wait complete. 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 Processor -- start 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- start start 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74065c40 0x7f6b7410d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b7410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7410dbe0 con 0x7f6b74065c40 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b79698640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7410e400 con 0x7f6b740ff680 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.153+0000 7f6b727fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b7410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b727fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b7410d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50658/0 (socket says 172.21.15.153:50658) 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b727fc640 1 -- 172.21.15.153:0/742626481 learned_addr learned my addr 172.21.15.153:0/742626481 (peer_addr_for_me v2:172.21.15.153:0/0) 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b72ffd640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74065c40 0x7f6b7410d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b727fc640 1 -- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74065c40 msgr2=0x7f6b7410d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b727fc640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74065c40 0x7f6b7410d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b727fc640 1 -- 172.21.15.153:0/742626481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c005040 con 0x7f6b740ff680 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b727fc640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b7410d590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0043d0 tx=0x7f6b5c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5c038070 con 0x7f6b740ff680 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b5c02ae90 con 0x7f6b740ff680 2024-09-12T01:39:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7410e630 con 0x7f6b740ff680 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5c03e670 con 0x7f6b740ff680 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.154+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7410ebd0 con 0x7f6b740ff680 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.155+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b740fa890 con 0x7f6b740ff680 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.156+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6b5c030020 con 0x7f6b740ff680 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.156+0000 7f6b6b7fe640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6b6006ed60 0x7f6b60071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.156+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6b5c0ae030 con 0x7f6b740ff680 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.156+0000 7f6b72ffd640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6b6006ed60 0x7f6b60071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.157+0000 7f6b72ffd640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6b6006ed60 0x7f6b60071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b64004fd0 tx=0x7f6b64009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.160+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6b5c07b540 con 0x7f6b740ff680 2024-09-12T01:39:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.371+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f6b7404b720 con 0x7f6b740ff680 2024-09-12T01:39:36.371 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:35 smithi153 ceph-mon[34713]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.377+0000 7f6b6b7fe640 1 -- 172.21.15.153:0/742626481 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f6b5c07aee0 con 0x7f6b740ff680 2024-09-12T01:39:36.377 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-12T01:39:36.377 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBYRuJmjm1FFhAAKy+OWI7VsZ8uy8CLkcy42A== 2024-09-12T01:39:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6b6006ed60 msgr2=0x7f6b60071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6b6006ed60 0x7f6b60071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6b64004fd0 tx=0x7f6b64009040 comp rx=0 tx=0).stop 2024-09-12T01:39:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 msgr2=0x7f6b7410d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b7410d590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0043d0 tx=0x7f6b5c009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 shutdown_connections 2024-09-12T01:39:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6b6006ed60 0x7f6b60071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b740ff680 0x7f6b7410d590 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 --2- 172.21.15.153:0/742626481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b74065c40 0x7f6b7410d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.379+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 >> 172.21.15.153:0/742626481 conn(0x7f6b740f6bf0 msgr2=0x7f6b740f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.380+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 shutdown_connections 2024-09-12T01:39:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:39:36.380+0000 7f6b79698640 1 -- 172.21.15.153:0/742626481 wait complete. 2024-09-12T01:39:36.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:35 smithi066 ceph-mon[27875]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:37.011 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:39:37.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-12T01:39:37.011 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T01:39:37.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:36 smithi153 ceph-mon[34713]: from='client.? 172.21.15.153:0/742626481' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:39:37.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:36 smithi153 ceph-mon[34713]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:39:37.073 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:36 smithi153 ceph-mon[34713]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:39:37.087 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:39:37.088 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:39:37.088 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-12T01:39:37.355 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:37.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:36 smithi066 ceph-mon[27875]: from='client.? 172.21.15.153:0/742626481' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:39:37.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:36 smithi066 ceph-mon[27875]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-12T01:39:37.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:36 smithi066 ceph-mon[27875]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-12T01:39:38.086 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:37 smithi066 ceph-mon[27875]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:38.306 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:37 smithi153 ceph-mon[34713]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:38.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 -- 172.21.15.66:0/2357122179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 msgr2=0x7f2e9c0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 --2- 172.21.15.66:0/2357122179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c0fbbe0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e980048d0 tx=0x7f2e98009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 -- 172.21.15.66:0/2357122179 shutdown_connections 2024-09-12T01:39:38.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 --2- 172.21.15.66:0/2357122179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e9c0fcf80 0x7f2e9c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 --2- 172.21.15.66:0/2357122179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c0fbbe0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 -- 172.21.15.66:0/2357122179 >> 172.21.15.66:0/2357122179 conn(0x7f2e9c0723b0 msgr2=0x7f2e9c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 -- 172.21.15.66:0/2357122179 shutdown_connections 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.803+0000 7f2ea3785640 1 -- 172.21.15.66:0/2357122179 wait complete. 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea3785640 1 Processor -- start 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea3785640 1 -- start start 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea3785640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea3785640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e9c0fcf80 0x7f2e9c10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea3785640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c10ed00 con 0x7f2e9c0fb810 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea3785640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c10ee70 con 0x7f2e9c0fcf80 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea1521640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea1521640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c10e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56650/0 (socket says 172.21.15.66:56650) 2024-09-12T01:39:38.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea1521640 1 -- 172.21.15.66:0/11044812 learned_addr learned my addr 172.21.15.66:0/11044812 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.804+0000 7f2ea0d20640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e9c0fcf80 0x7f2e9c10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2ea1521640 1 -- 172.21.15.66:0/11044812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e9c0fcf80 msgr2=0x7f2e9c10e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2ea1521640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e9c0fcf80 0x7f2e9c10e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2ea1521640 1 -- 172.21.15.66:0/11044812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98005040 con 0x7f2e9c0fb810 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2ea1521640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c10e170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e98038070 con 0x7f2e9c0fb810 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c1171e0 con 0x7f2e9c0fb810 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2e9802ade0 con 0x7f2e9c0fb810 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9802c7e0 con 0x7f2e9c0fb810 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.805+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c117640 con 0x7f2e9c0fb810 2024-09-12T01:39:38.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.806+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c0fcbc0 con 0x7f2e9c0fb810 2024-09-12T01:39:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.807+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2e98030020 con 0x7f2e9c0fb810 2024-09-12T01:39:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.807+0000 7f2e91ffb640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f2e8806ed60 0x7f2e88071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.807+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f2e980ada00 con 0x7f2e9c0fb810 2024-09-12T01:39:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.807+0000 7f2ea0d20640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f2e8806ed60 0x7f2e88071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.808+0000 7f2ea0d20640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f2e8806ed60 0x7f2e88071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c065980 tx=0x7f2e8c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:38.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:38.812+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2e9807af90 con 0x7f2e9c0fb810 2024-09-12T01:39:39.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.020+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2e9c065730 con 0x7f2e9c0fb810 2024-09-12T01:39:39.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.023+0000 7f2e91ffb640 1 -- 172.21.15.66:0/11044812 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176710 (secure 0 0 0) 0x7f2e9807a930 con 0x7f2e9c0fb810 2024-09-12T01:39:39.025 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:39:39.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f2e8806ed60 msgr2=0x7f2e88071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:39.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f2e8806ed60 0x7f2e88071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c065980 tx=0x7f2e8c00b040 comp rx=0 tx=0).stop 2024-09-12T01:39:39.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 msgr2=0x7f2e9c10e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:39.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c10e170 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e98009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 shutdown_connections 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f2e8806ed60 0x7f2e88071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e9c0fcf80 0x7f2e9c10e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 --2- 172.21.15.66:0/11044812 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e9c0fb810 0x7f2e9c10e170 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 >> 172.21.15.66:0/11044812 conn(0x7f2e9c0723b0 msgr2=0x7f2e9c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 shutdown_connections 2024-09-12T01:39:39.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:39.026+0000 7f2ea3785640 1 -- 172.21.15.66:0/11044812 wait complete. 2024-09-12T01:39:39.710 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":19,"flags":0,"active_gid":14208,"active_name":"smithi066.qdwcrh","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":1778679519},{"type":"v1","addr":"172.21.15.66:6801","nonce":1778679519}]},"active_addr":"172.21.15.66:6801/1778679519","active_change":"2024-09-12T01:36:02.780332+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14226,"name":"smithi153.jpnqza","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.66:8443/","prometheus":"http://172.21.15.66:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":2126394205}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":3667221974}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":77725105}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.66:0","nonce":666035643}]}]} 2024-09-12T01:39:39.716 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-12T01:39:39.716 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-12T01:39:39.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:39:39.972 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:40.280 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:39 smithi066 ceph-mon[27875]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:40.280 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:39 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/11044812' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:39:40.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:39 smithi153 ceph-mon[34713]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:40.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:39 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/11044812' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 -- 172.21.15.66:0/1787313139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc0fac80 msgr2=0x7f25cc0fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 --2- 172.21.15.66:0/1787313139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc0fac80 0x7f25cc0fb0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0049c0 tx=0x7f25bc00aeb0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 -- 172.21.15.66:0/1787313139 shutdown_connections 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 --2- 172.21.15.66:0/1787313139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc0fac80 0x7f25cc0fb0d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 --2- 172.21.15.66:0/1787313139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc100c70 0x7f25cc101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 -- 172.21.15.66:0/1787313139 >> 172.21.15.66:0/1787313139 conn(0x7f25cc070ce0 msgr2=0x7f25cc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:41.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 -- 172.21.15.66:0/1787313139 shutdown_connections 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.566+0000 7f25d0958640 1 -- 172.21.15.66:0/1787313139 wait complete. 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25d0958640 1 Processor -- start 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25d0958640 1 -- start start 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25d0958640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc0fac80 0x7f25cc1153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25d0958640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 0x7f25cc115930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25d0958640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc115f30 con 0x7f25cc100c70 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25d0958640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1160a0 con 0x7f25cc0fac80 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 0x7f25cc115930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 0x7f25cc115930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56670/0 (socket says 172.21.15.66:56670) 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 -- 172.21.15.66:0/1554518918 learned_addr learned my addr 172.21.15.66:0/1554518918 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25ca59c640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc0fac80 0x7f25cc1153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 -- 172.21.15.66:0/1554518918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc0fac80 msgr2=0x7f25cc1153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:41.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc0fac80 0x7f25cc1153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 -- 172.21.15.66:0/1554518918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc005040 con 0x7f25cc100c70 2024-09-12T01:39:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25ca59c640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc0fac80 0x7f25cc1153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:41.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.567+0000 7f25c9d9b640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 0x7f25cc115930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc00aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.568+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25bc033740 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.568+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc10f4c0 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.568+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f25bc033d40 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.568+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25bc034be0 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.568+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc10fa60 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.569+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25cc0fc370 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.569+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f25bc031020 con 0x7f25cc100c70 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.570+0000 7f25c2ffd640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f25b806ed60 0x7f25b8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:41.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.570+0000 7f25ca59c640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f25b806ed60 0x7f25b8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:41.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.570+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f25bc0adb90 con 0x7f25cc100c70 2024-09-12T01:39:41.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.570+0000 7f25ca59c640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f25b806ed60 0x7f25b8071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009fd0 tx=0x7f25b4009e50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:41.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.574+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f25bc07b070 con 0x7f25cc100c70 2024-09-12T01:39:41.737 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.737+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25cc107370 con 0x7f25cc100c70 2024-09-12T01:39:41.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.738+0000 7f25c2ffd640 1 -- 172.21.15.66:0/1554518918 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11079 (secure 0 0 0) 0x7f25bc042090 con 0x7f25cc100c70 2024-09-12T01:39:41.739 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:39:41.739 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":38,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","created":"2024-09-12T01:34:00.031708+0000","modified":"2024-09-12T01:39:22.761770+0000","last_up_change":"2024-09-12T01:39:21.754471+0000","last_in_change":"2024-09-12T01:39:03.358557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:38:09.276324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"edc79b5e-a9ef-40b7-8782-b0fa04f78cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6803","nonce":2436938389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6805","nonce":2436938389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6809","nonce":2436938389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6807","nonce":2436938389}]},"public_addr":"172.21.15.66:6803/2436938389","cluster_addr":"172.21.15.66:6805/2436938389","heartbeat_back_addr":"172.21.15.66:6809/2436938389","heartbeat_front_addr":"172.21.15.66:6807/2436938389","state":["exists","up"]},{"osd":1,"uuid":"e607715a-e1aa-4f1e-967a-9a7fbd0663e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6811","nonce":4197000140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6813","nonce":4197000140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6817","nonce":4197000140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6815","nonce":4197000140}]},"public_addr":"172.21.15.66:6811/4197000140","cluster_addr":"172.21.15.66:6813/4197000140","heartbeat_back_addr":"172.21.15.66:6817/4197000140","heartbeat_front_addr":"172.21.15.66:6815/4197000140","state":["exists","up"]},{"osd":2,"uuid":"ef7fccb5-01e7-467b-951f-d4ba9425c78d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6819","nonce":2925426172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6821","nonce":2925426172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6825","nonce":2925426172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6823","nonce":2925426172}]},"public_addr":"172.21.15.66:6819/2925426172","cluster_addr":"172.21.15.66:6821/2925426172","heartbeat_back_addr":"172.21.15.66:6825/2925426172","heartbeat_front_addr":"172.21.15.66:6823/2925426172","state":["exists","up"]},{"osd":3,"uuid":"a62ea4ad-82e8-4dd6-8211-efa1e65af2f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6801","nonce":2866587131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6803","nonce":2866587131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6807","nonce":2866587131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6805","nonce":2866587131}]},"public_addr":"172.21.15.153:6801/2866587131","cluster_addr":"172.21.15.153:6803/2866587131","heartbeat_back_addr":"172.21.15.153:6807/2866587131","heartbeat_front_addr":"172.21.15.153:6805/2866587131","state":["exists","up"]},{"osd":4,"uuid":"672bb0ec-7a4e-4673-b73d-f0a110c47e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6809","nonce":2609916870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6811","nonce":2609916870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6815","nonce":2609916870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6813","nonce":2609916870}]},"public_addr":"172.21.15.153:6809/2609916870","cluster_addr":"172.21.15.153:6811/2609916870","heartbeat_back_addr":"172.21.15.153:6815/2609916870","heartbeat_front_addr":"172.21.15.153:6813/2609916870","state":["exists","up"]},{"osd":5,"uuid":"216a8552-eab1-4684-bdd5-3a660212926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6817","nonce":873059570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6819","nonce":873059570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6823","nonce":873059570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6821","nonce":873059570}]},"public_addr":"172.21.15.153:6817/873059570","cluster_addr":"172.21.15.153:6819/873059570","heartbeat_back_addr":"172.21.15.153:6823/873059570","heartbeat_front_addr":"172.21.15.153:6821/873059570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:37:11.338198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:37:38.743153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:06.877247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:29.422586+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:54.963969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:39:20.453430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3969880503":"2024-09-13T01:36:02.780216+0000","172.21.15.66:0/1197929559":"2024-09-13T01:34:28.667247+0000","172.21.15.66:6801/151382692":"2024-09-13T01:36:02.780216+0000","172.21.15.66:6800/3928441794":"2024-09-13T01:34:58.305660+0000","172.21.15.66:6800/2001799335":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/2113754837":"2024-09-13T01:34:28.667247+0000","172.21.15.66:6801/3928441794":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/2635713227":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/671152596":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/109517485":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/532912125":"2024-09-13T01:34:58.305660+0000","172.21.15.66:6801/2001799335":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/201526823":"2024-09-13T01:36:02.780216+0000","172.21.15.66:0/2691404876":"2024-09-13T01:36:02.780216+0000","172.21.15.66:6800/151382692":"2024-09-13T01:36:02.780216+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:41.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f25b806ed60 msgr2=0x7f25b8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f25b806ed60 0x7f25b8071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009fd0 tx=0x7f25b4009e50 comp rx=0 tx=0).stop 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 msgr2=0x7f25cc115930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 0x7f25cc115930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc00aeb0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 shutdown_connections 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f25b806ed60 0x7f25b8071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25cc100c70 0x7f25cc115930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.740+0000 7f25d0958640 1 --2- 172.21.15.66:0/1554518918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25cc0fac80 0x7f25cc1153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.741+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 >> 172.21.15.66:0/1554518918 conn(0x7f25cc070ce0 msgr2=0x7f25cc0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.741+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 shutdown_connections 2024-09-12T01:39:41.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:41.741+0000 7f25d0958640 1 -- 172.21.15.66:0/1554518918 wait complete. 2024-09-12T01:39:42.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:41 smithi066 ceph-mon[27875]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:42.057 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:41 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1554518918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:39:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:41 smithi153 ceph-mon[34713]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:41 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1554518918' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:39:42.442 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-12T01:39:42.443 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-12T01:39:42.700 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:44.099 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:43 smithi066 ceph-mon[27875]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 -- 172.21.15.66:0/3442290057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c40fe780 msgr2=0x7f83c40febf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3442290057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c40fe780 0x7f83c40febf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0048d0 tx=0x7f83ac009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 -- 172.21.15.66:0/3442290057 shutdown_connections 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3442290057 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c40fe780 0x7f83c40febf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3442290057 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c41047a0 0x7f83c4104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 -- 172.21.15.66:0/3442290057 >> 172.21.15.66:0/3442290057 conn(0x7f83c40fa320 msgr2=0x7f83c40fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 -- 172.21.15.66:0/3442290057 shutdown_connections 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.279+0000 7f83c9da7640 1 -- 172.21.15.66:0/3442290057 wait complete. 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c9da7640 1 Processor -- start 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c9da7640 1 -- start start 2024-09-12T01:39:44.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c9da7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c40fe780 0x7f83c4115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c9da7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 0x7f83c4115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c9da7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c4115ff0 con 0x7f83c41047a0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c9da7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c410f3e0 con 0x7f83c40fe780 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 0x7f83c4115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 0x7f83c4115960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37434/0 (socket says 172.21.15.66:37434) 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83bbfff640 1 -- 172.21.15.66:0/3357379632 learned_addr learned my addr 172.21.15.66:0/3357379632 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83c37fe640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c40fe780 0x7f83c4115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83bbfff640 1 -- 172.21.15.66:0/3357379632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c40fe780 msgr2=0x7f83c4115420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83bbfff640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c40fe780 0x7f83c4115420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.280+0000 7f83bbfff640 1 -- 172.21.15.66:0/3357379632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac005040 con 0x7f83c41047a0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.281+0000 7f83bbfff640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 0x7f83c4115960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83ac003080 tx=0x7f83ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.281+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ac038070 con 0x7f83c41047a0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.281+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83ac0097e0 con 0x7f83c41047a0 2024-09-12T01:39:44.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.281+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c410f660 con 0x7f83c41047a0 2024-09-12T01:39:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.281+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ac03d420 con 0x7f83c41047a0 2024-09-12T01:39:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.281+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c410fb20 con 0x7f83c41047a0 2024-09-12T01:39:44.283 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.282+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c40ffec0 con 0x7f83c41047a0 2024-09-12T01:39:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.282+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f83ac030020 con 0x7f83c41047a0 2024-09-12T01:39:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.283+0000 7f83c0ff9640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f83b006ed60 0x7f83b0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.283+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f83ac0ae370 con 0x7f83c41047a0 2024-09-12T01:39:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.283+0000 7f83c37fe640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f83b006ed60 0x7f83b0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.283+0000 7f83c37fe640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f83b006ed60 0x7f83b0071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006fd0 tx=0x7f83b4008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:44.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.287+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f83ac07b850 con 0x7f83c41047a0 2024-09-12T01:39:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:43 smithi153 ceph-mon[34713]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:44.453 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.452+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c40fdf40 con 0x7f83c41047a0 2024-09-12T01:39:44.454 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.453+0000 7f83c0ff9640 1 -- 172.21.15.66:0/3357379632 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11079 (secure 0 0 0) 0x7f83ac07b1f0 con 0x7f83c41047a0 2024-09-12T01:39:44.454 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:39:44.454 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":38,"fsid":"f9344df4-70a6-11ef-bcea-c7b262605968","created":"2024-09-12T01:34:00.031708+0000","modified":"2024-09-12T01:39:22.761770+0000","last_up_change":"2024-09-12T01:39:21.754471+0000","last_in_change":"2024-09-12T01:39:03.358557+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:38:09.276324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"edc79b5e-a9ef-40b7-8782-b0fa04f78cf4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6803","nonce":2436938389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6805","nonce":2436938389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6809","nonce":2436938389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":2436938389},{"type":"v1","addr":"172.21.15.66:6807","nonce":2436938389}]},"public_addr":"172.21.15.66:6803/2436938389","cluster_addr":"172.21.15.66:6805/2436938389","heartbeat_back_addr":"172.21.15.66:6809/2436938389","heartbeat_front_addr":"172.21.15.66:6807/2436938389","state":["exists","up"]},{"osd":1,"uuid":"e607715a-e1aa-4f1e-967a-9a7fbd0663e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6811","nonce":4197000140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6813","nonce":4197000140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6817","nonce":4197000140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":4197000140},{"type":"v1","addr":"172.21.15.66:6815","nonce":4197000140}]},"public_addr":"172.21.15.66:6811/4197000140","cluster_addr":"172.21.15.66:6813/4197000140","heartbeat_back_addr":"172.21.15.66:6817/4197000140","heartbeat_front_addr":"172.21.15.66:6815/4197000140","state":["exists","up"]},{"osd":2,"uuid":"ef7fccb5-01e7-467b-951f-d4ba9425c78d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6819","nonce":2925426172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6821","nonce":2925426172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6825","nonce":2925426172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":2925426172},{"type":"v1","addr":"172.21.15.66:6823","nonce":2925426172}]},"public_addr":"172.21.15.66:6819/2925426172","cluster_addr":"172.21.15.66:6821/2925426172","heartbeat_back_addr":"172.21.15.66:6825/2925426172","heartbeat_front_addr":"172.21.15.66:6823/2925426172","state":["exists","up"]},{"osd":3,"uuid":"a62ea4ad-82e8-4dd6-8211-efa1e65af2f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6801","nonce":2866587131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6803","nonce":2866587131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6807","nonce":2866587131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2866587131},{"type":"v1","addr":"172.21.15.153:6805","nonce":2866587131}]},"public_addr":"172.21.15.153:6801/2866587131","cluster_addr":"172.21.15.153:6803/2866587131","heartbeat_back_addr":"172.21.15.153:6807/2866587131","heartbeat_front_addr":"172.21.15.153:6805/2866587131","state":["exists","up"]},{"osd":4,"uuid":"672bb0ec-7a4e-4673-b73d-f0a110c47e3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6809","nonce":2609916870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6811","nonce":2609916870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6815","nonce":2609916870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":2609916870},{"type":"v1","addr":"172.21.15.153:6813","nonce":2609916870}]},"public_addr":"172.21.15.153:6809/2609916870","cluster_addr":"172.21.15.153:6811/2609916870","heartbeat_back_addr":"172.21.15.153:6815/2609916870","heartbeat_front_addr":"172.21.15.153:6813/2609916870","state":["exists","up"]},{"osd":5,"uuid":"216a8552-eab1-4684-bdd5-3a660212926a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6817","nonce":873059570}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6819","nonce":873059570}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6823","nonce":873059570}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":873059570},{"type":"v1","addr":"172.21.15.153:6821","nonce":873059570}]},"public_addr":"172.21.15.153:6817/873059570","cluster_addr":"172.21.15.153:6819/873059570","heartbeat_back_addr":"172.21.15.153:6823/873059570","heartbeat_front_addr":"172.21.15.153:6821/873059570","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:37:11.338198+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:37:38.743153+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:06.877247+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:29.422586+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:38:54.963969+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:39:20.453430+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.66:0/3969880503":"2024-09-13T01:36:02.780216+0000","172.21.15.66:0/1197929559":"2024-09-13T01:34:28.667247+0000","172.21.15.66:6801/151382692":"2024-09-13T01:36:02.780216+0000","172.21.15.66:6800/3928441794":"2024-09-13T01:34:58.305660+0000","172.21.15.66:6800/2001799335":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/2113754837":"2024-09-13T01:34:28.667247+0000","172.21.15.66:6801/3928441794":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/2635713227":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/671152596":"2024-09-13T01:34:58.305660+0000","172.21.15.66:0/109517485":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/532912125":"2024-09-13T01:34:58.305660+0000","172.21.15.66:6801/2001799335":"2024-09-13T01:34:28.667247+0000","172.21.15.66:0/201526823":"2024-09-13T01:36:02.780216+0000","172.21.15.66:0/2691404876":"2024-09-13T01:36:02.780216+0000","172.21.15.66:6800/151382692":"2024-09-13T01:36:02.780216+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:44.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f83b006ed60 msgr2=0x7f83b0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f83b006ed60 0x7f83b0071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006fd0 tx=0x7f83b4008040 comp rx=0 tx=0).stop 2024-09-12T01:39:44.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 msgr2=0x7f83c4115960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 0x7f83c4115960 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f83ac003080 tx=0x7f83ac009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 shutdown_connections 2024-09-12T01:39:44.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f83b006ed60 0x7f83b0071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83c41047a0 0x7f83c4115960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 --2- 172.21.15.66:0/3357379632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83c40fe780 0x7f83c4115420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 >> 172.21.15.66:0/3357379632 conn(0x7f83c40fa320 msgr2=0x7f83c40fb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:44.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 shutdown_connections 2024-09-12T01:39:44.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:44.455+0000 7f83c9da7640 1 -- 172.21.15.66:0/3357379632 wait complete. 2024-09-12T01:39:45.065 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-12T01:39:45.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-12T01:39:45.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-12T01:39:45.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-12T01:39:45.067 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-12T01:39:45.067 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-12T01:39:45.383 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:45.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:44 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3357379632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:39:45.396 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:45.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:44 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3357379632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-12T01:39:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:45 smithi066 ceph-mon[27875]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:45 smithi153 ceph-mon[34713]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:47.905 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:47.906 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:47.906 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:48.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:47 smithi066 ceph-mon[27875]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:48.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:47 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:48.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 -- 172.21.15.66:0/371559969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 msgr2=0x7ff1b00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:48.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 --2- 172.21.15.66:0/371559969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b00fbbe0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00048d0 tx=0x7ff1a0009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 -- 172.21.15.66:0/371559969 shutdown_connections 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 --2- 172.21.15.66:0/371559969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b00fcf80 0x7ff1b00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 --2- 172.21.15.66:0/371559969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b00fbbe0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 -- 172.21.15.66:0/371559969 >> 172.21.15.66:0/371559969 conn(0x7ff1b00723b0 msgr2=0x7ff1b00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 -- 172.21.15.66:0/371559969 shutdown_connections 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.315+0000 7ff1b572e640 1 -- 172.21.15.66:0/371559969 wait complete. 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1b572e640 1 Processor -- start 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1b572e640 1 -- start start 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1b572e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b010e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1b572e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b00fcf80 0x7ff1b010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1b572e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b010ed00 con 0x7ff1b00fb810 2024-09-12T01:39:48.345 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1b572e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b010ee70 con 0x7ff1b00fcf80 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1aeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b010e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1aeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b010e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37462/0 (socket says 172.21.15.66:37462) 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1aeffd640 1 -- 172.21.15.66:0/2819635179 learned_addr learned my addr 172.21.15.66:0/2819635179 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1ae7fc640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b00fcf80 0x7ff1b010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1aeffd640 1 -- 172.21.15.66:0/2819635179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b00fcf80 msgr2=0x7ff1b010e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1aeffd640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b00fcf80 0x7ff1b010e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.316+0000 7ff1aeffd640 1 -- 172.21.15.66:0/2819635179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0005040 con 0x7ff1b00fb810 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.317+0000 7ff1aeffd640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b010e170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0000c00 tx=0x7ff1a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.317+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a0038070 con 0x7ff1b00fb810 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.317+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b01171e0 con 0x7ff1b00fb810 2024-09-12T01:39:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.317+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1a002ade0 con 0x7ff1b00fb810 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.317+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b0117640 con 0x7ff1b00fb810 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.317+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a002c7e0 con 0x7ff1b00fb810 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.318+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1b00fae90 con 0x7ff1b00fb810 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff1a0030020 con 0x7ff1b00fb810 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1977fe640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff19806ed60 0x7ff198071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff1a00ae5a0 con 0x7ff1b00fb810 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1ae7fc640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff19806ed60 0x7ff198071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1977fe640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] conn(0x7ff198074ae0 0x7ff198076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 --> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1980775a0 con 0x7ff198074ae0 2024-09-12T01:39:48.347 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a00ae980 con 0x7ff1b00fb810 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.319+0000 7ff1af7fe640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] conn(0x7ff198074ae0 0x7ff198076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.320+0000 7ff1ae7fc640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff19806ed60 0x7ff198071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0065980 tx=0x7ff1a400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.320+0000 7ff1af7fe640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] conn(0x7ff198074ae0 0x7ff198076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.320+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== osd.1 v2:172.21.15.66:6810/4197000140 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff1980775a0 con 0x7ff198074ae0 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.333+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 --> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1b00fcbc0 con 0x7ff198074ae0 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.333+0000 7ff1977fe640 1 -- 172.21.15.66:0/2819635179 <== osd.1 v2:172.21.15.66:6810/4197000140 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff1b00fcbc0 con 0x7ff198074ae0 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.333+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] conn(0x7ff198074ae0 msgr2=0x7ff198076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.333+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] conn(0x7ff198074ae0 0x7ff198076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff19806ed60 msgr2=0x7ff198071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff19806ed60 0x7ff198071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0065980 tx=0x7ff1a400b040 comp rx=0 tx=0).stop 2024-09-12T01:39:48.348 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 msgr2=0x7ff1b010e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b010e170 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0000c00 tx=0x7ff1a0009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 shutdown_connections 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6810/4197000140,v1:172.21.15.66:6811/4197000140] conn(0x7ff198074ae0 0x7ff198076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff19806ed60 0x7ff198071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1b00fcf80 0x7ff1b010e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 --2- 172.21.15.66:0/2819635179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1b00fb810 0x7ff1b010e170 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 >> 172.21.15.66:0/2819635179 conn(0x7ff1b00723b0 msgr2=0x7ff1b00fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 shutdown_connections 2024-09-12T01:39:48.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:48.334+0000 7ff1b572e640 1 -- 172.21.15.66:0/2819635179 wait complete. 2024-09-12T01:39:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:47 smithi153 ceph-mon[34713]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:47 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:39:49.020 INFO:teuthology.orchestra.run.smithi066.stdout:60129542173 2024-09-12T01:39:49.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- 172.21.15.66:0/12317736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 msgr2=0x7f4ad8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/12317736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8102900 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00048d0 tx=0x7f4ad0009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- 172.21.15.66:0/12317736 shutdown_connections 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/12317736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 0x7f4ad80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/12317736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8102900 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- 172.21.15.66:0/12317736 >> 172.21.15.66:0/12317736 conn(0x7f4ad80f80f0 msgr2=0x7f4ad80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- 172.21.15.66:0/12317736 shutdown_connections 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- 172.21.15.66:0/12317736 wait complete. 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 Processor -- start 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- start start 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.484+0000 7f4adf4c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8113e20 con 0x7f4ad8102530 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4adf4c1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad810d1d0 con 0x7f4ad8102ed0 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37476/0 (socket says 172.21.15.66:37476) 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 -- 172.21.15.66:0/120525741 learned_addr learned my addr 172.21.15.66:0/120525741 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 -- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 msgr2=0x7f4ad8113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4adca5c640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 -- 172.21.15.66:0/120525741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0005040 con 0x7f4ad8102530 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4adca5c640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4add25d640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8113250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000c00 tx=0x7f4ad0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad0038070 con 0x7f4ad8102530 2024-09-12T01:39:49.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ad003daf0 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad810d450 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.485+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ad0033b20 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.486+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad810d970 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.486+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ad810dea0 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.487+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4ad0030020 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.487+0000 7f4ad5ffb640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4ac006ed60 0x7f4ac0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f4ad00ae010 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4adca5c640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4ac006ed60 0x7f4ac0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4ad5ffb640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] conn(0x7f4ac0074ae0 0x7f4ac0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 --> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ac00775a0 con 0x7f4ac0074ae0 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ad00b0600 con 0x7f4ad8102530 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4adca5c640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4ac006ed60 0x7f4ac0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006fd0 tx=0x7f4acc008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.488+0000 7f4adda5e640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] conn(0x7f4ac0074ae0 0x7f4ac0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.489+0000 7f4adda5e640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] conn(0x7f4ac0074ae0 0x7f4ac0076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.489+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== osd.3 v2:172.21.15.153:6800/2866587131 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f4ac00775a0 con 0x7f4ac0074ae0 2024-09-12T01:39:49.497 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:49.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.502+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 --> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ad810e060 con 0x7f4ac0074ae0 2024-09-12T01:39:49.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.503+0000 7f4ad5ffb640 1 -- 172.21.15.66:0/120525741 <== osd.3 v2:172.21.15.153:6800/2866587131 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4ac800ae50 con 0x7f4ac0074ae0 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.503+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] conn(0x7f4ac0074ae0 msgr2=0x7f4ac0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.503+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] conn(0x7f4ac0074ae0 0x7f4ac0076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4ac006ed60 msgr2=0x7f4ac0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4ac006ed60 0x7f4ac0071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4acc006fd0 tx=0x7f4acc008040 comp rx=0 tx=0).stop 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 msgr2=0x7f4ad8113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8113250 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000c00 tx=0x7f4ad0009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 shutdown_connections 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:6800/2866587131,v1:172.21.15.153:6801/2866587131] conn(0x7f4ac0074ae0 0x7f4ac0076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4ac006ed60 0x7f4ac0071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ad8102ed0 0x7f4ad8113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 --2- 172.21.15.66:0/120525741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4ad8102530 0x7f4ad8113250 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 >> 172.21.15.66:0/120525741 conn(0x7f4ad80f80f0 msgr2=0x7f4ad80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 shutdown_connections 2024-09-12T01:39:49.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:49.504+0000 7f4adf4c1640 1 -- 172.21.15.66:0/120525741 wait complete. 2024-09-12T01:39:50.304 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:49 smithi066 ceph-mon[27875]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:50.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:49 smithi153 ceph-mon[34713]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:51.097 INFO:teuthology.orchestra.run.smithi066.stdout:111669149714 2024-09-12T01:39:51.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-12T01:39:52.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:51 smithi066 ceph-mon[27875]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:51 smithi153 ceph-mon[34713]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:53.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 -- 172.21.15.66:0/193284625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102ed0 msgr2=0x7f10400fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:53.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 --2- 172.21.15.66:0/193284625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102ed0 0x7f10400fc590 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f10340048d0 tx=0x7f1034009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 -- 172.21.15.66:0/193284625 shutdown_connections 2024-09-12T01:39:53.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 --2- 172.21.15.66:0/193284625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102ed0 0x7f10400fc590 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 --2- 172.21.15.66:0/193284625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1040102530 0x7f1040102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 -- 172.21.15.66:0/193284625 >> 172.21.15.66:0/193284625 conn(0x7f10400f80f0 msgr2=0x7f10400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:53.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 -- 172.21.15.66:0/193284625 shutdown_connections 2024-09-12T01:39:53.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 -- 172.21.15.66:0/193284625 wait complete. 2024-09-12T01:39:53.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.554+0000 7f1046518640 1 Processor -- start 2024-09-12T01:39:53.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f1046518640 1 -- start start 2024-09-12T01:39:53.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f1046518640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 0x7f10401131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:53.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f1046518640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1040102ed0 0x7f1040113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:53.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f1046518640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1040113d30 con 0x7f1040102530 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f1046518640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104010d170 con 0x7f1040102ed0 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 0x7f10401131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 0x7f10401131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57022/0 (socket says 172.21.15.66:57022) 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103ffff640 1 -- 172.21.15.66:0/1701704597 learned_addr learned my addr 172.21.15.66:0/1701704597 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103f7fe640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1040102ed0 0x7f1040113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103ffff640 1 -- 172.21.15.66:0/1701704597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1040102ed0 msgr2=0x7f1040113730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103ffff640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1040102ed0 0x7f1040113730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.555+0000 7f103ffff640 1 -- 172.21.15.66:0/1701704597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034005040 con 0x7f1040102530 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.556+0000 7f103ffff640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 0x7f10401131f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1030002a50 tx=0x7f1030004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.556+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1030007c30 con 0x7f1040102530 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.556+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f103000f040 con 0x7f1040102530 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.556+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104010d450 con 0x7f1040102530 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.556+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103000da10 con 0x7f1040102530 2024-09-12T01:39:53.557 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.556+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104010d9c0 con 0x7f1040102530 2024-09-12T01:39:53.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.557+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f104010df30 con 0x7f1040102530 2024-09-12T01:39:53.558 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.557+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f103000dc80 con 0x7f1040102530 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103cff9640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f102806ed60 0x7f1028071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f103008d600 con 0x7f1040102530 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103f7fe640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f102806ed60 0x7f1028071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103cff9640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] conn(0x7f1028074ae0 0x7f1028076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 --> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10280775a0 con 0x7f1028074ae0 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f103008fc50 con 0x7f1040102530 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f1044ab5640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] conn(0x7f1028074ae0 0x7f1028076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:53.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f103f7fe640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f102806ed60 0x7f1028071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10340048a0 tx=0x7f1034035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:53.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.558+0000 7f1044ab5640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] conn(0x7f1028074ae0 0x7f1028076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:53.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.559+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== osd.2 v2:172.21.15.66:6818/2925426172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f10280775a0 con 0x7f1028074ae0 2024-09-12T01:39:53.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.571+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 --> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f10400fdcb0 con 0x7f1028074ae0 2024-09-12T01:39:53.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f103cff9640 1 -- 172.21.15.66:0/1701704597 <== osd.2 v2:172.21.15.66:6818/2925426172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f10400fdcb0 con 0x7f1028074ae0 2024-09-12T01:39:53.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] conn(0x7f1028074ae0 msgr2=0x7f1028076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:53.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] conn(0x7f1028074ae0 0x7f1028076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f102806ed60 msgr2=0x7f1028071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:53.572 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f102806ed60 0x7f1028071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f10340048a0 tx=0x7f1034035040 comp rx=0 tx=0).stop 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 msgr2=0x7f10401131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 0x7f10401131f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1030002a50 tx=0x7f1030004600 comp rx=0 tx=0).stop 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 shutdown_connections 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6818/2925426172,v1:172.21.15.66:6819/2925426172] conn(0x7f1028074ae0 0x7f1028076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f102806ed60 0x7f1028071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1040102ed0 0x7f1040113730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 --2- 172.21.15.66:0/1701704597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1040102530 0x7f10401131f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 >> 172.21.15.66:0/1701704597 conn(0x7f10400f80f0 msgr2=0x7f10400f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 shutdown_connections 2024-09-12T01:39:53.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:53.572+0000 7f1046518640 1 -- 172.21.15.66:0/1701704597 wait complete. 2024-09-12T01:39:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:53 smithi066 ceph-mon[27875]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:54.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:53 smithi153 ceph-mon[34713]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:55.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2611928236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 msgr2=0x7fdf380fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2611928236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf380fd3d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0048d0 tx=0x7fdf2c009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2611928236 shutdown_connections 2024-09-12T01:39:55.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2611928236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf380fd3d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2611928236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf380fb810 0x7fdf380fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2611928236 >> 172.21.15.66:0/2611928236 conn(0x7fdf380723b0 msgr2=0x7fdf380727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:55.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2611928236 shutdown_connections 2024-09-12T01:39:55.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.148+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2611928236 wait complete. 2024-09-12T01:39:55.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.149+0000 7fdf3e7e6640 1 Processor -- start 2024-09-12T01:39:55.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.149+0000 7fdf3e7e6640 1 -- start start 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf3e7e6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf380fb810 0x7fdf38113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf3e7e6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf381136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf3e7e6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38113cb0 con 0x7fdf380fcf80 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf3e7e6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3810d0f0 con 0x7fdf380fb810 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf381136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf381136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57034/0 (socket says 172.21.15.66:57034) 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf377fe640 1 -- 172.21.15.66:0/2102397127 learned_addr learned my addr 172.21.15.66:0/2102397127 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf37fff640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf380fb810 0x7fdf38113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf377fe640 1 -- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf380fb810 msgr2=0x7fdf38113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf377fe640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf380fb810 0x7fdf38113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.150+0000 7fdf377fe640 1 -- 172.21.15.66:0/2102397127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c005040 con 0x7fdf380fcf80 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.151+0000 7fdf377fe640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf381136b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c000c00 tx=0x7fdf2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.151+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf2c038070 con 0x7fdf380fcf80 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.151+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf2c02ade0 con 0x7fdf380fcf80 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.151+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3810d370 con 0x7fdf380fcf80 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.151+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf2c02c7e0 con 0x7fdf380fcf80 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.151+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3810d8b0 con 0x7fdf380fcf80 2024-09-12T01:39:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.152+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf3810de50 con 0x7fdf380fcf80 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.153+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdf2c030020 con 0x7fdf380fcf80 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.153+0000 7fdf34ff9640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf2006ed60 0x7fdf20071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.153+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fdf2c0ada80 con 0x7fdf380fcf80 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.153+0000 7fdf37fff640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf2006ed60 0x7fdf20071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.153+0000 7fdf34ff9640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] conn(0x7fdf20074b30 0x7fdf20076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.153+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 --> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf200775f0 con 0x7fdf20074b30 2024-09-12T01:39:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.154+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf2c0b2220 con 0x7fdf380fcf80 2024-09-12T01:39:55.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.154+0000 7fdf3cd83640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] conn(0x7fdf20074b30 0x7fdf20076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:55.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.154+0000 7fdf37fff640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf2006ed60 0x7fdf20071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf28004ed0 tx=0x7fdf2800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:55.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.154+0000 7fdf3cd83640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] conn(0x7fdf20074b30 0x7fdf20076f40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:55.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.155+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== osd.5 v2:172.21.15.153:6816/873059570 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fdf200775f0 con 0x7fdf20074b30 2024-09-12T01:39:55.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.171+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 --> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf380ff950 con 0x7fdf20074b30 2024-09-12T01:39:55.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.172+0000 7fdf34ff9640 1 -- 172.21.15.66:0/2102397127 <== osd.5 v2:172.21.15.153:6816/873059570 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdf380ff950 con 0x7fdf20074b30 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.172+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] conn(0x7fdf20074b30 msgr2=0x7fdf20076f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.172+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] conn(0x7fdf20074b30 0x7fdf20076f40 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf2006ed60 msgr2=0x7fdf20071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf2006ed60 0x7fdf20071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf28004ed0 tx=0x7fdf2800b040 comp rx=0 tx=0).stop 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 msgr2=0x7fdf381136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf381136b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c000c00 tx=0x7fdf2c009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 shutdown_connections 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:6816/873059570,v1:172.21.15.153:6817/873059570] conn(0x7fdf20074b30 0x7fdf20076f40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fdf2006ed60 0x7fdf20071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdf380fcf80 0x7fdf381136b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 --2- 172.21.15.66:0/2102397127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf380fb810 0x7fdf38113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 >> 172.21.15.66:0/2102397127 conn(0x7fdf380723b0 msgr2=0x7fdf38065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 shutdown_connections 2024-09-12T01:39:55.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.173+0000 7fdf3e7e6640 1 -- 172.21.15.66:0/2102397127 wait complete. 2024-09-12T01:39:56.210 INFO:teuthology.orchestra.run.smithi066.stdout:81604378648 2024-09-12T01:39:56.211 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-12T01:39:56.235 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:55 smithi066 ceph-mon[27875]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.339+0000 7efcbe510640 1 -- 172.21.15.66:0/1961596403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb8102620 msgr2=0x7efcb81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.339+0000 7efcbe510640 1 --2- 172.21.15.66:0/1961596403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb8102620 0x7efcb81029f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efca80048d0 tx=0x7efca8009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.339+0000 7efcbe510640 1 -- 172.21.15.66:0/1961596403 shutdown_connections 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.339+0000 7efcbe510640 1 --2- 172.21.15.66:0/1961596403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcb80fac80 0x7efcb80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.339+0000 7efcbe510640 1 --2- 172.21.15.66:0/1961596403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb8102620 0x7efcb81029f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 -- 172.21.15.66:0/1961596403 >> 172.21.15.66:0/1961596403 conn(0x7efcb8070ce0 msgr2=0x7efcb80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 -- 172.21.15.66:0/1961596403 shutdown_connections 2024-09-12T01:39:56.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 -- 172.21.15.66:0/1961596403 wait complete. 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 Processor -- start 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 -- start start 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 0x7efcb81153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcb8102620 0x7efcb81158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb8115f70 con 0x7efcb80fac80 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.340+0000 7efcbe510640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb810f360 con 0x7efcb8102620 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 0x7efcb81153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 0x7efcb81153a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57044/0 (socket says 172.21.15.66:57044) 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 -- 172.21.15.66:0/1131635274 learned_addr learned my addr 172.21.15.66:0/1131635274 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb77fe640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcb8102620 0x7efcb81158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 -- 172.21.15.66:0/1131635274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcb8102620 msgr2=0x7efcb81158e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcb8102620 0x7efcb81158e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 -- 172.21.15.66:0/1131635274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8005040 con 0x7efcb80fac80 2024-09-12T01:39:56.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb7fff640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 0x7efcb81153a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efca8003080 tx=0x7efca8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca8038070 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efca80097e0 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb810f5e0 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca803d420 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.341+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb810faa0 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.342+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcb810ff80 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7efca8030020 con 0x7efcb80fac80 2024-09-12T01:39:56.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb4ff9640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7efca006ed60 0x7efca0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7efca80ae370 con 0x7efcb80fac80 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb77fe640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7efca006ed60 0x7efca0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb4ff9640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] conn(0x7efca0074ae0 0x7efca0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 --> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efca00775a0 con 0x7efca0074ae0 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.343+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca80b0960 con 0x7efcb80fac80 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.344+0000 7efcbcaad640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] conn(0x7efca0074ae0 0x7efca0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.344+0000 7efcb77fe640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7efca006ed60 0x7efca0071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efcb8110ca0 tx=0x7efcac009120 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.344+0000 7efcbcaad640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] conn(0x7efca0074ae0 0x7efca0076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:56.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.345+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== osd.0 v2:172.21.15.66:6802/2436938389 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7efca00775a0 con 0x7efca0074ae0 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.357+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 --> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcb80657b0 con 0x7efca0074ae0 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.357+0000 7efcb4ff9640 1 -- 172.21.15.66:0/1131635274 <== osd.0 v2:172.21.15.66:6802/2436938389 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efcb80657b0 con 0x7efca0074ae0 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] conn(0x7efca0074ae0 msgr2=0x7efca0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] conn(0x7efca0074ae0 0x7efca0076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7efca006ed60 msgr2=0x7efca0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7efca006ed60 0x7efca0071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efcb8110ca0 tx=0x7efcac009120 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 msgr2=0x7efcb81153a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 0x7efcb81153a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efca8003080 tx=0x7efca8009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 shutdown_connections 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7efca006ed60 0x7efca0071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efcb8102620 0x7efcb81158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:6802/2436938389,v1:172.21.15.66:6803/2436938389] conn(0x7efca0074ae0 0x7efca0076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 --2- 172.21.15.66:0/1131635274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcb80fac80 0x7efcb81153a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 >> 172.21.15.66:0/1131635274 conn(0x7efcb8070ce0 msgr2=0x7efcb80720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:56.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 shutdown_connections 2024-09-12T01:39:56.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:55.358+0000 7efcbe510640 1 -- 172.21.15.66:0/1131635274 wait complete. 2024-09-12T01:39:56.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:55 smithi153 ceph-mon[34713]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:56.805 INFO:teuthology.orchestra.run.smithi066.stdout:38654705699 2024-09-12T01:39:56.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-12T01:39:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:57.219 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:57.253 INFO:teuthology.orchestra.run.smithi066.stdout:158913789961 2024-09-12T01:39:57.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-12T01:39:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:57.701 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:39:58.115 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:57 smithi066 ceph-mon[27875]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:57 smithi153 ceph-mon[34713]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 -- 172.21.15.66:0/601019611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 msgr2=0x7ff0880fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/601019611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff0880fe830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff0840048d0 tx=0x7ff084009da0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 -- 172.21.15.66:0/601019611 shutdown_connections 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/601019611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff088064fc0 0x7ff088065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/601019611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff0880fe830 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 -- 172.21.15.66:0/601019611 >> 172.21.15.66:0/601019611 conn(0x7ff0880723b0 msgr2=0x7ff0880727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.861+0000 7ff08f9eb640 1 -- 172.21.15.66:0/601019611 shutdown_connections 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 -- 172.21.15.66:0/601019611 wait complete. 2024-09-12T01:39:59.862 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 Processor -- start 2024-09-12T01:39:59.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 -- start start 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff088064fc0 0x7ff088113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff088113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088113dd0 con 0x7ff0880fe460 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08f9eb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08810d180 con 0x7ff088064fc0 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.862+0000 7ff08cf86640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff088113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08cf86640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff088113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57048/0 (socket says 172.21.15.66:57048) 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08cf86640 1 -- 172.21.15.66:0/2655823152 learned_addr learned my addr 172.21.15.66:0/2655823152 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08d787640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff088064fc0 0x7ff088113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08cf86640 1 -- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff088064fc0 msgr2=0x7ff088113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:59.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08cf86640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff088064fc0 0x7ff088113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08cf86640 1 -- 172.21.15.66:0/2655823152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff084005040 con 0x7ff0880fe460 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08cf86640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff088113740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b790 tx=0x7ff0780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07800c700 con 0x7ff0880fe460 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08810d460 con 0x7ff0880fe460 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff07800cd00 con 0x7ff0880fe460 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.863+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff078015e80 con 0x7ff0880fe460 2024-09-12T01:39:59.865 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.864+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08810d980 con 0x7ff0880fe460 2024-09-12T01:39:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.864+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff08810dec0 con 0x7ff0880fe460 2024-09-12T01:39:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.865+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff078012070 con 0x7ff0880fe460 2024-09-12T01:39:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff07dffb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff07406ed60 0x7ff074071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:59.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff07808d6d0 con 0x7ff0880fe460 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff08d787640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff07406ed60 0x7ff074071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff07dffb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] conn(0x7ff074074ae0 0x7ff074076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 --> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0740775a0 con 0x7ff074074ae0 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff07808fd20 con 0x7ff0880fe460 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.866+0000 7ff08df88640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] conn(0x7ff074074ae0 0x7ff074076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.867+0000 7ff08d787640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff07406ed60 0x7ff074071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff084009ac0 tx=0x7ff084035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.867+0000 7ff08df88640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] conn(0x7ff074074ae0 0x7ff074076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:59.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.868+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== osd.4 v2:172.21.15.153:6808/2609916870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff0740775a0 con 0x7ff074074ae0 2024-09-12T01:39:59.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.880+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 --> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff088106df0 con 0x7ff074074ae0 2024-09-12T01:39:59.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff07dffb640 1 -- 172.21.15.66:0/2655823152 <== osd.4 v2:172.21.15.153:6808/2609916870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff088106df0 con 0x7ff074074ae0 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] conn(0x7ff074074ae0 msgr2=0x7ff074076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] conn(0x7ff074074ae0 0x7ff074076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff07406ed60 msgr2=0x7ff074071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff07406ed60 0x7ff074071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff084009ac0 tx=0x7ff084035040 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 msgr2=0x7ff088113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.881+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff088113740 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff07800b790 tx=0x7ff0780091d0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 shutdown_connections 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:6808/2609916870,v1:172.21.15.153:6809/2609916870] conn(0x7ff074074ae0 0x7ff074076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff07406ed60 0x7ff074071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0880fe460 0x7ff088113740 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 --2- 172.21.15.66:0/2655823152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff088064fc0 0x7ff088113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 >> 172.21.15.66:0/2655823152 conn(0x7ff0880723b0 msgr2=0x7ff088105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:59.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 shutdown_connections 2024-09-12T01:39:59.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:39:59.882+0000 7ff08f9eb640 1 -- 172.21.15.66:0/2655823152 wait complete. 2024-09-12T01:40:00.307 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:39:59 smithi066 ceph-mon[27875]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:00.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:39:59 smithi153 ceph-mon[34713]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:01.118 INFO:teuthology.orchestra.run.smithi066.stdout:137438953487 2024-09-12T01:40:01.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-12T01:40:01.263 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:00 smithi066 ceph-mon[27875]: overall HEALTH_OK 2024-09-12T01:40:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:00 smithi153 ceph-mon[34713]: overall HEALTH_OK 2024-09-12T01:40:01.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 -- 172.21.15.66:0/4169895551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 msgr2=0x7f8bc00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:01.440 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 --2- 172.21.15.66:0/4169895551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc00fbbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8ba80048d0 tx=0x7f8ba8009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 -- 172.21.15.66:0/4169895551 shutdown_connections 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 --2- 172.21.15.66:0/4169895551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc00fcf80 0x7f8bc00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 --2- 172.21.15.66:0/4169895551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc00fbbe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 -- 172.21.15.66:0/4169895551 >> 172.21.15.66:0/4169895551 conn(0x7f8bc00723b0 msgr2=0x7f8bc00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 -- 172.21.15.66:0/4169895551 shutdown_connections 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.438+0000 7f8bc4886640 1 -- 172.21.15.66:0/4169895551 wait complete. 2024-09-12T01:40:01.441 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bc4886640 1 Processor -- start 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bc4886640 1 -- start start 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bc4886640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc010e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bc4886640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc00fcf80 0x7f8bc010e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bc4886640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc010ed40 con 0x7f8bc00fb810 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bc4886640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc010eeb0 con 0x7f8bc00fcf80 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bbe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc010e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bbe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc010e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57064/0 (socket says 172.21.15.66:57064) 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bbe59c640 1 -- 172.21.15.66:0/3017780333 learned_addr learned my addr 172.21.15.66:0/3017780333 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:01.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.439+0000 7f8bbdd9b640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc00fcf80 0x7f8bc010e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bbe59c640 1 -- 172.21.15.66:0/3017780333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc00fcf80 msgr2=0x7f8bc010e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bbe59c640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc00fcf80 0x7f8bc010e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bbe59c640 1 -- 172.21.15.66:0/3017780333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8005040 con 0x7f8bc00fb810 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bbe59c640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc010e1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8000c00 tx=0x7f8ba8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba802ade0 con 0x7f8bc00fb810 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc010bfa0 con 0x7f8bc00fb810 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ba8009760 con 0x7f8bc00fb810 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba8038450 con 0x7f8bc00fb810 2024-09-12T01:40:01.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.440+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc010c4e0 con 0x7f8bc00fb810 2024-09-12T01:40:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.441+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc00fcbc0 con 0x7f8bc00fb810 2024-09-12T01:40:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.442+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8ba8030020 con 0x7f8bc00fb810 2024-09-12T01:40:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.443+0000 7f8bb6ffd640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8bac06ed60 0x7f8bac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.443+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8ba80b20e0 con 0x7f8bc00fb810 2024-09-12T01:40:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.443+0000 7f8bbdd9b640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8bac06ed60 0x7f8bac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:01.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.443+0000 7f8bbdd9b640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8bac06ed60 0x7f8bac071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0065980 tx=0x7f8bb000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:01.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.447+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8ba807f5c0 con 0x7f8bc00fb810 2024-09-12T01:40:01.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.614+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8bc004b720 con 0x7f8bc00fb810 2024-09-12T01:40:01.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.615+0000 7f8bb6ffd640 1 -- 172.21.15.66:0/3017780333 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ba807ef60 con 0x7f8bc00fb810 2024-09-12T01:40:01.615 INFO:teuthology.orchestra.run.smithi066.stdout:111669149716 2024-09-12T01:40:01.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8bac06ed60 msgr2=0x7f8bac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:01.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8bac06ed60 0x7f8bac071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0065980 tx=0x7f8bb000b040 comp rx=0 tx=0).stop 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 msgr2=0x7f8bc010e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc010e1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8000c00 tx=0x7f8ba8009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 shutdown_connections 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8bac06ed60 0x7f8bac071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8bc00fcf80 0x7f8bc010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 --2- 172.21.15.66:0/3017780333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8bc00fb810 0x7f8bc010e1b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 >> 172.21.15.66:0/3017780333 conn(0x7f8bc00723b0 msgr2=0x7f8bc00fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.616+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 shutdown_connections 2024-09-12T01:40:01.617 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:01.617+0000 7f8bc4886640 1 -- 172.21.15.66:0/3017780333 wait complete. 2024-09-12T01:40:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:01 smithi066 ceph-mon[27875]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:01 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3017780333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:40:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:01 smithi153 ceph-mon[34713]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:01 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3017780333' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-12T01:40:03.209 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:03.931 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149716 for osd.3 2024-09-12T01:40:03.931 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 -- 172.21.15.66:0/273668383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a80064fc0 msgr2=0x7f8a80065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 --2- 172.21.15.66:0/273668383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a80064fc0 0x7f8a80065430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a700048d0 tx=0x7f8a70009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 -- 172.21.15.66:0/273668383 shutdown_connections 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 --2- 172.21.15.66:0/273668383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a80064fc0 0x7f8a80065430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 --2- 172.21.15.66:0/273668383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a800fe460 0x7f8a800fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 -- 172.21.15.66:0/273668383 >> 172.21.15.66:0/273668383 conn(0x7f8a800723b0 msgr2=0x7f8a800727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 -- 172.21.15.66:0/273668383 shutdown_connections 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.122+0000 7f8a8760e640 1 -- 172.21.15.66:0/273668383 wait complete. 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a8760e640 1 Processor -- start 2024-09-12T01:40:04.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a8760e640 1 -- start start 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a8760e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a80064fc0 0x7f8a80113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a8760e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 0x7f8a80113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a8760e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a80113e00 con 0x7f8a800fe460 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a8760e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8010d1b0 con 0x7f8a80064fc0 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a84ba9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 0x7f8a80113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a84ba9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 0x7f8a80113770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41680/0 (socket says 172.21.15.66:41680) 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a84ba9640 1 -- 172.21.15.66:0/2432743022 learned_addr learned my addr 172.21.15.66:0/2432743022 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.123+0000 7f8a853aa640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a80064fc0 0x7f8a80113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a84ba9640 1 -- 172.21.15.66:0/2432743022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a80064fc0 msgr2=0x7f8a80113230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a84ba9640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a80064fc0 0x7f8a80113230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a84ba9640 1 -- 172.21.15.66:0/2432743022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70005040 con 0x7f8a800fe460 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a84ba9640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 0x7f8a80113770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a70003080 tx=0x7f8a70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a70038070 con 0x7f8a800fe460 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8a7002ade0 con 0x7f8a800fe460 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8010d430 con 0x7f8a800fe460 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a7002c880 con 0x7f8a800fe460 2024-09-12T01:40:04.126 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.124+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8010d890 con 0x7f8a800fe460 2024-09-12T01:40:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.125+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a800fdcf0 con 0x7f8a800fe460 2024-09-12T01:40:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.126+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8a70030020 con 0x7f8a800fe460 2024-09-12T01:40:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.126+0000 7f8a75ffb640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8a6c06ed50 0x7f8a6c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.127+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8a700add40 con 0x7f8a800fe460 2024-09-12T01:40:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.127+0000 7f8a853aa640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8a6c06ed50 0x7f8a6c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:04.127 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.127+0000 7f8a853aa640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8a6c06ed50 0x7f8a6c071200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009b50 tx=0x7f8a7c009120 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:04.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.131+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8a7007b220 con 0x7f8a800fe460 2024-09-12T01:40:04.267 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:04 smithi066 ceph-mon[27875]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:04.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.295+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a8010e8d0 con 0x7f8a800fe460 2024-09-12T01:40:04.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.296+0000 7f8a75ffb640 1 -- 172.21.15.66:0/2432743022 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a7007abc0 con 0x7f8a800fe460 2024-09-12T01:40:04.296 INFO:teuthology.orchestra.run.smithi066.stdout:81604378650 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8a6c06ed50 msgr2=0x7f8a6c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8a6c06ed50 0x7f8a6c071200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009b50 tx=0x7f8a7c009120 comp rx=0 tx=0).stop 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 msgr2=0x7f8a80113770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 0x7f8a80113770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8a70003080 tx=0x7f8a70009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 shutdown_connections 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8a6c06ed50 0x7f8a6c071200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a800fe460 0x7f8a80113770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 --2- 172.21.15.66:0/2432743022 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a80064fc0 0x7f8a80113230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 >> 172.21.15.66:0/2432743022 conn(0x7f8a800723b0 msgr2=0x7f8a80105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 shutdown_connections 2024-09-12T01:40:04.298 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.298+0000 7f8a8760e640 1 -- 172.21.15.66:0/2432743022 wait complete. 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 -- 172.21.15.66:0/1297800610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c0fe460 msgr2=0x7f193c0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 --2- 172.21.15.66:0/1297800610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c0fe460 0x7f193c0fe830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19380048d0 tx=0x7f1938009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 -- 172.21.15.66:0/1297800610 shutdown_connections 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 --2- 172.21.15.66:0/1297800610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c064fc0 0x7f193c065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 --2- 172.21.15.66:0/1297800610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c0fe460 0x7f193c0fe830 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 -- 172.21.15.66:0/1297800610 >> 172.21.15.66:0/1297800610 conn(0x7f193c0723b0 msgr2=0x7f193c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 -- 172.21.15.66:0/1297800610 shutdown_connections 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.350+0000 7f1944513640 1 -- 172.21.15.66:0/1297800610 wait complete. 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1944513640 1 Processor -- start 2024-09-12T01:40:04.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1944513640 1 -- start start 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1944513640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 0x7f193c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1944513640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c0fe460 0x7f193c1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1944513640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c113cd0 con 0x7f193c064fc0 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1944513640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c10d110 con 0x7f193c0fe460 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f19422af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 0x7f193c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f19422af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 0x7f193c113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41708/0 (socket says 172.21.15.66:41708) 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f19422af640 1 -- 172.21.15.66:0/2761522356 learned_addr learned my addr 172.21.15.66:0/2761522356 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f1941aae640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c0fe460 0x7f193c1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.351+0000 7f19422af640 1 -- 172.21.15.66:0/2761522356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c0fe460 msgr2=0x7f193c1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f19422af640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c0fe460 0x7f193c1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f19422af640 1 -- 172.21.15.66:0/2761522356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938005040 con 0x7f193c064fc0 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f1941aae640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c0fe460 0x7f193c1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:40:04.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f19422af640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 0x7f193c113190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1938000c00 tx=0x7f1938009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1938038070 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f193802ade0 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c10d390 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f193802c7e0 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.352+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c10d850 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.353+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c0fdcf0 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.354+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1938030020 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.354+0000 7f1932ffd640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f192806ed60 0x7f1928071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.354+0000 7f1941aae640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f192806ed60 0x7f1928071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.354+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f19380adad0 con 0x7f193c064fc0 2024-09-12T01:40:04.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.355+0000 7f1941aae640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f192806ed60 0x7f1928071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f192c009af0 tx=0x7f192c00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:04.361 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.358+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f193807afe0 con 0x7f193c064fc0 2024-09-12T01:40:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:04 smithi153 ceph-mon[34713]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:04.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.523+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f193c04b720 con 0x7f193c064fc0 2024-09-12T01:40:04.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.524+0000 7f1932ffd640 1 -- 172.21.15.66:0/2761522356 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f193807a980 con 0x7f193c064fc0 2024-09-12T01:40:04.525 INFO:teuthology.orchestra.run.smithi066.stdout:60129542176 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f192806ed60 msgr2=0x7f1928071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f192806ed60 0x7f1928071210 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f192c009af0 tx=0x7f192c00b040 comp rx=0 tx=0).stop 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 msgr2=0x7f193c113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 0x7f193c113190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1938000c00 tx=0x7f1938009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 shutdown_connections 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f192806ed60 0x7f1928071210 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f193c0fe460 0x7f193c1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 --2- 172.21.15.66:0/2761522356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f193c064fc0 0x7f193c113190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 >> 172.21.15.66:0/2761522356 conn(0x7f193c0723b0 msgr2=0x7f193c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 shutdown_connections 2024-09-12T01:40:04.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:04.527+0000 7f1944513640 1 -- 172.21.15.66:0/2761522356 wait complete. 2024-09-12T01:40:05.053 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378650 for osd.2 2024-09-12T01:40:05.053 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:05.379 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:05 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2432743022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:40:05.379 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:05 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2761522356' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:40:05.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:05 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2432743022' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-12T01:40:05.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:05 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2761522356' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-12T01:40:05.554 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:06.258 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:06 smithi066 ceph-mon[27875]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:06 smithi153 ceph-mon[34713]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:07.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 -- 172.21.15.66:0/1555448884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fcf80 msgr2=0x7f701c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:07.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 --2- 172.21.15.66:0/1555448884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fcf80 0x7f701c0fd3d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7010009c50 tx=0x7f7010004d10 comp rx=0 tx=0).stop 2024-09-12T01:40:07.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 -- 172.21.15.66:0/1555448884 shutdown_connections 2024-09-12T01:40:07.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 --2- 172.21.15.66:0/1555448884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fcf80 0x7f701c0fd3d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:07.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 --2- 172.21.15.66:0/1555448884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0fb810 0x7f701c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:07.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 -- 172.21.15.66:0/1555448884 >> 172.21.15.66:0/1555448884 conn(0x7f701c0723b0 msgr2=0x7f701c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:07.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 -- 172.21.15.66:0/1555448884 shutdown_connections 2024-09-12T01:40:07.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.100+0000 7f7023b65640 1 -- 172.21.15.66:0/1555448884 wait complete. 2024-09-12T01:40:07.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7023b65640 1 Processor -- start 2024-09-12T01:40:07.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7023b65640 1 -- start start 2024-09-12T01:40:07.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7023b65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 0x7f701c10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:07.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7023b65640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0fcf80 0x7f701c10e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7023b65640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c10ed30 con 0x7f701c0fb810 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7023b65640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c10eea0 con 0x7f701c0fcf80 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7021901640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 0x7f701c10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7021901640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 0x7f701c10e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41728/0 (socket says 172.21.15.66:41728) 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7021901640 1 -- 172.21.15.66:0/2952142025 learned_addr learned my addr 172.21.15.66:0/2952142025 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.101+0000 7f7021100640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0fcf80 0x7f701c10e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f7021901640 1 -- 172.21.15.66:0/2952142025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0fcf80 msgr2=0x7f701c10e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f7021901640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0fcf80 0x7f701c10e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f7021901640 1 -- 172.21.15.66:0/2952142025 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100098b0 con 0x7f701c0fb810 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f7021901640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 0x7f701c10e2b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f701800c830 tx=0x7f7018004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f701800a850 con 0x7f701c0fb810 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c117180 con 0x7f701c0fb810 2024-09-12T01:40:07.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f701800ae50 con 0x7f701c0fb810 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70180113a0 con 0x7f701c0fb810 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.102+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c1176f0 con 0x7f701c0fb810 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.103+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c0fcbc0 con 0x7f701c0fb810 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.104+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7018012400 con 0x7f701c0fb810 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.104+0000 7f700e7fc640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f700806ed60 0x7f7008071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.104+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f701808e030 con 0x7f701c0fb810 2024-09-12T01:40:07.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.104+0000 7f7021100640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f700806ed60 0x7f7008071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:07.106 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.105+0000 7f7021100640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f700806ed60 0x7f7008071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f701c0659e0 tx=0x7f7010004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:07.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.108+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f701805b510 con 0x7f701c0fb810 2024-09-12T01:40:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.275+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f701c072ec0 con 0x7f701c0fb810 2024-09-12T01:40:07.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.276+0000 7f700e7fc640 1 -- 172.21.15.66:0/2952142025 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f701805aeb0 con 0x7f701c0fb810 2024-09-12T01:40:07.276 INFO:teuthology.orchestra.run.smithi066.stdout:158913789963 2024-09-12T01:40:07.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.277+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f700806ed60 msgr2=0x7f7008071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.277+0000 7f7023b65640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f700806ed60 0x7f7008071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f701c0659e0 tx=0x7f7010004d10 comp rx=0 tx=0).stop 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.277+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 msgr2=0x7f701c10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.277+0000 7f7023b65640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 0x7f701c10e2b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f701800c830 tx=0x7f7018004430 comp rx=0 tx=0).stop 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.277+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 shutdown_connections 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.277+0000 7f7023b65640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f700806ed60 0x7f7008071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.278+0000 7f7023b65640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0fcf80 0x7f701c10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.278+0000 7f7023b65640 1 --2- 172.21.15.66:0/2952142025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f701c0fb810 0x7f701c10e2b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.278+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 >> 172.21.15.66:0/2952142025 conn(0x7f701c0723b0 msgr2=0x7f701c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.278+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 shutdown_connections 2024-09-12T01:40:07.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:07.278+0000 7f7023b65640 1 -- 172.21.15.66:0/2952142025 wait complete. 2024-09-12T01:40:07.656 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542176 for osd.1 2024-09-12T01:40:07.656 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:08.345 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:08 smithi066 ceph-mon[27875]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:08.346 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:08 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2952142025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:40:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:08 smithi153 ceph-mon[34713]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:08 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2952142025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-12T01:40:08.745 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789961 got 158913789963 for osd.5 2024-09-12T01:40:08.745 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:08.828 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.231+0000 7f1a26b53640 1 -- 172.21.15.66:0/2987123957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a201014f0 msgr2=0x7f1a201018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.231+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2987123957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a201014f0 0x7f1a201018c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1a180048d0 tx=0x7f1a18009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 -- 172.21.15.66:0/2987123957 shutdown_connections 2024-09-12T01:40:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2987123957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a200fbd90 0x7f1a200fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2987123957 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a201014f0 0x7f1a201018c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 -- 172.21.15.66:0/2987123957 >> 172.21.15.66:0/2987123957 conn(0x7f1a20070ce0 msgr2=0x7f1a200710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 -- 172.21.15.66:0/2987123957 shutdown_connections 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 -- 172.21.15.66:0/2987123957 wait complete. 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 Processor -- start 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.232+0000 7f1a26b53640 1 -- start start 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a26b53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 0x7f1a2010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a26b53640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a201014f0 0x7f1a2010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a26b53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2010ed20 con 0x7f1a200fbd90 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a26b53640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2010ee90 con 0x7f1a201014f0 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 0x7f1a2010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 0x7f1a2010e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41750/0 (socket says 172.21.15.66:41750) 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 -- 172.21.15.66:0/2978750532 learned_addr learned my addr 172.21.15.66:0/2978750532 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a1ffff640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a201014f0 0x7f1a2010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:09.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 -- 172.21.15.66:0/2978750532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a201014f0 msgr2=0x7f1a2010e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a201014f0 0x7f1a2010e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 -- 172.21.15.66:0/2978750532 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18005040 con 0x7f1a200fbd90 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.233+0000 7f1a248ef640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 0x7f1a2010e190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1a18008f40 tx=0x7f1a18009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.234+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a18038070 con 0x7f1a200fbd90 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.234+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a1802ade0 con 0x7f1a200fbd90 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.234+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a1802c810 con 0x7f1a200fbd90 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.234+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a20117200 con 0x7f1a200fbd90 2024-09-12T01:40:09.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.235+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a20117660 con 0x7f1a200fbd90 2024-09-12T01:40:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.236+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a200fcda0 con 0x7f1a200fbd90 2024-09-12T01:40:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.236+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1a18030020 con 0x7f1a200fbd90 2024-09-12T01:40:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.237+0000 7f1a1d7fa640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1a0c06ed60 0x7f1a0c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.237+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1a180ae150 con 0x7f1a200fbd90 2024-09-12T01:40:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.237+0000 7f1a1ffff640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1a0c06ed60 0x7f1a0c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:09.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.238+0000 7f1a1ffff640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1a0c06ed60 0x7f1a0c071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a200fb680 tx=0x7f1a0800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:09.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.244+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1a1807b630 con 0x7f1a200fbd90 2024-09-12T01:40:09.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.412+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a20074c00 con 0x7f1a200fbd90 2024-09-12T01:40:09.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.413+0000 7f1a1d7fa640 1 -- 172.21.15.66:0/2978750532 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a1807afd0 con 0x7f1a200fbd90 2024-09-12T01:40:09.413 INFO:teuthology.orchestra.run.smithi066.stdout:38654705701 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.414+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1a0c06ed60 msgr2=0x7f1a0c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1a0c06ed60 0x7f1a0c071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1a200fb680 tx=0x7f1a0800b040 comp rx=0 tx=0).stop 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 msgr2=0x7f1a2010e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 0x7f1a2010e190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1a18008f40 tx=0x7f1a18009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 shutdown_connections 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1a0c06ed60 0x7f1a0c071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a201014f0 0x7f1a2010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 --2- 172.21.15.66:0/2978750532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a200fbd90 0x7f1a2010e190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:09.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 >> 172.21.15.66:0/2978750532 conn(0x7f1a20070ce0 msgr2=0x7f1a20104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:09.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 shutdown_connections 2024-09-12T01:40:09.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:09.415+0000 7f1a26b53640 1 -- 172.21.15.66:0/2978750532 wait complete. 2024-09-12T01:40:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:10 smithi066 ceph-mon[27875]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:10 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2978750532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:40:10.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:10 smithi153 ceph-mon[34713]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:10.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:10 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2978750532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-12T01:40:11.306 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705699 got 38654705701 for osd.0 2024-09-12T01:40:11.306 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:11.559 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 -- 172.21.15.66:0/1041735275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab40fac80 msgr2=0x7f7ab40fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:11.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 --2- 172.21.15.66:0/1041735275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab40fac80 0x7f7ab40fb0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80048d0 tx=0x7f7aa8009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 -- 172.21.15.66:0/1041735275 shutdown_connections 2024-09-12T01:40:11.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 --2- 172.21.15.66:0/1041735275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab40fac80 0x7f7ab40fb0d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 --2- 172.21.15.66:0/1041735275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab4102640 0x7f7ab4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.560 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 -- 172.21.15.66:0/1041735275 >> 172.21.15.66:0/1041735275 conn(0x7f7ab4070ce0 msgr2=0x7f7ab40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:11.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 -- 172.21.15.66:0/1041735275 shutdown_connections 2024-09-12T01:40:11.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.556+0000 7f7ab932c640 1 -- 172.21.15.66:0/1041735275 wait complete. 2024-09-12T01:40:11.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab932c640 1 Processor -- start 2024-09-12T01:40:11.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab932c640 1 -- start start 2024-09-12T01:40:11.561 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab932c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab40fac80 0x7f7ab41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab932c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 0x7f7ab41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab932c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4113cf0 con 0x7f7ab4102640 2024-09-12T01:40:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab932c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab410d130 con 0x7f7ab40fac80 2024-09-12T01:40:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 0x7f7ab41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 0x7f7ab41136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41758/0 (socket says 172.21.15.66:41758) 2024-09-12T01:40:11.562 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab27fc640 1 -- 172.21.15.66:0/3429737338 learned_addr learned my addr 172.21.15.66:0/3429737338 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.557+0000 7f7ab2ffd640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab40fac80 0x7f7ab41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7ab27fc640 1 -- 172.21.15.66:0/3429737338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab40fac80 msgr2=0x7f7ab41131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7ab27fc640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab40fac80 0x7f7ab41131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7ab27fc640 1 -- 172.21.15.66:0/3429737338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8005040 con 0x7f7ab4102640 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7ab27fc640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 0x7f7ab41136f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8003080 tx=0x7f7aa8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa8038070 con 0x7f7ab4102640 2024-09-12T01:40:11.563 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7aa802ade0 con 0x7f7ab4102640 2024-09-12T01:40:11.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab410d3b0 con 0x7f7ab4102640 2024-09-12T01:40:11.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aa802c880 con 0x7f7ab4102640 2024-09-12T01:40:11.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.558+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab410d890 con 0x7f7ab4102640 2024-09-12T01:40:11.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.559+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40657c0 con 0x7f7ab4102640 2024-09-12T01:40:11.564 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.560+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7aa8030020 con 0x7f7ab4102640 2024-09-12T01:40:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.560+0000 7f7a9b7fe640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f7a9c06ed50 0x7f7a9c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.560+0000 7f7ab2ffd640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f7a9c06ed50 0x7f7a9c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.560+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7aa80ade60 con 0x7f7ab4102640 2024-09-12T01:40:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.561+0000 7f7ab2ffd640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f7a9c06ed50 0x7f7a9c071200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40041d0 tx=0x7f7aa4004330 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:11.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.565+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7aa807b380 con 0x7f7ab4102640 2024-09-12T01:40:11.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.730+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7ab4109590 con 0x7f7ab4102640 2024-09-12T01:40:11.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.731+0000 7f7a9b7fe640 1 -- 172.21.15.66:0/3429737338 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7aa8075e60 con 0x7f7ab4102640 2024-09-12T01:40:11.731 INFO:teuthology.orchestra.run.smithi066.stdout:137438953489 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f7a9c06ed50 msgr2=0x7f7a9c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f7a9c06ed50 0x7f7a9c071200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40041d0 tx=0x7f7aa4004330 comp rx=0 tx=0).stop 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 msgr2=0x7f7ab41136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 0x7f7ab41136f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8003080 tx=0x7f7aa8009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 shutdown_connections 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f7a9c06ed50 0x7f7a9c071200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ab4102640 0x7f7ab41136f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.732+0000 7f7ab932c640 1 --2- 172.21.15.66:0/3429737338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab40fac80 0x7f7ab41131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.733+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 >> 172.21.15.66:0/3429737338 conn(0x7f7ab4070ce0 msgr2=0x7f7ab4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:11.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.733+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 shutdown_connections 2024-09-12T01:40:11.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:11.733+0000 7f7ab932c640 1 -- 172.21.15.66:0/3429737338 wait complete. 2024-09-12T01:40:12.364 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:12 smithi066 ceph-mon[27875]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:12.364 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:12 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3429737338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:40:12.390 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953487 got 137438953489 for osd.4 2024-09-12T01:40:12.390 DEBUG:teuthology.parallel:result is None 2024-09-12T01:40:12.390 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-12T01:40:12.390 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:40:12.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:12 smithi153 ceph-mon[34713]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:12.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:12 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3429737338' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-12T01:40:12.646 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:14.091 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:14 smithi066 ceph-mon[27875]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:14.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 -- 172.21.15.66:0/4284067570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fe100 msgr2=0x7eff3c1065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:14.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 --2- 172.21.15.66:0/4284067570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fe100 0x7eff3c1065a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff2c0048d0 tx=0x7eff2c009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 -- 172.21.15.66:0/4284067570 shutdown_connections 2024-09-12T01:40:14.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 --2- 172.21.15.66:0/4284067570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fe100 0x7eff3c1065a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.314 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 --2- 172.21.15.66:0/4284067570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c0fd760 0x7eff3c0fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 -- 172.21.15.66:0/4284067570 >> 172.21.15.66:0/4284067570 conn(0x7eff3c0f7030 msgr2=0x7eff3c0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:14.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 -- 172.21.15.66:0/4284067570 shutdown_connections 2024-09-12T01:40:14.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.314+0000 7eff43819640 1 -- 172.21.15.66:0/4284067570 wait complete. 2024-09-12T01:40:14.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff43819640 1 Processor -- start 2024-09-12T01:40:14.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff43819640 1 -- start start 2024-09-12T01:40:14.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff43819640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 0x7eff3c1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:14.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff43819640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c0fe100 0x7eff3c1138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:14.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff43819640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c113f70 con 0x7eff3c0fd760 2024-09-12T01:40:14.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff43819640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c10d320 con 0x7eff3c0fe100 2024-09-12T01:40:14.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff415b5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 0x7eff3c1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:14.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff415b5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 0x7eff3c1133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46110/0 (socket says 172.21.15.66:46110) 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff415b5640 1 -- 172.21.15.66:0/1101061640 learned_addr learned my addr 172.21.15.66:0/1101061640 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff40db4640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c0fe100 0x7eff3c1138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff415b5640 1 -- 172.21.15.66:0/1101061640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c0fe100 msgr2=0x7eff3c1138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff415b5640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c0fe100 0x7eff3c1138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.315+0000 7eff415b5640 1 -- 172.21.15.66:0/1101061640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c005040 con 0x7eff3c0fd760 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.316+0000 7eff415b5640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 0x7eff3c1133a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7eff3800b790 tx=0x7eff380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.316+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff3800c700 con 0x7eff3c0fd760 2024-09-12T01:40:14.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.316+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c10d600 con 0x7eff3c0fd760 2024-09-12T01:40:14.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.316+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff3800cd00 con 0x7eff3c0fd760 2024-09-12T01:40:14.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.316+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff38015e70 con 0x7eff3c0fd760 2024-09-12T01:40:14.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.316+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c10daf0 con 0x7eff3c0fd760 2024-09-12T01:40:14.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.317+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c0fac90 con 0x7eff3c0fd760 2024-09-12T01:40:14.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.317+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7eff38012070 con 0x7eff3c0fd760 2024-09-12T01:40:14.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.318+0000 7eff31ffb640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7eff2806ed60 0x7eff28071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:14.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.318+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff3808d9c0 con 0x7eff3c0fd760 2024-09-12T01:40:14.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.318+0000 7eff40db4640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7eff2806ed60 0x7eff28071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:14.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.318+0000 7eff40db4640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7eff2806ed60 0x7eff28071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff2c000c00 tx=0x7eff2c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:14.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.322+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7eff3805ae20 con 0x7eff3c0fd760 2024-09-12T01:40:14.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:14 smithi153 ceph-mon[34713]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:14.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.483+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff3c10ea70 con 0x7eff2806ed60 2024-09-12T01:40:14.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.484+0000 7eff31ffb640 1 -- 172.21.15.66:0/1101061640 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27875 (secure 0 0 0) 0x7eff3c10ea70 con 0x7eff2806ed60 2024-09-12T01:40:14.485 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:40:14.485 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T01:40:14.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7eff2806ed60 msgr2=0x7eff28071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:14.486 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7eff2806ed60 0x7eff28071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7eff2c000c00 tx=0x7eff2c035040 comp rx=0 tx=0).stop 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 msgr2=0x7eff3c1133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 0x7eff3c1133a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7eff3800b790 tx=0x7eff380091d0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 shutdown_connections 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7eff2806ed60 0x7eff28071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff3c0fe100 0x7eff3c1138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 --2- 172.21.15.66:0/1101061640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff3c0fd760 0x7eff3c1133a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.486+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 >> 172.21.15.66:0/1101061640 conn(0x7eff3c0f7030 msgr2=0x7eff3c0f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.487+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 shutdown_connections 2024-09-12T01:40:14.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:14.487+0000 7eff43819640 1 -- 172.21.15.66:0/1101061640 wait complete. 2024-09-12T01:40:15.156 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-12T01:40:12.825178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787936,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682976,"statfs":{"total":575970213888,"available":574139367424,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002225"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T01:39:20.747898+0000","last_change":"2024-09-12T01:38:56.386417+0000","last_active":"2024-09-12T01:39:20.747898+0000","last_peered":"2024-09-12T01:39:20.747898+0000","last_clean":"2024-09-12T01:39:20.747898+0000","last_became_active":"2024-09-12T01:38:56.386129+0000","last_became_peered":"2024-09-12T01:38:56.386129+0000","last_unstale":"2024-09-12T01:39:20.747898+0000","last_undegraded":"2024-09-12T01:39:20.747898+0000","last_fullsized":"2024-09-12T01:39:20.747898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.331035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.331035+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.331035+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:16.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.51100000000000001}]},{"osd":1,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.497},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.433}]},{"osd":3,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.313}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Sep 12 01:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Sep 12 01:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.34399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.38100000000000001}]},{"osd":1,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Sep 12 01:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.629},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.222}]},{"osd":2,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Sep 12 01:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 12 01:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.47099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51100000000000001,"5min":0.627,"15min":0.627},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Sep 12 01:39:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Sep 12 01:39:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:40:15.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-12T01:40:15.412 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:16.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:16 smithi066 ceph-mon[27875]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:40:16.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:16 smithi066 ceph-mon[27875]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:16.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:16 smithi153 ceph-mon[34713]: from='client.14406 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:40:16.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:16 smithi153 ceph-mon[34713]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 -- 172.21.15.66:0/3193710765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102580 msgr2=0x7f717c102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 --2- 172.21.15.66:0/3193710765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102580 0x7f717c102950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f71780048d0 tx=0x7f7178009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 -- 172.21.15.66:0/3193710765 shutdown_connections 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 --2- 172.21.15.66:0/3193710765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c102f20 0x7f717c0fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 --2- 172.21.15.66:0/3193710765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102580 0x7f717c102950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 -- 172.21.15.66:0/3193710765 >> 172.21.15.66:0/3193710765 conn(0x7f717c0f81a0 msgr2=0x7f717c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 -- 172.21.15.66:0/3193710765 shutdown_connections 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.188+0000 7f7183668640 1 -- 172.21.15.66:0/3193710765 wait complete. 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7183668640 1 Processor -- start 2024-09-12T01:40:17.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7183668640 1 -- start start 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7183668640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c102580 0x7f717c113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7183668640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 0x7f717c1136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7183668640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c113cb0 con 0x7f717c102f20 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7183668640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c113e20 con 0x7f717c102580 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7180c03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 0x7f717c1136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7180c03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 0x7f717c1136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46138/0 (socket says 172.21.15.66:46138) 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7180c03640 1 -- 172.21.15.66:0/2222394779 learned_addr learned my addr 172.21.15.66:0/2222394779 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.189+0000 7f7181404640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c102580 0x7f717c113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7180c03640 1 -- 172.21.15.66:0/2222394779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c102580 msgr2=0x7f717c113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7180c03640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c102580 0x7f717c113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7180c03640 1 -- 172.21.15.66:0/2222394779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178005040 con 0x7f717c102f20 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7180c03640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 0x7f717c1136b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f716c002840 tx=0x7f716c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:17.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716c007c30 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f716c00f040 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c10d310 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716c009410 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.190+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c10d8b0 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.191+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c0fdd00 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.191+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f716c009680 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.192+0000 7f7171ffb640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f716806ed60 0x7f7168071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.192+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f716c08d640 con 0x7f717c102f20 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.192+0000 7f7181404640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f716806ed60 0x7f7168071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.193+0000 7f7181404640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f716806ed60 0x7f7168071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7178009ac0 tx=0x7f7178035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:17.226 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.196+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f716c04d2a0 con 0x7f717c102f20 2024-09-12T01:40:17.359 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.358+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f717c04b720 con 0x7f716806ed60 2024-09-12T01:40:17.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.360+0000 7f7171ffb640 1 -- 172.21.15.66:0/2222394779 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27886 (secure 0 0 0) 0x7f717c04b720 con 0x7f716806ed60 2024-09-12T01:40:17.361 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:40:17.361 INFO:teuthology.orchestra.run.smithi066.stderr:dumped all 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.361+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f716806ed60 msgr2=0x7f7168071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.361+0000 7f7183668640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f716806ed60 0x7f7168071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7178009ac0 tx=0x7f7178035040 comp rx=0 tx=0).stop 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.361+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 msgr2=0x7f717c1136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.361+0000 7f7183668640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 0x7f717c1136b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f716c002840 tx=0x7f716c004570 comp rx=0 tx=0).stop 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 shutdown_connections 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f716806ed60 0x7f7168071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f717c102f20 0x7f717c1136b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 --2- 172.21.15.66:0/2222394779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f717c102580 0x7f717c113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 >> 172.21.15.66:0/2222394779 conn(0x7f717c0f81a0 msgr2=0x7f717c0f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 shutdown_connections 2024-09-12T01:40:17.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:17.362+0000 7f7183668640 1 -- 172.21.15.66:0/2222394779 wait complete. 2024-09-12T01:40:17.979 INFO:teuthology.orchestra.run.smithi066.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-12T01:40:16.826053+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787936,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682976,"statfs":{"total":575970213888,"available":574139367424,"internally_reserved":0,"allocated":3870720,"data_stored":2558100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002447"},"pg_stats":[{"pgid":"1.0","version":"23'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T01:39:20.747898+0000","last_change":"2024-09-12T01:38:56.386417+0000","last_active":"2024-09-12T01:39:20.747898+0000","last_peered":"2024-09-12T01:39:20.747898+0000","last_clean":"2024-09-12T01:39:20.747898+0000","last_became_active":"2024-09-12T01:38:56.386129+0000","last_became_peered":"2024-09-12T01:38:56.386129+0000","last_unstale":"2024-09-12T01:39:20.747898+0000","last_undegraded":"2024-09-12T01:39:20.747898+0000","last_fullsized":"2024-09-12T01:39:20.747898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.331035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.331035+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.331035+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:16.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004}]},{"osd":2,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55300000000000005}]},{"osd":3,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.35099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.56899999999999995}]},{"osd":1,"last update":"Thu Sep 12 01:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.5},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Sep 12 01:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51700000000000002}]},{"osd":4,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297704,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447448,"statfs":{"total":95995035648,"available":95690186752,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"last":0.307},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.33000000000000002}]},{"osd":1,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Sep 12 01:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 12 01:39:47 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.246},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36199999999999999,"15min":0.36299999999999999},"min":{"1min":0.22700000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.31}]},{"osd":2,"last update":"Thu Sep 12 01:40:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.38600000000000001,"15min":0.39100000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.49099999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.39300000000000002,"15min":0.40000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61699999999999999,"5min":0.625,"15min":0.625},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Sep 12 01:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.70499999999999996}]},{"osd":4,"last update":"Thu Sep 12 01:39:59 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 12 01:39:43 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.33200000000000002,"15min":0.33300000000000002},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.47099999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.318},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34399999999999997,"15min":0.34599999999999997},"min":{"1min":0.224,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.51100000000000001,"5min":0.627,"15min":0.627},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Sep 12 01:39:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.38100000000000001}]},{"osd":3,"last update":"Thu Sep 12 01:39:31 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Sep 12 01:39:57 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:40:17.980 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-12T01:40:17.980 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:40:17.980 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:40:17.980 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-12T01:40:18.245 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:18.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:18 smithi066 ceph-mon[27875]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:18.367 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:18 smithi153 ceph-mon[34713]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:19.344 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:19 smithi066 ceph-mon[27875]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:40:19.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:19 smithi153 ceph-mon[34713]: from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-12T01:40:19.830 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 -- 172.21.15.66:0/2344575959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102550 msgr2=0x7f1cb0102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 --2- 172.21.15.66:0/2344575959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102550 0x7f1cb0102920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00048d0 tx=0x7f1ca0009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 -- 172.21.15.66:0/2344575959 shutdown_connections 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 --2- 172.21.15.66:0/2344575959 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cb0102ef0 0x7f1cb00fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 --2- 172.21.15.66:0/2344575959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102550 0x7f1cb0102920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 -- 172.21.15.66:0/2344575959 >> 172.21.15.66:0/2344575959 conn(0x7f1cb00f80f0 msgr2=0x7f1cb00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 -- 172.21.15.66:0/2344575959 shutdown_connections 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.825+0000 7f1cb6350640 1 -- 172.21.15.66:0/2344575959 wait complete. 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1cb6350640 1 Processor -- start 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1cb6350640 1 -- start start 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1cb6350640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cb0102550 0x7f1cb006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1cb6350640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 0x7f1cb006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1cb6350640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0070490 con 0x7f1cb0102ef0 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1cb6350640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0070600 con 0x7f1cb0102550 2024-09-12T01:40:19.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1ca7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 0x7f1cb006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1ca7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 0x7f1cb006ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46158/0 (socket says 172.21.15.66:46158) 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1ca7fff640 1 -- 172.21.15.66:0/858377926 learned_addr learned my addr 172.21.15.66:0/858377926 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.826+0000 7f1caffff640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cb0102550 0x7f1cb006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1ca7fff640 1 -- 172.21.15.66:0/858377926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cb0102550 msgr2=0x7f1cb006fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1ca7fff640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cb0102550 0x7f1cb006fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1ca7fff640 1 -- 172.21.15.66:0/858377926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0005040 con 0x7f1cb0102ef0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1ca7fff640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 0x7f1cb006ff50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c98002840 tx=0x7f1c98004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c98007c30 con 0x7f1cb0102ef0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb0070890 con 0x7f1cb0102ef0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c9800f040 con 0x7f1cb0102ef0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c9800d990 con 0x7f1cb0102ef0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.827+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0119c60 con 0x7f1cb0102ef0 2024-09-12T01:40:19.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.828+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb00fdcd0 con 0x7f1cb0102ef0 2024-09-12T01:40:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.829+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1c98009600 con 0x7f1cb0102ef0 2024-09-12T01:40:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.829+0000 7f1cad7fa640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1c9c06ed60 0x7f1c9c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.830+0000 7f1caffff640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1c9c06ed60 0x7f1c9c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.830+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f1c9808d490 con 0x7f1cb0102ef0 2024-09-12T01:40:19.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.830+0000 7f1caffff640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1c9c06ed60 0x7f1c9c071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009ac0 tx=0x7f1ca0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:19.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:19.834+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c9804d2a0 con 0x7f1cb0102ef0 2024-09-12T01:40:20.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.029+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1cb0109620 con 0x7f1cb0102ef0 2024-09-12T01:40:20.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.029+0000 7f1cad7fa640 1 -- 172.21.15.66:0/858377926 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1c9805a5a0 con 0x7f1cb0102ef0 2024-09-12T01:40:20.030 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:40:20.030 INFO:teuthology.orchestra.run.smithi066.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:40:20.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1c9c06ed60 msgr2=0x7f1c9c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:20.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1c9c06ed60 0x7f1c9c071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0009ac0 tx=0x7f1ca0035040 comp rx=0 tx=0).stop 2024-09-12T01:40:20.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 msgr2=0x7f1cb006ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 0x7f1cb006ff50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1c98002840 tx=0x7f1c98004570 comp rx=0 tx=0).stop 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 shutdown_connections 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f1c9c06ed60 0x7f1c9c071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1cb0102ef0 0x7f1cb006ff50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 --2- 172.21.15.66:0/858377926 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1cb0102550 0x7f1cb006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 >> 172.21.15.66:0/858377926 conn(0x7f1cb00f80f0 msgr2=0x7f1cb00f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 shutdown_connections 2024-09-12T01:40:20.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:20.031+0000 7f1cb6350640 1 -- 172.21.15.66:0/858377926 wait complete. 2024-09-12T01:40:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:20 smithi066 ceph-mon[27875]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:20 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/858377926' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:40:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:20 smithi153 ceph-mon[34713]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:20 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/858377926' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-12T01:40:20.696 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:40:20.696 INFO:tasks.cephadm:Setup complete, yielding 2024-09-12T01:40:20.696 INFO:teuthology.run_tasks:Running task print... 2024-09-12T01:40:20.705 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-12T01:40:20.705 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:20.713 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:20.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-12T01:40:20.975 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:22.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:22 smithi066 ceph-mon[27875]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:22 smithi153 ceph-mon[34713]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 -- 172.21.15.66:0/3145459782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fa960 msgr2=0x7fb4400fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 --2- 172.21.15.66:0/3145459782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fa960 0x7fb4400fad70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb4300048d0 tx=0x7fb430009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 -- 172.21.15.66:0/3145459782 shutdown_connections 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 --2- 172.21.15.66:0/3145459782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4400fb2b0 0x7fb4400fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 --2- 172.21.15.66:0/3145459782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fa960 0x7fb4400fad70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 -- 172.21.15.66:0/3145459782 >> 172.21.15.66:0/3145459782 conn(0x7fb4400f63a0 msgr2=0x7fb4400f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 -- 172.21.15.66:0/3145459782 shutdown_connections 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.598+0000 7fb44690e640 1 -- 172.21.15.66:0/3145459782 wait complete. 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb44690e640 1 Processor -- start 2024-09-12T01:40:22.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb44690e640 1 -- start start 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb44690e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4400fa960 0x7fb44010d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb44690e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 0x7fb44010d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb44690e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44010e730 con 0x7fb4400fb2b0 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb44690e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44010e8a0 con 0x7fb4400fa960 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 0x7fb44010d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 0x7fb44010d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35212/0 (socket says 172.21.15.66:35212) 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb43ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4400fa960 0x7fb44010d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:22.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.599+0000 7fb43f7fe640 1 -- 172.21.15.66:0/3737462767 learned_addr learned my addr 172.21.15.66:0/3737462767 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43f7fe640 1 -- 172.21.15.66:0/3737462767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4400fa960 msgr2=0x7fb44010d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43f7fe640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4400fa960 0x7fb44010d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43f7fe640 1 -- 172.21.15.66:0/3737462767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430005040 con 0x7fb4400fb2b0 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43f7fe640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 0x7fb44010d8c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb43400b580 tx=0x7fb4340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43400f6f0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb43400fcf0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4340103a0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44010eb80 con 0x7fb4400fb2b0 2024-09-12T01:40:22.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.600+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44010f0a0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.601+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4400fa040 con 0x7fb4400fb2b0 2024-09-12T01:40:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.602+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb4340116b0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.602+0000 7fb43cff9640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fb42806ed60 0x7fb428071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.602+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fb43408dbc0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.602+0000 7fb43ffff640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fb42806ed60 0x7fb428071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:22.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.603+0000 7fb43ffff640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fb42806ed60 0x7fb428071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb430000c00 tx=0x7fb430035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:22.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.606+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb43405b140 con 0x7fb4400fb2b0 2024-09-12T01:40:22.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.769+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7fb44004b720 con 0x7fb4400fb2b0 2024-09-12T01:40:22.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.774+0000 7fb43cff9640 1 -- 172.21.15.66:0/3737462767 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7fb43405aae0 con 0x7fb4400fb2b0 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fb42806ed60 msgr2=0x7fb428071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fb42806ed60 0x7fb428071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb430000c00 tx=0x7fb430035040 comp rx=0 tx=0).stop 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 msgr2=0x7fb44010d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 0x7fb44010d8c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb43400b580 tx=0x7fb4340091a0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 shutdown_connections 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fb42806ed60 0x7fb428071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4400fb2b0 0x7fb44010d8c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 --2- 172.21.15.66:0/3737462767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4400fa960 0x7fb44010d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 >> 172.21.15.66:0/3737462767 conn(0x7fb4400f63a0 msgr2=0x7fb4400f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:22.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 shutdown_connections 2024-09-12T01:40:22.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:22.776+0000 7fb44690e640 1 -- 172.21.15.66:0/3737462767 wait complete. 2024-09-12T01:40:23.516 INFO:teuthology.run_tasks:Running task print... 2024-09-12T01:40:23.525 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-12T01:40:23.525 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:23.540 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:23.540 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-12T01:40:23.796 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:24.121 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:23 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3737462767' entity='client.admin' 2024-09-12T01:40:24.121 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:40:24.122 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:23 smithi066 ceph-mon[27875]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:24.122 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:24.122 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:40:24.122 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:23 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:24.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:23 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3737462767' entity='client.admin' 2024-09-12T01:40:24.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:40:24.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:23 smithi153 ceph-mon[34713]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:24.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:24.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:40:24.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:23 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 -- 172.21.15.66:0/3044836665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb430 msgr2=0x7f6ff00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/3044836665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb430 0x7f6ff00fb840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80048d0 tx=0x7f6fe8009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 -- 172.21.15.66:0/3044836665 shutdown_connections 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/3044836665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fc700 0x7f6ff00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/3044836665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb430 0x7f6ff00fb840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 -- 172.21.15.66:0/3044836665 >> 172.21.15.66:0/3044836665 conn(0x7f6ff00f6c10 msgr2=0x7f6ff00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:25.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 -- 172.21.15.66:0/3044836665 shutdown_connections 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.351+0000 7f6ff7a59640 1 -- 172.21.15.66:0/3044836665 wait complete. 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff7a59640 1 Processor -- start 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff7a59640 1 -- start start 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff7a59640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fb430 0x7f6ff010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff7a59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 0x7f6ff0112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff7a59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0065cf0 con 0x7f6ff00fc700 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff7a59640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff0065e60 con 0x7f6ff00fb430 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff4ff4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 0x7f6ff0112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff4ff4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 0x7f6ff0112370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35222/0 (socket says 172.21.15.66:35222) 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff4ff4640 1 -- 172.21.15.66:0/523412362 learned_addr learned my addr 172.21.15.66:0/523412362 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.352+0000 7f6ff57f5640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fb430 0x7f6ff010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6ff4ff4640 1 -- 172.21.15.66:0/523412362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fb430 msgr2=0x7f6ff010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6ff4ff4640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fb430 0x7f6ff010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6ff4ff4640 1 -- 172.21.15.66:0/523412362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe8005040 con 0x7f6ff00fc700 2024-09-12T01:40:25.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6ff4ff4640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 0x7f6ff0112370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400b790 tx=0x7f6fe40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:25.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe400c700 con 0x7f6ff00fc700 2024-09-12T01:40:25.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6fe400cd00 con 0x7f6ff00fc700 2024-09-12T01:40:25.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff0112970 con 0x7f6ff00fc700 2024-09-12T01:40:25.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe4015e80 con 0x7f6ff00fc700 2024-09-12T01:40:25.356 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.353+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff0112e90 con 0x7f6ff00fc700 2024-09-12T01:40:25.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.355+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00fa890 con 0x7f6ff00fc700 2024-09-12T01:40:25.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.355+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6fe4012070 con 0x7f6ff00fc700 2024-09-12T01:40:25.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.355+0000 7f6fedffb640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6fd806ed60 0x7f6fd8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:25.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.356+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6fe408d780 con 0x7f6ff00fc700 2024-09-12T01:40:25.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.356+0000 7f6ff57f5640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6fd806ed60 0x7f6fd8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:25.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.356+0000 7f6ff57f5640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6fd806ed60 0x7f6fd8071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8000c00 tx=0x7f6fe8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:25.360 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.360+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6fe405abe0 con 0x7f6ff00fc700 2024-09-12T01:40:25.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.536+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ff0100b20 con 0x7f6fd806ed60 2024-09-12T01:40:25.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.537+0000 7f6fedffb640 1 -- 172.21.15.66:0/523412362 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6ff0100b20 con 0x7f6fd806ed60 2024-09-12T01:40:25.539 INFO:teuthology.orchestra.run.smithi066.stdout:Backend: cephadm 2024-09-12T01:40:25.539 INFO:teuthology.orchestra.run.smithi066.stdout:Available: Yes 2024-09-12T01:40:25.539 INFO:teuthology.orchestra.run.smithi066.stdout:Paused: No 2024-09-12T01:40:25.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6fd806ed60 msgr2=0x7f6fd8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:25.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6fd806ed60 0x7f6fd8071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8000c00 tx=0x7f6fe8035040 comp rx=0 tx=0).stop 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 msgr2=0x7f6ff0112370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 0x7f6ff0112370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6fe400b790 tx=0x7f6fe40091d0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 shutdown_connections 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6fd806ed60 0x7f6fd8071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fc700 0x7f6ff0112370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 --2- 172.21.15.66:0/523412362 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fb430 0x7f6ff010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:25.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 >> 172.21.15.66:0/523412362 conn(0x7f6ff00f6c10 msgr2=0x7f6ff00f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:25.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 shutdown_connections 2024-09-12T01:40:25.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:25.539+0000 7f6ff7a59640 1 -- 172.21.15.66:0/523412362 wait complete. 2024-09-12T01:40:26.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:25 smithi066 ceph-mon[27875]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:26.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:25 smithi153 ceph-mon[34713]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:26.282 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-12T01:40:26.541 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:26.983 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:26 smithi066 ceph-mon[27875]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:27.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:26 smithi153 ceph-mon[34713]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:28.012 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:27 smithi066 ceph-mon[27875]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:28.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:27 smithi153 ceph-mon[34713]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:28.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 -- 172.21.15.66:0/3146939060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 msgr2=0x7feffc0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 --2- 172.21.15.66:0/3146939060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc0fdc60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fefe40048d0 tx=0x7fefe4009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 -- 172.21.15.66:0/3146939060 shutdown_connections 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 --2- 172.21.15.66:0/3146939060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc0fdc60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 --2- 172.21.15.66:0/3146939060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feffc0fc520 0x7feffc0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 -- 172.21.15.66:0/3146939060 >> 172.21.15.66:0/3146939060 conn(0x7feffc0f7ce0 msgr2=0x7feffc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 -- 172.21.15.66:0/3146939060 shutdown_connections 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 -- 172.21.15.66:0/3146939060 wait complete. 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 Processor -- start 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.190+0000 7ff00277b640 1 -- start start 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7ff00277b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feffc0fc520 0x7feffc10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7ff00277b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:28.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7ff00277b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc10e490 con 0x7feffc0fd7f0 2024-09-12T01:40:28.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7ff00277b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc10e600 con 0x7feffc0fc520 2024-09-12T01:40:28.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:28.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35234/0 (socket says 172.21.15.66:35234) 2024-09-12T01:40:28.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 -- 172.21.15.66:0/2346381523 learned_addr learned my addr 172.21.15.66:0/2346381523 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:28.192 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feffbfff640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feffc0fc520 0x7feffc10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 -- 172.21.15.66:0/2346381523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feffc0fc520 msgr2=0x7feffc10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feffc0fc520 0x7feffc10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 -- 172.21.15.66:0/2346381523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4005040 con 0x7feffc0fd7f0 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff3fff640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc10d620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefe4003080 tx=0x7fefe4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe4038070 con 0x7feffc0fd7f0 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fefe4009800 con 0x7feffc0fd7f0 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefe4033660 con 0x7feffc0fd7f0 2024-09-12T01:40:28.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.191+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc10e880 con 0x7feffc0fd7f0 2024-09-12T01:40:28.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.192+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc10ed40 con 0x7feffc0fd7f0 2024-09-12T01:40:28.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.192+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc0fb980 con 0x7feffc0fd7f0 2024-09-12T01:40:28.194 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.193+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fefe4030020 con 0x7feffc0fd7f0 2024-09-12T01:40:28.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.194+0000 7feff97fa640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fefe806ed50 0x7fefe8071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:28.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.194+0000 7feffbfff640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fefe806ed50 0x7fefe8071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:28.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.194+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fefe40ade30 con 0x7feffc0fd7f0 2024-09-12T01:40:28.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.194+0000 7feffbfff640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fefe806ed50 0x7fefe8071200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fefec009b50 tx=0x7fefec009120 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:28.198 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.198+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fefe407b3c0 con 0x7feffc0fd7f0 2024-09-12T01:40:28.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.366+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feffc10efb0 con 0x7fefe806ed50 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.374+0000 7feff97fa640 1 -- 172.21.15.66:0/2346381523 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7feffc10efb0 con 0x7fefe806ed50 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (3m) 2m ago 4m 26.3M - 0.25.0 c8568f914cd2 b2c0b1b4f381 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (5m) 2m ago 5m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (4m) 68s ago 4m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (3m) 2m ago 4m 80.2M - 9.4.7 954c08fa6188 a6ff5cae127b 2024-09-12T01:40:28.374 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:9283,8765,8443 running (6m) 2m ago 6m 442M - 17.2.7-1609-g554ba93e d4c538e492e4 d4facfef752d 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (4m) 68s ago 4m 400M - 17.2.7-1609-g554ba93e d4c538e492e4 4b0e5456f121 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (6m) 2m ago 6m 46.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (4m) 68s ago 4m 39.2M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (5m) 2m ago 5m 16.4M - 1.5.0 0da6a335fe13 ebe17b848675 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (4m) 68s ago 4m 16.5M - 1.5.0 0da6a335fe13 6391262c1a15 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (3m) 2m ago 3m 39.2M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (2m) 2m ago 2m 38.1M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (2m) 2m ago 2m 38.2M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (2m) 68s ago 2m 39.2M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (98s) 68s ago 98s 36.4M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:40:28.375 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (73s) 68s ago 72s 13.6M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:40:28.376 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (3m) 2m ago 4m 38.3M - 2.43.0 a07b618ecd1d 25c9c1516174 2024-09-12T01:40:28.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fefe806ed50 msgr2=0x7fefe8071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:28.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fefe806ed50 0x7fefe8071200 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fefec009b50 tx=0x7fefec009120 comp rx=0 tx=0).stop 2024-09-12T01:40:28.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 msgr2=0x7feffc10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:28.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc10d620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fefe4003080 tx=0x7fefe4009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 shutdown_connections 2024-09-12T01:40:28.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fefe806ed50 0x7fefe8071200 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feffc0fd7f0 0x7feffc10d620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 --2- 172.21.15.66:0/2346381523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feffc0fc520 0x7feffc10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:28.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 >> 172.21.15.66:0/2346381523 conn(0x7feffc0f7ce0 msgr2=0x7feffc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:28.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 shutdown_connections 2024-09-12T01:40:28.377 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:28.376+0000 7ff00277b640 1 -- 172.21.15.66:0/2346381523 wait complete. 2024-09-12T01:40:29.106 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-12T01:40:29.363 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:30.134 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:29 smithi066 ceph-mon[27875]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:30.134 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:29 smithi066 ceph-mon[27875]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:30.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:29 smithi153 ceph-mon[34713]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:30.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:29 smithi153 ceph-mon[34713]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 -- 172.21.15.66:0/2876970021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fd7f0 msgr2=0x7fa41c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2876970021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fd7f0 0x7fa41c0fdc60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa4100048d0 tx=0x7fa410009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 -- 172.21.15.66:0/2876970021 shutdown_connections 2024-09-12T01:40:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2876970021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fd7f0 0x7fa41c0fdc60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2876970021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa41c0fc520 0x7fa41c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 -- 172.21.15.66:0/2876970021 >> 172.21.15.66:0/2876970021 conn(0x7fa41c0f7ce0 msgr2=0x7fa41c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 -- 172.21.15.66:0/2876970021 shutdown_connections 2024-09-12T01:40:31.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.014+0000 7fa423a5d640 1 -- 172.21.15.66:0/2876970021 wait complete. 2024-09-12T01:40:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa423a5d640 1 Processor -- start 2024-09-12T01:40:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa423a5d640 1 -- start start 2024-09-12T01:40:31.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa423a5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 0x7fa41c10d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa423a5d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa41c0fd7f0 0x7fa41c10d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa423a5d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c10dc10 con 0x7fa41c0fc520 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa423a5d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c10e430 con 0x7fa41c0fd7f0 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.015+0000 7fa4217f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 0x7fa41c10d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa4217f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 0x7fa41c10d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:35262/0 (socket says 172.21.15.66:35262) 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa4217f9640 1 -- 172.21.15.66:0/2425635560 learned_addr learned my addr 172.21.15.66:0/2425635560 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa420ff8640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa41c0fd7f0 0x7fa41c10d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa4217f9640 1 -- 172.21.15.66:0/2425635560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa41c0fd7f0 msgr2=0x7fa41c10d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa4217f9640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa41c0fd7f0 0x7fa41c10d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa4217f9640 1 -- 172.21.15.66:0/2425635560 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410005040 con 0x7fa41c0fc520 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa4217f9640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 0x7fa41c10d080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa414002a50 tx=0x7fa414004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa414007c30 con 0x7fa41c0fc520 2024-09-12T01:40:31.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa41400f040 con 0x7fa41c0fc520 2024-09-12T01:40:31.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c10e6c0 con 0x7fa41c0fc520 2024-09-12T01:40:31.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa41400da10 con 0x7fa41c0fc520 2024-09-12T01:40:31.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.016+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c10ec60 con 0x7fa41c0fc520 2024-09-12T01:40:31.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.017+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c0fb980 con 0x7fa41c0fc520 2024-09-12T01:40:31.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.018+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa41400dc80 con 0x7fa41c0fc520 2024-09-12T01:40:31.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.018+0000 7fa419ffb640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa40406ed60 0x7fa404071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:31.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.018+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa41408d600 con 0x7fa41c0fc520 2024-09-12T01:40:31.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.018+0000 7fa420ff8640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa40406ed60 0x7fa404071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:31.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.019+0000 7fa420ff8640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa40406ed60 0x7fa404071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa41c10ce30 tx=0x7fa410035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:31.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.023+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa41404d2a0 con 0x7fa41c0fc520 2024-09-12T01:40:31.195 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.195+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa41c10efc0 con 0x7fa40406ed60 2024-09-12T01:40:31.199 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.199+0000 7fa419ffb640 1 -- 172.21.15.66:0/2425635560 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7fa41c10efc0 con 0x7fa40406ed60 2024-09-12T01:40:31.199 INFO:teuthology.orchestra.run.smithi066.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:crash 2/2 2m ago 5m * 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:mgr 2/2 2m ago 5m count:2 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:mon 2/2 2m ago 4m smithi066:172.21.15.66=smithi066;smithi153:172.21.15.153=smithi153;count:2 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:osd 6 2m ago - 2024-09-12T01:40:31.200 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-12T01:40:31.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa40406ed60 msgr2=0x7fa404071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:31.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa40406ed60 0x7fa404071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa41c10ce30 tx=0x7fa410035040 comp rx=0 tx=0).stop 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 msgr2=0x7fa41c10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 0x7fa41c10d080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa414002a50 tx=0x7fa414004600 comp rx=0 tx=0).stop 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 shutdown_connections 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa40406ed60 0x7fa404071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa41c0fd7f0 0x7fa41c10d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 --2- 172.21.15.66:0/2425635560 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0fc520 0x7fa41c10d080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 >> 172.21.15.66:0/2425635560 conn(0x7fa41c0f7ce0 msgr2=0x7fa41c0f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.201+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 shutdown_connections 2024-09-12T01:40:31.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:31.202+0000 7fa423a5d640 1 -- 172.21.15.66:0/2425635560 wait complete. 2024-09-12T01:40:31.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-12T01:40:32.086 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:32.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:31 smithi066 ceph-mon[27875]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:32.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:31 smithi066 ceph-mon[27875]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:32.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:31 smithi153 ceph-mon[34713]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:32.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:31 smithi153 ceph-mon[34713]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:33.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:32 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:33.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:32 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:33.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 -- 172.21.15.66:0/2397551986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 msgr2=0x7fccc00fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 --2- 172.21.15.66:0/2397551986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc00fc970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fccb00048d0 tx=0x7fccb0009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 -- 172.21.15.66:0/2397551986 shutdown_connections 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 --2- 172.21.15.66:0/2397551986 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 0x7fccc00fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 --2- 172.21.15.66:0/2397551986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc00fc970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 -- 172.21.15.66:0/2397551986 >> 172.21.15.66:0/2397551986 conn(0x7fccc00f7d40 msgr2=0x7fccc00fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 -- 172.21.15.66:0/2397551986 shutdown_connections 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.633+0000 7fccc4c32640 1 -- 172.21.15.66:0/2397551986 wait complete. 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccc4c32640 1 Processor -- start 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccc4c32640 1 -- start start 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccc4c32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc0071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:33.636 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccc4c32640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 0x7fccc006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccc4c32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc0070080 con 0x7fccc00fc560 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccc4c32640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc00701c0 con 0x7fccc00fd830 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc0071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc0071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47174/0 (socket says 172.21.15.66:47174) 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbe59c640 1 -- 172.21.15.66:0/1275725179 learned_addr learned my addr 172.21.15.66:0/1275725179 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbdd9b640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 0x7fccc006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbe59c640 1 -- 172.21.15.66:0/1275725179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 msgr2=0x7fccc006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbe59c640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 0x7fccc006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.637 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbe59c640 1 -- 172.21.15.66:0/1275725179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb0005040 con 0x7fccc00fc560 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.634+0000 7fccbdd9b640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 0x7fccc006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.635+0000 7fccbe59c640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc0071570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccb0003080 tx=0x7fccb0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.635+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb0038070 con 0x7fccc00fc560 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.635+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc0070440 con 0x7fccc00fc560 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.635+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fccb002abd0 con 0x7fccc00fc560 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.635+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb003e670 con 0x7fccc00fc560 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.635+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc0115130 con 0x7fccc00fc560 2024-09-12T01:40:33.638 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.636+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc00fb9c0 con 0x7fccc00fc560 2024-09-12T01:40:33.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.636+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fccb0030020 con 0x7fccc00fc560 2024-09-12T01:40:33.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.637+0000 7fccb6ffd640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fccac06ed60 0x7fccac071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:33.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.637+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fccb00ae250 con 0x7fccc00fc560 2024-09-12T01:40:33.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.637+0000 7fccbdd9b640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fccac06ed60 0x7fccac071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:33.639 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.638+0000 7fccbdd9b640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fccac06ed60 0x7fccac071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcca8006fd0 tx=0x7fcca8008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:33.641 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.641+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fccb007b6b0 con 0x7fccc00fc560 2024-09-12T01:40:33.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.813+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fccc0101bd0 con 0x7fccac06ed60 2024-09-12T01:40:33.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.814+0000 7fccb6ffd640 1 -- 172.21.15.66:0/1275725179 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fccc0101bd0 con 0x7fccac06ed60 2024-09-12T01:40:33.814 INFO:teuthology.orchestra.run.smithi066.stdout:HOST ADDR LABELS STATUS 2024-09-12T01:40:33.815 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066 172.21.15.66 2024-09-12T01:40:33.815 INFO:teuthology.orchestra.run.smithi066.stdout:smithi153 172.21.15.153 2024-09-12T01:40:33.815 INFO:teuthology.orchestra.run.smithi066.stdout:2 hosts in cluster 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fccac06ed60 msgr2=0x7fccac071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fccac06ed60 0x7fccac071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcca8006fd0 tx=0x7fcca8008040 comp rx=0 tx=0).stop 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 msgr2=0x7fccc0071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc0071570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fccb0003080 tx=0x7fccb0009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 shutdown_connections 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fccac06ed60 0x7fccac071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccc00fd830 0x7fccc006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 --2- 172.21.15.66:0/1275725179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccc00fc560 0x7fccc0071570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 >> 172.21.15.66:0/1275725179 conn(0x7fccc00f7d40 msgr2=0x7fccc00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:33.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 shutdown_connections 2024-09-12T01:40:33.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:33.817+0000 7fccc4c32640 1 -- 172.21.15.66:0/1275725179 wait complete. 2024-09-12T01:40:34.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:33 smithi066 ceph-mon[27875]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:34.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:33 smithi153 ceph-mon[34713]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:34.489 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-12T01:40:34.746 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:35.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:34 smithi066 ceph-mon[27875]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:35.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:34 smithi153 ceph-mon[34713]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:36.121 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:35 smithi066 ceph-mon[27875]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:36.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 -- 172.21.15.66:0/2573759855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 msgr2=0x7f5b3c0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 --2- 172.21.15.66:0/2573759855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c0fc960 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5b380048d0 tx=0x7f5b38009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 -- 172.21.15.66:0/2573759855 shutdown_connections 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 --2- 172.21.15.66:0/2573759855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 0x7f5b3c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 --2- 172.21.15.66:0/2573759855 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c0fc960 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 -- 172.21.15.66:0/2573759855 >> 172.21.15.66:0/2573759855 conn(0x7f5b3c0f7d30 msgr2=0x7f5b3c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 -- 172.21.15.66:0/2573759855 shutdown_connections 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 -- 172.21.15.66:0/2573759855 wait complete. 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.333+0000 7f5b43a64640 1 Processor -- start 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b43a64640 1 -- start start 2024-09-12T01:40:36.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b43a64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c10d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b43a64640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 0x7f5b3c10d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b43a64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c10e4e0 con 0x7f5b3c0fc550 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b43a64640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c10e650 con 0x7f5b3c0fd820 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b41800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c10d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b41800640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c10d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47192/0 (socket says 172.21.15.66:47192) 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b41800640 1 -- 172.21.15.66:0/1957307845 learned_addr learned my addr 172.21.15.66:0/1957307845 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b40fff640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 0x7f5b3c10d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b41800640 1 -- 172.21.15.66:0/1957307845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 msgr2=0x7f5b3c10d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b41800640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 0x7f5b3c10d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b41800640 1 -- 172.21.15.66:0/1957307845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b38005040 con 0x7f5b3c0fc550 2024-09-12T01:40:36.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.334+0000 7f5b40fff640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 0x7f5b3c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.335+0000 7f5b41800640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c10d130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b38003080 tx=0x7f5b38009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.335+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b38038070 con 0x7f5b3c0fc550 2024-09-12T01:40:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.335+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c10e8d0 con 0x7f5b3c0fc550 2024-09-12T01:40:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.335+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b3802abd0 con 0x7f5b3c0fc550 2024-09-12T01:40:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.335+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b3803e670 con 0x7f5b3c0fc550 2024-09-12T01:40:36.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.335+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c10edf0 con 0x7f5b3c0fc550 2024-09-12T01:40:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.336+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b3c1057e0 con 0x7f5b3c0fc550 2024-09-12T01:40:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.337+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5b38030020 con 0x7f5b3c0fc550 2024-09-12T01:40:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.337+0000 7f5b31ffb640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f5b2806ed60 0x7f5b28071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.337+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5b380ae250 con 0x7f5b3c0fc550 2024-09-12T01:40:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.338+0000 7f5b40fff640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f5b2806ed60 0x7f5b28071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:36.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.338+0000 7f5b40fff640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f5b2806ed60 0x7f5b28071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c10cee0 tx=0x7f5b2c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:36.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.342+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5b3807b6b0 con 0x7f5b3c0fc550 2024-09-12T01:40:36.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:35 smithi153 ceph-mon[34713]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:36.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.515+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b3c10f010 con 0x7f5b2806ed60 2024-09-12T01:40:36.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.517+0000 7f5b31ffb640 1 -- 172.21.15.66:0/1957307845 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f5b3c10f010 con 0x7f5b2806ed60 2024-09-12T01:40:36.517 INFO:teuthology.orchestra.run.smithi066.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-12T01:40:36.517 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT53430091400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-12T01:40:36.517 INFO:teuthology.orchestra.run.smithi066.stdout:smithi153 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300MV400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-09-12T01:40:36.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f5b2806ed60 msgr2=0x7f5b28071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:36.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f5b2806ed60 0x7f5b28071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c10cee0 tx=0x7f5b2c008040 comp rx=0 tx=0).stop 2024-09-12T01:40:36.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 msgr2=0x7f5b3c10d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:36.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c10d130 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5b38003080 tx=0x7f5b38009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 shutdown_connections 2024-09-12T01:40:36.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f5b2806ed60 0x7f5b28071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b3c0fd820 0x7f5b3c10d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 --2- 172.21.15.66:0/1957307845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b3c0fc550 0x7f5b3c10d130 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:36.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 >> 172.21.15.66:0/1957307845 conn(0x7f5b3c0f7d30 msgr2=0x7f5b3c0f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:36.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 shutdown_connections 2024-09-12T01:40:36.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:36.519+0000 7f5b43a64640 1 -- 172.21.15.66:0/1957307845 wait complete. 2024-09-12T01:40:37.122 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:37.132 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:37.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-12T01:40:37.392 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:37 smithi066 ceph-mon[27875]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:37 smithi066 ceph-mon[27875]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:38.206 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:37 smithi153 ceph-mon[34713]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:38.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:37 smithi153 ceph-mon[34713]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:39.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 -- 172.21.15.66:0/1685080996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d78065c40 msgr2=0x7f0d780ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:39.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/1685080996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d78065c40 0x7f0d780ff140 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009c50 tx=0x7f0d70004d10 comp rx=0 tx=0).stop 2024-09-12T01:40:39.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 -- 172.21.15.66:0/1685080996 shutdown_connections 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/1685080996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d780ff680 0x7f0d78101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/1685080996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d78065c40 0x7f0d780ff140 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 -- 172.21.15.66:0/1685080996 >> 172.21.15.66:0/1685080996 conn(0x7f0d780f6c10 msgr2=0x7f0d780f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 -- 172.21.15.66:0/1685080996 shutdown_connections 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 -- 172.21.15.66:0/1685080996 wait complete. 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 Processor -- start 2024-09-12T01:40:39.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.003+0000 7f0d7eb02640 1 -- start start 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d7eb02640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d78065c40 0x7f0d780fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d7eb02640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 0x7f0d780fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d7eb02640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780fb610 con 0x7f0d780ff680 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d7eb02640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780fb750 con 0x7f0d78065c40 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 0x7f0d780fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 0x7f0d780fb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47222/0 (socket says 172.21.15.66:47222) 2024-09-12T01:40:39.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 -- 172.21.15.66:0/754312821 learned_addr learned my addr 172.21.15.66:0/754312821 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d7c89e640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d78065c40 0x7f0d780fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 -- 172.21.15.66:0/754312821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d78065c40 msgr2=0x7f0d780fcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d78065c40 0x7f0d780fcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 -- 172.21.15.66:0/754312821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700098b0 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.004+0000 7f0d77fff640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 0x7f0d780fb040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000b790 tx=0x7f0d600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.005+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d6000c700 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.005+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780fba30 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.005+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0d6000cd00 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.005+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d60015e70 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.005+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d78115180 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.006+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d780fa890 con 0x7f0d780ff680 2024-09-12T01:40:39.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.006+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0d60012070 con 0x7f0d780ff680 2024-09-12T01:40:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.007+0000 7f0d757fa640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f0d6406ed60 0x7f0d64071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.007+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0d6008d770 con 0x7f0d780ff680 2024-09-12T01:40:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.007+0000 7f0d7c89e640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f0d6406ed60 0x7f0d64071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:39.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.007+0000 7f0d7c89e640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f0d6406ed60 0x7f0d64071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d780fc8b0 tx=0x7f0d70004d10 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:39.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.011+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0d6005abd0 con 0x7f0d780ff680 2024-09-12T01:40:39.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:39.200+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d780f8700 con 0x7f0d6406ed60 2024-09-12T01:40:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:39 smithi066 ceph-mon[27875]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:39 smithi066 ceph-mon[27875]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:39 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-12T01:40:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:39 smithi153 ceph-mon[34713]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:39 smithi153 ceph-mon[34713]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:40:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:39 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-12T01:40:40.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.951+0000 7f0d757fa640 1 -- 172.21.15.66:0/754312821 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0d780f8700 con 0x7f0d6406ed60 2024-09-12T01:40:40.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f0d6406ed60 msgr2=0x7f0d64071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:40.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f0d6406ed60 0x7f0d64071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d780fc8b0 tx=0x7f0d70004d10 comp rx=0 tx=0).stop 2024-09-12T01:40:40.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 msgr2=0x7f0d780fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:40.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 0x7f0d780fb040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000b790 tx=0x7f0d600091d0 comp rx=0 tx=0).stop 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 shutdown_connections 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f0d6406ed60 0x7f0d64071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d780ff680 0x7f0d780fb040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 --2- 172.21.15.66:0/754312821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d78065c40 0x7f0d780fcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 >> 172.21.15.66:0/754312821 conn(0x7f0d780f6c10 msgr2=0x7f0d780f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 shutdown_connections 2024-09-12T01:40:40.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:40.954+0000 7f0d7eb02640 1 -- 172.21.15.66:0/754312821 wait complete. 2024-09-12T01:40:41.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:40 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-12T01:40:41.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:40 smithi066 ceph-mon[27875]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:40:41.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:40 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-12T01:40:41.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:40 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[27871]: 2024-09-12T01:40:40.931+0000 7f17baaf6640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:40:41.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:40 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-12T01:40:41.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:40 smithi153 ceph-mon[34713]: osdmap e39: 6 total, 6 up, 6 in 2024-09-12T01:40:41.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:40 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-12T01:40:41.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:40:42.029 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: pgmap v166: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:42.029 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:40:42.029 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: fsmap cephfs:0 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: Saving service mds.cephfs spec with placement count:4 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:42.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:42.031 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:42.031 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:41 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: pgmap v166: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: osdmap e40: 6 total, 6 up, 6 in 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: osdmap e41: 6 total, 6 up, 6 in 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: fsmap cephfs:0 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: Saving service mds.cephfs spec with placement count:4 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:40:42.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:42.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:40:42.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:42.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:42.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:42.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:41 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:42.807 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:43.206 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:42 smithi066 ceph-mon[27875]: Deploying daemon mds.cephfs.smithi066.ipygev on smithi066 2024-09-12T01:40:43.206 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:42 smithi066 ceph-mon[27875]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T01:40:43.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:42 smithi153 ceph-mon[34713]: Deploying daemon mds.cephfs.smithi066.ipygev on smithi066 2024-09-12T01:40:43.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:42 smithi153 ceph-mon[34713]: osdmap e42: 6 total, 6 up, 6 in 2024-09-12T01:40:44.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:43 smithi066 ceph-mon[27875]: pgmap v170: 65 pgs: 17 creating+peering, 24 active+clean, 24 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:44.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:43 smithi066 ceph-mon[27875]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:40:44.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:43 smithi066 ceph-mon[27875]: osdmap e43: 6 total, 6 up, 6 in 2024-09-12T01:40:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:43 smithi153 ceph-mon[34713]: pgmap v170: 65 pgs: 17 creating+peering, 24 active+clean, 24 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:43 smithi153 ceph-mon[34713]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-12T01:40:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:43 smithi153 ceph-mon[34713]: osdmap e43: 6 total, 6 up, 6 in 2024-09-12T01:40:44.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 -- 172.21.15.66:0/4022015181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fc750 msgr2=0x7f95140fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:44.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 --2- 172.21.15.66:0/4022015181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fc750 0x7f95140fcbc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95040048d0 tx=0x7f9504009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 -- 172.21.15.66:0/4022015181 shutdown_connections 2024-09-12T01:40:44.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 --2- 172.21.15.66:0/4022015181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fc750 0x7f95140fcbc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 --2- 172.21.15.66:0/4022015181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95140fb480 0x7f95140fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 -- 172.21.15.66:0/4022015181 >> 172.21.15.66:0/4022015181 conn(0x7f95140f6c40 msgr2=0x7f95140f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 -- 172.21.15.66:0/4022015181 shutdown_connections 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.417+0000 7f951b2ec640 1 -- 172.21.15.66:0/4022015181 wait complete. 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f951b2ec640 1 Processor -- start 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f951b2ec640 1 -- start start 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f951b2ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 0x7f951410f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f951b2ec640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95140fc750 0x7f951410f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f951b2ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514110740 con 0x7f95140fb480 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f951b2ec640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95141108b0 con 0x7f95140fc750 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f9519088640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 0x7f951410f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f9519088640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 0x7f951410f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51490/0 (socket says 172.21.15.66:51490) 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.418+0000 7f9519088640 1 -- 172.21.15.66:0/909636778 learned_addr learned my addr 172.21.15.66:0/909636778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9518887640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95140fc750 0x7f951410f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:44.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9519088640 1 -- 172.21.15.66:0/909636778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95140fc750 msgr2=0x7f951410f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9519088640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95140fc750 0x7f951410f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9519088640 1 -- 172.21.15.66:0/909636778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504005040 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9519088640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 0x7f951410f390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f951000b790 tx=0x7f95100091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951000c700 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f951000cd00 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9514110b90 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9510015e70 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.419+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95141110b0 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.420+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9514104710 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.421+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9510012070 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.421+0000 7f9509ffb640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f950006ed60 0x7f9500071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.421+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f951008dc70 con 0x7f95140fb480 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.421+0000 7f9518887640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f950006ed60 0x7f9500071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:44.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.422+0000 7f9518887640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f950006ed60 0x7f9500071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9504007ac0 tx=0x7f9504035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:44.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.425+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f951005ae10 con 0x7f95140fb480 2024-09-12T01:40:44.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.630+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f951404b720 con 0x7f95140fb480 2024-09-12T01:40:44.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.630+0000 7f9509ffb640 1 -- 172.21.15.66:0/909636778 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f951005a7b0 con 0x7f95140fb480 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:e2 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 2 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:40:44.631 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:40.932547+0000 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 0 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:in 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:up {} 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:40:44.632 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 0 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:40:44.633 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 2 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f950006ed60 msgr2=0x7f9500071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f950006ed60 0x7f9500071210 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9504007ac0 tx=0x7f9504035040 comp rx=0 tx=0).stop 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 msgr2=0x7f951410f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 0x7f951410f390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f951000b790 tx=0x7f95100091d0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 shutdown_connections 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f950006ed60 0x7f9500071210 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95140fc750 0x7f951410f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 --2- 172.21.15.66:0/909636778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95140fb480 0x7f951410f390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 >> 172.21.15.66:0/909636778 conn(0x7f95140f6c40 msgr2=0x7f9514066120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:44.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 shutdown_connections 2024-09-12T01:40:44.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:44.633+0000 7f951b2ec640 1 -- 172.21.15.66:0/909636778 wait complete. 2024-09-12T01:40:45.222 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:44 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/909636778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:40:45.353 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:45.367 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:45.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-12T01:40:45.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:44 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/909636778' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:40:45.647 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: pgmap v172: 65 pgs: 17 creating+peering, 42 active+clean, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:46.088 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:45 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: pgmap v172: 65 pgs: 17 creating+peering, 42 active+clean, 6 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:46.293 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:45 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:47.055 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: Deploying daemon mds.cephfs.smithi153.cbdplo on smithi153 2024-09-12T01:40:47.055 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6826/3743386224,v1:172.21.15.66:6827/3743386224] up:boot 2024-09-12T01:40:47.055 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: daemon mds.cephfs.smithi066.ipygev assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: Cluster is now healthy 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: fsmap cephfs:0 1 up:standby 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:creating} 2024-09-12T01:40:47.056 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:46 smithi066 ceph-mon[27875]: daemon mds.cephfs.smithi066.ipygev is now active in filesystem cephfs as rank 0 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 -- 172.21.15.66:0/1025720647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fa960 msgr2=0x7f16ec0fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/1025720647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fa960 0x7f16ec0fad70 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0048d0 tx=0x7f16dc009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 -- 172.21.15.66:0/1025720647 shutdown_connections 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/1025720647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec0fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/1025720647 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fa960 0x7f16ec0fad70 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 -- 172.21.15.66:0/1025720647 >> 172.21.15.66:0/1025720647 conn(0x7f16ec0f63a0 msgr2=0x7f16ec0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 -- 172.21.15.66:0/1025720647 shutdown_connections 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.250+0000 7f16f1e3c640 1 -- 172.21.15.66:0/1025720647 wait complete. 2024-09-12T01:40:47.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.251+0000 7f16f1e3c640 1 Processor -- start 2024-09-12T01:40:47.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.251+0000 7f16f1e3c640 1 -- start start 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.251+0000 7f16f1e3c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fa960 0x7f16ec10d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.251+0000 7f16f1e3c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec10d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.251+0000 7f16f1e3c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec10e730 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.251+0000 7f16f1e3c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec10e8a0 con 0x7f16ec0fa960 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec10d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec10d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51530/0 (socket says 172.21.15.66:51530) 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eb7fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fa960 0x7f16ec10d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:47.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 -- 172.21.15.66:0/3059951621 learned_addr learned my addr 172.21.15.66:0/3059951621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 -- 172.21.15.66:0/3059951621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fa960 msgr2=0x7f16ec10d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fa960 0x7f16ec10d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 -- 172.21.15.66:0/3059951621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc005040 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eb7fe640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fa960 0x7f16ec10d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16eaffd640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec10d8c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b580 tx=0x7f16e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e000f570 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f16e000fb70 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16e0010cd0 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec10eb80 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.252+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec10f0a0 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.254+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec0fa040 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.254+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f16e000fce0 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.255+0000 7f16d3fff640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f16d406ed50 0x7f16d4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.255+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f16e008de40 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.255+0000 7f16eb7fe640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f16d406ed50 0x7f16d4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:47.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.255+0000 7f16eb7fe640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f16d406ed50 0x7f16d4071200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16dc007eb0 tx=0x7f16dc035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:47.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.259+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f16e005b080 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.323 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: Deploying daemon mds.cephfs.smithi153.cbdplo on smithi153 2024-09-12T01:40:47.323 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6826/3743386224,v1:172.21.15.66:6827/3743386224] up:boot 2024-09-12T01:40:47.323 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: daemon mds.cephfs.smithi066.ipygev assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-12T01:40:47.323 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:40:47.323 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-12T01:40:47.323 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: Cluster is now healthy 2024-09-12T01:40:47.324 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: fsmap cephfs:0 1 up:standby 2024-09-12T01:40:47.324 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:40:47.324 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:creating} 2024-09-12T01:40:47.324 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:46 smithi153 ceph-mon[34713]: daemon mds.cephfs.smithi066.ipygev is now active in filesystem cephfs as rank 0 2024-09-12T01:40:47.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.461+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f16ec105230 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.966 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.966+0000 7f16d3fff640 1 -- 172.21.15.66:0/3059951621 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f16e005aa20 con 0x7f16ec0fb2b0 2024-09-12T01:40:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f16d406ed50 msgr2=0x7f16d4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f16d406ed50 0x7f16d4071200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f16dc007eb0 tx=0x7f16dc035040 comp rx=0 tx=0).stop 2024-09-12T01:40:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 msgr2=0x7f16ec10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec10d8c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f16e000b580 tx=0x7f16e00091a0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 shutdown_connections 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f16d406ed50 0x7f16d4071200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ec0fb2b0 0x7f16ec10d8c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 --2- 172.21.15.66:0/3059951621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16ec0fa960 0x7f16ec10d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 >> 172.21.15.66:0/3059951621 conn(0x7f16ec0f63a0 msgr2=0x7f16ec0f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 shutdown_connections 2024-09-12T01:40:47.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:47.968+0000 7f16f1e3c640 1 -- 172.21.15.66:0/3059951621 wait complete. 2024-09-12T01:40:47.984 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:47 smithi153 ceph-mon[34713]: pgmap v173: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 173 B/s wr, 0 op/s 2024-09-12T01:40:47.984 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:47 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6826/3743386224,v1:172.21.15.66:6827/3743386224] up:active 2024-09-12T01:40:47.984 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:47 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2024-09-12T01:40:47.985 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:47 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3059951621' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-12T01:40:47.985 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:47 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:48.298 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:47 smithi066 ceph-mon[27875]: pgmap v173: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 173 B/s wr, 0 op/s 2024-09-12T01:40:48.299 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:47 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6826/3743386224,v1:172.21.15.66:6827/3743386224] up:active 2024-09-12T01:40:48.299 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:47 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2024-09-12T01:40:48.299 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:47 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3059951621' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-12T01:40:48.299 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:47 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:40:48.718 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:48.727 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:48.727 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3059951621' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:49.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:49.262 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:48 smithi066 ceph-mon[27875]: Deploying daemon mds.cephfs.smithi066.jacfsu on smithi066 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3059951621' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:49.379 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:49.380 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:48 smithi153 ceph-mon[34713]: Deploying daemon mds.cephfs.smithi066.jacfsu on smithi066 2024-09-12T01:40:49.996 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:50.336 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:49 smithi153 ceph-mon[34713]: pgmap v174: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 129 B/s wr, 0 op/s 2024-09-12T01:40:50.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:49 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:boot 2024-09-12T01:40:50.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:49 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 1 up:standby 2024-09-12T01:40:50.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:49 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:40:50.337 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:49 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 1 up:standby 2024-09-12T01:40:50.349 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:49 smithi066 ceph-mon[27875]: pgmap v174: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 129 B/s wr, 0 op/s 2024-09-12T01:40:50.349 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:49 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:boot 2024-09-12T01:40:50.349 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:49 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 1 up:standby 2024-09-12T01:40:50.349 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:49 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:40:50.349 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:49 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 1 up:standby 2024-09-12T01:40:52.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:51 smithi066 ceph-mon[27875]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 920 B/s wr, 2 op/s 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.163+0000 7fcc03172640 1 -- 172.21.15.66:0/1519742853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 msgr2=0x7fcbfc101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.163+0000 7fcc03172640 1 --2- 172.21.15.66:0/1519742853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc101b20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40048d0 tx=0x7fcbe4009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.163+0000 7fcc03172640 1 -- 172.21.15.66:0/1519742853 shutdown_connections 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 --2- 172.21.15.66:0/1519742853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc101b20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 --2- 172.21.15.66:0/1519742853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbfc065b80 0x7fcbfc0ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 -- 172.21.15.66:0/1519742853 >> 172.21.15.66:0/1519742853 conn(0x7fcbfc0f6c10 msgr2=0x7fcbfc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 -- 172.21.15.66:0/1519742853 shutdown_connections 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 -- 172.21.15.66:0/1519742853 wait complete. 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 Processor -- start 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.164+0000 7fcc03172640 1 -- start start 2024-09-12T01:40:52.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc03172640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbfc065b80 0x7fcbfc10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc03172640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc03172640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc10dc60 con 0x7fcbfc0ff740 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc03172640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc10e430 con 0x7fcbfc065b80 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc10d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51582/0 (socket says 172.21.15.66:51582) 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 -- 172.21.15.66:0/90250192 learned_addr learned my addr 172.21.15.66:0/90250192 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc00f0e640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbfc065b80 0x7fcbfc10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 -- 172.21.15.66:0/90250192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbfc065b80 msgr2=0x7fcbfc10d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbfc065b80 0x7fcbfc10d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 -- 172.21.15.66:0/90250192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe4005040 con 0x7fcbfc0ff740 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbfbfff640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc10d610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40043d0 tx=0x7fcbe4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe4038070 con 0x7fcbfc0ff740 2024-09-12T01:40:52.189 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcbe402ae90 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbfc10e660 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbe403e670 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.165+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc10ec00 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.166+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc0fa890 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.167+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcbe4030020 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.167+0000 7fcbf97fa640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcbe806ed60 0x7fcbe8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.168+0000 7fcc00f0e640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcbe806ed60 0x7fcbe8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.168+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fcbe40ae2b0 con 0x7fcbfc0ff740 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.168+0000 7fcc00f0e640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcbe806ed60 0x7fcbe8071210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4004fd0 tx=0x7fcbf4009040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:52.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.172+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcbe407b500 con 0x7fcbfc0ff740 2024-09-12T01:40:52.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:52.370+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcbfc04b720 con 0x7fcbfc0ff740 2024-09-12T01:40:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:51 smithi153 ceph-mon[34713]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 920 B/s wr, 2 op/s 2024-09-12T01:40:53.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.034+0000 7fcbf97fa640 1 -- 172.21.15.66:0/90250192 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcbe407aea0 con 0x7fcbfc0ff740 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.036+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcbe806ed60 msgr2=0x7fcbe8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.036+0000 7fcc03172640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcbe806ed60 0x7fcbe8071210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4004fd0 tx=0x7fcbf4009040 comp rx=0 tx=0).stop 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.036+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 msgr2=0x7fcbfc10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.036+0000 7fcc03172640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc10d610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40043d0 tx=0x7fcbe4009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 shutdown_connections 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcbe806ed60 0x7fcbe8071210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbfc0ff740 0x7fcbfc10d610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 --2- 172.21.15.66:0/90250192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbfc065b80 0x7fcbfc10d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 >> 172.21.15.66:0/90250192 conn(0x7fcbfc0f6c10 msgr2=0x7fcbfc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 shutdown_connections 2024-09-12T01:40:53.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:53.037+0000 7fcc03172640 1 -- 172.21.15.66:0/90250192 wait complete. 2024-09-12T01:40:53.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:boot 2024-09-12T01:40:53.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2 up:standby 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: Deploying daemon mds.cephfs.smithi153.aiydtj on smithi153 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/90250192' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-12T01:40:53.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.342 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:boot 2024-09-12T01:40:53.342 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2 up:standby 2024-09-12T01:40:53.342 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:40:53.342 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: Deploying daemon mds.cephfs.smithi153.aiydtj on smithi153 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/90250192' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-12T01:40:53.343 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:53.646 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:53.655 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:53.655 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-12T01:40:53.924 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:54.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:54 smithi153 ceph-mon[34713]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-12T01:40:54.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:54 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/90250192' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-12T01:40:54.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:54 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2 up:standby 2024-09-12T01:40:54.311 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:54 smithi066 ceph-mon[27875]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-12T01:40:54.311 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:54 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/90250192' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-12T01:40:54.311 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:54 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 2 up:standby 2024-09-12T01:40:55.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 -- 172.21.15.66:0/3273660069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 msgr2=0x7f3fd40fad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:55.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 --2- 172.21.15.66:0/3273660069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fad70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40048d0 tx=0x7f3fc4009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:55.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 -- 172.21.15.66:0/3273660069 shutdown_connections 2024-09-12T01:40:55.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 --2- 172.21.15.66:0/3273660069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fd40fb2b0 0x7f3fd40fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:55.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 --2- 172.21.15.66:0/3273660069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fad70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:55.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 -- 172.21.15.66:0/3273660069 >> 172.21.15.66:0/3273660069 conn(0x7f3fd40f63a0 msgr2=0x7f3fd40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 -- 172.21.15.66:0/3273660069 shutdown_connections 2024-09-12T01:40:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.443+0000 7f3fda363640 1 -- 172.21.15.66:0/3273660069 wait complete. 2024-09-12T01:40:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fda363640 1 Processor -- start 2024-09-12T01:40:55.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fda363640 1 -- start start 2024-09-12T01:40:55.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fda363640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fda363640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fd40fb2b0 0x7f3fd40fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fda363640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40fbef0 con 0x7f3fd40fa960 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fda363640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40fc030 con 0x7f3fd40fb2b0 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52596/0 (socket says 172.21.15.66:52596) 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.444+0000 7f3fd3fff640 1 -- 172.21.15.66:0/367946450 learned_addr learned my addr 172.21.15.66:0/367946450 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd37fe640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fd40fb2b0 0x7f3fd40fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd3fff640 1 -- 172.21.15.66:0/367946450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fd40fb2b0 msgr2=0x7f3fd40fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd3fff640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fd40fb2b0 0x7f3fd40fb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd3fff640 1 -- 172.21.15.66:0/367946450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4005040 con 0x7f3fd40fa960 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd3fff640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fd470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40048a0 tx=0x7f3fc4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:55.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc4038070 con 0x7f3fd40fa960 2024-09-12T01:40:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd40fc2b0 con 0x7f3fd40fa960 2024-09-12T01:40:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fc4004290 con 0x7f3fd40fa960 2024-09-12T01:40:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc4033660 con 0x7f3fd40fa960 2024-09-12T01:40:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.445+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd4115370 con 0x7f3fd40fa960 2024-09-12T01:40:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.446+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd40fa040 con 0x7f3fd40fa960 2024-09-12T01:40:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.447+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3fc4030020 con 0x7f3fd40fa960 2024-09-12T01:40:55.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.447+0000 7f3fd0ff9640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fbc06ed60 0x7f3fbc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:55.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.447+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3fc40ae2b0 con 0x7f3fd40fa960 2024-09-12T01:40:55.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.447+0000 7f3fd37fe640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fbc06ed60 0x7f3fbc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:55.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.448+0000 7f3fd37fe640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fbc06ed60 0x7f3fbc071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009af0 tx=0x7f3fc800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:55.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.451+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3fc407b480 con 0x7f3fd40fa960 2024-09-12T01:40:55.656 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:55.657+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f3fd404b720 con 0x7f3fd40fa960 2024-09-12T01:40:55.922 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.922 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.922 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.922 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:boot 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:40:55.923 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:55 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/367946450' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 3 op/s 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:boot 2024-09-12T01:40:55.993 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:40:55.994 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:40:55.994 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:55 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/367946450' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-12T01:40:56.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.038+0000 7f3fd0ff9640 1 -- 172.21.15.66:0/367946450 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3fc402c870 con 0x7f3fd40fa960 2024-09-12T01:40:56.039 INFO:teuthology.orchestra.run.smithi066.stderr:inline data disabled 2024-09-12T01:40:56.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fbc06ed60 msgr2=0x7f3fbc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:56.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fbc06ed60 0x7f3fbc071210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8009af0 tx=0x7f3fc800b040 comp rx=0 tx=0).stop 2024-09-12T01:40:56.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 msgr2=0x7f3fd40fd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:56.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fd470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3fc40048a0 tx=0x7f3fc4009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:56.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 shutdown_connections 2024-09-12T01:40:56.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fbc06ed60 0x7f3fbc071210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:56.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fd40fb2b0 0x7f3fd40fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:56.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 --2- 172.21.15.66:0/367946450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd40fa960 0x7f3fd40fd470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:56.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 >> 172.21.15.66:0/367946450 conn(0x7f3fd40f63a0 msgr2=0x7f3fd40f7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:56.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 shutdown_connections 2024-09-12T01:40:56.042 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:56.041+0000 7f3fda363640 1 -- 172.21.15.66:0/367946450 wait complete. 2024-09-12T01:40:56.810 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:40:56.820 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:40:56.820 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:40:57.329 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/367946450' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-12T01:40:57.329 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:standby 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:standby 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: Dropping low affinity active daemon mds.cephfs.smithi066.ipygev in favor of higher affinity standby. 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: Replacing daemon mds.cephfs.smithi066.ipygev as rank 0 with standby daemon mds.cephfs.smithi066.jacfsu 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: osdmap e44: 6 total, 6 up, 6 in 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: fsmap cephfs:1/1 {0=cephfs.smithi066.jacfsu=up:replay} 2 up:standby 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:57.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:57 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:57.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/367946450' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-12T01:40:57.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:standby 2024-09-12T01:40:57.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:standby 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: Dropping low affinity active daemon mds.cephfs.smithi066.ipygev in favor of higher affinity standby. 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: Replacing daemon mds.cephfs.smithi066.ipygev as rank 0 with standby daemon mds.cephfs.smithi066.jacfsu 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: osdmap e44: 6 total, 6 up, 6 in 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: fsmap cephfs:1/1 {0=cephfs.smithi066.jacfsu=up:replay} 2 up:standby 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:57.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:57 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:57.709 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:40:58.134 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:58 smithi066 ceph-mon[27875]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-12T01:40:58.135 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:58 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:reconnect 2024-09-12T01:40:58.135 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:58 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] up:boot 2024-09-12T01:40:58.135 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:58 smithi066 ceph-mon[27875]: fsmap cephfs:1/1 {0=cephfs.smithi066.jacfsu=up:reconnect} 3 up:standby 2024-09-12T01:40:58.135 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:58 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:40:58.135 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:58 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:58 smithi153 ceph-mon[34713]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-12T01:40:58.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:58 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:reconnect 2024-09-12T01:40:58.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:58 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] up:boot 2024-09-12T01:40:58.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:58 smithi153 ceph-mon[34713]: fsmap cephfs:1/1 {0=cephfs.smithi066.jacfsu=up:reconnect} 3 up:standby 2024-09-12T01:40:58.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:58 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:40:58.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:58 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:40:59.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:59 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:rejoin 2024-09-12T01:40:59.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:59 smithi066 ceph-mon[27875]: fsmap cephfs:1/1 {0=cephfs.smithi066.jacfsu=up:rejoin} 3 up:standby 2024-09-12T01:40:59.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:40:59 smithi066 ceph-mon[27875]: daemon mds.cephfs.smithi066.jacfsu is now active in filesystem cephfs as rank 0 2024-09-12T01:40:59.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:59 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:rejoin 2024-09-12T01:40:59.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:59 smithi153 ceph-mon[34713]: fsmap cephfs:1/1 {0=cephfs.smithi066.jacfsu=up:rejoin} 3 up:standby 2024-09-12T01:40:59.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:40:59 smithi153 ceph-mon[34713]: daemon mds.cephfs.smithi066.jacfsu is now active in filesystem cephfs as rank 0 2024-09-12T01:40:59.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 -- 172.21.15.66:0/1384691980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fdbb0 msgr2=0x7f3ff80fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/1384691980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fdbb0 0x7f3ff80fdfc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80048d0 tx=0x7f3fe8009da0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 -- 172.21.15.66:0/1384691980 shutdown_connections 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/1384691980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80fe500 0x7f3ff80fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/1384691980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fdbb0 0x7f3ff80fdfc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 -- 172.21.15.66:0/1384691980 >> 172.21.15.66:0/1384691980 conn(0x7f3ff80f63b0 msgr2=0x7f3ff80f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 -- 172.21.15.66:0/1384691980 shutdown_connections 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.793+0000 7f3ffd96f640 1 -- 172.21.15.66:0/1384691980 wait complete. 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ffd96f640 1 Processor -- start 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ffd96f640 1 -- start start 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ffd96f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80fdbb0 0x7f3ff810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ffd96f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 0x7f3ff810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ffd96f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff810e4b0 con 0x7f3ff80fe500 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ffd96f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff810e620 con 0x7f3ff80fdbb0 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.794+0000 7f3ff67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 0x7f3ff810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff67fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 0x7f3ff810d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52640/0 (socket says 172.21.15.66:52640) 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff67fc640 1 -- 172.21.15.66:0/761709613 learned_addr learned my addr 172.21.15.66:0/761709613 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff6ffd640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80fdbb0 0x7f3ff810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff67fc640 1 -- 172.21.15.66:0/761709613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80fdbb0 msgr2=0x7f3ff810d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff67fc640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80fdbb0 0x7f3ff810d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff67fc640 1 -- 172.21.15.66:0/761709613 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8005040 con 0x7f3ff80fe500 2024-09-12T01:40:59.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ff67fc640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 0x7f3ff810d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00b580 tx=0x7f3fec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fec00f570 con 0x7f3ff80fe500 2024-09-12T01:40:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff810e900 con 0x7f3ff80fe500 2024-09-12T01:40:59.797 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3fec00fb70 con 0x7f3ff80fe500 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fec010d40 con 0x7f3ff80fe500 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.795+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff810ee20 con 0x7f3ff80fe500 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.796+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff80fa050 con 0x7f3ff80fe500 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.797+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3fec00fce0 con 0x7f3ff80fe500 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.797+0000 7f3fdf7fe640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fe006ed60 0x7f3fe0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.797+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3fec08e090 con 0x7f3ff80fe500 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.797+0000 7f3ff6ffd640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fe006ed60 0x7f3fe0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.798+0000 7f3ff6ffd640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fe006ed60 0x7f3fe0071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8007ac0 tx=0x7f3fe8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:59.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:40:59.802+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3fec05b1e0 con 0x7f3ff80fe500 2024-09-12T01:41:00.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.001+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ff804b720 con 0x7f3ff80fe500 2024-09-12T01:41:00.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.001+0000 7f3fdf7fe640 1 -- 172.21.15.66:0/761709613 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1806 (secure 0 0 0) 0x7f3fec05ab80 con 0x7f3ff80fe500 2024-09-12T01:41:00.001 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:41:00.001 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:41:00.001 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:41:00.002 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:41:00.003 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:41:00.004 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fe006ed60 msgr2=0x7f3fe0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fe006ed60 0x7f3fe0071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8007ac0 tx=0x7f3fe8035040 comp rx=0 tx=0).stop 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 msgr2=0x7f3ff810d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 0x7f3ff810d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3fec00b580 tx=0x7f3fec0091a0 comp rx=0 tx=0).stop 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 shutdown_connections 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3fe006ed60 0x7f3fe0071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ff80fe500 0x7f3ff810d640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 --2- 172.21.15.66:0/761709613 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ff80fdbb0 0x7f3ff810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 >> 172.21.15.66:0/761709613 conn(0x7f3ff80f63b0 msgr2=0x7f3ff80f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 shutdown_connections 2024-09-12T01:41:00.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:00.003+0000 7f3ffd96f640 1 -- 172.21.15.66:0/761709613 wait complete. 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: Cluster is now healthy 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:active 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:standby 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:41:00.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:00 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/761709613' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 102 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: Cluster is now healthy 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] up:active 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:standby 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:41:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:00 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/761709613' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:41:00.625 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-12T01:41:01.074 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:02 smithi066 ceph-mon[27875]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-12T01:41:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:02 smithi153 ceph-mon[34713]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-12T01:41:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 -- 172.21.15.66:0/168569081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fb430 msgr2=0x7f9a240fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 --2- 172.21.15.66:0/168569081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fb430 0x7f9a240fb840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a140048d0 tx=0x7f9a14009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 -- 172.21.15.66:0/168569081 shutdown_connections 2024-09-12T01:41:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 --2- 172.21.15.66:0/168569081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a240fc700 0x7f9a240fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 --2- 172.21.15.66:0/168569081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fb430 0x7f9a240fb840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 -- 172.21.15.66:0/168569081 >> 172.21.15.66:0/168569081 conn(0x7f9a240f6c10 msgr2=0x7f9a240f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 -- 172.21.15.66:0/168569081 shutdown_connections 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.187+0000 7f9a298e9640 1 -- 172.21.15.66:0/168569081 wait complete. 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a298e9640 1 Processor -- start 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a298e9640 1 -- start start 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a298e9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a240fb430 0x7f9a2410bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a298e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 0x7f9a2410c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a298e9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2410caf0 con 0x7f9a240fc700 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a298e9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2410d310 con 0x7f9a240fb430 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a227fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 0x7f9a2410c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a227fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 0x7f9a2410c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40340/0 (socket says 172.21.15.66:40340) 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a227fc640 1 -- 172.21.15.66:0/1142340431 learned_addr learned my addr 172.21.15.66:0/1142340431 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.188+0000 7f9a22ffd640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a240fb430 0x7f9a2410bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a227fc640 1 -- 172.21.15.66:0/1142340431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a240fb430 msgr2=0x7f9a2410bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:03.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a227fc640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a240fb430 0x7f9a2410bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a227fc640 1 -- 172.21.15.66:0/1142340431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a14005040 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a227fc640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 0x7f9a2410c4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a18002a50 tx=0x7f9a18004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a18007c30 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2410d5a0 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a1800f040 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a1800dad0 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.189+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2410db40 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.190+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a240fa890 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.191+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f9a1800dc30 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.191+0000 7f9a0b7fe640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f9a0c06ed60 0x7f9a0c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.191+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f9a1808e080 con 0x7f9a240fc700 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.192+0000 7f9a22ffd640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f9a0c06ed60 0x7f9a0c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.192+0000 7f9a22ffd640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f9a0c06ed60 0x7f9a0c071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b020 tx=0x7f9a14035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:03.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.196+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9a1805b0f0 con 0x7f9a240fc700 2024-09-12T01:41:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:41:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:41:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:03.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.402+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a24103e30 con 0x7f9a240fc700 2024-09-12T01:41:03.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.403+0000 7f9a0b7fe640 1 -- 172.21.15.66:0/1142340431 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f9a1805aa90 con 0x7f9a240fc700 2024-09-12T01:41:03.403 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:41:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:41:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:41:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:03.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f9a0c06ed60 msgr2=0x7f9a0c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:03.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f9a0c06ed60 0x7f9a0c071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b020 tx=0x7f9a14035040 comp rx=0 tx=0).stop 2024-09-12T01:41:03.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 msgr2=0x7f9a2410c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:03.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 0x7f9a2410c4a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a18002a50 tx=0x7f9a18004600 comp rx=0 tx=0).stop 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 shutdown_connections 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f9a0c06ed60 0x7f9a0c071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a240fc700 0x7f9a2410c4a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 --2- 172.21.15.66:0/1142340431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a240fb430 0x7f9a2410bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 >> 172.21.15.66:0/1142340431 conn(0x7f9a240f6c10 msgr2=0x7f9a240f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 shutdown_connections 2024-09-12T01:41:03.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:03.405+0000 7f9a298e9640 1 -- 172.21.15.66:0/1142340431 wait complete. 2024-09-12T01:41:03.414 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:41:03.996 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-12T01:41:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:04 smithi066 ceph-mon[27875]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 4 op/s 2024-09-12T01:41:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:04 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:41:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:04 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1142340431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:41:04.380 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:04 smithi153 ceph-mon[34713]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 4 op/s 2024-09-12T01:41:04.380 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:04 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:41:04.380 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:04 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1142340431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:41:04.775 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:06.266 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:06 smithi066 ceph-mon[27875]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-12T01:41:06.266 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:06.266 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:06 smithi153 ceph-mon[34713]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.1 KiB/s rd, 4 op/s 2024-09-12T01:41:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:06.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 -- 172.21.15.66:0/3336482008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c065c40 msgr2=0x7f6c3c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3336482008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c065c40 0x7f6c3c0ff140 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c240048d0 tx=0x7f6c24009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 -- 172.21.15.66:0/3336482008 shutdown_connections 2024-09-12T01:41:06.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3336482008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3336482008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c065c40 0x7f6c3c0ff140 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 -- 172.21.15.66:0/3336482008 >> 172.21.15.66:0/3336482008 conn(0x7f6c3c0f6c10 msgr2=0x7f6c3c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 -- 172.21.15.66:0/3336482008 shutdown_connections 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 -- 172.21.15.66:0/3336482008 wait complete. 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 Processor -- start 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.419+0000 7f6c408cb640 1 -- start start 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c408cb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3c065c40 0x7f6c3c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c408cb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c408cb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c10dc80 con 0x7f6c3c0ff680 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c408cb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3c10e3e0 con 0x7f6c3c065c40 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40368/0 (socket says 172.21.15.66:40368) 2024-09-12T01:41:06.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 -- 172.21.15.66:0/3175717709 learned_addr learned my addr 172.21.15.66:0/3175717709 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 -- 172.21.15.66:0/3175717709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3c065c40 msgr2=0x7f6c3c10d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3c065c40 0x7f6c3c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 -- 172.21.15.66:0/3175717709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24005040 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c39d9b640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c10d630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c830 tx=0x7f6c2c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.420+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c2c00a850 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.421+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3c10e670 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.421+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c2c00ae50 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.421+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c2c0113a0 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.421+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c3c10ec10 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.422+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c3c0fa890 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.422+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6c2c012400 con 0x7f6c3c0ff680 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.423+0000 7f6c32ffd640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6c2806ed60 0x7f6c28071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:06.432 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.423+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f6c2c08e410 con 0x7f6c3c0ff680 2024-09-12T01:41:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.423+0000 7f6c3a59c640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6c2806ed60 0x7f6c28071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.424+0000 7f6c3a59c640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6c2806ed60 0x7f6c28071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c2402a530 tx=0x7f6c24009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:06.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.427+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6c2c05b560 con 0x7f6c3c0ff680 2024-09-12T01:41:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.666+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f6c3c04b720 con 0x7f6c3c0ff680 2024-09-12T01:41:06.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.666+0000 7f6c32ffd640 1 -- 172.21.15.66:0/3175717709 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+100 (secure 0 0 0) 0x7f6c2c05af00 con 0x7f6c3c0ff680 2024-09-12T01:41:06.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.668+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6c2806ed60 msgr2=0x7f6c28071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.668+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6c2806ed60 0x7f6c28071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c2402a530 tx=0x7f6c24009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.668+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 msgr2=0x7f6c3c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.668+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c10d630 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c00c830 tx=0x7f6c2c004430 comp rx=0 tx=0).stop 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 shutdown_connections 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f6c2806ed60 0x7f6c28071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c3c0ff680 0x7f6c3c10d630 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 --2- 172.21.15.66:0/3175717709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c3c065c40 0x7f6c3c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 >> 172.21.15.66:0/3175717709 conn(0x7f6c3c0f6c10 msgr2=0x7f6c3c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 shutdown_connections 2024-09-12T01:41:06.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:06.669+0000 7f6c408cb640 1 -- 172.21.15.66:0/3175717709 wait complete. 2024-09-12T01:41:06.677 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:41:07.296 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:07 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3175717709' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-12T01:41:07.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:07 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3175717709' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-12T01:41:07.582 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-12T01:41:07.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:41:08.090 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:08 smithi066 ceph-mon[27875]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-12T01:41:08.306 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:08 smithi153 ceph-mon[34713]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-12T01:41:08.314 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:10.333 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:10 smithi066 ceph-mon[27875]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-12T01:41:10.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 -- 172.21.15.66:0/1926140960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc0fac80 msgr2=0x7f50cc0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:10.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 --2- 172.21.15.66:0/1926140960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc0fac80 0x7f50cc0fb0f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f50b80048d0 tx=0x7f50b8009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 -- 172.21.15.66:0/1926140960 shutdown_connections 2024-09-12T01:41:10.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 --2- 172.21.15.66:0/1926140960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc0fac80 0x7f50cc0fb0f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 --2- 172.21.15.66:0/1926140960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50cc102620 0x7f50cc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 -- 172.21.15.66:0/1926140960 >> 172.21.15.66:0/1926140960 conn(0x7f50cc070ce0 msgr2=0x7f50cc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 -- 172.21.15.66:0/1926140960 shutdown_connections 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.332+0000 7f50d2d43640 1 -- 172.21.15.66:0/1926140960 wait complete. 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50d2d43640 1 Processor -- start 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50d2d43640 1 -- start start 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50d2d43640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50cc0fac80 0x7f50cc0fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50d2d43640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 0x7f50cc0fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50d2d43640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0fc970 con 0x7f50cc102620 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50d2d43640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc0fcae0 con 0x7f50cc0fac80 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 0x7f50cc0fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50cbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 0x7f50cc0fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40378/0 (socket says 172.21.15.66:40378) 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.333+0000 7f50cbfff640 1 -- 172.21.15.66:0/349266675 learned_addr learned my addr 172.21.15.66:0/349266675 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:10.365 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50d0adf640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50cc0fac80 0x7f50cc0fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50cbfff640 1 -- 172.21.15.66:0/349266675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50cc0fac80 msgr2=0x7f50cc0fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50cbfff640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50cc0fac80 0x7f50cc0fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50cbfff640 1 -- 172.21.15.66:0/349266675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8005040 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50cbfff640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 0x7f50cc0fc3a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50b8003080 tx=0x7f50b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b8038070 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50b80097e0 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc119540 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50b803d420 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.334+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc1198c0 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.335+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc0657b0 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.336+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f50b8030020 con 0x7f50cc102620 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.336+0000 7f50c97fa640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f50bc06ed60 0x7f50bc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:10.366 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.336+0000 7f50d0adf640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f50bc06ed60 0x7f50bc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.336+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f50b80ae660 con 0x7f50cc102620 2024-09-12T01:41:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.337+0000 7f50d0adf640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f50bc06ed60 0x7f50bc071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009b50 tx=0x7f50c0009120 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:10.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.341+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f50b807b7b0 con 0x7f50cc102620 2024-09-12T01:41:10.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:10 smithi153 ceph-mon[34713]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-12T01:41:10.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.543+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50cc074c00 con 0x7f50cc102620 2024-09-12T01:41:10.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.544+0000 7f50c97fa640 1 -- 172.21.15.66:0/349266675 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4685 (secure 0 0 0) 0x7f50b807b150 con 0x7f50cc102620 2024-09-12T01:41:10.544 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:41:10.544 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14478,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/2183385729","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":2183385729},{"type":"v1","addr":"172.21.15.66:6827","nonce":2183385729}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:40:59.057757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14462":{"gid":14462,"name":"cephfs.smithi066.jacfsu","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.66:6829/299983733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":299983733},{"type":"v1","addr":"172.21.15.66:6829","nonce":299983733}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-12T01:41:10.544 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f50bc06ed60 msgr2=0x7f50bc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f50bc06ed60 0x7f50bc071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009b50 tx=0x7f50c0009120 comp rx=0 tx=0).stop 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 msgr2=0x7f50cc0fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 0x7f50cc0fc3a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f50b8003080 tx=0x7f50b8009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 shutdown_connections 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f50bc06ed60 0x7f50bc071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc102620 0x7f50cc0fc3a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 --2- 172.21.15.66:0/349266675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50cc0fac80 0x7f50cc0fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 >> 172.21.15.66:0/349266675 conn(0x7f50cc070ce0 msgr2=0x7f50cc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 shutdown_connections 2024-09-12T01:41:10.546 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:10.546+0000 7f50d2d43640 1 -- 172.21.15.66:0/349266675 wait complete. 2024-09-12T01:41:11.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:11 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/349266675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:41:11.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:11 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/349266675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:41:11.603 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 18} 2024-09-12T01:41:11.604 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:41:11.631 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:41:11.632 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-12T01:41:11.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:11.632 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-12T01:41:11.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:11.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-09-12T01:41:11.722 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2024-09-12T01:41:11.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:11.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:11.725 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T01:41:11.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:11.746 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-12T01:41:11.816 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2024-09-12T01:41:11.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:11.818 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-12T01:41:11.818 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:41:11.818 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:11.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:41:12.074 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:12.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:12 smithi066 ceph-mon[27875]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-12T01:41:12.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:12.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:12.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:41:12.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:41:12.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:12 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:12 smithi153 ceph-mon[34713]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 4 op/s 2024-09-12T01:41:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:41:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:41:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:12 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:41:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 -- 172.21.15.66:0/1346548248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 msgr2=0x7fe75c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 --2- 172.21.15.66:0/1346548248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c0fc5c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe7500048d0 tx=0x7fe750009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 -- 172.21.15.66:0/1346548248 shutdown_connections 2024-09-12T01:41:13.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 --2- 172.21.15.66:0/1346548248 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c0fc5c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 --2- 172.21.15.66:0/1346548248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe75c102560 0x7fe75c102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 -- 172.21.15.66:0/1346548248 >> 172.21.15.66:0/1346548248 conn(0x7fe75c0f8100 msgr2=0x7fe75c0fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 -- 172.21.15.66:0/1346548248 shutdown_connections 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 -- 172.21.15.66:0/1346548248 wait complete. 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.623+0000 7fe761053640 1 Processor -- start 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe761053640 1 -- start start 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe761053640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe75c102560 0x7fe75c113280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe761053640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c1137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe761053640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c113e50 con 0x7fe75c102f00 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe761053640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75c10d200 con 0x7fe75c102560 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c1137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c1137c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42704/0 (socket says 172.21.15.66:42704) 2024-09-12T01:41:13.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 -- 172.21.15.66:0/2727276030 learned_addr learned my addr 172.21.15.66:0/2727276030 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75ad9d640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe75c102560 0x7fe75c113280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 -- 172.21.15.66:0/2727276030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe75c102560 msgr2=0x7fe75c113280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe75c102560 0x7fe75c113280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 -- 172.21.15.66:0/2727276030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750005040 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.624+0000 7fe75a59c640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c1137c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe750003080 tx=0x7fe750009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.625+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe750038070 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.625+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe750009760 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.625+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75c10d480 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.625+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe750033420 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.625+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75c10d8e0 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.626+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75c0fdce0 con 0x7fe75c102f00 2024-09-12T01:41:13.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.626+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe750030020 con 0x7fe75c102f00 2024-09-12T01:41:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.627+0000 7fe7437fe640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe74406ed60 0x7fe744071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.627+0000 7fe75ad9d640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe74406ed60 0x7fe744071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.627+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe7500adf00 con 0x7fe75c102f00 2024-09-12T01:41:13.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.627+0000 7fe75ad9d640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe74406ed60 0x7fe744071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe74c006fd0 tx=0x7fe74c008040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:13.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.631+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe75007afd0 con 0x7fe75c102f00 2024-09-12T01:41:13.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.830+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe75c0fbd60 con 0x7fe75c102f00 2024-09-12T01:41:13.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.831+0000 7fe7437fe640 1 -- 172.21.15.66:0/2727276030 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe75007a970 con 0x7fe75c102f00 2024-09-12T01:41:13.831 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-12T01:41:13.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe74406ed60 msgr2=0x7fe744071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:13.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe74406ed60 0x7fe744071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe74c006fd0 tx=0x7fe74c008040 comp rx=0 tx=0).stop 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 msgr2=0x7fe75c1137c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c1137c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe750003080 tx=0x7fe750009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 shutdown_connections 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fe74406ed60 0x7fe744071210 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe75c102f00 0x7fe75c1137c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 --2- 172.21.15.66:0/2727276030 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe75c102560 0x7fe75c113280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 >> 172.21.15.66:0/2727276030 conn(0x7fe75c0f8100 msgr2=0x7fe75c0f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.833+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 shutdown_connections 2024-09-12T01:41:13.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:13.834+0000 7fe761053640 1 -- 172.21.15.66:0/2727276030 wait complete. 2024-09-12T01:41:14.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:14 smithi066 ceph-mon[27875]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-12T01:41:14.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:14 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2727276030' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:41:14.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:14 smithi153 ceph-mon[34713]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 2 op/s 2024-09-12T01:41:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:14 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2727276030' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:41:14.440 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:41:14.441 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:41:14.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:14.441 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2024-09-12T01:41:14.458 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:14.459 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42352sec preferred_lft 42352sec 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link noprefixroute 2024-09-12T01:41:14.460 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:41:14.460 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:41:14.461 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T01:41:14.549 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:14.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:14.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:14.671 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:41:14.696 INFO:teuthology.orchestra.run.smithi066.stdout:1 2024-09-12T01:41:14.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:14.698 DEBUG:teuthology.orchestra.run.smithi066:> route 2024-09-12T01:41:14.768 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2024-09-12T01:41:14.768 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:41:14.768 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:41:14.768 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:41:14.768 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:41:14.768 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:14.769 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T01:41:14.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:41:14.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:41:14.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:41:14.769 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T01:41:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:15.063 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:15.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:15.069 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-12T01:41:15.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:15.086 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2024-09-12T01:41:15.142 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:15.142 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T01:41:15.142 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:41:15.142 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:41:15.142 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T01:41:15.231 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:15.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:15.262 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:41:15.262 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:15.262 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T01:41:15.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:41:15.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:41:15.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:41:15.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:41:15.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:41:15.263 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T01:41:15.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:15.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:15.393 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:15.393 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2024-09-12T01:41:15.393 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2024-09-12T01:41:15.393 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:41:15.393 DEBUG:teuthology.orchestra.run.smithi066:> ') 2024-09-12T01:41:15.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:15.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:15.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:41:15.472 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:15.488 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:41:15.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:41:15.489 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:15.544 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:41:15.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:15.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:41:15.642 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:41:15.642 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:41:15.642 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-09-12T01:41:15.778 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:41:15.778 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:41:15.779 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-09-12T01:41:15.779 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.153:3300" 2024-09-12T01:41:15.779 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:41:15.783 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-12T01:41:15.783 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-12T01:41:15.784 INFO:teuthology.orchestra.run.smithi066.stdout:invalid new device string format 2024-09-12T01:41:15.784 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.153:3300" 2024-09-12T01:41:15.784 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:41:15.784 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.153:6789" 2024-09-12T01:41:15.784 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.153:6789:/ 2024-09-12T01:41:15.785 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f9344df4-70a6-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T01:41:15.785 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:41:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:41:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:41:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:41:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:41:15.787 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:41:15.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:15.788 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:15.814 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:41:15.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:41:15.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:15.916 INFO:teuthology.orchestra.run.smithi066.stdout:client24305 2024-09-12T01:41:15.916 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:41:15.917 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:15.936 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:41:16.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:41:16.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:16.040 INFO:teuthology.orchestra.run.smithi066.stdout:client24305 2024-09-12T01:41:16.040 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:41:16.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:41:16.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:16.103 INFO:teuthology.orchestra.run.smithi066.stdout:client24305 2024-09-12T01:41:16.103 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9344df4-70a6-11ef-bcea-c7b262605968.client24305/status') 2024-09-12T01:41:16.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:16.166 INFO:teuthology.orchestra.run.smithi066.stdout:instance: client.24305 (3)172.21.15.66:0/2556098362 2024-09-12T01:41:16.166 INFO:teuthology.orchestra.run.smithi066.stdout:blocklisted: false 2024-09-12T01:41:16.166 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2024-09-12T01:41:16.166 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2024-09-12T01:41:16.166 INFO:teuthology.orchestra.run.smithi066.stderr:71 bytes copied, 2.4048e-05 s, 3.0 MB/s 2024-09-12T01:41:16.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:16.173 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-12T01:41:16.173 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:41:16.173 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:16.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-12T01:41:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:16 smithi066 ceph-mon[27875]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-09-12T01:41:16.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:16 smithi153 ceph-mon[34713]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-09-12T01:41:16.431 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:17.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 -- 172.21.15.66:0/3557867852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 msgr2=0x7f38640fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:17.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 --2- 172.21.15.66:0/3557867852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38640fc5e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3858009c50 tx=0x7f3858004d10 comp rx=0 tx=0).stop 2024-09-12T01:41:17.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 -- 172.21.15.66:0/3557867852 shutdown_connections 2024-09-12T01:41:17.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 --2- 172.21.15.66:0/3557867852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38640fc5e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:17.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 --2- 172.21.15.66:0/3557867852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3864102580 0x7f3864102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:17.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 -- 172.21.15.66:0/3557867852 >> 172.21.15.66:0/3557867852 conn(0x7f38640f81a0 msgr2=0x7f38640fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:17.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 -- 172.21.15.66:0/3557867852 shutdown_connections 2024-09-12T01:41:17.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.765+0000 7f3868eb6640 1 -- 172.21.15.66:0/3557867852 wait complete. 2024-09-12T01:41:17.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3868eb6640 1 Processor -- start 2024-09-12T01:41:17.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3868eb6640 1 -- start start 2024-09-12T01:41:17.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3868eb6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3864102580 0x7f38641131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:17.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3868eb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38641136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:17.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3868eb6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3864113ce0 con 0x7f3864102f20 2024-09-12T01:41:17.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3868eb6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386410d120 con 0x7f3864102580 2024-09-12T01:41:17.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3861d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38641136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:17.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3861d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38641136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42724/0 (socket says 172.21.15.66:42724) 2024-09-12T01:41:17.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f3861d9b640 1 -- 172.21.15.66:0/2896039634 learned_addr learned my addr 172.21.15.66:0/2896039634 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:17.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.766+0000 7f386259c640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3864102580 0x7f38641131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:17.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3861d9b640 1 -- 172.21.15.66:0/2896039634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3864102580 msgr2=0x7f38641131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:17.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3861d9b640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3864102580 0x7f38641131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:17.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3861d9b640 1 -- 172.21.15.66:0/2896039634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580098b0 con 0x7f3864102f20 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3861d9b640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38641136e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3858004750 tx=0x7f3858004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3858009590 con 0x7f3864102f20 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38580096f0 con 0x7f3864102f20 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386410d3a0 con 0x7f3864102f20 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385803d960 con 0x7f3864102f20 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.767+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386410d940 con 0x7f3864102f20 2024-09-12T01:41:17.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.768+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38640fdd00 con 0x7f3864102f20 2024-09-12T01:41:17.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.768+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f385802f030 con 0x7f3864102f20 2024-09-12T01:41:17.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.769+0000 7f3852ffd640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f384c06ed60 0x7f384c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:17.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.769+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f38580af0b0 con 0x7f3864102f20 2024-09-12T01:41:17.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.769+0000 7f386259c640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f384c06ed60 0x7f384c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:17.776 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.771+0000 7f386259c640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f384c06ed60 0x7f384c071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3854004eb0 tx=0x7f385400b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:17.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.774+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f385807c200 con 0x7f3864102f20 2024-09-12T01:41:17.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.973+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3864109590 con 0x7f3864102f20 2024-09-12T01:41:17.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.974+0000 7f3852ffd640 1 -- 172.21.15.66:0/2896039634 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f385807bba0 con 0x7f3864102f20 2024-09-12T01:41:17.974 INFO:teuthology.orchestra.run.smithi066.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-12T01:41:17.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f384c06ed60 msgr2=0x7f384c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:17.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f384c06ed60 0x7f384c071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3854004eb0 tx=0x7f385400b040 comp rx=0 tx=0).stop 2024-09-12T01:41:17.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 msgr2=0x7f38641136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:17.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38641136e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3858004750 tx=0x7f3858004d10 comp rx=0 tx=0).stop 2024-09-12T01:41:17.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 shutdown_connections 2024-09-12T01:41:17.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f384c06ed60 0x7f384c071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:17.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3864102f20 0x7f38641136e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:17.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 --2- 172.21.15.66:0/2896039634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3864102580 0x7f38641131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:17.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 >> 172.21.15.66:0/2896039634 conn(0x7f38640f81a0 msgr2=0x7f38640f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:17.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 shutdown_connections 2024-09-12T01:41:17.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:17.976+0000 7f3868eb6640 1 -- 172.21.15.66:0/2896039634 wait complete. 2024-09-12T01:41:18.266 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:18 smithi066 ceph-mon[27875]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:41:18.267 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:18.267 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:18 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2896039634' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:41:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:18 smithi153 ceph-mon[34713]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:41:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:18 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2896039634' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:41:18.767 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:41:18.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:18.768 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2024-09-12T01:41:18.790 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2024-09-12T01:41:18.791 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42334sec preferred_lft 42334sec 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link noprefixroute 2024-09-12T01:41:18.792 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:41:18.792 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:41:18.792 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:18.793 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T01:41:18.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:41:18.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2024-09-12T01:41:18.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2024-09-12T01:41:18.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:41:18.793 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T01:41:18.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:19.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:19.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:19.014 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:41:19.040 INFO:teuthology.orchestra.run.smithi153.stdout:1 2024-09-12T01:41:19.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:19.041 DEBUG:teuthology.orchestra.run.smithi153:> route 2024-09-12T01:41:19.119 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2024-09-12T01:41:19.119 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:41:19.119 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:41:19.119 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:41:19.119 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:41:19.119 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:19.119 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T01:41:19.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:41:19.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:41:19.120 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:41:19.120 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T01:41:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:19.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:19.426 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T01:41:19.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:19.442 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2024-09-12T01:41:19.496 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:19.496 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T01:41:19.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:41:19.497 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T01:41:19.497 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T01:41:19.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:19.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:19.613 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T01:41:19.613 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:19.613 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T01:41:19.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T01:41:19.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:41:19.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T01:41:19.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T01:41:19.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T01:41:19.614 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T01:41:19.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:19.745 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:41:19.745 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2024-09-12T01:41:19.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2024-09-12T01:41:19.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:41:19.745 DEBUG:teuthology.orchestra.run.smithi153:> ') 2024-09-12T01:41:19.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:19.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:19.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:41:19.821 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:19.841 INFO:teuthology.orchestra.run.smithi153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:41:19.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:41:19.841 DEBUG:teuthology.orchestra.run.smithi153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:19.896 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-12T01:41:19.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:19.896 DEBUG:teuthology.orchestra.run.smithi153:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:41:19.997 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:41:19.997 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T01:41:19.997 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T01:41:20.123 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:41:20.123 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T01:41:20.123 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T01:41:20.123 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.153:3300" 2024-09-12T01:41:20.123 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:41:20.132 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-12T01:41:20.132 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-12T01:41:20.132 INFO:teuthology.orchestra.run.smithi153.stdout:invalid new device string format 2024-09-12T01:41:20.132 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.66:3300,172.21.15.153:3300" 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: resolved to: "172.21.15.66:6789,172.21.15.153:6789" 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.66:6789,172.21.15.153:6789:/ 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f9344df4-70a6-11ef-bcea-c7b262605968" will pass to kernel 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:41:20.133 INFO:teuthology.orchestra.run.smithi153.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:41:20.135 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:41:20.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:20.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:20.160 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:41:20.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:41:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:20.255 INFO:teuthology.orchestra.run.smithi153.stdout:client24311 2024-09-12T01:41:20.255 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:41:20.255 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:20.271 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:41:20.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:41:20.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:20.368 INFO:teuthology.orchestra.run.smithi153.stdout:client24311 2024-09-12T01:41:20.368 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:41:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:20 smithi066 ceph-mon[27875]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:41:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:20 smithi153 ceph-mon[34713]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:41:20.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:41:20.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:20.425 INFO:teuthology.orchestra.run.smithi153.stdout:client24311 2024-09-12T01:41:20.425 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f9344df4-70a6-11ef-bcea-c7b262605968.client24311/status') 2024-09-12T01:41:20.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:41:20.523 INFO:teuthology.orchestra.run.smithi153.stdout:instance: client.24311 (3)192.168.0.1:0/1436831423 2024-09-12T01:41:20.524 INFO:teuthology.orchestra.run.smithi153.stdout:blocklisted: false 2024-09-12T01:41:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records in 2024-09-12T01:41:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:0+1 records out 2024-09-12T01:41:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:70 bytes copied, 2.3462e-05 s, 3.0 MB/s 2024-09-12T01:41:20.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-12T01:41:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:20.531 INFO:teuthology.run_tasks:Running task print... 2024-09-12T01:41:20.542 INFO:teuthology.task.print:**** done client 2024-09-12T01:41:20.542 INFO:teuthology.run_tasks:Running task parallel... 2024-09-12T01:41:20.574 INFO:teuthology.task.parallel:starting parallel... 2024-09-12T01:41:20.574 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-12T01:41:20.575 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-12T01:41:20.576 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:41:20.576 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-12T01:41:20.576 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-12T01:41:20.576 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-12T01:41:20.581 INFO:tasks.workunit:Pulling workunits from ref 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:41:20.582 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:41:20.582 INFO:tasks.workunit:timeout=3h 2024-09-12T01:41:20.582 INFO:tasks.workunit:cleanup=True 2024-09-12T01:41:20.582 DEBUG:teuthology.orchestra.run.smithi066:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2024-09-12 01:40:45.957700089 +0000 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2024-09-12 01:41:15.812485768 +0000 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2024-09-12 01:40:45.957700089 +0000 2024-09-12T01:41:20.605 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:20.606 DEBUG:teuthology.orchestra.run.smithi066:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-12T01:41:20.676 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:20.693 INFO:teuthology.orchestra.run.smithi153.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:20.693 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-12T01:41:20.693 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-12T01:41:20.693 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:41:20.693 INFO:teuthology.orchestra.run.smithi153.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-12T01:41:20.693 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-12T01:41:20.694 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-12 01:41:20.671444594 +0000 2024-09-12T01:41:20.694 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-12 01:41:20.671444594 +0000 2024-09-12T01:41:20.694 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: 2024-09-12 01:40:45.957700089 +0000 2024-09-12T01:41:20.694 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:20.694 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-12T01:41:20.763 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:41:20.764 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 2024-09-12T01:41:20.781 INFO:tasks.workunit.client.0.smithi066.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:41:20.820 INFO:tasks.workunit.client.1.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-12T01:41:20.857 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:22.327 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:22 smithi066 ceph-mon[27875]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:41:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:22 smithi153 ceph-mon[34713]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.410+0000 7f69f3ed7640 1 -- 172.21.15.66:0/656278708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fdc60 msgr2=0x7f69ec0fe070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.410+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/656278708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fdc60 0x7f69ec0fe070 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f69e80048d0 tx=0x7f69e8009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.410+0000 7f69f3ed7640 1 -- 172.21.15.66:0/656278708 shutdown_connections 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.410+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/656278708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec0fa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.410+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/656278708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fdc60 0x7f69ec0fe070 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.410+0000 7f69f3ed7640 1 -- 172.21.15.66:0/656278708 >> 172.21.15.66:0/656278708 conn(0x7f69ec0f63a0 msgr2=0x7f69ec0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 -- 172.21.15.66:0/656278708 shutdown_connections 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 -- 172.21.15.66:0/656278708 wait complete. 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 Processor -- start 2024-09-12T01:41:22.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 -- start start 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fdc60 0x7f69ec10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec10dc70 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f3ed7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec10e490 con 0x7f69ec0fdc60 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f1472640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f1472640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54888/0 (socket says 172.21.15.66:54888) 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f1472640 1 -- 172.21.15.66:0/1734377011 learned_addr learned my addr 172.21.15.66:0/1734377011 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.411+0000 7f69f1c73640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fdc60 0x7f69ec10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f1472640 1 -- 172.21.15.66:0/1734377011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fdc60 msgr2=0x7f69ec10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f1472640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fdc60 0x7f69ec10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f1472640 1 -- 172.21.15.66:0/1734377011 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8005040 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f1c73640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fdc60 0x7f69ec10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:22.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f1472640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec10d620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00c7e0 tx=0x7f69dc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc00a820 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f69dc00ae20 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec10e720 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc0113a0 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.412+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec10ecc0 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.413+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec0fa040 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.413+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f69dc00a980 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.414+0000 7f69e27fc640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f69d806ed60 0x7f69d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.414+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f69dc08e1f0 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.414+0000 7f69f1c73640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f69d806ed60 0x7f69d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.414+0000 7f69f1c73640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f69d806ed60 0x7f69d8071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69e8004540 tx=0x7f69e8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:22.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.418+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f69dc05b3e0 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.583+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f69ec04b720 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.584+0000 7f69e27fc640 1 -- 172.21.15.66:0/1734377011 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f69dc05ad80 con 0x7f69ec0fe5b0 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f69d806ed60 msgr2=0x7f69d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f69d806ed60 0x7f69d8071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f69e8004540 tx=0x7f69e8035040 comp rx=0 tx=0).stop 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 msgr2=0x7f69ec10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec10d620 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00c7e0 tx=0x7f69dc0043c0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 shutdown_connections 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f69d806ed60 0x7f69d8071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.586 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69ec0fe5b0 0x7f69ec10d620 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 --2- 172.21.15.66:0/1734377011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69ec0fdc60 0x7f69ec10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:22.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 >> 172.21.15.66:0/1734377011 conn(0x7f69ec0f63a0 msgr2=0x7f69ec0f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:22.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 shutdown_connections 2024-09-12T01:41:22.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:22.586+0000 7f69f3ed7640 1 -- 172.21.15.66:0/1734377011 wait complete. 2024-09-12T01:41:23.198 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-12T01:41:23.496 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:24.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:24 smithi066 ceph-mon[27875]: pgmap v192: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-12T01:41:24.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:24 smithi153 ceph-mon[34713]: pgmap v192: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 -- 172.21.15.66:0/545932596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fb8b0 msgr2=0x7f81180fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 --2- 172.21.15.66:0/545932596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fb8b0 0x7f81180fbcc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f81080048d0 tx=0x7f8108009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 -- 172.21.15.66:0/545932596 shutdown_connections 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 --2- 172.21.15.66:0/545932596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81180fc200 0x7f81180fc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 --2- 172.21.15.66:0/545932596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fb8b0 0x7f81180fbcc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 -- 172.21.15.66:0/545932596 >> 172.21.15.66:0/545932596 conn(0x7f81180f6220 msgr2=0x7f81180f8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.933+0000 7f811759e640 1 -- 172.21.15.66:0/545932596 shutdown_connections 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 -- 172.21.15.66:0/545932596 wait complete. 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 Processor -- start 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 -- start start 2024-09-12T01:41:24.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81180fb8b0 0x7f811810cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 0x7f811810d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811810daf0 con 0x7f81180fc200 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f811759e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811810e2c0 con 0x7f81180fb8b0 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.934+0000 7f8115d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 0x7f811810d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8115d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 0x7f811810d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54904/0 (socket says 172.21.15.66:54904) 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8115d9b640 1 -- 172.21.15.66:0/1210577287 learned_addr learned my addr 172.21.15.66:0/1210577287 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f811659c640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81180fb8b0 0x7f811810cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8115d9b640 1 -- 172.21.15.66:0/1210577287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81180fb8b0 msgr2=0x7f811810cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8115d9b640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81180fb8b0 0x7f811810cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8115d9b640 1 -- 172.21.15.66:0/1210577287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108005040 con 0x7f81180fc200 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8115d9b640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 0x7f811810d4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c810 tx=0x7f810c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c00a7a0 con 0x7f81180fc200 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f810c00ada0 con 0x7f81180fc200 2024-09-12T01:41:24.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811810e550 con 0x7f81180fc200 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c011380 con 0x7f81180fc200 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.935+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811810eaf0 con 0x7f81180fc200 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.936+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81180f9ea0 con 0x7f81180fc200 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.937+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f810c0127d0 con 0x7f81180fc200 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.937+0000 7f8106ffd640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f810006ed60 0x7f8100071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.937+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f810c08e690 con 0x7f81180fc200 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.937+0000 7f811659c640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f810006ed60 0x7f8100071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.938+0000 7f811659c640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f810006ed60 0x7f8100071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8108000c00 tx=0x7f8108035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:24.941 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:24.942+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f810c05b2e0 con 0x7f81180fc200 2024-09-12T01:41:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.107+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f811804b720 con 0x7f81180fc200 2024-09-12T01:41:25.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.107+0000 7f8106ffd640 1 -- 172.21.15.66:0/1210577287 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f810c05b100 con 0x7f81180fc200 2024-09-12T01:41:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.109+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f810006ed60 msgr2=0x7f8100071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.109+0000 7f811759e640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f810006ed60 0x7f8100071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8108000c00 tx=0x7f8108035040 comp rx=0 tx=0).stop 2024-09-12T01:41:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.109+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 msgr2=0x7f811810d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.109+0000 7f811759e640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 0x7f811810d4a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f810c00c810 tx=0x7f810c0043c0 comp rx=0 tx=0).stop 2024-09-12T01:41:25.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 shutdown_connections 2024-09-12T01:41:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f810006ed60 0x7f8100071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81180fc200 0x7f811810d4a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 --2- 172.21.15.66:0/1210577287 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81180fb8b0 0x7f811810cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 >> 172.21.15.66:0/1210577287 conn(0x7f81180f6220 msgr2=0x7f81180fabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 shutdown_connections 2024-09-12T01:41:25.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:25.110+0000 7f811759e640 1 -- 172.21.15.66:0/1210577287 wait complete. 2024-09-12T01:41:25.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-12T01:41:25.962 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:26.373 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:26 smithi066 ceph-mon[27875]: pgmap v193: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-12T01:41:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:26 smithi153 ceph-mon[34713]: pgmap v193: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-12T01:41:27.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 -- 172.21.15.66:0/1681888117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 msgr2=0x7f20ac0fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:27.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1681888117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac0fc960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f20a80048d0 tx=0x7f20a8009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 -- 172.21.15.66:0/1681888117 shutdown_connections 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1681888117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0fd820 0x7f20ac0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1681888117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac0fc960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 -- 172.21.15.66:0/1681888117 >> 172.21.15.66:0/1681888117 conn(0x7f20ac0f7d30 msgr2=0x7f20ac0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 -- 172.21.15.66:0/1681888117 shutdown_connections 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 -- 172.21.15.66:0/1681888117 wait complete. 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 Processor -- start 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.532+0000 7f20b3c59640 1 -- start start 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b3c59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b3c59640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0fd820 0x7f20ac10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b3c59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac10dc30 con 0x7f20ac0fc550 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b3c59640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac10e450 con 0x7f20ac0fd820 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:27.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54934/0 (socket says 172.21.15.66:54934) 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 -- 172.21.15.66:0/1427885008 learned_addr learned my addr 172.21.15.66:0/1427885008 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 -- 172.21.15.66:0/1427885008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0fd820 msgr2=0x7f20ac10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0fd820 0x7f20ac10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 -- 172.21.15.66:0/1427885008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8005040 con 0x7f20ac0fc550 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b19f5640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac10d0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20a8003080 tx=0x7f20a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a8038070 con 0x7f20ac0fc550 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20a802abd0 con 0x7f20ac0fc550 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac10e680 con 0x7f20ac0fc550 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a803e670 con 0x7f20ac0fc550 2024-09-12T01:41:27.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.533+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac10ec20 con 0x7f20ac0fc550 2024-09-12T01:41:27.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.535+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac0fb9b0 con 0x7f20ac0fc550 2024-09-12T01:41:27.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.535+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f20a8030020 con 0x7f20ac0fc550 2024-09-12T01:41:27.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.536+0000 7f20a27fc640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f209806ed60 0x7f2098071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:27.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.536+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f20a80ae4e0 con 0x7f20ac0fc550 2024-09-12T01:41:27.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.536+0000 7f20b11f4640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f209806ed60 0x7f2098071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:27.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.536+0000 7f20b11f4640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f209806ed60 0x7f2098071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20ac10ce50 tx=0x7f209c007cb0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:27.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.542+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f20a807b630 con 0x7f20ac0fc550 2024-09-12T01:41:27.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.706+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f20ac04b720 con 0x7f20ac0fc550 2024-09-12T01:41:27.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.706+0000 7f20a27fc640 1 -- 172.21.15.66:0/1427885008 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f20a807afd0 con 0x7f20ac0fc550 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f209806ed60 msgr2=0x7f2098071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f209806ed60 0x7f2098071210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f20ac10ce50 tx=0x7f209c007cb0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 msgr2=0x7f20ac10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac10d0a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f20a8003080 tx=0x7f20a8009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 shutdown_connections 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f209806ed60 0x7f2098071210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20ac0fd820 0x7f20ac10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 --2- 172.21.15.66:0/1427885008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20ac0fc550 0x7f20ac10d0a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 >> 172.21.15.66:0/1427885008 conn(0x7f20ac0f7d30 msgr2=0x7f20ac0f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:27.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 shutdown_connections 2024-09-12T01:41:27.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:27.708+0000 7f20b3c59640 1 -- 172.21.15.66:0/1427885008 wait complete. 2024-09-12T01:41:28.308 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:28 smithi066 ceph-mon[27875]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-12T01:41:28.310 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-12T01:41:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:28 smithi153 ceph-mon[34713]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-12T01:41:28.568 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:41:30.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 -- 172.21.15.66:0/1907529243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0ff730 msgr2=0x7f3c4c101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:30.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/1907529243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0ff730 0x7f3c4c101b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0048d0 tx=0x7f3c3c009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:30.026 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 -- 172.21.15.66:0/1907529243 shutdown_connections 2024-09-12T01:41:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/1907529243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0ff730 0x7f3c4c101b10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/1907529243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 -- 172.21.15.66:0/1907529243 >> 172.21.15.66:0/1907529243 conn(0x7f3c4c0f6c40 msgr2=0x7f3c4c0f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 -- 172.21.15.66:0/1907529243 shutdown_connections 2024-09-12T01:41:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.022+0000 7f3c53a6a640 1 -- 172.21.15.66:0/1907529243 wait complete. 2024-09-12T01:41:30.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c53a6a640 1 Processor -- start 2024-09-12T01:41:30.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c53a6a640 1 -- start start 2024-09-12T01:41:30.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c53a6a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:30.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c53a6a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0ff730 0x7f3c4c0fb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:30.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c53a6a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0fb630 con 0x7f3c4c0666b0 2024-09-12T01:41:30.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c53a6a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0fb770 con 0x7f3c4c0ff730 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51806640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51806640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:54950/0 (socket says 172.21.15.66:54950) 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51806640 1 -- 172.21.15.66:0/2022509305 learned_addr learned my addr 172.21.15.66:0/2022509305 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51005640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0ff730 0x7f3c4c0fb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51806640 1 -- 172.21.15.66:0/2022509305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0ff730 msgr2=0x7f3c4c0fb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51806640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0ff730 0x7f3c4c0fb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.023+0000 7f3c51806640 1 -- 172.21.15.66:0/2022509305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c005040 con 0x7f3c4c0666b0 2024-09-12T01:41:30.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.024+0000 7f3c51806640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0fcbb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3c48002840 tx=0x7f3c48004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.024+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c48007c30 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.024+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c4800f040 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.024+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c48009410 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.024+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0fba50 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.024+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c1151b0 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.025+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c0fa8e0 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.025+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3c480096d0 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.026+0000 7f3c427fc640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c3806ed60 0x7f3c38071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.026+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3c4808e200 con 0x7f3c4c0666b0 2024-09-12T01:41:30.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.026+0000 7f3c51005640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c3806ed60 0x7f3c38071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:30.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.026+0000 7f3c51005640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c3806ed60 0x7f3c38071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009ac0 tx=0x7f3c3c009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:30.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.030+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3c4805b2d0 con 0x7f3c4c0666b0 2024-09-12T01:41:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:30 smithi066 ceph-mon[27875]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-12T01:41:30.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:30.209+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c4c0f8780 con 0x7f3c3806ed60 2024-09-12T01:41:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:30 smithi153 ceph-mon[34713]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-12T01:41:31.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:31 smithi066 ceph-mon[27875]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:41:31.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:31 smithi153 ceph-mon[34713]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:41:32.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:32 smithi066 ceph-mon[27875]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-12T01:41:32.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:32 smithi153 ceph-mon[34713]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-12T01:41:33.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:34.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:34 smithi066 ceph-mon[27875]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-12T01:41:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:34 smithi153 ceph-mon[34713]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-12T01:41:36.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:36 smithi066 ceph-mon[27875]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:41:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:36 smithi153 ceph-mon[34713]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:41:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:38 smithi066 ceph-mon[27875]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:41:38.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:38 smithi153 ceph-mon[34713]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:41:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:40 smithi066 ceph-mon[27875]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:40 smithi153 ceph-mon[34713]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:42.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:42 smithi066 ceph-mon[27875]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:42 smithi153 ceph-mon[34713]: pgmap v201: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:44.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:44 smithi066 ceph-mon[27875]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:44 smithi153 ceph-mon[34713]: pgmap v202: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:46 smithi066 ceph-mon[27875]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:46 smithi153 ceph-mon[34713]: pgmap v203: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:48 smithi066 ceph-mon[27875]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:48 smithi153 ceph-mon[34713]: pgmap v204: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:41:50.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:50 smithi066 ceph-mon[27875]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:50 smithi153 ceph-mon[34713]: pgmap v205: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:52.399 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:52 smithi066 ceph-mon[27875]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:52 smithi153 ceph-mon[34713]: pgmap v206: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:54 smithi066 ceph-mon[27875]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:54.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:54 smithi153 ceph-mon[34713]: pgmap v207: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:56.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:56 smithi066 ceph-mon[27875]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:56.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:56 smithi153 ceph-mon[34713]: pgmap v208: 65 pgs: 65 active+clean; 584 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:41:58.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:41:58 smithi066 ceph-mon[27875]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:41:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:41:58 smithi153 ceph-mon[34713]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:41:59.587 INFO:teuthology.orchestra.run.smithi066.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:41:59.587 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.586+0000 7f3c427fc640 1 -- 172.21.15.66:0/2022509305 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f3c4c0f8780 con 0x7f3c3806ed60 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c3806ed60 msgr2=0x7f3c38071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c3806ed60 0x7f3c38071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009ac0 tx=0x7f3c3c009da0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 msgr2=0x7f3c4c0fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0fcbb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3c48002840 tx=0x7f3c48004570 comp rx=0 tx=0).stop 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 shutdown_connections 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3c3806ed60 0x7f3c38071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c4c0ff730 0x7f3c4c0fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 --2- 172.21.15.66:0/2022509305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c4c0666b0 0x7f3c4c0fcbb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.589+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 >> 172.21.15.66:0/2022509305 conn(0x7f3c4c0f6c40 msgr2=0x7f3c4c0f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:59.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.590+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 shutdown_connections 2024-09-12T01:41:59.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:41:59.590+0000 7f3c53a6a640 1 -- 172.21.15.66:0/2022509305 wait complete. 2024-09-12T01:42:00.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:00 smithi066 ceph-mon[27875]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:42:00.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:00 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:00.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:00 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:00.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-12T01:42:00.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:00 smithi153 ceph-mon[34713]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:42:00.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:00 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:00.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:00 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:00.607 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:42:01.130 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:01 smithi066 ceph-mon[27875]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:42:01.130 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:42:01.130 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:42:01.130 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:01 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:01 smithi153 ceph-mon[34713]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:42:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:42:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:42:01.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:01 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:02 smithi066 ceph-mon[27875]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:42:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:02 smithi066 ceph-mon[27875]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:42:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:02 smithi153 ceph-mon[34713]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:42:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:02 smithi153 ceph-mon[34713]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:42:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:03 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:03 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:04.191 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:04 smithi066 ceph-mon[27875]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-12T01:42:04.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 -- 172.21.15.66:0/2407424834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 msgr2=0x7fd6d40ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/2407424834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d40ff130 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40048d0 tx=0x7fd6c4009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 -- 172.21.15.66:0/2407424834 shutdown_connections 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/2407424834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d40ff670 0x7fd6d4101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/2407424834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d40ff130 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 -- 172.21.15.66:0/2407424834 >> 172.21.15.66:0/2407424834 conn(0x7fd6d40f6c00 msgr2=0x7fd6d40f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 -- 172.21.15.66:0/2407424834 shutdown_connections 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.190+0000 7fd6d9a61640 1 -- 172.21.15.66:0/2407424834 wait complete. 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.191+0000 7fd6d9a61640 1 Processor -- start 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.191+0000 7fd6d9a61640 1 -- start start 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d9a61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d41136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d9a61640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d40ff670 0x7fd6d4113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d9a61640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4114240 con 0x7fd6d40664d0 2024-09-12T01:42:04.280 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d9a61640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4114a60 con 0x7fd6d40ff670 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d41136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d27fc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d40ff670 0x7fd6d4113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d41136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43460/0 (socket says 172.21.15.66:43460) 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d2ffd640 1 -- 172.21.15.66:0/4001325098 learned_addr learned my addr 172.21.15.66:0/4001325098 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d2ffd640 1 -- 172.21.15.66:0/4001325098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d40ff670 msgr2=0x7fd6d4113bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d2ffd640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d40ff670 0x7fd6d4113bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.192+0000 7fd6d2ffd640 1 -- 172.21.15.66:0/4001325098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4005040 con 0x7fd6d40664d0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.193+0000 7fd6d2ffd640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d41136b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40043d0 tx=0x7fd6c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.193+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c4038070 con 0x7fd6d40664d0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.193+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4114c90 con 0x7fd6d40664d0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.193+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d41151b0 con 0x7fd6d40664d0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.194+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6c402ae90 con 0x7fd6d40664d0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.194+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c4038070 con 0x7fd6d40664d0 2024-09-12T01:42:04.281 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.195+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40fa880 con 0x7fd6d40664d0 2024-09-12T01:42:04.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.195+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd6c4030020 con 0x7fd6d40664d0 2024-09-12T01:42:04.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.197+0000 7fd6bb7fe640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fd6bc06edb0 0x7fd6bc071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.197+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fd6c40adfa0 con 0x7fd6d40664d0 2024-09-12T01:42:04.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.197+0000 7fd6d27fc640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fd6bc06edb0 0x7fd6bc071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.198+0000 7fd6d27fc640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fd6bc06edb0 0x7fd6bc071260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4113460 tx=0x7fd6c800b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.282 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.201+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd6c407b1a0 con 0x7fd6d40664d0 2024-09-12T01:42:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:04 smithi153 ceph-mon[34713]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-12T01:42:04.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.537+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d4105060 con 0x7fd6bc06edb0 2024-09-12T01:42:04.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.539+0000 7fd6bb7fe640 1 -- 172.21.15.66:0/4001325098 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7fd6d4105060 con 0x7fd6bc06edb0 2024-09-12T01:42:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fd6bc06edb0 msgr2=0x7fd6bc071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fd6bc06edb0 0x7fd6bc071260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4113460 tx=0x7fd6c800b040 comp rx=0 tx=0).stop 2024-09-12T01:42:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 msgr2=0x7fd6d41136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d41136b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40043d0 tx=0x7fd6c4009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 shutdown_connections 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fd6bc06edb0 0x7fd6bc071260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6d40ff670 0x7fd6d4113bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 --2- 172.21.15.66:0/4001325098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40664d0 0x7fd6d41136b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.542+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 >> 172.21.15.66:0/4001325098 conn(0x7fd6d40f6c00 msgr2=0x7fd6d40fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.543+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 shutdown_connections 2024-09-12T01:42:04.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.543+0000 7fd6d9a61640 1 -- 172.21.15.66:0/4001325098 wait complete. 2024-09-12T01:42:04.555 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:42:04.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.676+0000 7f8ac49ce640 1 -- 172.21.15.66:0/722988517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 msgr2=0x7f8ac00fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.676+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/722988517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac00fb850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00048d0 tx=0x7f8ab0009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.677+0000 7f8ac49ce640 1 -- 172.21.15.66:0/722988517 shutdown_connections 2024-09-12T01:42:04.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.677+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/722988517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac00fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.677+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/722988517 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac00fb850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.677+0000 7f8ac49ce640 1 -- 172.21.15.66:0/722988517 >> 172.21.15.66:0/722988517 conn(0x7f8ac00f6c00 msgr2=0x7f8ac00f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:04.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.677+0000 7f8ac49ce640 1 -- 172.21.15.66:0/722988517 shutdown_connections 2024-09-12T01:42:04.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.677+0000 7f8ac49ce640 1 -- 172.21.15.66:0/722988517 wait complete. 2024-09-12T01:42:04.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.678+0000 7f8ac49ce640 1 Processor -- start 2024-09-12T01:42:04.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.678+0000 7f8ac49ce640 1 -- start start 2024-09-12T01:42:04.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.678+0000 7f8ac49ce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac0066660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.678+0000 7f8ac49ce640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac01141f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.678 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.678+0000 7f8ac49ce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac010dc90 con 0x7f8ac00fb440 2024-09-12T01:42:04.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.678+0000 7f8ac49ce640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac0114760 con 0x7f8ac00fc710 2024-09-12T01:42:04.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.679+0000 7f8abdd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac01141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.679+0000 7f8abdd9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac01141f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:52070/0 (socket says 172.21.15.66:52070) 2024-09-12T01:42:04.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.679+0000 7f8abdd9b640 1 -- 172.21.15.66:0/3902571941 learned_addr learned my addr 172.21.15.66:0/3902571941 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:04.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.679+0000 7f8abe59c640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac0066660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.679+0000 7f8abdd9b640 1 -- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 msgr2=0x7f8ac0066660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.680+0000 7f8abdd9b640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac0066660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.680+0000 7f8abdd9b640 1 -- 172.21.15.66:0/3902571941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0005040 con 0x7f8ac00fc710 2024-09-12T01:42:04.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.680+0000 7f8abe59c640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac0066660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:04.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.680+0000 7f8abdd9b640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac01141f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400eb70 tx=0x7f8ab400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.680 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.680+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab4007c30 con 0x7f8ac00fc710 2024-09-12T01:42:04.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.681+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ab400f040 con 0x7f8ac00fc710 2024-09-12T01:42:04.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.681+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac01149e0 con 0x7f8ac00fc710 2024-09-12T01:42:04.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.681+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ab4009450 con 0x7f8ac00fc710 2024-09-12T01:42:04.681 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.681+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac0114f80 con 0x7f8ac00fc710 2024-09-12T01:42:04.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.682+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac00fa8a0 con 0x7f8ac00fc710 2024-09-12T01:42:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.684+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8ab40096c0 con 0x7f8ac00fc710 2024-09-12T01:42:04.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.685+0000 7f8aaeffd640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8aa806ed60 0x7f8aa8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.685+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8ab408def0 con 0x7f8ac00fc710 2024-09-12T01:42:04.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.685+0000 7f8abe59c640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8aa806ed60 0x7f8aa8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.686+0000 7f8abe59c640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8aa806ed60 0x7f8aa8071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0003080 tx=0x7f8ab0035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.693 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:04.693+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8ab405afd0 con 0x7f8ac00fc710 2024-09-12T01:42:05.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.031+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ac0100af0 con 0x7f8aa806ed60 2024-09-12T01:42:05.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.033+0000 7f8aaeffd640 1 -- 172.21.15.66:0/3902571941 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f8ac0100af0 con 0x7f8aa806ed60 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.035+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8aa806ed60 msgr2=0x7f8aa8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.035+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8aa806ed60 0x7f8aa8071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ab0003080 tx=0x7f8ab0035040 comp rx=0 tx=0).stop 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 msgr2=0x7f8ac01141f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac01141f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400eb70 tx=0x7f8ab400b040 comp rx=0 tx=0).stop 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 shutdown_connections 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8aa806ed60 0x7f8aa8071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.036 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac00fc710 0x7f8ac01141f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 --2- 172.21.15.66:0/3902571941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ac00fb440 0x7f8ac0066660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 >> 172.21.15.66:0/3902571941 conn(0x7f8ac00f6c00 msgr2=0x7f8ac00f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 shutdown_connections 2024-09-12T01:42:05.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.036+0000 7f8ac49ce640 1 -- 172.21.15.66:0/3902571941 wait complete. 2024-09-12T01:42:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.166+0000 7f7470b93640 1 -- 172.21.15.66:0/2913740132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 msgr2=0x7f746c0fafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.166+0000 7f7470b93640 1 --2- 172.21.15.66:0/2913740132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c0fafc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f745c0049c0 tx=0x7f745c00aeb0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.167+0000 7f7470b93640 1 -- 172.21.15.66:0/2913740132 shutdown_connections 2024-09-12T01:42:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.167+0000 7f7470b93640 1 --2- 172.21.15.66:0/2913740132 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c0fc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.167+0000 7f7470b93640 1 --2- 172.21.15.66:0/2913740132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c0fafc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.167+0000 7f7470b93640 1 -- 172.21.15.66:0/2913740132 >> 172.21.15.66:0/2913740132 conn(0x7f746c0f6390 msgr2=0x7f746c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:05.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.167+0000 7f7470b93640 1 -- 172.21.15.66:0/2913740132 shutdown_connections 2024-09-12T01:42:05.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.167+0000 7f7470b93640 1 -- 172.21.15.66:0/2913740132 wait complete. 2024-09-12T01:42:05.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.168+0000 7f7470b93640 1 Processor -- start 2024-09-12T01:42:05.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.168+0000 7f7470b93640 1 -- start start 2024-09-12T01:42:05.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.168+0000 7f7470b93640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:05.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.168+0000 7f7470b93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:05.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f746a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:05.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f746a59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c10d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:52092/0 (socket says 172.21.15.66:52092) 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f7469d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f746a59c640 1 -- 172.21.15.66:0/306603744 learned_addr learned my addr 172.21.15.66:0/306603744 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f7469d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43498/0 (socket says 172.21.15.66:43498) 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c10dc80 con 0x7f746c0fbe80 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.169+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c10e4a0 con 0x7f746c0fabb0 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.170+0000 7f746a59c640 1 -- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 msgr2=0x7f746c10d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.170+0000 7f746a59c640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c10d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.170+0000 7f746a59c640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460005040 con 0x7f746c0fabb0 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.170+0000 7f7469d9b640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.170+0000 7f746a59c640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c10d0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c00aeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.170+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745c033920 con 0x7f746c0fabb0 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.171+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f745c034420 con 0x7f746c0fabb0 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.171+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c005040 con 0x7f746c0fabb0 2024-09-12T01:42:05.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.171+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f745c03b560 con 0x7f746c0fabb0 2024-09-12T01:42:05.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.171+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c10eae0 con 0x7f746c0fabb0 2024-09-12T01:42:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.172+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746c0fa010 con 0x7f746c0fabb0 2024-09-12T01:42:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.174+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f745c031020 con 0x7f746c0fabb0 2024-09-12T01:42:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.174+0000 7f745affd640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f745406ed60 0x7f7454071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:05.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.175+0000 7f7469d9b640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f745406ed60 0x7f7454071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.175+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f745c0ae4b0 con 0x7f746c0fabb0 2024-09-12T01:42:05.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.175+0000 7f7469d9b640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f745406ed60 0x7f7454071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f746c10cea0 tx=0x7f746000b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:05.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.181+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f745c07b690 con 0x7f746c0fabb0 2024-09-12T01:42:05.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.524+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f746c10eed0 con 0x7f745406ed60 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.540+0000 7f745affd640 1 -- 172.21.15.66:0/306603744 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f746c10eed0 con 0x7f745406ed60 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (5m) 53s ago 6m 25.3M - 0.25.0 c8568f914cd2 b2c0b1b4f381 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (6m) 53s ago 6m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (5m) 60s ago 5m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (5m) 53s ago 6m 82.9M - 9.4.7 954c08fa6188 a6ff5cae127b 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (81s) 53s ago 79s 10.9M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (74s) 53s ago 73s 16.2M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:42:05.541 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (71s) 60s ago 70s 14.0M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (77s) 60s ago 77s 14.3M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:9283,8765,8443 running (7m) 53s ago 7m 450M - 17.2.7-1609-g554ba93e d4c538e492e4 d4facfef752d 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (5m) 60s ago 5m 400M - 17.2.7-1609-g554ba93e d4c538e492e4 4b0e5456f121 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (8m) 53s ago 8m 49.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (5m) 60s ago 5m 36.9M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (6m) 53s ago 6m 16.1M - 1.5.0 0da6a335fe13 ebe17b848675 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (5m) 60s ago 5m 16.4M - 1.5.0 0da6a335fe13 6391262c1a15 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (4m) 53s ago 4m 45.9M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (4m) 53s ago 4m 44.5M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (4m) 53s ago 4m 42.8M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (3m) 60s ago 3m 44.5M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (3m) 60s ago 3m 41.0M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (2m) 60s ago 2m 43.1M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:42:05.542 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (5m) 53s ago 6m 53.3M - 2.43.0 a07b618ecd1d 25c9c1516174 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f745406ed60 msgr2=0x7f7454071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f745406ed60 0x7f7454071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f746c10cea0 tx=0x7f746000b040 comp rx=0 tx=0).stop 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 msgr2=0x7f746c10d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c10d0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f745c000c00 tx=0x7f745c00aeb0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 shutdown_connections 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f745406ed60 0x7f7454071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c0fbe80 0x7f746c10d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 --2- 172.21.15.66:0/306603744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f746c0fabb0 0x7f746c10d0f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 >> 172.21.15.66:0/306603744 conn(0x7f746c0f6390 msgr2=0x7f746c0f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:05.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 shutdown_connections 2024-09-12T01:42:05.545 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.543+0000 7f7470b93640 1 -- 172.21.15.66:0/306603744 wait complete. 2024-09-12T01:42:05.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.677+0000 7f8ffa710640 1 -- 172.21.15.66:0/3350142589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 msgr2=0x7f8ff40fa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.677+0000 7f8ff2ffd640 1 -- 172.21.15.66:0/3350142589 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe8032610 con 0x7f8ff40fe540 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.677+0000 7f8ffa710640 1 --2- 172.21.15.66:0/3350142589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 0x7f8ff40fa6a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80048d0 tx=0x7f8fe8009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.678+0000 7f8ffa710640 1 -- 172.21.15.66:0/3350142589 shutdown_connections 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.678+0000 7f8ffa710640 1 --2- 172.21.15.66:0/3350142589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 0x7f8ff40fa6a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.678+0000 7f8ffa710640 1 --2- 172.21.15.66:0/3350142589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff40fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.678+0000 7f8ffa710640 1 -- 172.21.15.66:0/3350142589 >> 172.21.15.66:0/3350142589 conn(0x7f8ff40f6390 msgr2=0x7f8ff40f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.678+0000 7f8ffa710640 1 -- 172.21.15.66:0/3350142589 shutdown_connections 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.678+0000 7f8ffa710640 1 -- 172.21.15.66:0/3350142589 wait complete. 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.679+0000 7f8ffa710640 1 Processor -- start 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.679+0000 7f8ffa710640 1 -- start start 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.679+0000 7f8ffa710640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.680+0000 7f8ffa710640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 0x7f8ff406f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:05.683 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.680+0000 7f8ffa710640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff406f750 con 0x7f8ff40fe540 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.680+0000 7f8ff3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.680+0000 7f8ff3fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff406ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:52112/0 (socket says 172.21.15.66:52112) 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.680+0000 7f8ff3fff640 1 -- 172.21.15.66:0/153352932 learned_addr learned my addr 172.21.15.66:0/153352932 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.680+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff406a5c0 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.681+0000 7f8ff3fff640 1 -- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 msgr2=0x7f8ff406f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.681+0000 7f8ff3fff640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 0x7f8ff406f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.681+0000 7f8ff3fff640 1 -- 172.21.15.66:0/153352932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8005040 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.681+0000 7f8ff3fff640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff406ec10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400eb70 tx=0x7f8fe400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:05.684 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.682+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4007c30 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.682+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8fe400f040 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.682+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff406a840 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.682+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff406ad60 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.683+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fe4009490 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.685 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.685+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8fe40096d0 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.685+0000 7f8ff0ff9640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8fdc06ee80 0x7f8fdc071330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:05.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.686+0000 7f8ff37fe640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8fdc06ee80 0x7f8fdc071330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:05.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.686+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f8fe408ed80 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.686 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.686+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe0005240 con 0x7f8ff40fdbf0 2024-09-12T01:42:05.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.687+0000 7f8ff37fe640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8fdc06ee80 0x7f8fdc071330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80043d0 tx=0x7f8fe8009da0 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:05.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:05.695+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8fe405bee0 con 0x7f8ff40fdbf0 2024-09-12T01:42:06.096 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:06 smithi066 ceph-mon[27875]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:06.096 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:06 smithi066 ceph-mon[27875]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-12T01:42:06.096 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:06 smithi066 ceph-mon[27875]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:06.096 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:06.096 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:06.096 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:06 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:06.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.118+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8fe0005d00 con 0x7f8ff40fdbf0 2024-09-12T01:42:06.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.119+0000 7f8ff0ff9640 1 -- 172.21.15.66:0/153352932 <== mon.1 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f8fe4019070 con 0x7f8ff40fdbf0 2024-09-12T01:42:06.120 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:42:06.120 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:42:06.120 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:42:06.120 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:06.120 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 14 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:42:06.121 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8fdc06ee80 msgr2=0x7f8fdc071330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8fdc06ee80 0x7f8fdc071330 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8fe80043d0 tx=0x7f8fe8009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 msgr2=0x7f8ff406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff406ec10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400eb70 tx=0x7f8fe400b040 comp rx=0 tx=0).stop 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 shutdown_connections 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f8fdc06ee80 0x7f8fdc071330 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ff40fe540 0x7f8ff406f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 --2- 172.21.15.66:0/153352932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff40fdbf0 0x7f8ff406ec10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 >> 172.21.15.66:0/153352932 conn(0x7f8ff40f6390 msgr2=0x7f8ff40f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 shutdown_connections 2024-09-12T01:42:06.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.122+0000 7f8ffa710640 1 -- 172.21.15.66:0/153352932 wait complete. 2024-09-12T01:42:06.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 -- 172.21.15.66:0/2971833599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 msgr2=0x7ff2840fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:06.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 --2- 172.21.15.66:0/2971833599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff2840fcb70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff2740048d0 tx=0x7ff274009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 -- 172.21.15.66:0/2971833599 shutdown_connections 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 --2- 172.21.15.66:0/2971833599 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff2840fcb70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 --2- 172.21.15.66:0/2971833599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2840fb430 0x7ff2840fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 -- 172.21.15.66:0/2971833599 >> 172.21.15.66:0/2971833599 conn(0x7ff2840f6c10 msgr2=0x7ff2840f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.207+0000 7ff28c28d640 1 -- 172.21.15.66:0/2971833599 shutdown_connections 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.208+0000 7ff28c28d640 1 -- 172.21.15.66:0/2971833599 wait complete. 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.208+0000 7ff28c28d640 1 Processor -- start 2024-09-12T01:42:06.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.208+0000 7ff28c28d640 1 -- start start 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.208+0000 7ff28c28d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2840fb430 0x7ff28410ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.208+0000 7ff28c28d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff28410b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.208+0000 7ff289828640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff28410b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff28c28d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28410b920 con 0x7ff2840fc700 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff289828640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff28410b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:43538/0 (socket says 172.21.15.66:43538) 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff28c28d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284111440 con 0x7ff2840fb430 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff289828640 1 -- 172.21.15.66:0/840290769 learned_addr learned my addr 172.21.15.66:0/840290769 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff289828640 1 -- 172.21.15.66:0/840290769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2840fb430 msgr2=0x7ff28410ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:06.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff289828640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2840fb430 0x7ff28410ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff289828640 1 -- 172.21.15.66:0/840290769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff274005040 con 0x7ff2840fc700 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff289828640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff28410b320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2740043d0 tx=0x7ff274009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff274038070 con 0x7ff2840fc700 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff274009800 con 0x7ff2840fc700 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27403e670 con 0x7ff2840fc700 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.209+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2841116c0 con 0x7ff2840fc700 2024-09-12T01:42:06.210 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.210+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284111c60 con 0x7ff2840fc700 2024-09-12T01:42:06.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.211+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2840fa890 con 0x7ff2840fc700 2024-09-12T01:42:06.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.213+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff274030020 con 0x7ff2840fc700 2024-09-12T01:42:06.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.213+0000 7ff27affd640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff27006ed50 0x7ff270071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:06.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.213+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff2740ae780 con 0x7ff2840fc700 2024-09-12T01:42:06.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.214+0000 7ff28a029640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff27006ed50 0x7ff270071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:06.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.214+0000 7ff28a029640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff27006ed50 0x7ff270071200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff28410ab90 tx=0x7ff280009c50 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:06.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.217+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff27407b8b0 con 0x7ff2840fc700 2024-09-12T01:42:06.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.399+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff284100c60 con 0x7ff27006ed50 2024-09-12T01:42:06.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.401+0000 7ff27affd640 1 -- 172.21.15.66:0/840290769 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff284100c60 con 0x7ff27006ed50 2024-09-12T01:42:06.401 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:42:06.401 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:42:06.402 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:42:06.402 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:42:06.402 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [], 2024-09-12T01:42:06.402 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "0/2 daemons upgraded", 2024-09-12T01:42:06.402 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 image on host smithi153", 2024-09-12T01:42:06.402 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:42:06.403 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:42:06.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff27006ed50 msgr2=0x7ff270071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:06.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff27006ed50 0x7ff270071200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff28410ab90 tx=0x7ff280009c50 comp rx=0 tx=0).stop 2024-09-12T01:42:06.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 msgr2=0x7ff28410b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:06.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff28410b320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2740043d0 tx=0x7ff274009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:06 smithi153 ceph-mon[34713]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:06.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:06 smithi153 ceph-mon[34713]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-12T01:42:06.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:06 smithi153 ceph-mon[34713]: from='client.24327 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:06.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:06.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:06.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:06 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:06.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 shutdown_connections 2024-09-12T01:42:06.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7ff27006ed50 0x7ff270071200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2840fc700 0x7ff28410b320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 --2- 172.21.15.66:0/840290769 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2840fb430 0x7ff28410ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:06.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 >> 172.21.15.66:0/840290769 conn(0x7ff2840f6c10 msgr2=0x7ff284065500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:06.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 shutdown_connections 2024-09-12T01:42:06.407 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:06.403+0000 7ff28c28d640 1 -- 172.21.15.66:0/840290769 wait complete. 2024-09-12T01:42:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:07 smithi066 ceph-mon[27875]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:07 smithi066 ceph-mon[27875]: Upgrade: Target is version 19.1.1-298-gb53b6d3e (unknown) 2024-09-12T01:42:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:07 smithi066 ceph-mon[27875]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66'] 2024-09-12T01:42:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:07 smithi066 ceph-mon[27875]: Upgrade: Need to upgrade myself (mgr.smithi066.qdwcrh) 2024-09-12T01:42:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:07 smithi066 ceph-mon[27875]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 on smithi153 2024-09-12T01:42:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:07 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/153352932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:42:07.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:07 smithi153 ceph-mon[34713]: from='client.24331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:07.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:07 smithi153 ceph-mon[34713]: Upgrade: Target is version 19.1.1-298-gb53b6d3e (unknown) 2024-09-12T01:42:07.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:07 smithi153 ceph-mon[34713]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66'] 2024-09-12T01:42:07.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:07 smithi153 ceph-mon[34713]: Upgrade: Need to upgrade myself (mgr.smithi066.qdwcrh) 2024-09-12T01:42:07.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:07 smithi153 ceph-mon[34713]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 on smithi153 2024-09-12T01:42:07.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:07 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/153352932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:42:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:08 smithi066 ceph-mon[27875]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:08 smithi066 ceph-mon[27875]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-12T01:42:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:08 smithi153 ceph-mon[34713]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:08 smithi153 ceph-mon[34713]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-12T01:42:10.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:10 smithi066 ceph-mon[27875]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:42:10.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:10 smithi153 ceph-mon[34713]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:42:12.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:12 smithi066 ceph-mon[27875]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:42:12.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:12 smithi153 ceph-mon[34713]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:42:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:14 smithi066 ceph-mon[27875]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:42:14.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:14 smithi153 ceph-mon[34713]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:42:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:16 smithi066 ceph-mon[27875]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:42:16.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:16 smithi153 ceph-mon[34713]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:42:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:18 smithi066 ceph-mon[27875]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:42:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:18 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:18 smithi153 ceph-mon[34713]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-12T01:42:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:18 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:19.294 INFO:tasks.workunit.client.1.smithi153.stderr:Updating files: 90% (11679/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T01:42:19.967 INFO:tasks.workunit.client.1.smithi153.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T01:42:19.967 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.968 INFO:tasks.workunit.client.1.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:42:19.968 INFO:tasks.workunit.client.1.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:42:19.968 INFO:tasks.workunit.client.1.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:42:19.968 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.968 INFO:tasks.workunit.client.1.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:42:19.968 INFO:tasks.workunit.client.1.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:42:19.969 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.969 INFO:tasks.workunit.client.1.smithi153.stderr: git switch -c 2024-09-12T01:42:19.969 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.969 INFO:tasks.workunit.client.1.smithi153.stderr:Or undo this operation with: 2024-09-12T01:42:19.969 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.969 INFO:tasks.workunit.client.1.smithi153.stderr: git switch - 2024-09-12T01:42:19.970 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.970 INFO:tasks.workunit.client.1.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:42:19.970 INFO:tasks.workunit.client.1.smithi153.stderr: 2024-09-12T01:42:19.970 INFO:tasks.workunit.client.1.smithi153.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T01:42:19.974 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-12T01:42:20.039 INFO:tasks.workunit.client.1.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:42:20.042 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-12T01:42:20.042 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:42:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:20 smithi066 ceph-mon[27875]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:20 smithi153 ceph-mon[34713]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:20.695 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:42:20.770 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:42:20.812 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-12T01:42:20.813 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-12T01:42:20.813 INFO:tasks.workunit.client.1.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:42:20.857 INFO:tasks.workunit.client.1.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-12T01:42:20.861 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:42:20.861 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-12T01:42:20.917 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-12T01:42:20.919 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-12T01:42:20.919 DEBUG:teuthology.orchestra.run.smithi153:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-12T01:42:20.980 INFO:tasks.workunit.client.1.smithi153.stderr:+ mkdir -p fsstress 2024-09-12T01:42:20.982 INFO:tasks.workunit.client.1.smithi153.stderr:+ pushd fsstress 2024-09-12T01:42:20.982 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-12T01:42:20.982 INFO:tasks.workunit.client.1.smithi153.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-12T01:42:21.488 INFO:tasks.workunit.client.1.smithi153.stderr:+ tar xzf ltp-full.tgz 2024-09-12T01:42:22.343 INFO:tasks.workunit.client.0.smithi066.stderr:Updating files: 87% (11353/12903) Updating files: 88% (11355/12903) Updating files: 89% (11484/12903) Updating files: 90% (11613/12903) Updating files: 91% (11742/12903) Updating files: 92% (11871/12903) Updating files: 93% (12000/12903) Updating files: 94% (12129/12903) Updating files: 95% (12258/12903) Updating files: 96% (12387/12903) Updating files: 97% (12516/12903) Updating files: 98% (12645/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-12T01:42:22.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:22 smithi066 ceph-mon[27875]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:22 smithi153 ceph-mon[34713]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr:Note: switching to '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'. 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr: git switch -c 2024-09-12T01:42:23.020 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr:Or undo this operation with: 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr: git switch - 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr: 2024-09-12T01:42:23.021 INFO:tasks.workunit.client.0.smithi066.stderr:HEAD is now at 086c737fa75 Merge pull request #59733 from zdover23/wip-doc-2024-09-11-backport-59635-to-squid 2024-09-12T01:42:23.025 DEBUG:teuthology.orchestra.run.smithi066:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:42:23.053 INFO:tasks.workunit.client.0.smithi066.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:42:23.360 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:42:23.360 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:42:23.739 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:42:23.805 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:42:23.847 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:42:23.848 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:42:23.849 INFO:tasks.workunit.client.0.smithi066.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:42:23.891 INFO:tasks.workunit.client.0.smithi066.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:42:23.895 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:42:23.895 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:42:23.952 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-12T01:42:23.953 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-12T01:42:23.953 DEBUG:teuthology.orchestra.run.smithi066:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=086c737fa75c22d521a3932c59b31c5e1d1c9ef4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-12T01:42:24.014 INFO:tasks.workunit.client.0.smithi066.stderr:+ mkdir -p fsstress 2024-09-12T01:42:24.015 INFO:tasks.workunit.client.0.smithi066.stderr:+ pushd fsstress 2024-09-12T01:42:24.015 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T01:42:24.016 INFO:tasks.workunit.client.0.smithi066.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-12T01:42:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:24 smithi066 ceph-mon[27875]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:24.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:24 smithi153 ceph-mon[34713]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:24.939 INFO:tasks.workunit.client.0.smithi066.stderr:+ tar xzf ltp-full.tgz 2024-09-12T01:42:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:26 smithi066 ceph-mon[27875]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:26 smithi153 ceph-mon[34713]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:42:28.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:28 smithi066 ceph-mon[27875]: pgmap v224: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 12 op/s 2024-09-12T01:42:28.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:28 smithi153 ceph-mon[34713]: pgmap v224: 65 pgs: 65 active+clean; 13 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s wr, 12 op/s 2024-09-12T01:42:30.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:30 smithi066 ceph-mon[27875]: pgmap v225: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s wr, 87 op/s 2024-09-12T01:42:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:30 smithi153 ceph-mon[34713]: pgmap v225: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s wr, 87 op/s 2024-09-12T01:42:32.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:32 smithi066 ceph-mon[27875]: pgmap v226: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 187 op/s 2024-09-12T01:42:32.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:32 smithi153 ceph-mon[34713]: pgmap v226: 65 pgs: 65 active+clean; 37 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 3.1 MiB/s wr, 187 op/s 2024-09-12T01:42:33.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:33 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:33 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:34.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:34 smithi066 ceph-mon[27875]: pgmap v227: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 408 op/s 2024-09-12T01:42:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:34 smithi153 ceph-mon[34713]: pgmap v227: 65 pgs: 65 active+clean; 69 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 6.0 MiB/s wr, 408 op/s 2024-09-12T01:42:36.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:36 smithi066 ceph-mon[27875]: pgmap v228: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 454 op/s 2024-09-12T01:42:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:36 smithi153 ceph-mon[34713]: pgmap v228: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 454 op/s 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.496+0000 7fa552943640 1 -- 172.21.15.66:0/1448025021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fc700 msgr2=0x7fa54c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.496+0000 7fa552943640 1 --2- 172.21.15.66:0/1448025021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fc700 0x7fa54c0fcb70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa5340048d0 tx=0x7fa534009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- 172.21.15.66:0/1448025021 shutdown_connections 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 --2- 172.21.15.66:0/1448025021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fc700 0x7fa54c0fcb70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 --2- 172.21.15.66:0/1448025021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0fb430 0x7fa54c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- 172.21.15.66:0/1448025021 >> 172.21.15.66:0/1448025021 conn(0x7fa54c0f6c10 msgr2=0x7fa54c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:36.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- 172.21.15.66:0/1448025021 shutdown_connections 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- 172.21.15.66:0/1448025021 wait complete. 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 Processor -- start 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- start start 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 0x7fa54c10d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0fc700 0x7fa54c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c10dbd0 con 0x7fa54c0fb430 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.497+0000 7fa552943640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c10e3f0 con 0x7fa54c0fc700 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 0x7fa54c10d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 0x7fa54c10d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33368/0 (socket says 172.21.15.66:33368) 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 -- 172.21.15.66:0/1586403851 learned_addr learned my addr 172.21.15.66:0/1586403851 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa543fff640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0fc700 0x7fa54c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 -- 172.21.15.66:0/1586403851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0fc700 msgr2=0x7fa54c10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0fc700 0x7fa54c10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 -- 172.21.15.66:0/1586403851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa534005040 con 0x7fa54c0fb430 2024-09-12T01:42:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa54bfff640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 0x7fa54c10d040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa53c002a80 tx=0x7fa53c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.498+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53c007c30 con 0x7fa54c0fb430 2024-09-12T01:42:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.499+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa53c00f040 con 0x7fa54c0fb430 2024-09-12T01:42:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.499+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c10e680 con 0x7fa54c0fb430 2024-09-12T01:42:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.499+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa53c007c30 con 0x7fa54c0fb430 2024-09-12T01:42:36.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.499+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c10eba0 con 0x7fa54c0fb430 2024-09-12T01:42:36.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.500+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa54c0fa890 con 0x7fa54c0fb430 2024-09-12T01:42:36.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.500+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa53c00d890 con 0x7fa54c0fb430 2024-09-12T01:42:36.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.501+0000 7fa5497fa640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa53806edb0 0x7fa538071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.501+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa53c08d750 con 0x7fa54c0fb430 2024-09-12T01:42:36.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.501+0000 7fa543fff640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa53806edb0 0x7fa538071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.502+0000 7fa543fff640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa53806edb0 0x7fa538071260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa54c10cdf0 tx=0x7fa534035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:36.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.509+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa53c04d2a0 con 0x7fa54c0fb430 2024-09-12T01:42:36.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.713+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa54c10edc0 con 0x7fa53806edb0 2024-09-12T01:42:36.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.715+0000 7fa5497fa640 1 -- 172.21.15.66:0/1586403851 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa54c10edc0 con 0x7fa53806edb0 2024-09-12T01:42:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa53806edb0 msgr2=0x7fa538071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa53806edb0 0x7fa538071260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa54c10cdf0 tx=0x7fa534035040 comp rx=0 tx=0).stop 2024-09-12T01:42:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 msgr2=0x7fa54c10d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 0x7fa54c10d040 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa53c002a80 tx=0x7fa53c004600 comp rx=0 tx=0).stop 2024-09-12T01:42:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 shutdown_connections 2024-09-12T01:42:36.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fa53806edb0 0x7fa538071260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa54c0fc700 0x7fa54c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 --2- 172.21.15.66:0/1586403851 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa54c0fb430 0x7fa54c10d040 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 >> 172.21.15.66:0/1586403851 conn(0x7fa54c0f6c10 msgr2=0x7fa54c0655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 shutdown_connections 2024-09-12T01:42:36.718 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.717+0000 7fa552943640 1 -- 172.21.15.66:0/1586403851 wait complete. 2024-09-12T01:42:36.725 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 -- 172.21.15.66:0/2622344615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 msgr2=0x7f3ac80fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 --2- 172.21.15.66:0/2622344615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac80fdfb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80048d0 tx=0x7f3ab8009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 -- 172.21.15.66:0/2622344615 shutdown_connections 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 --2- 172.21.15.66:0/2622344615 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac80fe4f0 0x7f3ac80fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 --2- 172.21.15.66:0/2622344615 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac80fdfb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 -- 172.21.15.66:0/2622344615 >> 172.21.15.66:0/2622344615 conn(0x7f3ac80f63a0 msgr2=0x7f3ac80f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 -- 172.21.15.66:0/2622344615 shutdown_connections 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.818+0000 7f3ace789640 1 -- 172.21.15.66:0/2622344615 wait complete. 2024-09-12T01:42:36.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.819+0000 7f3ace789640 1 Processor -- start 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.819+0000 7f3ace789640 1 -- start start 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.819+0000 7f3ace789640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac810f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.819+0000 7f3ace789640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac80fe4f0 0x7f3ac810f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.819+0000 7f3ace789640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac810fe30 con 0x7f3ac80fdba0 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.819+0000 7f3ace789640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8110650 con 0x7f3ac80fe4f0 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac810f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac810f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33384/0 (socket says 172.21.15.66:33384) 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 -- 172.21.15.66:0/3128173710 learned_addr learned my addr 172.21.15.66:0/3128173710 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac77fe640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac80fe4f0 0x7f3ac810f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 -- 172.21.15.66:0/3128173710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac80fe4f0 msgr2=0x7f3ac810f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac80fe4f0 0x7f3ac810f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 -- 172.21.15.66:0/3128173710 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8005040 con 0x7f3ac80fdba0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac7fff640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac810f2a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80043d0 tx=0x7f3ab8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab8038070 con 0x7f3ac80fdba0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ab802ae90 con 0x7f3ac80fdba0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.820+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac8110880 con 0x7f3ac80fdba0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.821+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ab803e670 con 0x7f3ac80fdba0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.821+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac8110e20 con 0x7f3ac80fdba0 2024-09-12T01:42:36.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.822+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac80fa040 con 0x7f3ac80fdba0 2024-09-12T01:42:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.823+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3ab8030020 con 0x7f3ac80fdba0 2024-09-12T01:42:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.823+0000 7f3ac4ff9640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3ab006ed60 0x7f3ab0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:36.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.824+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3ab80ae350 con 0x7f3ac80fdba0 2024-09-12T01:42:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.824+0000 7f3ac77fe640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3ab006ed60 0x7f3ab0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:36.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.824+0000 7f3ac77fe640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3ab006ed60 0x7f3ab0071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ac810f050 tx=0x7f3abc00b040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:36.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:36.828+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3ab807b5f0 con 0x7f3ac80fdba0 2024-09-12T01:42:37.078 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.078+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ac8105130 con 0x7f3ab006ed60 2024-09-12T01:42:37.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.079+0000 7f3ac4ff9640 1 -- 172.21.15.66:0/3128173710 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f3ac8105130 con 0x7f3ab006ed60 2024-09-12T01:42:37.082 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3ab006ed60 msgr2=0x7f3ab0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3ab006ed60 0x7f3ab0071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3ac810f050 tx=0x7f3abc00b040 comp rx=0 tx=0).stop 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 msgr2=0x7f3ac810f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac810f2a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80043d0 tx=0x7f3ab8009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 shutdown_connections 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f3ab006ed60 0x7f3ab0071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ac80fe4f0 0x7f3ac810f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 --2- 172.21.15.66:0/3128173710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80fdba0 0x7f3ac810f2a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.082+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 >> 172.21.15.66:0/3128173710 conn(0x7f3ac80f63a0 msgr2=0x7f3ac80f7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.083+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 shutdown_connections 2024-09-12T01:42:37.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.083+0000 7f3ace789640 1 -- 172.21.15.66:0/3128173710 wait complete. 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 -- 172.21.15.66:0/2100787066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fe4c0 msgr2=0x7f4b2c0fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 --2- 172.21.15.66:0/2100787066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fe4c0 0x7f4b2c0fa620 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4b200048d0 tx=0x7f4b20009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 -- 172.21.15.66:0/2100787066 shutdown_connections 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 --2- 172.21.15.66:0/2100787066 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fe4c0 0x7f4b2c0fa620 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 --2- 172.21.15.66:0/2100787066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c0fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 -- 172.21.15.66:0/2100787066 >> 172.21.15.66:0/2100787066 conn(0x7f4b2c0f6390 msgr2=0x7f4b2c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 -- 172.21.15.66:0/2100787066 shutdown_connections 2024-09-12T01:42:37.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.179+0000 7f4b32981640 1 -- 172.21.15.66:0/2100787066 wait complete. 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.180+0000 7f4b32981640 1 Processor -- start 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.180+0000 7f4b32981640 1 -- start start 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b32981640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b32981640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0fe4c0 0x7f4b2c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b32981640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c10dc40 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b32981640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c10e460 con 0x7f4b2c0fe4c0 2024-09-12T01:42:37.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33396/0 (socket says 172.21.15.66:33396) 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 -- 172.21.15.66:0/766389443 learned_addr learned my addr 172.21.15.66:0/766389443 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2b7fe640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0fe4c0 0x7f4b2c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 -- 172.21.15.66:0/766389443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0fe4c0 msgr2=0x7f4b2c10d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0fe4c0 0x7f4b2c10d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 -- 172.21.15.66:0/766389443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20005040 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.181+0000 7f4b2bfff640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c10d0b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c810 tx=0x7f4b1c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.182+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1c00a7a0 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.182+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b1c00ada0 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.182+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c10e6f0 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.182+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1c011380 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.182+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c10ec60 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.183+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c105760 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.184+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4b1c0127d0 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.185+0000 7f4b28ff9640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b1406ed60 0x7f4b14071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.185+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4b1c08e5e0 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.185+0000 7f4b2b7fe640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b1406ed60 0x7f4b14071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.185+0000 7f4b2b7fe640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b1406ed60 0x7f4b14071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b20000c00 tx=0x7f4b20035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.191+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4b1c05b2b0 con 0x7f4b2c0fdb70 2024-09-12T01:42:37.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.374+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b2c10f040 con 0x7f4b1406ed60 2024-09-12T01:42:37.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.383+0000 7f4b28ff9640 1 -- 172.21.15.66:0/766389443 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7f4b2c10f040 con 0x7f4b1406ed60 2024-09-12T01:42:37.383 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:42:37.383 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (5m) 85s ago 7m 25.3M - 0.25.0 c8568f914cd2 b2c0b1b4f381 2024-09-12T01:42:37.383 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (7m) 85s ago 7m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:42:37.383 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (6m) 92s ago 6m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (5m) 85s ago 6m 82.9M - 9.4.7 954c08fa6188 a6ff5cae127b 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (112s) 85s ago 111s 10.9M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (106s) 85s ago 105s 16.2M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (103s) 92s ago 102s 14.0M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (109s) 92s ago 109s 14.3M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:9283,8765,8443 running (8m) 85s ago 8m 450M - 17.2.7-1609-g554ba93e d4c538e492e4 d4facfef752d 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (6m) 92s ago 6m 400M - 17.2.7-1609-g554ba93e d4c538e492e4 4b0e5456f121 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (8m) 85s ago 8m 49.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (6m) 92s ago 6m 36.9M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (7m) 85s ago 7m 16.1M - 1.5.0 0da6a335fe13 ebe17b848675 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (6m) 92s ago 6m 16.4M - 1.5.0 0da6a335fe13 6391262c1a15 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (5m) 85s ago 5m 45.9M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:42:37.384 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (5m) 85s ago 5m 44.5M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:42:37.385 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (4m) 85s ago 4m 42.8M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:42:37.385 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (4m) 92s ago 4m 44.5M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:42:37.385 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (3m) 92s ago 3m 41.0M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:42:37.385 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (3m) 92s ago 3m 43.1M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:42:37.385 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (5m) 85s ago 6m 53.3M - 2.43.0 a07b618ecd1d 25c9c1516174 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b1406ed60 msgr2=0x7f4b14071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b1406ed60 0x7f4b14071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4b20000c00 tx=0x7f4b20035040 comp rx=0 tx=0).stop 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 msgr2=0x7f4b2c10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c10d0b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c810 tx=0x7f4b1c0043c0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 shutdown_connections 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f4b1406ed60 0x7f4b14071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0fe4c0 0x7f4b2c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 --2- 172.21.15.66:0/766389443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b2c0fdb70 0x7f4b2c10d0b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 >> 172.21.15.66:0/766389443 conn(0x7f4b2c0f6390 msgr2=0x7f4b2c0f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.386 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 shutdown_connections 2024-09-12T01:42:37.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.385+0000 7f4b32981640 1 -- 172.21.15.66:0/766389443 wait complete. 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 -- 172.21.15.66:0/2198957719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fd7f0 msgr2=0x7fcfe40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/2198957719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fd7f0 0x7fcfe40fdc60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80048d0 tx=0x7fcfd8009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 -- 172.21.15.66:0/2198957719 shutdown_connections 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/2198957719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fd7f0 0x7fcfe40fdc60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/2198957719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe40fc520 0x7fcfe40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 -- 172.21.15.66:0/2198957719 >> 172.21.15.66:0/2198957719 conn(0x7fcfe40f7ce0 msgr2=0x7fcfe40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.473 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 -- 172.21.15.66:0/2198957719 shutdown_connections 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.472+0000 7fcfe94f7640 1 -- 172.21.15.66:0/2198957719 wait complete. 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe94f7640 1 Processor -- start 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe94f7640 1 -- start start 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe94f7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 0x7fcfe410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe94f7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe40fd7f0 0x7fcfe410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe94f7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410dc10 con 0x7fcfe40fc520 2024-09-12T01:42:37.474 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe94f7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe410e430 con 0x7fcfe40fd7f0 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 0x7fcfe410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 0x7fcfe410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33406/0 (socket says 172.21.15.66:33406) 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe2ffd640 1 -- 172.21.15.66:0/1055347283 learned_addr learned my addr 172.21.15.66:0/1055347283 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.473+0000 7fcfe27fc640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe40fd7f0 0x7fcfe410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfe2ffd640 1 -- 172.21.15.66:0/1055347283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe40fd7f0 msgr2=0x7fcfe410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfe2ffd640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe40fd7f0 0x7fcfe410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfe2ffd640 1 -- 172.21.15.66:0/1055347283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8005040 con 0x7fcfe40fc520 2024-09-12T01:42:37.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfe2ffd640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 0x7fcfe410d080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c790 tx=0x7fcfd40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd400a7a0 con 0x7fcfe40fc520 2024-09-12T01:42:37.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe410e6c0 con 0x7fcfe40fc520 2024-09-12T01:42:37.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcfd400ada0 con 0x7fcfe40fc520 2024-09-12T01:42:37.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe410ec60 con 0x7fcfe40fc520 2024-09-12T01:42:37.476 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.474+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd40113a0 con 0x7fcfe40fc520 2024-09-12T01:42:37.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.476+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe40fb980 con 0x7fcfe40fc520 2024-09-12T01:42:37.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.476+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcfd400a900 con 0x7fcfe40fc520 2024-09-12T01:42:37.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.477+0000 7fcfcb7fe640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcfcc073170 0x7fcfcc075620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.477+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcfd408e300 con 0x7fcfe40fc520 2024-09-12T01:42:37.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.477+0000 7fcfe27fc640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcfcc073170 0x7fcfcc075620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.477+0000 7fcfe27fc640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcfcc073170 0x7fcfcc075620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfe410ce30 tx=0x7fcfd8035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.485 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.485+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcfd405b3b0 con 0x7fcfe40fc520 2024-09-12T01:42:37.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.806+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcfe410ef90 con 0x7fcfe40fc520 2024-09-12T01:42:37.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.806+0000 7fcfcb7fe640 1 -- 172.21.15.66:0/1055347283 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fcfd405ad50 con 0x7fcfe40fc520 2024-09-12T01:42:37.806 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:42:37.806 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:42:37.807 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:42:37.808 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 14 2024-09-12T01:42:37.808 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:42:37.808 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:42:37.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcfcc073170 msgr2=0x7fcfcc075620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcfcc073170 0x7fcfcc075620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcfe410ce30 tx=0x7fcfd8035040 comp rx=0 tx=0).stop 2024-09-12T01:42:37.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 msgr2=0x7fcfe410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 0x7fcfe410d080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c790 tx=0x7fcfd40043c0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 shutdown_connections 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7fcfcc073170 0x7fcfcc075620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcfe40fd7f0 0x7fcfe410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 --2- 172.21.15.66:0/1055347283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe40fc520 0x7fcfe410d080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 >> 172.21.15.66:0/1055347283 conn(0x7fcfe40f7ce0 msgr2=0x7fcfe40f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 shutdown_connections 2024-09-12T01:42:37.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.809+0000 7fcfe94f7640 1 -- 172.21.15.66:0/1055347283 wait complete. 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.894+0000 7f877734e640 1 -- 172.21.15.66:0/3308394330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700664d0 msgr2=0x7f87700ff130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.894+0000 7f877734e640 1 --2- 172.21.15.66:0/3308394330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700664d0 0x7f87700ff130 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f876c0048d0 tx=0x7f876c009da0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 -- 172.21.15.66:0/3308394330 shutdown_connections 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 --2- 172.21.15.66:0/3308394330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87700ff670 0x7f8770101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 --2- 172.21.15.66:0/3308394330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700664d0 0x7f87700ff130 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 -- 172.21.15.66:0/3308394330 >> 172.21.15.66:0/3308394330 conn(0x7f87700f6c00 msgr2=0x7f87700f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 -- 172.21.15.66:0/3308394330 shutdown_connections 2024-09-12T01:42:37.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 -- 172.21.15.66:0/3308394330 wait complete. 2024-09-12T01:42:37.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 Processor -- start 2024-09-12T01:42:37.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.895+0000 7f877734e640 1 -- start start 2024-09-12T01:42:37.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f877734e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87700664d0 0x7f877010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f877734e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 0x7f877010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f877734e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877010dc10 con 0x7f87700ff670 2024-09-12T01:42:37.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f877734e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877010e430 con 0x7f87700664d0 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 0x7f877010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 0x7f877010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33416/0 (socket says 172.21.15.66:33416) 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 -- 172.21.15.66:0/2862843907 learned_addr learned my addr 172.21.15.66:0/2862843907 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87750ea640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87700664d0 0x7f877010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 -- 172.21.15.66:0/2862843907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87700664d0 msgr2=0x7f877010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87700664d0 0x7f877010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 -- 172.21.15.66:0/2862843907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c005040 con 0x7f87700ff670 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.896+0000 7f87748e9640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 0x7f877010d5c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8760002a50 tx=0x7f8760004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.897+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8760007c30 con 0x7f87700ff670 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.897+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f876000f040 con 0x7f87700ff670 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.897+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877010e6c0 con 0x7f87700ff670 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.897+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f876000da10 con 0x7f87700ff670 2024-09-12T01:42:37.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.897+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877010ec60 con 0x7f87700ff670 2024-09-12T01:42:37.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.898+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87700fa880 con 0x7f87700ff670 2024-09-12T01:42:37.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.899+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f876000dca0 con 0x7f87700ff670 2024-09-12T01:42:37.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.899+0000 7f8765ffb640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f875c06ed60 0x7f875c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.899+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f876008d990 con 0x7f87700ff670 2024-09-12T01:42:37.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.899+0000 7f87750ea640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f875c06ed60 0x7f875c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.901 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.900+0000 7f87750ea640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f875c06ed60 0x7f875c071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f876c000c00 tx=0x7f876c035040 comp rx=0 tx=0).ready entity=mgr.14208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.907 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:37.907+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f876004d2a0 con 0x7f87700ff670 2024-09-12T01:42:38.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.250+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 --> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f877010ef90 con 0x7f875c06ed60 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.251+0000 7f8765ffb640 1 -- 172.21.15.66:0/2862843907 <== mgr.14208 v2:172.21.15.66:6800/1778679519 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f877010ef90 con 0x7f875c06ed60 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [], 2024-09-12T01:42:38.251 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "0/2 daemons upgraded", 2024-09-12T01:42:38.252 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading mgr daemons", 2024-09-12T01:42:38.252 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:42:38.252 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f875c06ed60 msgr2=0x7f875c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f875c06ed60 0x7f875c071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f876c000c00 tx=0x7f876c035040 comp rx=0 tx=0).stop 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 msgr2=0x7f877010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 0x7f877010d5c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8760002a50 tx=0x7f8760004600 comp rx=0 tx=0).stop 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 shutdown_connections 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:6800/1778679519,v1:172.21.15.66:6801/1778679519] conn(0x7f875c06ed60 0x7f875c071210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87700ff670 0x7f877010d5c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 --2- 172.21.15.66:0/2862843907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87700664d0 0x7f877010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 >> 172.21.15.66:0/2862843907 conn(0x7f87700f6c00 msgr2=0x7f87700f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 shutdown_connections 2024-09-12T01:42:38.255 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:42:38.254+0000 7f877734e640 1 -- 172.21.15.66:0/2862843907 wait complete. 2024-09-12T01:42:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: pgmap v229: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.7 MiB/s wr, 462 op/s 2024-09-12T01:42:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1055347283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:42:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:42:38.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:42:38.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:38 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:42:38.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: pgmap v229: 65 pgs: 65 active+clean; 89 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.7 MiB/s wr, 462 op/s 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1055347283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:42:38.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:38 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:42:39.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:39 smithi153 ceph-mon[34713]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:39.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:39 smithi153 ceph-mon[34713]: Upgrade: Updating mgr.smithi153.jpnqza 2024-09-12T01:42:39.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:39 smithi153 ceph-mon[34713]: Deploying daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:42:39.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:39 smithi153 ceph-mon[34713]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:39.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:39 smithi066 ceph-mon[27875]: from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:39.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:39 smithi066 ceph-mon[27875]: Upgrade: Updating mgr.smithi153.jpnqza 2024-09-12T01:42:39.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:39 smithi066 ceph-mon[27875]: Deploying daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:42:39.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:39 smithi066 ceph-mon[27875]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:42:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:40 smithi153 ceph-mon[34713]: pgmap v230: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 449 op/s 2024-09-12T01:42:40.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:40 smithi066 ceph-mon[27875]: pgmap v230: 65 pgs: 65 active+clean; 93 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 7.0 MiB/s wr, 449 op/s 2024-09-12T01:42:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:42 smithi153 ceph-mon[34713]: pgmap v231: 65 pgs: 65 active+clean; 97 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 383 op/s 2024-09-12T01:42:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:42 smithi066 ceph-mon[27875]: pgmap v231: 65 pgs: 65 active+clean; 97 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s wr, 383 op/s 2024-09-12T01:42:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:44 smithi153 ceph-mon[34713]: pgmap v232: 65 pgs: 65 active+clean; 127 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 631 op/s 2024-09-12T01:42:44.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:44 smithi066 ceph-mon[27875]: pgmap v232: 65 pgs: 65 active+clean; 127 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 7.9 MiB/s wr, 631 op/s 2024-09-12T01:42:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:46 smithi153 ceph-mon[34713]: pgmap v233: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 651 op/s 2024-09-12T01:42:46.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:46 smithi066 ceph-mon[27875]: pgmap v233: 65 pgs: 65 active+clean; 139 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.2 MiB/s wr, 651 op/s 2024-09-12T01:42:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:48 smithi153 ceph-mon[34713]: pgmap v234: 65 pgs: 65 active+clean; 155 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 797 op/s 2024-09-12T01:42:48.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:48 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:48.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:48 smithi066 ceph-mon[27875]: pgmap v234: 65 pgs: 65 active+clean; 155 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.8 MiB/s wr, 797 op/s 2024-09-12T01:42:48.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:48 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:42:50.516 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:50 smithi153 ceph-mon[34713]: pgmap v235: 65 pgs: 65 active+clean; 162 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 797 op/s 2024-09-12T01:42:50.558 INFO:tasks.workunit.client.1.smithi153.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-12T01:42:50.558 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-12T01:42:50.558 INFO:tasks.workunit.client.1.smithi153.stderr:+ make 2024-09-12T01:42:50.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:50 smithi066 ceph-mon[27875]: pgmap v235: 65 pgs: 65 active+clean; 162 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 797 op/s 2024-09-12T01:42:52.016 INFO:tasks.workunit.client.1.smithi153.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-12T01:42:52.348 INFO:tasks.workunit.client.1.smithi153.stderr:++ readlink -f fsstress 2024-09-12T01:42:52.348 INFO:tasks.workunit.client.1.smithi153.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-12T01:42:52.348 INFO:tasks.workunit.client.1.smithi153.stderr:+ popd 2024-09-12T01:42:52.349 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-12T01:42:52.349 INFO:tasks.workunit.client.1.smithi153.stderr:+ popd 2024-09-12T01:42:52.349 INFO:tasks.workunit.client.1.smithi153.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-12T01:42:52.349 INFO:tasks.workunit.client.1.smithi153.stderr:++ mktemp -d -p . 2024-09-12T01:42:52.351 INFO:tasks.workunit.client.1.smithi153.stderr:+ T=./tmp.jZGZBbly5l 2024-09-12T01:42:52.352 INFO:tasks.workunit.client.1.smithi153.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.jZGZBbly5l -l 1 -n 1000 -p 10 -v 2024-09-12T01:42:52.354 INFO:tasks.workunit.client.1.smithi153.stdout:seed = 1726425628 2024-09-12T01:42:52.362 INFO:tasks.workunit.client.1.smithi153.stdout:0/0: creat f0 x:0 0 0 2024-09-12T01:42:52.362 INFO:tasks.workunit.client.1.smithi153.stdout:0/1: creat f1 x:0 0 0 2024-09-12T01:42:52.365 INFO:tasks.workunit.client.1.smithi153.stdout:1/0: creat f0 x:0 0 0 2024-09-12T01:42:52.369 INFO:tasks.workunit.client.1.smithi153.stdout:0/2: unlink f0 0 2024-09-12T01:42:52.371 INFO:tasks.workunit.client.1.smithi153.stdout:3/0: getdents . 0 2024-09-12T01:42:52.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/0: creat f0 x:0 0 0 2024-09-12T01:42:52.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/1: write f0 [763485,89058] 0 2024-09-12T01:42:52.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/2: read f0 [275970,65602] 0 2024-09-12T01:42:52.376 INFO:tasks.workunit.client.1.smithi153.stdout:1/1: mknod c1 0 2024-09-12T01:42:52.378 INFO:tasks.workunit.client.1.smithi153.stdout:0/3: symlink l2 0 2024-09-12T01:42:52.378 INFO:tasks.workunit.client.1.smithi153.stdout:0/4: write f1 [135752,96324] 0 2024-09-12T01:42:52.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/0: rename - no filename 2024-09-12T01:42:52.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/1: creat f0 x:0 0 0 2024-09-12T01:42:52.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/2: dread - f0 zero size 2024-09-12T01:42:52.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/3: write f0 [25358,125148] 0 2024-09-12T01:42:52.382 INFO:tasks.workunit.client.1.smithi153.stdout:1/2: mkdir d2 0 2024-09-12T01:42:52.383 INFO:tasks.workunit.client.1.smithi153.stdout:1/3: truncate f0 347578 0 2024-09-12T01:42:52.386 INFO:tasks.workunit.client.1.smithi153.stdout:3/4: mkdir d1 0 2024-09-12T01:42:52.386 INFO:tasks.workunit.client.1.smithi153.stdout:3/5: write f0 [698457,112198] 0 2024-09-12T01:42:52.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/4: creat d2/f3 x:0 0 0 2024-09-12T01:42:52.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/5: read - d2/f3 zero size 2024-09-12T01:42:52.393 INFO:tasks.workunit.client.1.smithi153.stdout:3/6: creat d1/f2 x:0 0 0 2024-09-12T01:42:52.393 INFO:tasks.workunit.client.1.smithi153.stdout:1/6: symlink d2/l4 0 2024-09-12T01:42:52.398 INFO:tasks.workunit.client.1.smithi153.stdout:3/7: symlink d1/l3 0 2024-09-12T01:42:52.398 INFO:tasks.workunit.client.1.smithi153.stdout:3/8: creat d1/f4 x:0 0 0 2024-09-12T01:42:52.398 INFO:tasks.workunit.client.1.smithi153.stdout:3/9: write d1/f2 [340489,60440] 0 2024-09-12T01:42:52.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:52 smithi153 ceph-mon[34713]: pgmap v236: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 797 op/s 2024-09-12T01:42:52.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:52.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:52.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:52 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:52.614 INFO:tasks.workunit.client.1.smithi153.stdout:2/3: dwrite f0 [0,4194304] 0 2024-09-12T01:42:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:52 smithi066 ceph-mon[27875]: pgmap v236: 65 pgs: 65 active+clean; 166 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 797 op/s 2024-09-12T01:42:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:52 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:42:52.645 INFO:tasks.workunit.client.1.smithi153.stdout:0/5: getdents . 0 2024-09-12T01:42:52.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/0: chown . 73415654 1 2024-09-12T01:42:52.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/1: stat - no entries 2024-09-12T01:42:52.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/2: chown . 30537 1 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/3: write - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/4: read - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/5: fdatasync - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/6: chown . 1614 1 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/7: dwrite - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/8: read - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/9: write - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/10: readlink - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/11: rename - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/0: rename - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/1: dread - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/2: stat - no entries 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/3: rename - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/4: dwrite - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:7/0: read - no filename 2024-09-12T01:42:52.720 INFO:tasks.workunit.client.1.smithi153.stdout:8/5: chown . 27465135 1 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:8/6: write - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/0: chown . 221218 1 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/1: unlink - no file 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/2: chown . 65071 1 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/3: rename - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/4: write - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/5: chown . 13807 1 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/6: rename - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/7: read - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/8: dwrite - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/9: unlink - no file 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/10: fdatasync - no filename 2024-09-12T01:42:52.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/11: write - no filename 2024-09-12T01:42:52.745 INFO:tasks.workunit.client.1.smithi153.stdout:2/4: dread f0 [0,4194304] 0 2024-09-12T01:42:52.752 INFO:tasks.workunit.client.1.smithi153.stdout:2/5: write f0 [3149266,115602] 0 2024-09-12T01:42:52.890 INFO:tasks.workunit.client.1.smithi153.stdout:0/6: rename f1 to f3 0 2024-09-12T01:42:53.032 INFO:tasks.workunit.client.1.smithi153.stdout:6/12: creat f0 x:0 0 0 2024-09-12T01:42:53.032 INFO:tasks.workunit.client.1.smithi153.stdout:6/13: dread - f0 zero size 2024-09-12T01:42:53.033 INFO:tasks.workunit.client.1.smithi153.stdout:7/1: creat f0 x:0 0 0 2024-09-12T01:42:53.035 INFO:tasks.workunit.client.1.smithi153.stdout:8/7: symlink l0 0 2024-09-12T01:42:53.035 INFO:tasks.workunit.client.1.smithi153.stdout:8/8: write - no filename 2024-09-12T01:42:53.035 INFO:tasks.workunit.client.1.smithi153.stdout:8/9: readlink l0 0 2024-09-12T01:42:53.047 INFO:tasks.workunit.client.1.smithi153.stdout:0/7: chown l2 347867 1 2024-09-12T01:42:53.426 INFO:tasks.workunit.client.1.smithi153.stdout:6/14: unlink f0 0 2024-09-12T01:42:53.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/15: chown . 2 1 2024-09-12T01:42:53.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/16: fdatasync - no filename 2024-09-12T01:42:53.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/17: stat - no entries 2024-09-12T01:42:53.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/18: write - no filename 2024-09-12T01:42:53.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/19: rename - no filename 2024-09-12T01:42:53.427 INFO:tasks.workunit.client.1.smithi153.stdout:7/2: symlink l1 0 2024-09-12T01:42:53.428 INFO:tasks.workunit.client.1.smithi153.stdout:7/3: dread - f0 zero size 2024-09-12T01:42:53.429 INFO:tasks.workunit.client.1.smithi153.stdout:8/10: rename l0 to l1 0 2024-09-12T01:42:53.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/6: getdents . 0 2024-09-12T01:42:53.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/7: getdents . 0 2024-09-12T01:42:53.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/8: read f0 [2773658,30327] 0 2024-09-12T01:42:53.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/9: write f0 [3640516,24928] 0 2024-09-12T01:42:53.430 INFO:tasks.workunit.client.1.smithi153.stdout:2/10: write f0 [3882969,30585] 0 2024-09-12T01:42:53.430 INFO:tasks.workunit.client.1.smithi153.stdout:0/8: creat f4 x:0 0 0 2024-09-12T01:42:53.442 INFO:tasks.workunit.client.1.smithi153.stdout:7/4: dwrite f0 [0,4194304] 0 2024-09-12T01:42:54.416 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:54 smithi153 ceph-mon[34713]: pgmap v237: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s wr, 954 op/s 2024-09-12T01:42:54.596 INFO:tasks.workunit.client.1.smithi153.stdout:6/20: mkdir d1 0 2024-09-12T01:42:54.596 INFO:tasks.workunit.client.1.smithi153.stdout:6/21: chown d1 242 1 2024-09-12T01:42:54.596 INFO:tasks.workunit.client.1.smithi153.stdout:6/22: readlink - no filename 2024-09-12T01:42:54.596 INFO:tasks.workunit.client.1.smithi153.stdout:8/11: symlink l2 0 2024-09-12T01:42:54.596 INFO:tasks.workunit.client.1.smithi153.stdout:8/12: rmdir - no directory 2024-09-12T01:42:54.596 INFO:tasks.workunit.client.1.smithi153.stdout:8/13: dwrite - no filename 2024-09-12T01:42:54.597 INFO:tasks.workunit.client.1.smithi153.stdout:8/14: truncate - no filename 2024-09-12T01:42:54.597 INFO:tasks.workunit.client.1.smithi153.stdout:2/11: creat f1 x:0 0 0 2024-09-12T01:42:54.597 INFO:tasks.workunit.client.1.smithi153.stdout:2/12: creat f2 x:0 0 0 2024-09-12T01:42:54.598 INFO:tasks.workunit.client.1.smithi153.stdout:0/9: creat f5 x:0 0 0 2024-09-12T01:42:54.598 INFO:tasks.workunit.client.1.smithi153.stdout:0/10: dread - f4 zero size 2024-09-12T01:42:54.598 INFO:tasks.workunit.client.1.smithi153.stdout:0/11: chown f5 99 1 2024-09-12T01:42:54.602 INFO:tasks.workunit.client.1.smithi153.stdout:7/5: mknod c2 0 2024-09-12T01:42:54.602 INFO:tasks.workunit.client.1.smithi153.stdout:7/6: chown l1 97783049 1 2024-09-12T01:42:54.606 INFO:tasks.workunit.client.1.smithi153.stdout:6/23: creat d1/f2 x:0 0 0 2024-09-12T01:42:54.606 INFO:tasks.workunit.client.1.smithi153.stdout:6/24: write d1/f2 [748338,53905] 0 2024-09-12T01:42:54.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/15: mknod c3 0 2024-09-12T01:42:54.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/16: read - no filename 2024-09-12T01:42:54.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/17: write - no filename 2024-09-12T01:42:54.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/18: dwrite - no filename 2024-09-12T01:42:54.609 INFO:tasks.workunit.client.1.smithi153.stdout:0/12: creat f6 x:0 0 0 2024-09-12T01:42:54.609 INFO:tasks.workunit.client.1.smithi153.stdout:0/13: write f5 [905908,9370] 0 2024-09-12T01:42:54.610 INFO:tasks.workunit.client.1.smithi153.stdout:6/25: symlink d1/l3 0 2024-09-12T01:42:54.611 INFO:tasks.workunit.client.1.smithi153.stdout:8/19: rename l2 to l4 0 2024-09-12T01:42:54.611 INFO:tasks.workunit.client.1.smithi153.stdout:8/20: dwrite - no filename 2024-09-12T01:42:54.612 INFO:tasks.workunit.client.1.smithi153.stdout:0/14: creat f7 x:0 0 0 2024-09-12T01:42:54.614 INFO:tasks.workunit.client.1.smithi153.stdout:8/21: creat f5 x:0 0 0 2024-09-12T01:42:54.616 INFO:tasks.workunit.client.1.smithi153.stdout:0/15: unlink f7 0 2024-09-12T01:42:54.617 INFO:tasks.workunit.client.1.smithi153.stdout:8/22: unlink l1 0 2024-09-12T01:42:54.617 INFO:tasks.workunit.client.1.smithi153.stdout:8/23: chown l4 0 1 2024-09-12T01:42:54.617 INFO:tasks.workunit.client.1.smithi153.stdout:8/24: creat f6 x:0 0 0 2024-09-12T01:42:54.617 INFO:tasks.workunit.client.1.smithi153.stdout:0/16: creat f8 x:0 0 0 2024-09-12T01:42:54.618 INFO:tasks.workunit.client.1.smithi153.stdout:2/13: dwrite f2 [0,4194304] 0 2024-09-12T01:42:54.619 INFO:tasks.workunit.client.1.smithi153.stdout:8/25: symlink l7 0 2024-09-12T01:42:54.623 INFO:tasks.workunit.client.1.smithi153.stdout:2/14: unlink f0 0 2024-09-12T01:42:54.623 INFO:tasks.workunit.client.1.smithi153.stdout:2/15: stat f2 0 2024-09-12T01:42:54.624 INFO:tasks.workunit.client.1.smithi153.stdout:0/17: symlink l9 0 2024-09-12T01:42:54.624 INFO:tasks.workunit.client.1.smithi153.stdout:0/18: chown f5 440334 1 2024-09-12T01:42:54.624 INFO:tasks.workunit.client.1.smithi153.stdout:0/19: write f6 [687245,105200] 0 2024-09-12T01:42:54.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/16: symlink l3 0 2024-09-12T01:42:54.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/17: chown l3 180064 1 2024-09-12T01:42:54.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/18: truncate f2 4462207 0 2024-09-12T01:42:54.625 INFO:tasks.workunit.client.1.smithi153.stdout:2/19: dread - f1 zero size 2024-09-12T01:42:54.627 INFO:tasks.workunit.client.1.smithi153.stdout:0/20: fdatasync f6 0 2024-09-12T01:42:54.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/21: rename f5 to fa 0 2024-09-12T01:42:54.633 INFO:tasks.workunit.client.1.smithi153.stdout:0/22: symlink lb 0 2024-09-12T01:42:54.634 INFO:tasks.workunit.client.1.smithi153.stdout:0/23: symlink lc 0 2024-09-12T01:42:54.638 INFO:tasks.workunit.client.1.smithi153.stdout:8/26: dwrite f6 [0,4194304] 0 2024-09-12T01:42:54.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:54 smithi066 ceph-mon[27875]: pgmap v237: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 8.3 MiB/s wr, 954 op/s 2024-09-12T01:42:54.641 INFO:tasks.workunit.client.1.smithi153.stdout:8/27: mknod c8 0 2024-09-12T01:42:54.641 INFO:tasks.workunit.client.1.smithi153.stdout:8/28: creat f9 x:0 0 0 2024-09-12T01:42:54.645 INFO:tasks.workunit.client.1.smithi153.stdout:8/29: rename f9 to fa 0 2024-09-12T01:42:54.646 INFO:tasks.workunit.client.1.smithi153.stdout:8/30: mkdir db 0 2024-09-12T01:42:54.647 INFO:tasks.workunit.client.1.smithi153.stdout:8/31: rmdir db 0 2024-09-12T01:42:54.648 INFO:tasks.workunit.client.1.smithi153.stdout:8/32: mknod cc 0 2024-09-12T01:42:54.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/33: link f5 fd 0 2024-09-12T01:42:54.650 INFO:tasks.workunit.client.1.smithi153.stdout:8/34: mknod ce 0 2024-09-12T01:42:54.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/24: dwrite f8 [0,4194304] 0 2024-09-12T01:42:54.654 INFO:tasks.workunit.client.1.smithi153.stdout:0/25: dread fa [0,4194304] 0 2024-09-12T01:42:54.724 INFO:tasks.workunit.client.1.smithi153.stdout:0/26: dwrite f8 [0,4194304] 0 2024-09-12T01:42:54.726 INFO:tasks.workunit.client.1.smithi153.stdout:0/27: dread f3 [0,4194304] 0 2024-09-12T01:42:54.726 INFO:tasks.workunit.client.1.smithi153.stdout:0/28: write f6 [1554678,120126] 0 2024-09-12T01:42:54.726 INFO:tasks.workunit.client.1.smithi153.stdout:0/29: stat f4 0 2024-09-12T01:42:54.726 INFO:tasks.workunit.client.1.smithi153.stdout:0/30: write f4 [466993,47199] 0 2024-09-12T01:42:55.114 INFO:tasks.workunit.client.1.smithi153.stdout:7/7: truncate f0 3897617 0 2024-09-12T01:42:55.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/8: rename l1 to l3 0 2024-09-12T01:42:55.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/9: rmdir - no directory 2024-09-12T01:42:55.121 INFO:tasks.workunit.client.1.smithi153.stdout:1/7: sync 2024-09-12T01:42:55.121 INFO:tasks.workunit.client.1.smithi153.stdout:9/12: sync 2024-09-12T01:42:55.121 INFO:tasks.workunit.client.1.smithi153.stdout:9/13: fsync - no filename 2024-09-12T01:42:55.121 INFO:tasks.workunit.client.1.smithi153.stdout:9/14: rename - no filename 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/15: readlink - no filename 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/16: chown . 1554804 1 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/17: write - no filename 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/18: chown . 19779516 1 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/19: stat - no entries 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/20: truncate - no filename 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/21: readlink - no filename 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/22: dread - no filename 2024-09-12T01:42:55.122 INFO:tasks.workunit.client.1.smithi153.stdout:6/26: getdents d1 0 2024-09-12T01:42:55.123 INFO:tasks.workunit.client.1.smithi153.stdout:5/0: sync 2024-09-12T01:42:55.123 INFO:tasks.workunit.client.1.smithi153.stdout:4/1: sync 2024-09-12T01:42:55.123 INFO:tasks.workunit.client.1.smithi153.stdout:5/1: dwrite - no filename 2024-09-12T01:42:55.123 INFO:tasks.workunit.client.1.smithi153.stdout:5/2: dread - no filename 2024-09-12T01:42:55.123 INFO:tasks.workunit.client.1.smithi153.stdout:5/3: chown . 33420656 1 2024-09-12T01:42:55.123 INFO:tasks.workunit.client.1.smithi153.stdout:5/4: link - no file 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/5: chown . 35393960 1 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/6: rename - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/7: fsync - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/8: dread - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/9: dread - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/10: dread - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/11: write - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/12: rename - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/13: rmdir - no directory 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/14: write - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:5/15: readlink - no filename 2024-09-12T01:42:55.124 INFO:tasks.workunit.client.1.smithi153.stdout:3/10: sync 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:3/11: write d1/f2 [818772,76760] 0 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:3/12: dread - d1/f4 zero size 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:3/13: creat d1/f5 x:0 0 0 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/8: dread f0 [0,4194304] 0 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/9: dread - d2/f3 zero size 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/10: readlink d2/l4 0 2024-09-12T01:42:55.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/11: fdatasync f0 0 2024-09-12T01:42:55.127 INFO:tasks.workunit.client.1.smithi153.stdout:9/23: mknod c0 0 2024-09-12T01:42:55.128 INFO:tasks.workunit.client.1.smithi153.stdout:9/24: fdatasync - no filename 2024-09-12T01:42:55.128 INFO:tasks.workunit.client.1.smithi153.stdout:6/27: rename d1/f2 to d1/f4 0 2024-09-12T01:42:55.129 INFO:tasks.workunit.client.1.smithi153.stdout:4/2: creat f0 x:0 0 0 2024-09-12T01:42:55.130 INFO:tasks.workunit.client.1.smithi153.stdout:5/16: mkdir d0 0 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/12: mknod d2/c5 0 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/13: chown f0 50 1 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/14: chown d2/l4 84 1 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/15: fsync d2/f3 0 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/16: chown c1 42668049 1 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/17: fdatasync d2/f3 0 2024-09-12T01:42:55.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/18: readlink d2/l4 0 2024-09-12T01:42:55.135 INFO:tasks.workunit.client.1.smithi153.stdout:9/25: creat f1 x:0 0 0 2024-09-12T01:42:55.137 INFO:tasks.workunit.client.1.smithi153.stdout:5/17: mknod d0/c1 0 2024-09-12T01:42:55.140 INFO:tasks.workunit.client.1.smithi153.stdout:6/28: symlink d1/l5 0 2024-09-12T01:42:55.142 INFO:tasks.workunit.client.1.smithi153.stdout:5/18: creat d0/f2 x:0 0 0 2024-09-12T01:42:55.145 INFO:tasks.workunit.client.1.smithi153.stdout:3/14: dwrite f0 [0,4194304] 0 2024-09-12T01:42:55.145 INFO:tasks.workunit.client.1.smithi153.stdout:5/19: mknod d0/c3 0 2024-09-12T01:42:55.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/29: mkdir d1/d6 0 2024-09-12T01:42:55.151 INFO:tasks.workunit.client.1.smithi153.stdout:4/3: dwrite f0 [0,4194304] 0 2024-09-12T01:42:55.152 INFO:tasks.workunit.client.1.smithi153.stdout:8/35: getdents . 0 2024-09-12T01:42:55.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/31: truncate f8 1472863 0 2024-09-12T01:42:55.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/32: write f4 [1037361,78244] 0 2024-09-12T01:42:55.155 INFO:tasks.workunit.client.1.smithi153.stdout:0/33: read f3 [176312,46762] 0 2024-09-12T01:42:55.157 INFO:tasks.workunit.client.1.smithi153.stdout:6/30: dread d1/f4 [0,4194304] 0 2024-09-12T01:42:55.157 INFO:tasks.workunit.client.1.smithi153.stdout:4/4: mknod c1 0 2024-09-12T01:42:55.159 INFO:tasks.workunit.client.1.smithi153.stdout:1/19: dwrite f0 [0,4194304] 0 2024-09-12T01:42:55.159 INFO:tasks.workunit.client.1.smithi153.stdout:8/36: mknod cf 0 2024-09-12T01:42:55.162 INFO:tasks.workunit.client.1.smithi153.stdout:0/34: dread f6 [0,4194304] 0 2024-09-12T01:42:55.163 INFO:tasks.workunit.client.1.smithi153.stdout:6/31: creat d1/f7 x:0 0 0 2024-09-12T01:42:55.164 INFO:tasks.workunit.client.1.smithi153.stdout:9/26: dwrite f1 [0,4194304] 0 2024-09-12T01:42:55.164 INFO:tasks.workunit.client.1.smithi153.stdout:0/35: dread fa [0,4194304] 0 2024-09-12T01:42:55.170 INFO:tasks.workunit.client.1.smithi153.stdout:1/20: unlink c1 0 2024-09-12T01:42:55.172 INFO:tasks.workunit.client.1.smithi153.stdout:8/37: creat f10 x:0 0 0 2024-09-12T01:42:55.172 INFO:tasks.workunit.client.1.smithi153.stdout:8/38: stat l4 0 2024-09-12T01:42:55.172 INFO:tasks.workunit.client.1.smithi153.stdout:8/39: read - fa zero size 2024-09-12T01:42:55.172 INFO:tasks.workunit.client.1.smithi153.stdout:8/40: truncate fd 953676 0 2024-09-12T01:42:55.173 INFO:tasks.workunit.client.1.smithi153.stdout:8/41: dread f5 [0,4194304] 0 2024-09-12T01:42:55.176 INFO:tasks.workunit.client.1.smithi153.stdout:9/27: write f1 [1284273,36427] 0 2024-09-12T01:42:55.177 INFO:tasks.workunit.client.1.smithi153.stdout:0/36: creat fd x:0 0 0 2024-09-12T01:42:55.177 INFO:tasks.workunit.client.1.smithi153.stdout:0/37: rmdir - no directory 2024-09-12T01:42:55.179 INFO:tasks.workunit.client.1.smithi153.stdout:8/42: mknod c11 0 2024-09-12T01:42:55.184 INFO:tasks.workunit.client.1.smithi153.stdout:9/28: symlink l2 0 2024-09-12T01:42:55.184 INFO:tasks.workunit.client.1.smithi153.stdout:9/29: mkdir d3 0 2024-09-12T01:42:55.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/30: link f1 d3/f4 0 2024-09-12T01:42:55.322 INFO:tasks.workunit.client.1.smithi153.stdout:7/10: dread f0 [0,4194304] 0 2024-09-12T01:42:55.322 INFO:tasks.workunit.client.1.smithi153.stdout:7/11: readlink l3 0 2024-09-12T01:42:55.322 INFO:tasks.workunit.client.1.smithi153.stdout:7/12: chown c2 15 1 2024-09-12T01:42:55.328 INFO:tasks.workunit.client.1.smithi153.stdout:4/5: fsync f0 0 2024-09-12T01:42:55.344 INFO:tasks.workunit.client.1.smithi153.stdout:4/6: dwrite f0 [0,4194304] 0 2024-09-12T01:42:55.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/15: truncate f0 429129 0 2024-09-12T01:42:55.351 INFO:tasks.workunit.client.1.smithi153.stdout:4/7: dread f0 [0,4194304] 0 2024-09-12T01:42:55.351 INFO:tasks.workunit.client.1.smithi153.stdout:4/8: rmdir - no directory 2024-09-12T01:42:55.351 INFO:tasks.workunit.client.1.smithi153.stdout:4/9: creat f2 x:0 0 0 2024-09-12T01:42:55.357 INFO:tasks.workunit.client.1.smithi153.stdout:6/32: fsync d1/f7 0 2024-09-12T01:42:55.357 INFO:tasks.workunit.client.1.smithi153.stdout:6/33: write d1/f7 [756756,108416] 0 2024-09-12T01:42:55.359 INFO:tasks.workunit.client.1.smithi153.stdout:6/34: creat d1/d6/f8 x:0 0 0 2024-09-12T01:42:55.360 INFO:tasks.workunit.client.1.smithi153.stdout:6/35: write d1/d6/f8 [338763,19429] 0 2024-09-12T01:42:55.360 INFO:tasks.workunit.client.1.smithi153.stdout:6/36: creat d1/d6/f9 x:0 0 0 2024-09-12T01:42:55.363 INFO:tasks.workunit.client.1.smithi153.stdout:2/20: sync 2024-09-12T01:42:55.363 INFO:tasks.workunit.client.1.smithi153.stdout:2/21: dread - f1 zero size 2024-09-12T01:42:55.365 INFO:tasks.workunit.client.1.smithi153.stdout:6/37: mkdir d1/d6/da 0 2024-09-12T01:42:55.365 INFO:tasks.workunit.client.1.smithi153.stdout:8/43: fsync f10 0 2024-09-12T01:42:55.365 INFO:tasks.workunit.client.1.smithi153.stdout:8/44: creat f12 x:0 0 0 2024-09-12T01:42:55.365 INFO:tasks.workunit.client.1.smithi153.stdout:8/45: read - fa zero size 2024-09-12T01:42:55.366 INFO:tasks.workunit.client.1.smithi153.stdout:8/46: rmdir - no directory 2024-09-12T01:42:55.375 INFO:tasks.workunit.client.1.smithi153.stdout:4/10: dwrite f0 [4194304,4194304] 0 2024-09-12T01:42:55.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/11: write f0 [3532238,9653] 0 2024-09-12T01:42:55.380 INFO:tasks.workunit.client.1.smithi153.stdout:8/47: write f6 [840878,92502] 0 2024-09-12T01:42:55.380 INFO:tasks.workunit.client.1.smithi153.stdout:8/48: dread - f12 zero size 2024-09-12T01:42:55.382 INFO:tasks.workunit.client.1.smithi153.stdout:9/31: getdents d3 0 2024-09-12T01:42:55.388 INFO:tasks.workunit.client.1.smithi153.stdout:9/32: creat d3/f5 x:0 0 0 2024-09-12T01:42:55.390 INFO:tasks.workunit.client.1.smithi153.stdout:4/12: write f0 [7564111,91211] 0 2024-09-12T01:42:55.390 INFO:tasks.workunit.client.1.smithi153.stdout:4/13: creat f3 x:0 0 0 2024-09-12T01:42:55.390 INFO:tasks.workunit.client.1.smithi153.stdout:6/38: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:42:55.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/14: rename f2 to f4 0 2024-09-12T01:42:55.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/15: stat f4 0 2024-09-12T01:42:55.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/16: creat f5 x:0 0 0 2024-09-12T01:42:55.396 INFO:tasks.workunit.client.1.smithi153.stdout:2/22: dwrite f2 [0,4194304] 0 2024-09-12T01:42:55.399 INFO:tasks.workunit.client.1.smithi153.stdout:4/17: mkdir d6 0 2024-09-12T01:42:55.400 INFO:tasks.workunit.client.1.smithi153.stdout:6/39: mknod d1/cb 0 2024-09-12T01:42:55.400 INFO:tasks.workunit.client.1.smithi153.stdout:8/49: dwrite f5 [0,4194304] 0 2024-09-12T01:42:55.402 INFO:tasks.workunit.client.1.smithi153.stdout:2/23: unlink l3 0 2024-09-12T01:42:55.403 INFO:tasks.workunit.client.1.smithi153.stdout:4/18: symlink d6/l7 0 2024-09-12T01:42:55.403 INFO:tasks.workunit.client.1.smithi153.stdout:4/19: read - f3 zero size 2024-09-12T01:42:55.407 INFO:tasks.workunit.client.1.smithi153.stdout:6/40: rename d1/f7 to d1/d6/fc 0 2024-09-12T01:42:55.410 INFO:tasks.workunit.client.1.smithi153.stdout:8/50: unlink cf 0 2024-09-12T01:42:55.410 INFO:tasks.workunit.client.1.smithi153.stdout:8/51: creat f13 x:0 0 0 2024-09-12T01:42:55.411 INFO:tasks.workunit.client.1.smithi153.stdout:4/20: mknod d6/c8 0 2024-09-12T01:42:55.412 INFO:tasks.workunit.client.1.smithi153.stdout:4/21: dread - f3 zero size 2024-09-12T01:42:55.414 INFO:tasks.workunit.client.1.smithi153.stdout:2/24: dread f2 [0,4194304] 0 2024-09-12T01:42:55.416 INFO:tasks.workunit.client.1.smithi153.stdout:4/22: mkdir d6/d9 0 2024-09-12T01:42:55.416 INFO:tasks.workunit.client.1.smithi153.stdout:4/23: read - f3 zero size 2024-09-12T01:42:55.416 INFO:tasks.workunit.client.1.smithi153.stdout:4/24: write f3 [812947,52326] 0 2024-09-12T01:42:55.417 INFO:tasks.workunit.client.1.smithi153.stdout:2/25: symlink l4 0 2024-09-12T01:42:55.417 INFO:tasks.workunit.client.1.smithi153.stdout:2/26: fdatasync f2 0 2024-09-12T01:42:55.417 INFO:tasks.workunit.client.1.smithi153.stdout:2/27: chown f2 328682 1 2024-09-12T01:42:55.419 INFO:tasks.workunit.client.1.smithi153.stdout:2/28: symlink l5 0 2024-09-12T01:42:55.419 INFO:tasks.workunit.client.1.smithi153.stdout:2/29: read - f1 zero size 2024-09-12T01:42:55.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/30: dwrite f2 [0,4194304] 0 2024-09-12T01:42:55.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/31: truncate f1 740901 0 2024-09-12T01:42:55.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/32: fsync f1 0 2024-09-12T01:42:55.442 INFO:tasks.workunit.client.1.smithi153.stdout:2/33: symlink l6 0 2024-09-12T01:42:55.442 INFO:tasks.workunit.client.1.smithi153.stdout:2/34: truncate f1 1254324 0 2024-09-12T01:42:55.444 INFO:tasks.workunit.client.1.smithi153.stdout:2/35: unlink l6 0 2024-09-12T01:42:55.461 INFO:tasks.workunit.client.1.smithi153.stdout:8/52: dwrite f13 [0,4194304] 0 2024-09-12T01:42:55.461 INFO:tasks.workunit.client.1.smithi153.stdout:9/33: dwrite d3/f4 [0,4194304] 0 2024-09-12T01:42:55.461 INFO:tasks.workunit.client.1.smithi153.stdout:9/34: creat d3/f6 x:0 0 0 2024-09-12T01:42:55.464 INFO:tasks.workunit.client.1.smithi153.stdout:4/25: dread f3 [0,4194304] 0 2024-09-12T01:42:55.464 INFO:tasks.workunit.client.1.smithi153.stdout:6/41: dread d1/d6/f8 [0,4194304] 0 2024-09-12T01:42:55.473 INFO:tasks.workunit.client.1.smithi153.stdout:4/26: dread f3 [0,4194304] 0 2024-09-12T01:42:55.486 INFO:tasks.workunit.client.1.smithi153.stdout:9/35: dwrite f1 [0,4194304] 0 2024-09-12T01:42:55.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/36: unlink d3/f6 0 2024-09-12T01:42:55.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/37: chown d3/f4 627 1 2024-09-12T01:42:55.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/38: creat d3/f7 x:0 0 0 2024-09-12T01:42:55.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/39: creat d3/f8 x:0 0 0 2024-09-12T01:42:55.489 INFO:tasks.workunit.client.1.smithi153.stdout:9/40: dread - d3/f8 zero size 2024-09-12T01:42:55.498 INFO:tasks.workunit.client.1.smithi153.stdout:9/41: dread d3/f4 [0,4194304] 0 2024-09-12T01:42:55.502 INFO:tasks.workunit.client.1.smithi153.stdout:9/42: write f1 [3371691,98941] 0 2024-09-12T01:42:55.523 INFO:tasks.workunit.client.1.smithi153.stdout:9/43: dwrite d3/f5 [0,4194304] 0 2024-09-12T01:42:55.523 INFO:tasks.workunit.client.1.smithi153.stdout:9/44: rename d3 to d3/d9 22 2024-09-12T01:42:55.523 INFO:tasks.workunit.client.1.smithi153.stdout:9/45: stat d3/f8 0 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/20: sync 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/21: write d0/f2 [268894,105361] 0 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/22: truncate d0/f2 1376624 0 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/23: creat d0/f4 x:0 0 0 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/24: write d0/f4 [875500,117132] 0 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/25: chown d0/f4 66724298 1 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/26: chown d0 727 1 2024-09-12T01:42:55.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/27: chown d0/c3 1 1 2024-09-12T01:42:55.583 INFO:tasks.workunit.client.1.smithi153.stdout:8/53: truncate fd 3903268 0 2024-09-12T01:42:55.585 INFO:tasks.workunit.client.1.smithi153.stdout:6/42: getdents d1/d6 0 2024-09-12T01:42:55.586 INFO:tasks.workunit.client.1.smithi153.stdout:6/43: dread d1/d6/f8 [0,4194304] 0 2024-09-12T01:42:55.588 INFO:tasks.workunit.client.1.smithi153.stdout:6/44: unlink d1/d6/fc 0 2024-09-12T01:42:55.611 INFO:tasks.workunit.client.1.smithi153.stdout:6/45: dwrite d1/d6/f8 [0,4194304] 0 2024-09-12T01:42:55.611 INFO:tasks.workunit.client.1.smithi153.stdout:2/36: getdents . 0 2024-09-12T01:42:55.611 INFO:tasks.workunit.client.1.smithi153.stdout:2/37: write f1 [1410138,130766] 0 2024-09-12T01:42:55.616 INFO:tasks.workunit.client.1.smithi153.stdout:2/38: mkdir d7 0 2024-09-12T01:42:55.617 INFO:tasks.workunit.client.1.smithi153.stdout:6/46: getdents d1 0 2024-09-12T01:42:55.619 INFO:tasks.workunit.client.1.smithi153.stdout:2/39: symlink d7/l8 0 2024-09-12T01:42:55.620 INFO:tasks.workunit.client.1.smithi153.stdout:6/47: getdents d1 0 2024-09-12T01:42:55.620 INFO:tasks.workunit.client.1.smithi153.stdout:6/48: dread - d1/d6/f9 zero size 2024-09-12T01:42:55.620 INFO:tasks.workunit.client.1.smithi153.stdout:6/49: dread - d1/d6/f9 zero size 2024-09-12T01:42:55.622 INFO:tasks.workunit.client.1.smithi153.stdout:2/40: unlink l5 0 2024-09-12T01:42:55.622 INFO:tasks.workunit.client.1.smithi153.stdout:2/41: chown d7/l8 51054888 1 2024-09-12T01:42:55.622 INFO:tasks.workunit.client.1.smithi153.stdout:2/42: chown f1 45464 1 2024-09-12T01:42:55.632 INFO:tasks.workunit.client.1.smithi153.stdout:2/43: dread f2 [0,4194304] 0 2024-09-12T01:42:55.634 INFO:tasks.workunit.client.1.smithi153.stdout:6/50: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:42:55.634 INFO:tasks.workunit.client.1.smithi153.stdout:6/51: dread - d1/d6/f9 zero size 2024-09-12T01:42:55.634 INFO:tasks.workunit.client.1.smithi153.stdout:2/44: symlink d7/l9 0 2024-09-12T01:42:55.635 INFO:tasks.workunit.client.1.smithi153.stdout:4/27: truncate f3 759782 0 2024-09-12T01:42:55.635 INFO:tasks.workunit.client.1.smithi153.stdout:4/28: getdents d6/d9 0 2024-09-12T01:42:55.637 INFO:tasks.workunit.client.1.smithi153.stdout:6/52: creat d1/d6/da/fd x:0 0 0 2024-09-12T01:42:55.639 INFO:tasks.workunit.client.1.smithi153.stdout:2/45: rmdir d7 39 2024-09-12T01:42:55.639 INFO:tasks.workunit.client.1.smithi153.stdout:2/46: readlink l4 0 2024-09-12T01:42:55.652 INFO:tasks.workunit.client.1.smithi153.stdout:6/53: dwrite d1/d6/da/fd [0,4194304] 0 2024-09-12T01:42:55.656 INFO:tasks.workunit.client.1.smithi153.stdout:9/46: rmdir d3 39 2024-09-12T01:42:55.656 INFO:tasks.workunit.client.1.smithi153.stdout:9/47: write d3/f7 [248404,113042] 0 2024-09-12T01:42:55.658 INFO:tasks.workunit.client.1.smithi153.stdout:6/54: symlink d1/d6/le 0 2024-09-12T01:42:55.661 INFO:tasks.workunit.client.1.smithi153.stdout:9/48: dread f1 [0,4194304] 0 2024-09-12T01:42:55.664 INFO:tasks.workunit.client.1.smithi153.stdout:6/55: read d1/f4 [820379,74895] 0 2024-09-12T01:42:55.668 INFO:tasks.workunit.client.1.smithi153.stdout:9/49: link c0 d3/ca 0 2024-09-12T01:42:55.668 INFO:tasks.workunit.client.1.smithi153.stdout:9/50: truncate d3/f5 5071074 0 2024-09-12T01:42:55.668 INFO:tasks.workunit.client.1.smithi153.stdout:9/51: dread - d3/f8 zero size 2024-09-12T01:42:55.668 INFO:tasks.workunit.client.1.smithi153.stdout:9/52: read d3/f7 [224033,98532] 0 2024-09-12T01:42:55.669 INFO:tasks.workunit.client.1.smithi153.stdout:9/53: rmdir d3 39 2024-09-12T01:42:55.671 INFO:tasks.workunit.client.1.smithi153.stdout:6/56: mkdir d1/df 0 2024-09-12T01:42:55.671 INFO:tasks.workunit.client.1.smithi153.stdout:6/57: chown d1/d6 30946693 1 2024-09-12T01:42:55.675 INFO:tasks.workunit.client.1.smithi153.stdout:6/58: link d1/d6/le d1/d6/da/l10 0 2024-09-12T01:42:55.675 INFO:tasks.workunit.client.1.smithi153.stdout:9/54: dread d3/f4 [0,4194304] 0 2024-09-12T01:42:55.675 INFO:tasks.workunit.client.1.smithi153.stdout:9/55: truncate d3/f4 4564356 0 2024-09-12T01:42:55.677 INFO:tasks.workunit.client.1.smithi153.stdout:6/59: mknod d1/df/c11 0 2024-09-12T01:42:55.678 INFO:tasks.workunit.client.1.smithi153.stdout:9/56: dread d3/f7 [0,4194304] 0 2024-09-12T01:42:55.679 INFO:tasks.workunit.client.1.smithi153.stdout:6/60: creat d1/df/f12 x:0 0 0 2024-09-12T01:42:55.682 INFO:tasks.workunit.client.1.smithi153.stdout:7/13: truncate f0 2284944 0 2024-09-12T01:42:55.682 INFO:tasks.workunit.client.1.smithi153.stdout:7/14: creat f4 x:0 0 0 2024-09-12T01:42:55.700 INFO:tasks.workunit.client.1.smithi153.stdout:6/61: dwrite d1/d6/f9 [0,4194304] 0 2024-09-12T01:42:55.704 INFO:tasks.workunit.client.1.smithi153.stdout:6/62: symlink d1/df/l13 0 2024-09-12T01:42:55.706 INFO:tasks.workunit.client.1.smithi153.stdout:6/63: creat d1/f14 x:0 0 0 2024-09-12T01:42:55.706 INFO:tasks.workunit.client.1.smithi153.stdout:6/64: readlink d1/df/l13 0 2024-09-12T01:42:55.715 INFO:tasks.workunit.client.1.smithi153.stdout:6/65: dread d1/d6/f8 [0,4194304] 0 2024-09-12T01:42:55.715 INFO:tasks.workunit.client.1.smithi153.stdout:6/66: dread - d1/f14 zero size 2024-09-12T01:42:55.717 INFO:tasks.workunit.client.1.smithi153.stdout:6/67: unlink d1/d6/f9 0 2024-09-12T01:42:55.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/68: creat d1/d6/f15 x:0 0 0 2024-09-12T01:42:55.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/69: chown d1/df/f12 1782679 1 2024-09-12T01:42:55.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/70: unlink d1/l5 0 2024-09-12T01:42:55.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/71: write d1/d6/f15 [158686,85231] 0 2024-09-12T01:42:55.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/72: chown d1/d6/da 319 1 2024-09-12T01:42:55.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/73: fdatasync d1/d6/f8 0 2024-09-12T01:42:55.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/74: dwrite d1/d6/f8 [4194304,4194304] 0 2024-09-12T01:42:55.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/75: write d1/df/f12 [501266,103782] 0 2024-09-12T01:42:55.794 INFO:tasks.workunit.client.1.smithi153.stdout:6/76: symlink d1/d6/l16 0 2024-09-12T01:42:55.796 INFO:tasks.workunit.client.1.smithi153.stdout:6/77: symlink d1/d6/l17 0 2024-09-12T01:42:55.801 INFO:tasks.workunit.client.1.smithi153.stdout:6/78: symlink d1/df/l18 0 2024-09-12T01:42:55.801 INFO:tasks.workunit.client.1.smithi153.stdout:6/79: readlink d1/d6/l16 0 2024-09-12T01:42:55.801 INFO:tasks.workunit.client.1.smithi153.stdout:6/80: write d1/df/f12 [1402668,100693] 0 2024-09-12T01:42:55.801 INFO:tasks.workunit.client.1.smithi153.stdout:6/81: chown d1/d6/l17 339933 1 2024-09-12T01:42:55.801 INFO:tasks.workunit.client.1.smithi153.stdout:4/29: rename f3 to d6/fa 0 2024-09-12T01:42:55.802 INFO:tasks.workunit.client.1.smithi153.stdout:6/82: mkdir d1/d6/da/d19 0 2024-09-12T01:42:55.804 INFO:tasks.workunit.client.1.smithi153.stdout:2/47: rename l4 to d7/la 0 2024-09-12T01:42:55.806 INFO:tasks.workunit.client.1.smithi153.stdout:4/30: rename c1 to d6/d9/cb 0 2024-09-12T01:42:55.807 INFO:tasks.workunit.client.1.smithi153.stdout:2/48: mkdir d7/db 0 2024-09-12T01:42:55.810 INFO:tasks.workunit.client.1.smithi153.stdout:6/83: write d1/d6/da/fd [295490,81318] 0 2024-09-12T01:42:55.811 INFO:tasks.workunit.client.1.smithi153.stdout:6/84: readlink d1/d6/le 0 2024-09-12T01:42:55.811 INFO:tasks.workunit.client.1.smithi153.stdout:4/31: unlink f5 0 2024-09-12T01:42:55.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/85: unlink d1/d6/da/l10 0 2024-09-12T01:42:55.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/86: write d1/f14 [666000,42703] 0 2024-09-12T01:42:55.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/87: write d1/f4 [1151976,73668] 0 2024-09-12T01:42:55.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/88: read d1/df/f12 [88747,22372] 0 2024-09-12T01:42:55.814 INFO:tasks.workunit.client.1.smithi153.stdout:6/89: chown d1/d6/da/fd 5490903 1 2024-09-12T01:42:55.815 INFO:tasks.workunit.client.1.smithi153.stdout:4/32: mkdir d6/d9/dc 0 2024-09-12T01:42:55.815 INFO:tasks.workunit.client.1.smithi153.stdout:4/33: getdents d6/d9/dc 0 2024-09-12T01:42:55.826 INFO:tasks.workunit.client.1.smithi153.stdout:2/49: dwrite f2 [0,4194304] 0 2024-09-12T01:42:55.829 INFO:tasks.workunit.client.1.smithi153.stdout:2/50: rename d7/l8 to d7/db/lc 0 2024-09-12T01:42:55.838 INFO:tasks.workunit.client.1.smithi153.stdout:4/34: dwrite f4 [0,4194304] 0 2024-09-12T01:42:55.839 INFO:tasks.workunit.client.1.smithi153.stdout:4/35: chown d6/d9 88115 1 2024-09-12T01:42:55.841 INFO:tasks.workunit.client.1.smithi153.stdout:6/90: dwrite d1/d6/da/fd [0,4194304] 0 2024-09-12T01:42:55.841 INFO:tasks.workunit.client.1.smithi153.stdout:6/91: chown d1/f4 15532 1 2024-09-12T01:42:55.845 INFO:tasks.workunit.client.1.smithi153.stdout:9/57: truncate f1 3148527 0 2024-09-12T01:42:55.845 INFO:tasks.workunit.client.1.smithi153.stdout:4/36: symlink d6/d9/ld 0 2024-09-12T01:42:55.846 INFO:tasks.workunit.client.1.smithi153.stdout:1/21: sync 2024-09-12T01:42:55.846 INFO:tasks.workunit.client.1.smithi153.stdout:3/16: sync 2024-09-12T01:42:55.847 INFO:tasks.workunit.client.1.smithi153.stdout:0/38: sync 2024-09-12T01:42:55.847 INFO:tasks.workunit.client.1.smithi153.stdout:1/22: creat d2/f6 x:0 0 0 2024-09-12T01:42:55.847 INFO:tasks.workunit.client.1.smithi153.stdout:3/17: creat d1/f6 x:0 0 0 2024-09-12T01:42:55.847 INFO:tasks.workunit.client.1.smithi153.stdout:3/18: fdatasync d1/f2 0 2024-09-12T01:42:55.847 INFO:tasks.workunit.client.1.smithi153.stdout:3/19: write d1/f2 [79882,17004] 0 2024-09-12T01:42:55.848 INFO:tasks.workunit.client.1.smithi153.stdout:6/92: rename d1/f14 to d1/d6/da/f1a 0 2024-09-12T01:42:55.848 INFO:tasks.workunit.client.1.smithi153.stdout:6/93: read d1/f4 [3173945,73264] 0 2024-09-12T01:42:55.849 INFO:tasks.workunit.client.1.smithi153.stdout:9/58: symlink d3/lb 0 2024-09-12T01:42:55.849 INFO:tasks.workunit.client.1.smithi153.stdout:9/59: chown d3/ca 456389413 1 2024-09-12T01:42:55.851 INFO:tasks.workunit.client.1.smithi153.stdout:0/39: creat fe x:0 0 0 2024-09-12T01:42:55.851 INFO:tasks.workunit.client.1.smithi153.stdout:2/51: dwrite f2 [0,4194304] 0 2024-09-12T01:42:55.852 INFO:tasks.workunit.client.1.smithi153.stdout:6/94: fsync d1/f4 0 2024-09-12T01:42:55.857 INFO:tasks.workunit.client.1.smithi153.stdout:1/23: mknod d2/c7 0 2024-09-12T01:42:55.857 INFO:tasks.workunit.client.1.smithi153.stdout:4/37: dread f4 [0,4194304] 0 2024-09-12T01:42:55.857 INFO:tasks.workunit.client.1.smithi153.stdout:4/38: write f0 [1443005,57972] 0 2024-09-12T01:42:55.858 INFO:tasks.workunit.client.1.smithi153.stdout:7/15: dwrite f0 [0,4194304] 0 2024-09-12T01:42:55.863 INFO:tasks.workunit.client.1.smithi153.stdout:6/95: creat d1/f1b x:0 0 0 2024-09-12T01:42:55.867 INFO:tasks.workunit.client.1.smithi153.stdout:4/39: creat d6/fe x:0 0 0 2024-09-12T01:42:55.869 INFO:tasks.workunit.client.1.smithi153.stdout:7/16: symlink l5 0 2024-09-12T01:42:55.870 INFO:tasks.workunit.client.1.smithi153.stdout:0/40: link l2 lf 0 2024-09-12T01:42:55.872 INFO:tasks.workunit.client.1.smithi153.stdout:6/96: rename d1/d6/le to d1/d6/da/l1c 0 2024-09-12T01:42:55.875 INFO:tasks.workunit.client.1.smithi153.stdout:7/17: symlink l6 0 2024-09-12T01:42:55.875 INFO:tasks.workunit.client.1.smithi153.stdout:7/18: truncate f4 982672 0 2024-09-12T01:42:55.875 INFO:tasks.workunit.client.1.smithi153.stdout:7/19: chown l5 443493 1 2024-09-12T01:42:55.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/20: write f0 [3210630,91865] 0 2024-09-12T01:42:55.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/21: write f0 [869811,32322] 0 2024-09-12T01:42:55.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/22: dread f4 [0,4194304] 0 2024-09-12T01:42:55.902 INFO:tasks.workunit.client.1.smithi153.stdout:4/40: dwrite f0 [0,4194304] 0 2024-09-12T01:42:55.902 INFO:tasks.workunit.client.1.smithi153.stdout:0/41: dwrite f4 [0,4194304] 0 2024-09-12T01:42:55.902 INFO:tasks.workunit.client.1.smithi153.stdout:0/42: rmdir - no directory 2024-09-12T01:42:55.903 INFO:tasks.workunit.client.1.smithi153.stdout:0/43: fdatasync f4 0 2024-09-12T01:42:55.903 INFO:tasks.workunit.client.1.smithi153.stdout:6/97: dwrite d1/d6/f15 [0,4194304] 0 2024-09-12T01:42:55.909 INFO:tasks.workunit.client.1.smithi153.stdout:4/41: creat d6/d9/dc/ff x:0 0 0 2024-09-12T01:42:55.917 INFO:tasks.workunit.client.1.smithi153.stdout:0/44: mknod c10 0 2024-09-12T01:42:55.918 INFO:tasks.workunit.client.1.smithi153.stdout:0/45: write fa [740254,82197] 0 2024-09-12T01:42:55.918 INFO:tasks.workunit.client.1.smithi153.stdout:4/42: rename d6/d9/dc/ff to d6/d9/f10 0 2024-09-12T01:42:55.923 INFO:tasks.workunit.client.1.smithi153.stdout:4/43: write f4 [251426,12524] 0 2024-09-12T01:42:55.925 INFO:tasks.workunit.client.1.smithi153.stdout:0/46: rename fe to f11 0 2024-09-12T01:42:55.930 INFO:tasks.workunit.client.1.smithi153.stdout:0/47: link lf l12 0 2024-09-12T01:42:55.932 INFO:tasks.workunit.client.1.smithi153.stdout:0/48: creat f13 x:0 0 0 2024-09-12T01:42:55.934 INFO:tasks.workunit.client.1.smithi153.stdout:0/49: mknod c14 0 2024-09-12T01:42:55.974 INFO:tasks.workunit.client.1.smithi153.stdout:5/28: sync 2024-09-12T01:42:55.974 INFO:tasks.workunit.client.1.smithi153.stdout:8/54: sync 2024-09-12T01:42:55.974 INFO:tasks.workunit.client.1.smithi153.stdout:8/55: creat f14 x:0 0 0 2024-09-12T01:42:55.975 INFO:tasks.workunit.client.1.smithi153.stdout:8/56: creat f15 x:0 0 0 2024-09-12T01:42:55.975 INFO:tasks.workunit.client.1.smithi153.stdout:8/57: stat cc 0 2024-09-12T01:42:55.975 INFO:tasks.workunit.client.1.smithi153.stdout:8/58: creat f16 x:0 0 0 2024-09-12T01:42:55.975 INFO:tasks.workunit.client.1.smithi153.stdout:5/29: symlink d0/l5 0 2024-09-12T01:42:55.975 INFO:tasks.workunit.client.1.smithi153.stdout:5/30: creat d0/f6 x:0 0 0 2024-09-12T01:42:55.981 INFO:tasks.workunit.client.1.smithi153.stdout:8/59: mkdir d17 0 2024-09-12T01:42:55.984 INFO:tasks.workunit.client.1.smithi153.stdout:5/31: mknod d0/c7 0 2024-09-12T01:42:55.985 INFO:tasks.workunit.client.1.smithi153.stdout:8/60: rename c8 to d17/c18 0 2024-09-12T01:42:55.988 INFO:tasks.workunit.client.1.smithi153.stdout:8/61: symlink d17/l19 0 2024-09-12T01:42:55.988 INFO:tasks.workunit.client.1.smithi153.stdout:8/62: readlink d17/l19 0 2024-09-12T01:42:55.990 INFO:tasks.workunit.client.1.smithi153.stdout:8/63: link f13 d17/f1a 0 2024-09-12T01:42:55.991 INFO:tasks.workunit.client.1.smithi153.stdout:8/64: dread - f12 zero size 2024-09-12T01:42:55.992 INFO:tasks.workunit.client.1.smithi153.stdout:8/65: creat d17/f1b x:0 0 0 2024-09-12T01:42:55.993 INFO:tasks.workunit.client.1.smithi153.stdout:2/52: unlink d7/db/lc 0 2024-09-12T01:42:55.995 INFO:tasks.workunit.client.1.smithi153.stdout:8/66: symlink d17/l1c 0 2024-09-12T01:42:55.996 INFO:tasks.workunit.client.1.smithi153.stdout:2/53: mknod d7/cd 0 2024-09-12T01:42:55.999 INFO:tasks.workunit.client.1.smithi153.stdout:5/32: dwrite d0/f6 [0,4194304] 0 2024-09-12T01:42:55.999 INFO:tasks.workunit.client.1.smithi153.stdout:5/33: chown d0/f4 21135883 1 2024-09-12T01:42:55.999 INFO:tasks.workunit.client.1.smithi153.stdout:2/54: dread f1 [0,4194304] 0 2024-09-12T01:42:56.005 INFO:tasks.workunit.client.1.smithi153.stdout:5/34: rename d0/f4 to d0/f8 0 2024-09-12T01:42:56.008 INFO:tasks.workunit.client.1.smithi153.stdout:5/35: mknod d0/c9 0 2024-09-12T01:42:56.009 INFO:tasks.workunit.client.1.smithi153.stdout:5/36: chown d0/f2 12237204 1 2024-09-12T01:42:56.011 INFO:tasks.workunit.client.1.smithi153.stdout:8/67: dwrite f14 [0,4194304] 0 2024-09-12T01:42:56.011 INFO:tasks.workunit.client.1.smithi153.stdout:8/68: stat c3 0 2024-09-12T01:42:56.016 INFO:tasks.workunit.client.1.smithi153.stdout:3/20: getdents d1 0 2024-09-12T01:42:56.017 INFO:tasks.workunit.client.1.smithi153.stdout:9/60: dread d3/f4 [0,4194304] 0 2024-09-12T01:42:56.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/69: mkdir d17/d1d 0 2024-09-12T01:42:56.020 INFO:tasks.workunit.client.1.smithi153.stdout:3/21: symlink d1/l7 0 2024-09-12T01:42:56.020 INFO:tasks.workunit.client.1.smithi153.stdout:1/24: getdents d2 0 2024-09-12T01:42:56.022 INFO:tasks.workunit.client.1.smithi153.stdout:9/61: creat d3/fc x:0 0 0 2024-09-12T01:42:56.023 INFO:tasks.workunit.client.1.smithi153.stdout:5/37: dwrite d0/f6 [0,4194304] 0 2024-09-12T01:42:56.024 INFO:tasks.workunit.client.1.smithi153.stdout:8/70: mkdir d17/d1e 0 2024-09-12T01:42:56.025 INFO:tasks.workunit.client.1.smithi153.stdout:5/38: dread d0/f2 [0,4194304] 0 2024-09-12T01:42:56.026 INFO:tasks.workunit.client.1.smithi153.stdout:1/25: rmdir d2 39 2024-09-12T01:42:56.026 INFO:tasks.workunit.client.1.smithi153.stdout:1/26: dread - d2/f3 zero size 2024-09-12T01:42:56.026 INFO:tasks.workunit.client.1.smithi153.stdout:1/27: read - d2/f6 zero size 2024-09-12T01:42:56.029 INFO:tasks.workunit.client.1.smithi153.stdout:8/71: mkdir d17/d1f 0 2024-09-12T01:42:56.034 INFO:tasks.workunit.client.1.smithi153.stdout:3/22: rename f0 to d1/f8 0 2024-09-12T01:42:56.034 INFO:tasks.workunit.client.1.smithi153.stdout:9/62: write d3/f5 [1702077,70631] 0 2024-09-12T01:42:56.036 INFO:tasks.workunit.client.1.smithi153.stdout:1/28: symlink d2/l8 0 2024-09-12T01:42:56.042 INFO:tasks.workunit.client.1.smithi153.stdout:3/23: write d1/f2 [1259244,32396] 0 2024-09-12T01:42:56.042 INFO:tasks.workunit.client.1.smithi153.stdout:3/24: truncate d1/f2 1542223 0 2024-09-12T01:42:56.045 INFO:tasks.workunit.client.1.smithi153.stdout:1/29: mkdir d2/d9 0 2024-09-12T01:42:56.045 INFO:tasks.workunit.client.1.smithi153.stdout:1/30: chown d2/l8 2216205 1 2024-09-12T01:42:56.045 INFO:tasks.workunit.client.1.smithi153.stdout:1/31: stat d2/l8 0 2024-09-12T01:42:56.051 INFO:tasks.workunit.client.1.smithi153.stdout:3/25: rename d1/f6 to d1/f9 0 2024-09-12T01:42:56.051 INFO:tasks.workunit.client.1.smithi153.stdout:8/72: dwrite f10 [0,4194304] 0 2024-09-12T01:42:56.052 INFO:tasks.workunit.client.1.smithi153.stdout:8/73: dread - f15 zero size 2024-09-12T01:42:56.066 INFO:tasks.workunit.client.1.smithi153.stdout:9/63: dwrite f1 [0,4194304] 0 2024-09-12T01:42:56.067 INFO:tasks.workunit.client.1.smithi153.stdout:1/32: dwrite d2/f3 [0,4194304] 0 2024-09-12T01:42:56.075 INFO:tasks.workunit.client.1.smithi153.stdout:1/33: dread d2/f3 [0,4194304] 0 2024-09-12T01:42:56.077 INFO:tasks.workunit.client.1.smithi153.stdout:1/34: link d2/c7 d2/d9/ca 0 2024-09-12T01:42:56.077 INFO:tasks.workunit.client.1.smithi153.stdout:1/35: readlink d2/l4 0 2024-09-12T01:42:56.078 INFO:tasks.workunit.client.1.smithi153.stdout:1/36: readlink d2/l4 0 2024-09-12T01:42:56.080 INFO:tasks.workunit.client.1.smithi153.stdout:1/37: creat d2/fb x:0 0 0 2024-09-12T01:42:56.082 INFO:tasks.workunit.client.1.smithi153.stdout:1/38: rename d2/fb to d2/d9/fc 0 2024-09-12T01:42:56.083 INFO:tasks.workunit.client.1.smithi153.stdout:4/44: getdents d6/d9/dc 0 2024-09-12T01:42:56.085 INFO:tasks.workunit.client.1.smithi153.stdout:9/64: dwrite d3/fc [0,4194304] 0 2024-09-12T01:42:56.085 INFO:tasks.workunit.client.1.smithi153.stdout:6/98: truncate d1/d6/f15 2258567 0 2024-09-12T01:42:56.086 INFO:tasks.workunit.client.1.smithi153.stdout:1/39: mknod d2/d9/cd 0 2024-09-12T01:42:56.096 INFO:tasks.workunit.client.1.smithi153.stdout:9/65: mknod d3/cd 0 2024-09-12T01:42:56.099 INFO:tasks.workunit.client.1.smithi153.stdout:9/66: link f1 d3/fe 0 2024-09-12T01:42:56.101 INFO:tasks.workunit.client.1.smithi153.stdout:6/99: link d1/f1b d1/f1d 0 2024-09-12T01:42:56.104 INFO:tasks.workunit.client.1.smithi153.stdout:6/100: mkdir d1/d6/da/d19/d1e 0 2024-09-12T01:42:56.104 INFO:tasks.workunit.client.1.smithi153.stdout:6/101: stat d1/df/f12 0 2024-09-12T01:42:56.104 INFO:tasks.workunit.client.1.smithi153.stdout:6/102: chown d1/d6/da/fd 6 1 2024-09-12T01:42:56.110 INFO:tasks.workunit.client.1.smithi153.stdout:1/40: dwrite d2/f6 [0,4194304] 0 2024-09-12T01:42:56.110 INFO:tasks.workunit.client.1.smithi153.stdout:4/45: dwrite d6/fa [0,4194304] 0 2024-09-12T01:42:56.112 INFO:tasks.workunit.client.1.smithi153.stdout:9/67: dread d3/f5 [4194304,4194304] 0 2024-09-12T01:42:56.112 INFO:tasks.workunit.client.1.smithi153.stdout:9/68: creat d3/ff x:0 0 0 2024-09-12T01:42:56.113 INFO:tasks.workunit.client.1.smithi153.stdout:9/69: write d3/f8 [378038,26148] 0 2024-09-12T01:42:56.120 INFO:tasks.workunit.client.1.smithi153.stdout:1/41: dread f0 [0,4194304] 0 2024-09-12T01:42:56.120 INFO:tasks.workunit.client.1.smithi153.stdout:1/42: dread - d2/d9/fc zero size 2024-09-12T01:42:56.126 INFO:tasks.workunit.client.1.smithi153.stdout:4/46: mkdir d6/d9/d11 0 2024-09-12T01:42:56.127 INFO:tasks.workunit.client.1.smithi153.stdout:6/103: dwrite d1/f1d [0,4194304] 0 2024-09-12T01:42:56.129 INFO:tasks.workunit.client.1.smithi153.stdout:1/43: symlink d2/le 0 2024-09-12T01:42:56.131 INFO:tasks.workunit.client.1.smithi153.stdout:4/47: mknod d6/c12 0 2024-09-12T01:42:56.132 INFO:tasks.workunit.client.1.smithi153.stdout:6/104: dread d1/d6/f8 [0,4194304] 0 2024-09-12T01:42:56.134 INFO:tasks.workunit.client.1.smithi153.stdout:9/70: dwrite d3/fc [0,4194304] 0 2024-09-12T01:42:56.136 INFO:tasks.workunit.client.1.smithi153.stdout:4/48: dread f0 [4194304,4194304] 0 2024-09-12T01:42:56.137 INFO:tasks.workunit.client.1.smithi153.stdout:9/71: symlink d3/l10 0 2024-09-12T01:42:56.137 INFO:tasks.workunit.client.1.smithi153.stdout:9/72: fsync d3/f7 0 2024-09-12T01:42:56.140 INFO:tasks.workunit.client.1.smithi153.stdout:6/105: rename d1/d6/da/fd to d1/f1f 0 2024-09-12T01:42:56.142 INFO:tasks.workunit.client.1.smithi153.stdout:4/49: mkdir d6/d9/d11/d13 0 2024-09-12T01:42:56.144 INFO:tasks.workunit.client.1.smithi153.stdout:6/106: creat d1/d6/da/d19/d1e/f20 x:0 0 0 2024-09-12T01:42:56.144 INFO:tasks.workunit.client.1.smithi153.stdout:6/107: write d1/df/f12 [248098,114840] 0 2024-09-12T01:42:56.147 INFO:tasks.workunit.client.1.smithi153.stdout:6/108: symlink d1/d6/da/l21 0 2024-09-12T01:42:56.147 INFO:tasks.workunit.client.1.smithi153.stdout:6/109: write d1/d6/da/f1a [988213,126246] 0 2024-09-12T01:42:56.148 INFO:tasks.workunit.client.1.smithi153.stdout:4/50: write f0 [3285755,104] 0 2024-09-12T01:42:56.150 INFO:tasks.workunit.client.1.smithi153.stdout:6/110: rename d1/l3 to d1/d6/da/d19/l22 0 2024-09-12T01:42:56.150 INFO:tasks.workunit.client.1.smithi153.stdout:6/111: chown d1/f4 100 1 2024-09-12T01:42:56.152 INFO:tasks.workunit.client.1.smithi153.stdout:4/51: mkdir d6/d9/d11/d14 0 2024-09-12T01:42:56.157 INFO:tasks.workunit.client.0.smithi066.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-12T01:42:56.157 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T01:42:56.157 INFO:tasks.workunit.client.0.smithi066.stderr:+ make 2024-09-12T01:42:56.158 INFO:tasks.workunit.client.1.smithi153.stdout:4/52: dread f0 [4194304,4194304] 0 2024-09-12T01:42:56.159 INFO:tasks.workunit.client.1.smithi153.stdout:6/112: dread d1/d6/f8 [4194304,4194304] 0 2024-09-12T01:42:56.164 INFO:tasks.workunit.client.1.smithi153.stdout:8/74: fsync d17/f1b 0 2024-09-12T01:42:56.167 INFO:tasks.workunit.client.1.smithi153.stdout:8/75: symlink d17/d1f/l20 0 2024-09-12T01:42:56.169 INFO:tasks.workunit.client.1.smithi153.stdout:8/76: rename d17/d1e to d17/d21 0 2024-09-12T01:42:56.172 INFO:tasks.workunit.client.1.smithi153.stdout:8/77: creat d17/d1d/f22 x:0 0 0 2024-09-12T01:42:56.174 INFO:tasks.workunit.client.1.smithi153.stdout:8/78: unlink f5 0 2024-09-12T01:42:56.174 INFO:tasks.workunit.client.1.smithi153.stdout:8/79: truncate d17/d1d/f22 35939 0 2024-09-12T01:42:56.175 INFO:tasks.workunit.client.1.smithi153.stdout:8/80: write f6 [1463762,107926] 0 2024-09-12T01:42:56.177 INFO:tasks.workunit.client.1.smithi153.stdout:5/39: rmdir d0 39 2024-09-12T01:42:56.177 INFO:tasks.workunit.client.1.smithi153.stdout:5/40: chown d0/f6 171 1 2024-09-12T01:42:56.178 INFO:tasks.workunit.client.1.smithi153.stdout:8/81: mknod d17/d21/c23 0 2024-09-12T01:42:56.178 INFO:tasks.workunit.client.1.smithi153.stdout:8/82: readlink d17/l19 0 2024-09-12T01:42:56.178 INFO:tasks.workunit.client.1.smithi153.stdout:8/83: write f6 [3842407,30406] 0 2024-09-12T01:42:56.180 INFO:tasks.workunit.client.1.smithi153.stdout:8/84: rename d17/d1d/f22 to d17/f24 0 2024-09-12T01:42:56.180 INFO:tasks.workunit.client.1.smithi153.stdout:8/85: fsync f16 0 2024-09-12T01:42:56.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/86: rename d17/c18 to d17/d1d/c25 0 2024-09-12T01:42:56.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/87: chown d17/l19 22 1 2024-09-12T01:42:56.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/88: fdatasync f14 0 2024-09-12T01:42:56.183 INFO:tasks.workunit.client.1.smithi153.stdout:6/113: dwrite d1/f4 [4194304,4194304] 0 2024-09-12T01:42:56.183 INFO:tasks.workunit.client.1.smithi153.stdout:8/89: creat d17/d1f/f26 x:0 0 0 2024-09-12T01:42:56.184 INFO:tasks.workunit.client.1.smithi153.stdout:8/90: chown d17/d1f 488 1 2024-09-12T01:42:56.186 INFO:tasks.workunit.client.1.smithi153.stdout:6/114: mkdir d1/d6/d23 0 2024-09-12T01:42:56.187 INFO:tasks.workunit.client.1.smithi153.stdout:8/91: mkdir d17/d1d/d27 0 2024-09-12T01:42:56.188 INFO:tasks.workunit.client.1.smithi153.stdout:5/41: write d0/f6 [886109,89458] 0 2024-09-12T01:42:56.232 INFO:tasks.workunit.client.1.smithi153.stdout:5/42: rename d0/c9 to d0/ca 0 2024-09-12T01:42:56.232 INFO:tasks.workunit.client.1.smithi153.stdout:5/43: fsync d0/f8 0 2024-09-12T01:42:56.234 INFO:tasks.workunit.client.1.smithi153.stdout:8/92: truncate fd 3780283 0 2024-09-12T01:42:56.234 INFO:tasks.workunit.client.1.smithi153.stdout:8/93: creat d17/f28 x:0 0 0 2024-09-12T01:42:56.238 INFO:tasks.workunit.client.1.smithi153.stdout:8/94: rename f12 to d17/f29 0 2024-09-12T01:42:56.241 INFO:tasks.workunit.client.1.smithi153.stdout:3/26: getdents d1 0 2024-09-12T01:42:56.246 INFO:tasks.workunit.client.1.smithi153.stdout:3/27: dread d1/f8 [0,4194304] 0 2024-09-12T01:42:56.246 INFO:tasks.workunit.client.1.smithi153.stdout:3/28: fdatasync d1/f2 0 2024-09-12T01:42:56.246 INFO:tasks.workunit.client.1.smithi153.stdout:3/29: fsync d1/f8 0 2024-09-12T01:42:56.256 INFO:tasks.workunit.client.1.smithi153.stdout:5/44: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:42:56.258 INFO:tasks.workunit.client.1.smithi153.stdout:5/45: creat d0/fb x:0 0 0 2024-09-12T01:42:56.260 INFO:tasks.workunit.client.1.smithi153.stdout:5/46: unlink d0/c1 0 2024-09-12T01:42:56.260 INFO:tasks.workunit.client.1.smithi153.stdout:5/47: chown d0/fb 7205 1 2024-09-12T01:42:56.260 INFO:tasks.workunit.client.1.smithi153.stdout:5/48: creat d0/fc x:0 0 0 2024-09-12T01:42:56.260 INFO:tasks.workunit.client.1.smithi153.stdout:7/23: sync 2024-09-12T01:42:56.260 INFO:tasks.workunit.client.1.smithi153.stdout:7/24: write f4 [1343518,25310] 0 2024-09-12T01:42:56.261 INFO:tasks.workunit.client.1.smithi153.stdout:7/25: write f0 [375044,82230] 0 2024-09-12T01:42:56.264 INFO:tasks.workunit.client.1.smithi153.stdout:0/50: sync 2024-09-12T01:42:56.264 INFO:tasks.workunit.client.1.smithi153.stdout:2/55: sync 2024-09-12T01:42:56.265 INFO:tasks.workunit.client.1.smithi153.stdout:8/95: dwrite d17/f29 [0,4194304] 0 2024-09-12T01:42:56.265 INFO:tasks.workunit.client.1.smithi153.stdout:8/96: chown fa 2206698 1 2024-09-12T01:42:56.265 INFO:tasks.workunit.client.1.smithi153.stdout:8/97: dread - fa zero size 2024-09-12T01:42:56.265 INFO:tasks.workunit.client.1.smithi153.stdout:8/98: readlink l4 0 2024-09-12T01:42:56.266 INFO:tasks.workunit.client.1.smithi153.stdout:8/99: creat d17/d1f/f2a x:0 0 0 2024-09-12T01:42:56.266 INFO:tasks.workunit.client.1.smithi153.stdout:3/30: dwrite d1/f5 [0,4194304] 0 2024-09-12T01:42:56.266 INFO:tasks.workunit.client.1.smithi153.stdout:0/51: creat f15 x:0 0 0 2024-09-12T01:42:56.267 INFO:tasks.workunit.client.1.smithi153.stdout:7/26: dread f4 [0,4194304] 0 2024-09-12T01:42:56.267 INFO:tasks.workunit.client.1.smithi153.stdout:7/27: chown f4 44830057 1 2024-09-12T01:42:56.268 INFO:tasks.workunit.client.1.smithi153.stdout:8/100: mknod d17/d21/c2b 0 2024-09-12T01:42:56.269 INFO:tasks.workunit.client.1.smithi153.stdout:7/28: dread f4 [0,4194304] 0 2024-09-12T01:42:56.271 INFO:tasks.workunit.client.1.smithi153.stdout:3/31: mknod d1/ca 0 2024-09-12T01:42:56.273 INFO:tasks.workunit.client.1.smithi153.stdout:3/32: symlink d1/lb 0 2024-09-12T01:42:56.274 INFO:tasks.workunit.client.1.smithi153.stdout:0/52: mknod c16 0 2024-09-12T01:42:56.275 INFO:tasks.workunit.client.1.smithi153.stdout:2/56: read f2 [2715892,20566] 0 2024-09-12T01:42:56.275 INFO:tasks.workunit.client.1.smithi153.stdout:2/57: write f1 [2581767,108658] 0 2024-09-12T01:42:56.275 INFO:tasks.workunit.client.1.smithi153.stdout:2/58: fsync f2 0 2024-09-12T01:42:56.276 INFO:tasks.workunit.client.1.smithi153.stdout:0/53: symlink l17 0 2024-09-12T01:42:56.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/59: creat d7/fe x:0 0 0 2024-09-12T01:42:56.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/60: stat d7/db 0 2024-09-12T01:42:56.278 INFO:tasks.workunit.client.1.smithi153.stdout:2/61: creat d7/db/ff x:0 0 0 2024-09-12T01:42:56.278 INFO:tasks.workunit.client.1.smithi153.stdout:2/62: write f2 [2096711,126824] 0 2024-09-12T01:42:56.278 INFO:tasks.workunit.client.1.smithi153.stdout:2/63: write d7/db/ff [825400,73938] 0 2024-09-12T01:42:56.279 INFO:tasks.workunit.client.1.smithi153.stdout:9/73: truncate d3/fc 2994617 0 2024-09-12T01:42:56.281 INFO:tasks.workunit.client.1.smithi153.stdout:3/33: dread d1/f5 [0,4194304] 0 2024-09-12T01:42:56.282 INFO:tasks.workunit.client.1.smithi153.stdout:3/34: creat d1/fc x:0 0 0 2024-09-12T01:42:56.284 INFO:tasks.workunit.client.1.smithi153.stdout:3/35: rename d1/l7 to d1/ld 0 2024-09-12T01:42:56.285 INFO:tasks.workunit.client.1.smithi153.stdout:3/36: truncate d1/f2 220959 0 2024-09-12T01:42:56.286 INFO:tasks.workunit.client.1.smithi153.stdout:7/29: dread f0 [0,4194304] 0 2024-09-12T01:42:56.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/101: dwrite d17/d1f/f26 [0,4194304] 0 2024-09-12T01:42:56.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/102: stat d17/f1a 0 2024-09-12T01:42:56.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/103: write f16 [163025,75199] 0 2024-09-12T01:42:56.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/104: getdents d17/d1d/d27 0 2024-09-12T01:42:56.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/105: readlink d17/l1c 0 2024-09-12T01:42:56.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/106: dread - d17/f28 zero size 2024-09-12T01:42:56.294 INFO:tasks.workunit.client.1.smithi153.stdout:7/30: getdents . 0 2024-09-12T01:42:56.294 INFO:tasks.workunit.client.1.smithi153.stdout:7/31: getdents . 0 2024-09-12T01:42:56.294 INFO:tasks.workunit.client.1.smithi153.stdout:7/32: truncate f4 1922901 0 2024-09-12T01:42:56.295 INFO:tasks.workunit.client.1.smithi153.stdout:7/33: creat f7 x:0 0 0 2024-09-12T01:42:56.295 INFO:tasks.workunit.client.1.smithi153.stdout:9/74: write f1 [3087345,128899] 0 2024-09-12T01:42:56.299 INFO:tasks.workunit.client.1.smithi153.stdout:7/34: dread f0 [0,4194304] 0 2024-09-12T01:42:56.300 INFO:tasks.workunit.client.1.smithi153.stdout:7/35: rename f0 to f8 0 2024-09-12T01:42:56.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/36: symlink l9 0 2024-09-12T01:42:56.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/37: chown c2 338916731 1 2024-09-12T01:42:56.301 INFO:tasks.workunit.client.1.smithi153.stdout:7/38: mknod ca 0 2024-09-12T01:42:56.302 INFO:tasks.workunit.client.1.smithi153.stdout:7/39: creat fb x:0 0 0 2024-09-12T01:42:56.304 INFO:tasks.workunit.client.1.smithi153.stdout:7/40: dread f4 [0,4194304] 0 2024-09-12T01:42:56.304 INFO:tasks.workunit.client.1.smithi153.stdout:7/41: creat fc x:0 0 0 2024-09-12T01:42:56.304 INFO:tasks.workunit.client.1.smithi153.stdout:7/42: write fc [696082,627] 0 2024-09-12T01:42:56.304 INFO:tasks.workunit.client.1.smithi153.stdout:7/43: fdatasync f4 0 2024-09-12T01:42:56.304 INFO:tasks.workunit.client.1.smithi153.stdout:7/44: creat fd x:0 0 0 2024-09-12T01:42:56.305 INFO:tasks.workunit.client.1.smithi153.stdout:8/107: write f13 [3682574,67920] 0 2024-09-12T01:42:56.306 INFO:tasks.workunit.client.1.smithi153.stdout:3/37: dwrite d1/f8 [0,4194304] 0 2024-09-12T01:42:56.311 INFO:tasks.workunit.client.1.smithi153.stdout:9/75: dread f1 [0,4194304] 0 2024-09-12T01:42:56.311 INFO:tasks.workunit.client.1.smithi153.stdout:9/76: readlink d3/l10 0 2024-09-12T01:42:56.313 INFO:tasks.workunit.client.1.smithi153.stdout:3/38: mknod d1/ce 0 2024-09-12T01:42:56.313 INFO:tasks.workunit.client.1.smithi153.stdout:3/39: write d1/f4 [847980,3568] 0 2024-09-12T01:42:56.313 INFO:tasks.workunit.client.1.smithi153.stdout:3/40: chown d1/f5 14950 1 2024-09-12T01:42:56.317 INFO:tasks.workunit.client.1.smithi153.stdout:3/41: dread d1/f5 [0,4194304] 0 2024-09-12T01:42:56.317 INFO:tasks.workunit.client.1.smithi153.stdout:9/77: dread d3/f5 [0,4194304] 0 2024-09-12T01:42:56.321 INFO:tasks.workunit.client.1.smithi153.stdout:3/42: write d1/f5 [807923,57335] 0 2024-09-12T01:42:56.321 INFO:tasks.workunit.client.1.smithi153.stdout:8/108: dwrite d17/d1f/f26 [0,4194304] 0 2024-09-12T01:42:56.323 INFO:tasks.workunit.client.1.smithi153.stdout:8/109: truncate f16 737567 0 2024-09-12T01:42:56.326 INFO:tasks.workunit.client.1.smithi153.stdout:5/49: rmdir d0 39 2024-09-12T01:42:56.327 INFO:tasks.workunit.client.1.smithi153.stdout:5/50: link d0/f2 d0/fd 0 2024-09-12T01:42:56.330 INFO:tasks.workunit.client.1.smithi153.stdout:9/78: rmdir d3 39 2024-09-12T01:42:56.331 INFO:tasks.workunit.client.1.smithi153.stdout:9/79: creat d3/f11 x:0 0 0 2024-09-12T01:42:56.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/51: dread d0/f6 [0,4194304] 0 2024-09-12T01:42:56.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/52: truncate d0/fc 1018416 0 2024-09-12T01:42:56.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/53: readlink d0/l5 0 2024-09-12T01:42:56.333 INFO:tasks.workunit.client.1.smithi153.stdout:9/80: rename d3/cd to d3/c12 0 2024-09-12T01:42:56.333 INFO:tasks.workunit.client.1.smithi153.stdout:9/81: chown d3/fc 79247 1 2024-09-12T01:42:56.334 INFO:tasks.workunit.client.1.smithi153.stdout:9/82: creat d3/f13 x:0 0 0 2024-09-12T01:42:56.334 INFO:tasks.workunit.client.1.smithi153.stdout:9/83: chown d3/ff 0 1 2024-09-12T01:42:56.335 INFO:tasks.workunit.client.1.smithi153.stdout:8/110: dread d17/d1f/f26 [0,4194304] 0 2024-09-12T01:42:56.335 INFO:tasks.workunit.client.1.smithi153.stdout:8/111: getdents d17/d1d/d27 0 2024-09-12T01:42:56.337 INFO:tasks.workunit.client.1.smithi153.stdout:3/43: dread d1/f2 [0,4194304] 0 2024-09-12T01:42:56.337 INFO:tasks.workunit.client.1.smithi153.stdout:3/44: creat d1/ff x:0 0 0 2024-09-12T01:42:56.338 INFO:tasks.workunit.client.1.smithi153.stdout:6/115: truncate d1/d6/f15 553274 0 2024-09-12T01:42:56.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/45: dread d1/f4 [0,4194304] 0 2024-09-12T01:42:56.343 INFO:tasks.workunit.client.1.smithi153.stdout:6/116: mknod d1/d6/d23/c24 0 2024-09-12T01:42:56.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/46: symlink d1/l10 0 2024-09-12T01:42:56.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/47: read - d1/ff zero size 2024-09-12T01:42:56.345 INFO:tasks.workunit.client.1.smithi153.stdout:6/117: link d1/df/l13 d1/d6/da/l25 0 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/48: rename d1/f8 to d1/f11 0 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/49: read - d1/ff zero size 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/50: chown d1/f2 390252225 1 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/51: creat d1/f12 x:0 0 0 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/52: readlink d1/ld 0 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/53: stat d1/ld 0 2024-09-12T01:42:56.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/54: chown d1/f11 0 1 2024-09-12T01:42:56.348 INFO:tasks.workunit.client.1.smithi153.stdout:3/55: fsync d1/fc 0 2024-09-12T01:42:56.348 INFO:tasks.workunit.client.1.smithi153.stdout:7/45: getdents . 0 2024-09-12T01:42:56.349 INFO:tasks.workunit.client.1.smithi153.stdout:8/112: truncate f13 889064 0 2024-09-12T01:42:56.350 INFO:tasks.workunit.client.1.smithi153.stdout:5/54: dwrite d0/fc [0,4194304] 0 2024-09-12T01:42:56.351 INFO:tasks.workunit.client.1.smithi153.stdout:7/46: creat fe x:0 0 0 2024-09-12T01:42:56.352 INFO:tasks.workunit.client.1.smithi153.stdout:8/113: fdatasync f10 0 2024-09-12T01:42:56.354 INFO:tasks.workunit.client.0.smithi066.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-12T01:42:56.359 INFO:tasks.workunit.client.1.smithi153.stdout:6/118: dwrite d1/df/f12 [0,4194304] 0 2024-09-12T01:42:56.360 INFO:tasks.workunit.client.1.smithi153.stdout:5/55: getdents d0 0 2024-09-12T01:42:56.360 INFO:tasks.workunit.client.1.smithi153.stdout:5/56: read - d0/fb zero size 2024-09-12T01:42:56.362 INFO:tasks.workunit.client.1.smithi153.stdout:8/114: link d17/l1c d17/d1f/l2c 0 2024-09-12T01:42:56.363 INFO:tasks.workunit.client.1.smithi153.stdout:9/84: rmdir d3 39 2024-09-12T01:42:56.364 INFO:tasks.workunit.client.1.smithi153.stdout:9/85: stat d3/lb 0 2024-09-12T01:42:56.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/57: rmdir d0 39 2024-09-12T01:42:56.373 INFO:tasks.workunit.client.1.smithi153.stdout:3/56: truncate d1/f11 2162417 0 2024-09-12T01:42:56.374 INFO:tasks.workunit.client.1.smithi153.stdout:8/115: mkdir d17/d1d/d27/d2d 0 2024-09-12T01:42:56.375 INFO:tasks.workunit.client.1.smithi153.stdout:8/116: fdatasync d17/f29 0 2024-09-12T01:42:56.375 INFO:tasks.workunit.client.1.smithi153.stdout:9/86: creat d3/f14 x:0 0 0 2024-09-12T01:42:56.376 INFO:tasks.workunit.client.1.smithi153.stdout:5/58: creat d0/fe x:0 0 0 2024-09-12T01:42:56.377 INFO:tasks.workunit.client.1.smithi153.stdout:9/87: dread d3/f8 [0,4194304] 0 2024-09-12T01:42:56.377 INFO:tasks.workunit.client.1.smithi153.stdout:9/88: chown d3 52918 1 2024-09-12T01:42:56.377 INFO:tasks.workunit.client.1.smithi153.stdout:5/59: mkdir d0/df 0 2024-09-12T01:42:56.378 INFO:tasks.workunit.client.1.smithi153.stdout:8/117: link l7 d17/l2e 0 2024-09-12T01:42:56.379 INFO:tasks.workunit.client.1.smithi153.stdout:9/89: mknod d3/c15 0 2024-09-12T01:42:56.379 INFO:tasks.workunit.client.1.smithi153.stdout:9/90: write d3/f7 [681154,47586] 0 2024-09-12T01:42:56.379 INFO:tasks.workunit.client.1.smithi153.stdout:9/91: stat d3/f7 0 2024-09-12T01:42:56.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/60: creat d0/df/f10 x:0 0 0 2024-09-12T01:42:56.381 INFO:tasks.workunit.client.1.smithi153.stdout:5/61: symlink d0/df/l11 0 2024-09-12T01:42:56.381 INFO:tasks.workunit.client.1.smithi153.stdout:5/62: stat d0/c7 0 2024-09-12T01:42:56.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/63: creat d0/f12 x:0 0 0 2024-09-12T01:42:56.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/64: chown d0/fb 3673 1 2024-09-12T01:42:56.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/65: write d0/f8 [1371805,55676] 0 2024-09-12T01:42:56.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/66: chown d0/df/f10 3 1 2024-09-12T01:42:56.386 INFO:tasks.workunit.client.1.smithi153.stdout:9/92: dread d3/fe [0,4194304] 0 2024-09-12T01:42:56.386 INFO:tasks.workunit.client.1.smithi153.stdout:9/93: chown d3/l10 2933 1 2024-09-12T01:42:56.387 INFO:tasks.workunit.client.1.smithi153.stdout:9/94: symlink d3/l16 0 2024-09-12T01:42:56.387 INFO:tasks.workunit.client.1.smithi153.stdout:6/119: dwrite d1/f1f [0,4194304] 0 2024-09-12T01:42:56.388 INFO:tasks.workunit.client.1.smithi153.stdout:6/120: creat d1/df/f26 x:0 0 0 2024-09-12T01:42:56.388 INFO:tasks.workunit.client.1.smithi153.stdout:6/121: readlink d1/d6/l17 0 2024-09-12T01:42:56.388 INFO:tasks.workunit.client.1.smithi153.stdout:7/47: dwrite f4 [0,4194304] 0 2024-09-12T01:42:56.390 INFO:tasks.workunit.client.1.smithi153.stdout:9/95: symlink d3/l17 0 2024-09-12T01:42:56.390 INFO:tasks.workunit.client.1.smithi153.stdout:9/96: creat d3/f18 x:0 0 0 2024-09-12T01:42:56.397 INFO:tasks.workunit.client.1.smithi153.stdout:7/48: mknod cf 0 2024-09-12T01:42:56.398 INFO:tasks.workunit.client.1.smithi153.stdout:7/49: creat f10 x:0 0 0 2024-09-12T01:42:56.399 INFO:tasks.workunit.client.1.smithi153.stdout:7/50: write f8 [2103488,107193] 0 2024-09-12T01:42:56.404 INFO:tasks.workunit.client.1.smithi153.stdout:8/118: dwrite d17/f1a [0,4194304] 0 2024-09-12T01:42:56.404 INFO:tasks.workunit.client.1.smithi153.stdout:5/67: dwrite d0/fc [0,4194304] 0 2024-09-12T01:42:56.404 INFO:tasks.workunit.client.1.smithi153.stdout:5/68: chown d0/f6 0 1 2024-09-12T01:42:56.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:56 smithi153 ceph-mon[34713]: pgmap v238: 65 pgs: 65 active+clean; 204 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 683 KiB/s rd, 6.8 MiB/s wr, 714 op/s 2024-09-12T01:42:56.407 INFO:tasks.workunit.client.1.smithi153.stdout:8/119: rename d17/f29 to d17/f2f 0 2024-09-12T01:42:56.407 INFO:tasks.workunit.client.1.smithi153.stdout:8/120: readlink d17/d1f/l20 0 2024-09-12T01:42:56.407 INFO:tasks.workunit.client.1.smithi153.stdout:8/121: creat d17/d21/f30 x:0 0 0 2024-09-12T01:42:56.408 INFO:tasks.workunit.client.1.smithi153.stdout:8/122: truncate d17/f2f 3638359 0 2024-09-12T01:42:56.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/123: mknod d17/d1d/d27/c31 0 2024-09-12T01:42:56.413 INFO:tasks.workunit.client.1.smithi153.stdout:9/97: getdents d3 0 2024-09-12T01:42:56.413 INFO:tasks.workunit.client.1.smithi153.stdout:5/69: dread d0/f2 [0,4194304] 0 2024-09-12T01:42:56.413 INFO:tasks.workunit.client.1.smithi153.stdout:9/98: read d3/fe [2104842,8920] 0 2024-09-12T01:42:56.413 INFO:tasks.workunit.client.1.smithi153.stdout:6/122: truncate d1/f1f 3683425 0 2024-09-12T01:42:56.413 INFO:tasks.workunit.client.1.smithi153.stdout:5/70: symlink d0/df/l13 0 2024-09-12T01:42:56.415 INFO:tasks.workunit.client.1.smithi153.stdout:5/71: mknod d0/df/c14 0 2024-09-12T01:42:56.415 INFO:tasks.workunit.client.1.smithi153.stdout:5/72: chown d0/df 15246769 1 2024-09-12T01:42:56.415 INFO:tasks.workunit.client.1.smithi153.stdout:5/73: chown d0/fd 46 1 2024-09-12T01:42:56.415 INFO:tasks.workunit.client.1.smithi153.stdout:7/51: dwrite f10 [0,4194304] 0 2024-09-12T01:42:56.419 INFO:tasks.workunit.client.1.smithi153.stdout:4/53: sync 2024-09-12T01:42:56.419 INFO:tasks.workunit.client.1.smithi153.stdout:1/44: sync 2024-09-12T01:42:56.419 INFO:tasks.workunit.client.1.smithi153.stdout:4/54: write f4 [2602170,102553] 0 2024-09-12T01:42:56.419 INFO:tasks.workunit.client.1.smithi153.stdout:4/55: dread - d6/d9/f10 zero size 2024-09-12T01:42:56.420 INFO:tasks.workunit.client.1.smithi153.stdout:4/56: mkdir d6/d15 0 2024-09-12T01:42:56.420 INFO:tasks.workunit.client.1.smithi153.stdout:8/124: dread f6 [0,4194304] 0 2024-09-12T01:42:56.421 INFO:tasks.workunit.client.1.smithi153.stdout:5/74: write d0/f2 [2874147,128043] 0 2024-09-12T01:42:56.421 INFO:tasks.workunit.client.1.smithi153.stdout:5/75: write d0/f2 [2033799,74020] 0 2024-09-12T01:42:56.421 INFO:tasks.workunit.client.1.smithi153.stdout:4/57: creat d6/d9/d11/d13/f16 x:0 0 0 2024-09-12T01:42:56.422 INFO:tasks.workunit.client.1.smithi153.stdout:8/125: rename d17/d21/c23 to d17/d21/c32 0 2024-09-12T01:42:56.423 INFO:tasks.workunit.client.1.smithi153.stdout:7/52: link l3 l11 0 2024-09-12T01:42:56.425 INFO:tasks.workunit.client.1.smithi153.stdout:5/76: mkdir d0/d15 0 2024-09-12T01:42:56.426 INFO:tasks.workunit.client.1.smithi153.stdout:4/58: mkdir d6/d9/d17 0 2024-09-12T01:42:56.427 INFO:tasks.workunit.client.1.smithi153.stdout:4/59: creat d6/d9/d11/d13/f18 x:0 0 0 2024-09-12T01:42:56.427 INFO:tasks.workunit.client.1.smithi153.stdout:4/60: dread - d6/d9/d11/d13/f16 zero size 2024-09-12T01:42:56.427 INFO:tasks.workunit.client.1.smithi153.stdout:8/126: symlink d17/d1d/d27/l33 0 2024-09-12T01:42:56.429 INFO:tasks.workunit.client.1.smithi153.stdout:1/45: write d2/f6 [1935591,98045] 0 2024-09-12T01:42:56.429 INFO:tasks.workunit.client.1.smithi153.stdout:1/46: readlink d2/l4 0 2024-09-12T01:42:56.429 INFO:tasks.workunit.client.1.smithi153.stdout:7/53: unlink f8 0 2024-09-12T01:42:56.430 INFO:tasks.workunit.client.1.smithi153.stdout:3/57: truncate d1/f11 575557 0 2024-09-12T01:42:56.431 INFO:tasks.workunit.client.1.smithi153.stdout:5/77: rename d0/f6 to d0/d15/f16 0 2024-09-12T01:42:56.433 INFO:tasks.workunit.client.1.smithi153.stdout:8/127: truncate f10 1593116 0 2024-09-12T01:42:56.433 INFO:tasks.workunit.client.1.smithi153.stdout:8/128: dread - d17/d1f/f2a zero size 2024-09-12T01:42:56.434 INFO:tasks.workunit.client.1.smithi153.stdout:1/47: mknod d2/d9/cf 0 2024-09-12T01:42:56.435 INFO:tasks.workunit.client.1.smithi153.stdout:1/48: creat d2/f10 x:0 0 0 2024-09-12T01:42:56.436 INFO:tasks.workunit.client.1.smithi153.stdout:3/58: mkdir d1/d13 0 2024-09-12T01:42:56.438 INFO:tasks.workunit.client.1.smithi153.stdout:6/123: dwrite d1/df/f12 [0,4194304] 0 2024-09-12T01:42:56.438 INFO:tasks.workunit.client.1.smithi153.stdout:8/129: mkdir d17/d1d/d27/d2d/d34 0 2024-09-12T01:42:56.438 INFO:tasks.workunit.client.1.smithi153.stdout:9/99: dwrite d3/f7 [0,4194304] 0 2024-09-12T01:42:56.440 INFO:tasks.workunit.client.1.smithi153.stdout:7/54: mkdir d12 0 2024-09-12T01:42:56.441 INFO:tasks.workunit.client.1.smithi153.stdout:6/124: symlink d1/d6/da/d19/l27 0 2024-09-12T01:42:56.445 INFO:tasks.workunit.client.1.smithi153.stdout:9/100: mkdir d3/d19 0 2024-09-12T01:42:56.445 INFO:tasks.workunit.client.1.smithi153.stdout:9/101: write d3/f4 [887732,89154] 0 2024-09-12T01:42:56.445 INFO:tasks.workunit.client.1.smithi153.stdout:9/102: write d3/f4 [4499416,112369] 0 2024-09-12T01:42:56.446 INFO:tasks.workunit.client.1.smithi153.stdout:4/61: getdents d6 0 2024-09-12T01:42:56.448 INFO:tasks.workunit.client.1.smithi153.stdout:4/62: symlink d6/d15/l19 0 2024-09-12T01:42:56.448 INFO:tasks.workunit.client.1.smithi153.stdout:9/103: dread d3/f8 [0,4194304] 0 2024-09-12T01:42:56.450 INFO:tasks.workunit.client.1.smithi153.stdout:9/104: creat d3/d19/f1a x:0 0 0 2024-09-12T01:42:56.450 INFO:tasks.workunit.client.1.smithi153.stdout:9/105: creat d3/d19/f1b x:0 0 0 2024-09-12T01:42:56.450 INFO:tasks.workunit.client.1.smithi153.stdout:9/106: chown l2 8 1 2024-09-12T01:42:56.452 INFO:tasks.workunit.client.1.smithi153.stdout:7/55: dread f4 [0,4194304] 0 2024-09-12T01:42:56.452 INFO:tasks.workunit.client.1.smithi153.stdout:9/107: rename d3/l10 to d3/d19/l1c 0 2024-09-12T01:42:56.455 INFO:tasks.workunit.client.1.smithi153.stdout:9/108: creat d3/f1d x:0 0 0 2024-09-12T01:42:56.457 INFO:tasks.workunit.client.1.smithi153.stdout:7/56: unlink c2 0 2024-09-12T01:42:56.459 INFO:tasks.workunit.client.1.smithi153.stdout:7/57: write f7 [689945,78919] 0 2024-09-12T01:42:56.460 INFO:tasks.workunit.client.1.smithi153.stdout:4/63: write d6/fa [3768975,34236] 0 2024-09-12T01:42:56.461 INFO:tasks.workunit.client.1.smithi153.stdout:7/58: symlink d12/l13 0 2024-09-12T01:42:56.462 INFO:tasks.workunit.client.1.smithi153.stdout:7/59: creat d12/f14 x:0 0 0 2024-09-12T01:42:56.463 INFO:tasks.workunit.client.1.smithi153.stdout:7/60: truncate fb 218703 0 2024-09-12T01:42:56.464 INFO:tasks.workunit.client.1.smithi153.stdout:7/61: readlink l6 0 2024-09-12T01:42:56.464 INFO:tasks.workunit.client.1.smithi153.stdout:4/64: dread f0 [4194304,4194304] 0 2024-09-12T01:42:56.464 INFO:tasks.workunit.client.1.smithi153.stdout:4/65: write d6/d9/d11/d13/f18 [835738,117216] 0 2024-09-12T01:42:56.464 INFO:tasks.workunit.client.1.smithi153.stdout:4/66: chown f4 0 1 2024-09-12T01:42:56.465 INFO:tasks.workunit.client.1.smithi153.stdout:7/62: mknod d12/c15 0 2024-09-12T01:42:56.465 INFO:tasks.workunit.client.1.smithi153.stdout:7/63: creat d12/f16 x:0 0 0 2024-09-12T01:42:56.469 INFO:tasks.workunit.client.1.smithi153.stdout:7/64: write f4 [2923624,72540] 0 2024-09-12T01:42:56.469 INFO:tasks.workunit.client.1.smithi153.stdout:7/65: creat d12/f17 x:0 0 0 2024-09-12T01:42:56.469 INFO:tasks.workunit.client.1.smithi153.stdout:7/66: dread - fe zero size 2024-09-12T01:42:56.469 INFO:tasks.workunit.client.1.smithi153.stdout:7/67: write f7 [1448842,13906] 0 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:7/68: symlink d12/l18 0 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:7/69: creat d12/f19 x:0 0 0 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:7/70: dread - d12/f17 zero size 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:1/49: dwrite d2/f6 [0,4194304] 0 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:6/125: dwrite d1/f1f [0,4194304] 0 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:5/78: dwrite d0/df/f10 [0,4194304] 0 2024-09-12T01:42:56.471 INFO:tasks.workunit.client.1.smithi153.stdout:5/79: write d0/f12 [409340,11766] 0 2024-09-12T01:42:56.475 INFO:tasks.workunit.client.1.smithi153.stdout:1/50: mknod d2/c11 0 2024-09-12T01:42:56.477 INFO:tasks.workunit.client.1.smithi153.stdout:5/80: creat d0/d15/f17 x:0 0 0 2024-09-12T01:42:56.481 INFO:tasks.workunit.client.1.smithi153.stdout:1/51: rename d2/f3 to d2/d9/f12 0 2024-09-12T01:42:56.483 INFO:tasks.workunit.client.1.smithi153.stdout:6/126: write d1/f1d [1668460,122261] 0 2024-09-12T01:42:56.483 INFO:tasks.workunit.client.1.smithi153.stdout:4/67: dwrite d6/d9/f10 [0,4194304] 0 2024-09-12T01:42:56.483 INFO:tasks.workunit.client.1.smithi153.stdout:4/68: dread - d6/d9/d11/d13/f16 zero size 2024-09-12T01:42:56.483 INFO:tasks.workunit.client.1.smithi153.stdout:5/81: symlink d0/df/l18 0 2024-09-12T01:42:56.484 INFO:tasks.workunit.client.1.smithi153.stdout:9/109: getdents d3/d19 0 2024-09-12T01:42:56.484 INFO:tasks.workunit.client.1.smithi153.stdout:5/82: stat d0/l5 0 2024-09-12T01:42:56.484 INFO:tasks.workunit.client.1.smithi153.stdout:9/110: write d3/f5 [5675676,111608] 0 2024-09-12T01:42:56.488 INFO:tasks.workunit.client.1.smithi153.stdout:4/69: truncate f0 6545 0 2024-09-12T01:42:56.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/83: mkdir d0/d15/d19 0 2024-09-12T01:42:56.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/84: chown d0/ca 993872911 1 2024-09-12T01:42:56.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/85: chown d0/df 1 1 2024-09-12T01:42:56.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/86: creat d0/d15/f1a x:0 0 0 2024-09-12T01:42:56.495 INFO:tasks.workunit.client.1.smithi153.stdout:7/71: getdents d12 0 2024-09-12T01:42:56.495 INFO:tasks.workunit.client.1.smithi153.stdout:7/72: write d12/f17 [1001442,118439] 0 2024-09-12T01:42:56.496 INFO:tasks.workunit.client.1.smithi153.stdout:9/111: getdents d3 0 2024-09-12T01:42:56.496 INFO:tasks.workunit.client.1.smithi153.stdout:9/112: truncate d3/ff 55192 0 2024-09-12T01:42:56.499 INFO:tasks.workunit.client.1.smithi153.stdout:7/73: rmdir d12 39 2024-09-12T01:42:56.500 INFO:tasks.workunit.client.1.smithi153.stdout:7/74: write d12/f17 [1530564,35254] 0 2024-09-12T01:42:56.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/52: dwrite f0 [0,4194304] 0 2024-09-12T01:42:56.500 INFO:tasks.workunit.client.1.smithi153.stdout:9/113: creat d3/d19/f1e x:0 0 0 2024-09-12T01:42:56.501 INFO:tasks.workunit.client.1.smithi153.stdout:7/75: mknod d12/c1a 0 2024-09-12T01:42:56.502 INFO:tasks.workunit.client.1.smithi153.stdout:1/53: truncate d2/f6 1625726 0 2024-09-12T01:42:56.503 INFO:tasks.workunit.client.1.smithi153.stdout:1/54: fsync d2/f10 0 2024-09-12T01:42:56.506 INFO:tasks.workunit.client.1.smithi153.stdout:7/76: creat d12/f1b x:0 0 0 2024-09-12T01:42:56.506 INFO:tasks.workunit.client.1.smithi153.stdout:7/77: read f4 [722121,89384] 0 2024-09-12T01:42:56.506 INFO:tasks.workunit.client.1.smithi153.stdout:5/87: rmdir d0 39 2024-09-12T01:42:56.506 INFO:tasks.workunit.client.1.smithi153.stdout:5/88: write d0/f12 [1005575,104130] 0 2024-09-12T01:42:56.509 INFO:tasks.workunit.client.1.smithi153.stdout:5/89: creat d0/df/f1b x:0 0 0 2024-09-12T01:42:56.511 INFO:tasks.workunit.client.1.smithi153.stdout:5/90: mkdir d0/df/d1c 0 2024-09-12T01:42:56.513 INFO:tasks.workunit.client.1.smithi153.stdout:5/91: rename d0/df/l18 to d0/df/l1d 0 2024-09-12T01:42:56.513 INFO:tasks.workunit.client.1.smithi153.stdout:5/92: creat d0/df/f1e x:0 0 0 2024-09-12T01:42:56.528 INFO:tasks.workunit.client.1.smithi153.stdout:5/93: dread d0/df/f10 [0,4194304] 0 2024-09-12T01:42:56.531 INFO:tasks.workunit.client.1.smithi153.stdout:1/55: dwrite d2/d9/f12 [0,4194304] 0 2024-09-12T01:42:56.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/114: dwrite d3/fc [0,4194304] 0 2024-09-12T01:42:56.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/115: write d3/f8 [1375922,96094] 0 2024-09-12T01:42:56.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/116: write d3/f18 [957045,95587] 0 2024-09-12T01:42:56.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/117: read d3/f4 [4344313,31429] 0 2024-09-12T01:42:56.532 INFO:tasks.workunit.client.1.smithi153.stdout:1/56: rename d2/d9/cf to d2/d9/c13 0 2024-09-12T01:42:56.533 INFO:tasks.workunit.client.1.smithi153.stdout:9/118: creat d3/f1f x:0 0 0 2024-09-12T01:42:56.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/78: dwrite fd [0,4194304] 0 2024-09-12T01:42:56.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/79: fsync d12/f1b 0 2024-09-12T01:42:56.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/80: write fe [29796,125452] 0 2024-09-12T01:42:56.538 INFO:tasks.workunit.client.1.smithi153.stdout:9/119: symlink d3/l20 0 2024-09-12T01:42:56.544 INFO:tasks.workunit.client.1.smithi153.stdout:5/94: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:42:56.545 INFO:tasks.workunit.client.1.smithi153.stdout:7/81: fdatasync fe 0 2024-09-12T01:42:56.545 INFO:tasks.workunit.client.1.smithi153.stdout:7/82: creat d12/f1c x:0 0 0 2024-09-12T01:42:56.545 INFO:tasks.workunit.client.1.smithi153.stdout:7/83: fdatasync fe 0 2024-09-12T01:42:56.546 INFO:tasks.workunit.client.1.smithi153.stdout:5/95: rename d0/d15/f17 to d0/f1f 0 2024-09-12T01:42:56.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/84: dread fe [0,4194304] 0 2024-09-12T01:42:56.547 INFO:tasks.workunit.client.1.smithi153.stdout:7/85: stat f7 0 2024-09-12T01:42:56.548 INFO:tasks.workunit.client.1.smithi153.stdout:5/96: mkdir d0/d20 0 2024-09-12T01:42:56.550 INFO:tasks.workunit.client.1.smithi153.stdout:5/97: write d0/f8 [1214208,32631] 0 2024-09-12T01:42:56.559 INFO:tasks.workunit.client.1.smithi153.stdout:9/120: dwrite d3/d19/f1e [0,4194304] 0 2024-09-12T01:42:56.577 INFO:tasks.workunit.client.1.smithi153.stdout:7/86: dwrite f4 [0,4194304] 0 2024-09-12T01:42:56.578 INFO:tasks.workunit.client.1.smithi153.stdout:5/98: dwrite d0/df/f1e [0,4194304] 0 2024-09-12T01:42:56.578 INFO:tasks.workunit.client.1.smithi153.stdout:5/99: dread - d0/fe zero size 2024-09-12T01:42:56.578 INFO:tasks.workunit.client.1.smithi153.stdout:7/87: symlink d12/l1d 0 2024-09-12T01:42:56.578 INFO:tasks.workunit.client.1.smithi153.stdout:7/88: dread - d12/f1b zero size 2024-09-12T01:42:56.581 INFO:tasks.workunit.client.1.smithi153.stdout:7/89: dread f7 [0,4194304] 0 2024-09-12T01:42:56.583 INFO:tasks.workunit.client.1.smithi153.stdout:9/121: dread d3/f7 [0,4194304] 0 2024-09-12T01:42:56.583 INFO:tasks.workunit.client.1.smithi153.stdout:7/90: getdents d12 0 2024-09-12T01:42:56.583 INFO:tasks.workunit.client.1.smithi153.stdout:7/91: readlink l3 0 2024-09-12T01:42:56.587 INFO:tasks.workunit.client.1.smithi153.stdout:2/64: sync 2024-09-12T01:42:56.587 INFO:tasks.workunit.client.1.smithi153.stdout:0/54: sync 2024-09-12T01:42:56.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/65: mknod d7/c10 0 2024-09-12T01:42:56.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/66: chown f1 1441339 1 2024-09-12T01:42:56.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/67: write d7/fe [477696,53416] 0 2024-09-12T01:42:56.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/68: creat d7/f11 x:0 0 0 2024-09-12T01:42:56.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/69: truncate d7/fe 1294998 0 2024-09-12T01:42:56.595 INFO:tasks.workunit.client.1.smithi153.stdout:2/70: dread f1 [0,4194304] 0 2024-09-12T01:42:56.597 INFO:tasks.workunit.client.1.smithi153.stdout:2/71: rename d7/la to d7/l12 0 2024-09-12T01:42:56.621 INFO:tasks.workunit.client.1.smithi153.stdout:9/122: dwrite d3/fc [0,4194304] 0 2024-09-12T01:42:56.621 INFO:tasks.workunit.client.1.smithi153.stdout:9/123: write d3/f11 [786768,50567] 0 2024-09-12T01:42:56.621 INFO:tasks.workunit.client.1.smithi153.stdout:9/124: write d3/d19/f1a [185724,104364] 0 2024-09-12T01:42:56.621 INFO:tasks.workunit.client.1.smithi153.stdout:9/125: write d3/fe [2733873,9792] 0 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:9/126: read d3/f18 [844454,79848] 0 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:9/127: dread - d3/f1d zero size 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:9/128: chown d3/d19/f1a 442708920 1 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:0/55: dwrite fa [0,4194304] 0 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:7/92: dwrite fe [0,4194304] 0 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:2/72: dwrite f1 [0,4194304] 0 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:9/129: symlink d3/d19/l21 0 2024-09-12T01:42:56.622 INFO:tasks.workunit.client.1.smithi153.stdout:0/56: creat f18 x:0 0 0 2024-09-12T01:42:56.623 INFO:tasks.workunit.client.1.smithi153.stdout:7/93: mknod d12/c1e 0 2024-09-12T01:42:56.628 INFO:tasks.workunit.client.1.smithi153.stdout:9/130: unlink c0 0 2024-09-12T01:42:56.629 INFO:tasks.workunit.client.1.smithi153.stdout:9/131: write d3/f8 [533564,45438] 0 2024-09-12T01:42:56.629 INFO:tasks.workunit.client.1.smithi153.stdout:9/132: chown d3/f13 82561413 1 2024-09-12T01:42:56.630 INFO:tasks.workunit.client.1.smithi153.stdout:7/94: mknod d12/c1f 0 2024-09-12T01:42:56.630 INFO:tasks.workunit.client.1.smithi153.stdout:7/95: fdatasync d12/f19 0 2024-09-12T01:42:56.630 INFO:tasks.workunit.client.1.smithi153.stdout:0/57: mknod c19 0 2024-09-12T01:42:56.632 INFO:tasks.workunit.client.1.smithi153.stdout:9/133: unlink d3/l16 0 2024-09-12T01:42:56.632 INFO:tasks.workunit.client.1.smithi153.stdout:9/134: write d3/f1f [367697,76641] 0 2024-09-12T01:42:56.636 INFO:tasks.workunit.client.1.smithi153.stdout:2/73: dwrite f2 [4194304,4194304] 0 2024-09-12T01:42:56.636 INFO:tasks.workunit.client.1.smithi153.stdout:2/74: truncate d7/f11 784566 0 2024-09-12T01:42:56.637 INFO:tasks.workunit.client.1.smithi153.stdout:2/75: mkdir d7/db/d13 0 2024-09-12T01:42:56.637 INFO:tasks.workunit.client.1.smithi153.stdout:2/76: write d7/f11 [1060065,13692] 0 2024-09-12T01:42:56.638 INFO:tasks.workunit.client.1.smithi153.stdout:2/77: mknod d7/db/d13/c14 0 2024-09-12T01:42:56.639 INFO:tasks.workunit.client.1.smithi153.stdout:2/78: stat d7 0 2024-09-12T01:42:56.639 INFO:tasks.workunit.client.1.smithi153.stdout:9/135: fdatasync d3/f1f 0 2024-09-12T01:42:56.639 INFO:tasks.workunit.client.1.smithi153.stdout:9/136: write d3/f5 [6327664,23846] 0 2024-09-12T01:42:56.639 INFO:tasks.workunit.client.1.smithi153.stdout:9/137: chown d3 1250 1 2024-09-12T01:42:56.639 INFO:tasks.workunit.client.1.smithi153.stdout:9/138: truncate d3/f11 999904 0 2024-09-12T01:42:56.640 INFO:tasks.workunit.client.1.smithi153.stdout:9/139: creat d3/d19/f22 x:0 0 0 2024-09-12T01:42:56.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:56 smithi066 ceph-mon[27875]: pgmap v238: 65 pgs: 65 active+clean; 204 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 683 KiB/s rd, 6.8 MiB/s wr, 714 op/s 2024-09-12T01:42:56.641 INFO:tasks.workunit.client.1.smithi153.stdout:9/140: mknod d3/c23 0 2024-09-12T01:42:56.642 INFO:tasks.workunit.client.1.smithi153.stdout:7/96: dread f4 [0,4194304] 0 2024-09-12T01:42:56.642 INFO:tasks.workunit.client.1.smithi153.stdout:9/141: rename d3/d19/f1b to d3/f24 0 2024-09-12T01:42:56.643 INFO:tasks.workunit.client.1.smithi153.stdout:7/97: write f4 [2941837,90734] 0 2024-09-12T01:42:56.643 INFO:tasks.workunit.client.1.smithi153.stdout:7/98: truncate d12/f19 530239 0 2024-09-12T01:42:56.644 INFO:tasks.workunit.client.1.smithi153.stdout:0/58: dwrite f13 [0,4194304] 0 2024-09-12T01:42:56.650 INFO:tasks.workunit.client.1.smithi153.stdout:2/79: rmdir d7/db 39 2024-09-12T01:42:56.652 INFO:tasks.workunit.client.1.smithi153.stdout:3/59: sync 2024-09-12T01:42:56.652 INFO:tasks.workunit.client.1.smithi153.stdout:3/60: readlink d1/lb 0 2024-09-12T01:42:56.652 INFO:tasks.workunit.client.1.smithi153.stdout:3/61: truncate d1/f2 960038 0 2024-09-12T01:42:56.652 INFO:tasks.workunit.client.1.smithi153.stdout:3/62: dread - d1/ff zero size 2024-09-12T01:42:56.656 INFO:tasks.workunit.client.1.smithi153.stdout:0/59: link c19 c1a 0 2024-09-12T01:42:56.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/80: creat d7/db/f15 x:0 0 0 2024-09-12T01:42:56.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/81: stat d7/c10 0 2024-09-12T01:42:56.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/82: fsync d7/db/ff 0 2024-09-12T01:42:56.662 INFO:tasks.workunit.client.1.smithi153.stdout:2/83: rename d7/db/d13/c14 to d7/db/d13/c16 0 2024-09-12T01:42:56.666 INFO:tasks.workunit.client.1.smithi153.stdout:3/63: dwrite d1/f2 [0,4194304] 0 2024-09-12T01:42:56.666 INFO:tasks.workunit.client.1.smithi153.stdout:3/64: fdatasync d1/f4 0 2024-09-12T01:42:56.668 INFO:tasks.workunit.client.1.smithi153.stdout:0/60: getdents . 0 2024-09-12T01:42:56.669 INFO:tasks.workunit.client.1.smithi153.stdout:3/65: mknod d1/d13/c14 0 2024-09-12T01:42:56.671 INFO:tasks.workunit.client.1.smithi153.stdout:3/66: unlink d1/d13/c14 0 2024-09-12T01:42:56.671 INFO:tasks.workunit.client.1.smithi153.stdout:0/61: dread f6 [0,4194304] 0 2024-09-12T01:42:56.671 INFO:tasks.workunit.client.1.smithi153.stdout:0/62: write f13 [4289671,109072] 0 2024-09-12T01:42:56.672 INFO:tasks.workunit.client.1.smithi153.stdout:2/84: rename d7/db/d13 to d7/d17 0 2024-09-12T01:42:56.672 INFO:tasks.workunit.client.1.smithi153.stdout:3/67: symlink d1/l15 0 2024-09-12T01:42:56.673 INFO:tasks.workunit.client.1.smithi153.stdout:0/63: creat f1b x:0 0 0 2024-09-12T01:42:56.675 INFO:tasks.workunit.client.1.smithi153.stdout:3/68: unlink d1/ld 0 2024-09-12T01:42:56.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/64: mknod c1c 0 2024-09-12T01:42:56.676 INFO:tasks.workunit.client.1.smithi153.stdout:3/69: mkdir d1/d16 0 2024-09-12T01:42:56.676 INFO:tasks.workunit.client.1.smithi153.stdout:3/70: truncate d1/f11 1394405 0 2024-09-12T01:42:56.676 INFO:tasks.workunit.client.1.smithi153.stdout:3/71: dread - d1/ff zero size 2024-09-12T01:42:56.677 INFO:tasks.workunit.client.1.smithi153.stdout:0/65: mknod c1d 0 2024-09-12T01:42:56.678 INFO:tasks.workunit.client.1.smithi153.stdout:3/72: mkdir d1/d16/d17 0 2024-09-12T01:42:56.678 INFO:tasks.workunit.client.1.smithi153.stdout:2/85: rmdir d7/d17 39 2024-09-12T01:42:56.678 INFO:tasks.workunit.client.1.smithi153.stdout:2/86: stat d7/f11 0 2024-09-12T01:42:56.679 INFO:tasks.workunit.client.1.smithi153.stdout:2/87: read - d7/db/f15 zero size 2024-09-12T01:42:56.679 INFO:tasks.workunit.client.1.smithi153.stdout:2/88: stat d7/c10 0 2024-09-12T01:42:56.679 INFO:tasks.workunit.client.1.smithi153.stdout:0/66: mknod c1e 0 2024-09-12T01:42:56.680 INFO:tasks.workunit.client.1.smithi153.stdout:2/89: mknod d7/d17/c18 0 2024-09-12T01:42:56.681 INFO:tasks.workunit.client.1.smithi153.stdout:2/90: mkdir d7/d19 0 2024-09-12T01:42:56.682 INFO:tasks.workunit.client.1.smithi153.stdout:2/91: rename d7/l12 to d7/db/l1a 0 2024-09-12T01:42:56.683 INFO:tasks.workunit.client.1.smithi153.stdout:2/92: creat d7/d17/f1b x:0 0 0 2024-09-12T01:42:56.684 INFO:tasks.workunit.client.1.smithi153.stdout:2/93: link d7/d17/f1b d7/f1c 0 2024-09-12T01:42:56.685 INFO:tasks.workunit.client.1.smithi153.stdout:2/94: truncate d7/db/ff 1669326 0 2024-09-12T01:42:56.690 INFO:tasks.workunit.client.1.smithi153.stdout:2/95: dread d7/f11 [0,4194304] 0 2024-09-12T01:42:56.698 INFO:tasks.workunit.client.1.smithi153.stdout:2/96: read f1 [605273,73742] 0 2024-09-12T01:42:56.703 INFO:tasks.workunit.client.1.smithi153.stdout:0/67: dwrite f18 [0,4194304] 0 2024-09-12T01:42:56.703 INFO:tasks.workunit.client.1.smithi153.stdout:0/68: truncate f3 834026 0 2024-09-12T01:42:56.703 INFO:tasks.workunit.client.1.smithi153.stdout:0/69: chown c14 37 1 2024-09-12T01:42:56.703 INFO:tasks.workunit.client.1.smithi153.stdout:3/73: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:42:56.703 INFO:tasks.workunit.client.1.smithi153.stdout:3/74: chown d1/ca 19826784 1 2024-09-12T01:42:56.703 INFO:tasks.workunit.client.1.smithi153.stdout:3/75: fdatasync d1/f2 0 2024-09-12T01:42:56.706 INFO:tasks.workunit.client.1.smithi153.stdout:0/70: symlink l1f 0 2024-09-12T01:42:56.706 INFO:tasks.workunit.client.1.smithi153.stdout:0/71: truncate f11 70217 0 2024-09-12T01:42:56.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/76: dread d1/f5 [0,4194304] 0 2024-09-12T01:42:56.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/77: chown d1/ff 6331 1 2024-09-12T01:42:56.708 INFO:tasks.workunit.client.1.smithi153.stdout:3/78: truncate d1/f5 1643046 0 2024-09-12T01:42:56.708 INFO:tasks.workunit.client.1.smithi153.stdout:3/79: readlink d1/l10 0 2024-09-12T01:42:56.708 INFO:tasks.workunit.client.1.smithi153.stdout:3/80: truncate d1/ff 395979 0 2024-09-12T01:42:56.708 INFO:tasks.workunit.client.1.smithi153.stdout:3/81: fsync d1/f9 0 2024-09-12T01:42:56.709 INFO:tasks.workunit.client.1.smithi153.stdout:3/82: rename d1/ff to d1/d16/d17/f18 0 2024-09-12T01:42:56.711 INFO:tasks.workunit.client.1.smithi153.stdout:3/83: link d1/fc d1/f19 0 2024-09-12T01:42:56.711 INFO:tasks.workunit.client.1.smithi153.stdout:3/84: fdatasync d1/f4 0 2024-09-12T01:42:56.711 INFO:tasks.workunit.client.1.smithi153.stdout:3/85: creat d1/f1a x:0 0 0 2024-09-12T01:42:56.713 INFO:tasks.workunit.client.1.smithi153.stdout:3/86: rename d1/f9 to d1/d16/f1b 0 2024-09-12T01:42:56.714 INFO:tasks.workunit.client.1.smithi153.stdout:3/87: mkdir d1/d16/d1c 0 2024-09-12T01:42:56.714 INFO:tasks.workunit.client.1.smithi153.stdout:3/88: dread - d1/f19 zero size 2024-09-12T01:42:56.718 INFO:tasks.workunit.client.1.smithi153.stdout:6/127: sync 2024-09-12T01:42:56.719 INFO:tasks.workunit.client.1.smithi153.stdout:4/70: sync 2024-09-12T01:42:56.719 INFO:tasks.workunit.client.1.smithi153.stdout:8/130: sync 2024-09-12T01:42:56.720 INFO:tasks.workunit.client.1.smithi153.stdout:0/72: dwrite f15 [0,4194304] 0 2024-09-12T01:42:56.720 INFO:tasks.workunit.client.1.smithi153.stdout:4/71: mknod d6/d9/dc/c1a 0 2024-09-12T01:42:56.722 INFO:tasks.workunit.client.1.smithi153.stdout:4/72: symlink d6/l1b 0 2024-09-12T01:42:56.730 INFO:tasks.workunit.client.1.smithi153.stdout:6/128: write d1/f1f [299418,75138] 0 2024-09-12T01:42:56.731 INFO:tasks.workunit.client.1.smithi153.stdout:8/131: dread f13 [0,4194304] 0 2024-09-12T01:42:56.731 INFO:tasks.workunit.client.1.smithi153.stdout:8/132: chown d17/l1c 1029978 1 2024-09-12T01:42:56.732 INFO:tasks.workunit.client.1.smithi153.stdout:6/129: link d1/f1f d1/d6/da/d19/d1e/f28 0 2024-09-12T01:42:56.733 INFO:tasks.workunit.client.1.smithi153.stdout:3/89: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:42:56.734 INFO:tasks.workunit.client.1.smithi153.stdout:0/73: write f15 [2352102,46775] 0 2024-09-12T01:42:56.734 INFO:tasks.workunit.client.1.smithi153.stdout:6/130: creat d1/d6/d23/f29 x:0 0 0 2024-09-12T01:42:56.736 INFO:tasks.workunit.client.1.smithi153.stdout:8/133: rmdir d17 39 2024-09-12T01:42:56.738 INFO:tasks.workunit.client.1.smithi153.stdout:0/74: truncate f4 688355 0 2024-09-12T01:42:56.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/73: dwrite f4 [0,4194304] 0 2024-09-12T01:42:56.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/74: write f0 [424533,3941] 0 2024-09-12T01:42:56.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/75: fsync d6/d9/f10 0 2024-09-12T01:42:56.740 INFO:tasks.workunit.client.1.smithi153.stdout:6/131: link d1/d6/d23/f29 d1/d6/da/d19/d1e/f2a 0 2024-09-12T01:42:56.741 INFO:tasks.workunit.client.1.smithi153.stdout:6/132: fsync d1/df/f26 0 2024-09-12T01:42:56.741 INFO:tasks.workunit.client.1.smithi153.stdout:8/134: dread - f15 zero size 2024-09-12T01:42:56.743 INFO:tasks.workunit.client.1.smithi153.stdout:3/90: dread d1/f2 [0,4194304] 0 2024-09-12T01:42:56.744 INFO:tasks.workunit.client.1.smithi153.stdout:3/91: symlink d1/d16/d1c/l1d 0 2024-09-12T01:42:56.745 INFO:tasks.workunit.client.1.smithi153.stdout:3/92: chown d1/f5 1644 1 2024-09-12T01:42:56.745 INFO:tasks.workunit.client.1.smithi153.stdout:3/93: write d1/f19 [416920,124785] 0 2024-09-12T01:42:56.745 INFO:tasks.workunit.client.1.smithi153.stdout:3/94: stat d1/f4 0 2024-09-12T01:42:56.746 INFO:tasks.workunit.client.1.smithi153.stdout:4/76: dread f0 [0,4194304] 0 2024-09-12T01:42:56.747 INFO:tasks.workunit.client.1.smithi153.stdout:3/95: getdents d1/d16 0 2024-09-12T01:42:56.747 INFO:tasks.workunit.client.1.smithi153.stdout:3/96: write d1/f19 [878070,20538] 0 2024-09-12T01:42:56.748 INFO:tasks.workunit.client.1.smithi153.stdout:4/77: creat d6/d9/d11/f1c x:0 0 0 2024-09-12T01:42:56.748 INFO:tasks.workunit.client.1.smithi153.stdout:4/78: stat d6/d9/ld 0 2024-09-12T01:42:56.748 INFO:tasks.workunit.client.1.smithi153.stdout:4/79: chown d6/d9/d11/d14 48242 1 2024-09-12T01:42:56.749 INFO:tasks.workunit.client.1.smithi153.stdout:0/75: read f18 [3148164,73067] 0 2024-09-12T01:42:56.749 INFO:tasks.workunit.client.1.smithi153.stdout:4/80: mknod d6/d9/d17/c1d 0 2024-09-12T01:42:56.749 INFO:tasks.workunit.client.1.smithi153.stdout:8/135: dread d17/f1a [0,4194304] 0 2024-09-12T01:42:56.749 INFO:tasks.workunit.client.1.smithi153.stdout:8/136: chown d17/f28 422 1 2024-09-12T01:42:56.750 INFO:tasks.workunit.client.1.smithi153.stdout:8/137: creat d17/d1d/d27/f35 x:0 0 0 2024-09-12T01:42:56.750 INFO:tasks.workunit.client.1.smithi153.stdout:3/97: dread d1/f5 [0,4194304] 0 2024-09-12T01:42:56.750 INFO:tasks.workunit.client.1.smithi153.stdout:3/98: stat d1/l15 0 2024-09-12T01:42:56.751 INFO:tasks.workunit.client.1.smithi153.stdout:0/76: getdents . 0 2024-09-12T01:42:56.751 INFO:tasks.workunit.client.1.smithi153.stdout:4/81: dread d6/d9/d11/d13/f18 [0,4194304] 0 2024-09-12T01:42:56.751 INFO:tasks.workunit.client.1.smithi153.stdout:4/82: chown d6/fe 24 1 2024-09-12T01:42:56.752 INFO:tasks.workunit.client.1.smithi153.stdout:4/83: creat d6/d9/d11/f1e x:0 0 0 2024-09-12T01:42:56.752 INFO:tasks.workunit.client.1.smithi153.stdout:4/84: chown d6/d9/d11/d13/f16 744416 1 2024-09-12T01:42:56.752 INFO:tasks.workunit.client.1.smithi153.stdout:8/138: creat d17/d1d/f36 x:0 0 0 2024-09-12T01:42:56.753 INFO:tasks.workunit.client.1.smithi153.stdout:8/139: write f16 [134874,60673] 0 2024-09-12T01:42:56.759 INFO:tasks.workunit.client.1.smithi153.stdout:8/140: dread f13 [0,4194304] 0 2024-09-12T01:42:56.760 INFO:tasks.workunit.client.1.smithi153.stdout:8/141: mknod d17/d21/c37 0 2024-09-12T01:42:56.761 INFO:tasks.workunit.client.1.smithi153.stdout:8/142: symlink d17/d1d/d27/d2d/d34/l38 0 2024-09-12T01:42:56.762 INFO:tasks.workunit.client.1.smithi153.stdout:0/77: dread f13 [0,4194304] 0 2024-09-12T01:42:56.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/78: dread f13 [0,4194304] 0 2024-09-12T01:42:56.773 INFO:tasks.workunit.client.1.smithi153.stdout:0/79: dread f8 [0,4194304] 0 2024-09-12T01:42:56.776 INFO:tasks.workunit.client.1.smithi153.stdout:0/80: dread f6 [0,4194304] 0 2024-09-12T01:42:56.776 INFO:tasks.workunit.client.1.smithi153.stdout:0/81: dread - fd zero size 2024-09-12T01:42:56.777 INFO:tasks.workunit.client.1.smithi153.stdout:0/82: rename f11 to f20 0 2024-09-12T01:42:56.777 INFO:tasks.workunit.client.1.smithi153.stdout:0/83: creat f21 x:0 0 0 2024-09-12T01:42:56.778 INFO:tasks.workunit.client.1.smithi153.stdout:0/84: truncate fa 24225 0 2024-09-12T01:42:56.778 INFO:tasks.workunit.client.1.smithi153.stdout:0/85: stat f13 0 2024-09-12T01:42:56.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/86: mkdir d22 0 2024-09-12T01:42:56.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/87: readlink l9 0 2024-09-12T01:42:56.781 INFO:tasks.workunit.client.1.smithi153.stdout:8/143: dwrite d17/f24 [0,4194304] 0 2024-09-12T01:42:56.781 INFO:tasks.workunit.client.1.smithi153.stdout:4/85: dwrite f0 [0,4194304] 0 2024-09-12T01:42:56.781 INFO:tasks.workunit.client.1.smithi153.stdout:3/99: dwrite d1/f5 [0,4194304] 0 2024-09-12T01:42:56.783 INFO:tasks.workunit.client.1.smithi153.stdout:8/144: link f6 d17/d1f/f39 0 2024-09-12T01:42:56.784 INFO:tasks.workunit.client.1.smithi153.stdout:4/86: symlink d6/l1f 0 2024-09-12T01:42:56.791 INFO:tasks.workunit.client.1.smithi153.stdout:3/100: mkdir d1/d1e 0 2024-09-12T01:42:56.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/145: mkdir d17/d21/d3a 0 2024-09-12T01:42:56.794 INFO:tasks.workunit.client.1.smithi153.stdout:4/87: mkdir d6/d9/d20 0 2024-09-12T01:42:56.795 INFO:tasks.workunit.client.1.smithi153.stdout:3/101: creat d1/d16/d17/f1f x:0 0 0 2024-09-12T01:42:56.795 INFO:tasks.workunit.client.1.smithi153.stdout:8/146: dread - fa zero size 2024-09-12T01:42:56.797 INFO:tasks.workunit.client.1.smithi153.stdout:4/88: symlink d6/d9/l21 0 2024-09-12T01:42:56.797 INFO:tasks.workunit.client.1.smithi153.stdout:0/88: dwrite f6 [0,4194304] 0 2024-09-12T01:42:56.797 INFO:tasks.workunit.client.1.smithi153.stdout:0/89: chown lb 6 1 2024-09-12T01:42:56.797 INFO:tasks.workunit.client.1.smithi153.stdout:8/147: symlink d17/d1d/d27/d2d/d34/l3b 0 2024-09-12T01:42:56.800 INFO:tasks.workunit.client.1.smithi153.stdout:8/148: truncate f13 2390443 0 2024-09-12T01:42:56.801 INFO:tasks.workunit.client.1.smithi153.stdout:8/149: symlink d17/d21/l3c 0 2024-09-12T01:42:56.809 INFO:tasks.workunit.client.1.smithi153.stdout:5/100: sync 2024-09-12T01:42:56.810 INFO:tasks.workunit.client.1.smithi153.stdout:1/57: sync 2024-09-12T01:42:56.810 INFO:tasks.workunit.client.1.smithi153.stdout:5/101: write d0/f1f [239204,69128] 0 2024-09-12T01:42:56.810 INFO:tasks.workunit.client.1.smithi153.stdout:8/150: write d17/f1a [434088,94345] 0 2024-09-12T01:42:56.810 INFO:tasks.workunit.client.1.smithi153.stdout:9/142: sync 2024-09-12T01:42:56.811 INFO:tasks.workunit.client.1.smithi153.stdout:1/58: rename d2/c11 to d2/d9/c14 0 2024-09-12T01:42:56.813 INFO:tasks.workunit.client.1.smithi153.stdout:5/102: rmdir d0/d15/d19 0 2024-09-12T01:42:56.813 INFO:tasks.workunit.client.1.smithi153.stdout:5/103: stat d0/df/f1e 0 2024-09-12T01:42:56.814 INFO:tasks.workunit.client.1.smithi153.stdout:8/151: symlink d17/d1f/l3d 0 2024-09-12T01:42:56.816 INFO:tasks.workunit.client.1.smithi153.stdout:1/59: creat d2/d9/f15 x:0 0 0 2024-09-12T01:42:56.817 INFO:tasks.workunit.client.1.smithi153.stdout:1/60: write d2/f10 [491868,74239] 0 2024-09-12T01:42:56.831 INFO:tasks.workunit.client.1.smithi153.stdout:1/61: dread d2/d9/f12 [0,4194304] 0 2024-09-12T01:42:56.838 INFO:tasks.workunit.client.1.smithi153.stdout:3/102: dwrite d1/fc [0,4194304] 0 2024-09-12T01:42:56.838 INFO:tasks.workunit.client.1.smithi153.stdout:0/90: dwrite f1b [0,4194304] 0 2024-09-12T01:42:56.838 INFO:tasks.workunit.client.1.smithi153.stdout:0/91: chown c14 11391 1 2024-09-12T01:42:56.840 INFO:tasks.workunit.client.1.smithi153.stdout:8/152: dwrite f15 [0,4194304] 0 2024-09-12T01:42:56.842 INFO:tasks.workunit.client.1.smithi153.stdout:0/92: link c16 d22/c23 0 2024-09-12T01:42:56.842 INFO:tasks.workunit.client.1.smithi153.stdout:3/103: write d1/f2 [3943184,96105] 0 2024-09-12T01:42:56.842 INFO:tasks.workunit.client.1.smithi153.stdout:3/104: readlink d1/d16/d1c/l1d 0 2024-09-12T01:42:56.842 INFO:tasks.workunit.client.1.smithi153.stdout:4/89: dwrite f0 [0,4194304] 0 2024-09-12T01:42:56.843 INFO:tasks.workunit.client.1.smithi153.stdout:4/90: dread - d6/d9/d11/f1c zero size 2024-09-12T01:42:56.843 INFO:tasks.workunit.client.1.smithi153.stdout:9/143: dwrite d3/f1f [0,4194304] 0 2024-09-12T01:42:56.845 INFO:tasks.workunit.client.1.smithi153.stdout:4/91: dread d6/d9/d11/d13/f18 [0,4194304] 0 2024-09-12T01:42:56.845 INFO:tasks.workunit.client.1.smithi153.stdout:4/92: write f0 [4226107,44559] 0 2024-09-12T01:42:56.845 INFO:tasks.workunit.client.1.smithi153.stdout:4/93: write d6/d9/f10 [4713397,56042] 0 2024-09-12T01:42:56.845 INFO:tasks.workunit.client.1.smithi153.stdout:8/153: creat d17/f3e x:0 0 0 2024-09-12T01:42:56.845 INFO:tasks.workunit.client.1.smithi153.stdout:8/154: fsync d17/d1d/d27/f35 0 2024-09-12T01:42:56.845 INFO:tasks.workunit.client.1.smithi153.stdout:8/155: dread - d17/d21/f30 zero size 2024-09-12T01:42:56.846 INFO:tasks.workunit.client.1.smithi153.stdout:1/62: dwrite f0 [0,4194304] 0 2024-09-12T01:42:56.850 INFO:tasks.workunit.client.1.smithi153.stdout:3/105: mknod d1/d13/c20 0 2024-09-12T01:42:56.850 INFO:tasks.workunit.client.1.smithi153.stdout:9/144: write d3/f14 [460566,64848] 0 2024-09-12T01:42:56.851 INFO:tasks.workunit.client.1.smithi153.stdout:4/94: dread d6/d9/f10 [4194304,4194304] 0 2024-09-12T01:42:56.853 INFO:tasks.workunit.client.1.smithi153.stdout:8/156: symlink d17/l3f 0 2024-09-12T01:42:56.854 INFO:tasks.workunit.client.1.smithi153.stdout:1/63: rename d2/c7 to d2/d9/c16 0 2024-09-12T01:42:56.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/106: rename d1 to d1/d21 22 2024-09-12T01:42:56.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/107: creat d1/d16/d17/f22 x:0 0 0 2024-09-12T01:42:56.855 INFO:tasks.workunit.client.1.smithi153.stdout:4/95: creat d6/d15/f22 x:0 0 0 2024-09-12T01:42:56.855 INFO:tasks.workunit.client.1.smithi153.stdout:4/96: chown d6/c12 1546 1 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:8/157: creat d17/d1d/d27/d2d/d34/f40 x:0 0 0 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:8/158: creat d17/d1d/f41 x:0 0 0 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:8/159: chown d17/d21/c32 310734 1 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:8/160: chown d17/d21/f30 32286880 1 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:8/161: chown d17/d1d/c25 57 1 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:1/64: mkdir d2/d9/d17 0 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:7/99: sync 2024-09-12T01:42:56.857 INFO:tasks.workunit.client.1.smithi153.stdout:2/97: sync 2024-09-12T01:42:56.859 INFO:tasks.workunit.client.1.smithi153.stdout:3/108: mkdir d1/d13/d23 0 2024-09-12T01:42:56.859 INFO:tasks.workunit.client.1.smithi153.stdout:4/97: mknod d6/d9/dc/c23 0 2024-09-12T01:42:56.862 INFO:tasks.workunit.client.1.smithi153.stdout:2/98: truncate f2 5593809 0 2024-09-12T01:42:56.863 INFO:tasks.workunit.client.1.smithi153.stdout:1/65: mknod d2/c18 0 2024-09-12T01:42:56.865 INFO:tasks.workunit.client.1.smithi153.stdout:4/98: rmdir d6/d9/d11 39 2024-09-12T01:42:56.866 INFO:tasks.workunit.client.1.smithi153.stdout:0/93: dwrite f1b [4194304,4194304] 0 2024-09-12T01:42:56.868 INFO:tasks.workunit.client.1.smithi153.stdout:4/99: rename d6/d9/d11/d13/f16 to d6/d9/d17/f24 0 2024-09-12T01:42:56.870 INFO:tasks.workunit.client.1.smithi153.stdout:0/94: creat d22/f24 x:0 0 0 2024-09-12T01:42:56.872 INFO:tasks.workunit.client.1.smithi153.stdout:4/100: link f0 d6/d9/f25 0 2024-09-12T01:42:56.873 INFO:tasks.workunit.client.1.smithi153.stdout:3/109: read d1/fc [2488748,18421] 0 2024-09-12T01:42:56.873 INFO:tasks.workunit.client.1.smithi153.stdout:3/110: stat d1/d13/c20 0 2024-09-12T01:42:56.874 INFO:tasks.workunit.client.1.smithi153.stdout:0/95: rename lb to d22/l25 0 2024-09-12T01:42:56.874 INFO:tasks.workunit.client.1.smithi153.stdout:0/96: write f21 [758750,9912] 0 2024-09-12T01:42:56.874 INFO:tasks.workunit.client.1.smithi153.stdout:0/97: creat d22/f26 x:0 0 0 2024-09-12T01:42:56.874 INFO:tasks.workunit.client.1.smithi153.stdout:0/98: write f20 [531837,106894] 0 2024-09-12T01:42:56.876 INFO:tasks.workunit.client.1.smithi153.stdout:3/111: mknod d1/d16/d1c/c24 0 2024-09-12T01:42:56.876 INFO:tasks.workunit.client.1.smithi153.stdout:3/112: chown d1/d13/c20 185 1 2024-09-12T01:42:56.877 INFO:tasks.workunit.client.1.smithi153.stdout:3/113: read d1/d16/d17/f18 [92424,9358] 0 2024-09-12T01:42:56.881 INFO:tasks.workunit.client.1.smithi153.stdout:0/99: symlink d22/l27 0 2024-09-12T01:42:56.883 INFO:tasks.workunit.client.1.smithi153.stdout:9/145: dwrite d3/f11 [0,4194304] 0 2024-09-12T01:42:56.886 INFO:tasks.workunit.client.1.smithi153.stdout:3/114: mkdir d1/d13/d25 0 2024-09-12T01:42:56.887 INFO:tasks.workunit.client.1.smithi153.stdout:0/100: mknod d22/c28 0 2024-09-12T01:42:56.890 INFO:tasks.workunit.client.1.smithi153.stdout:9/146: fdatasync d3/f7 0 2024-09-12T01:42:56.891 INFO:tasks.workunit.client.1.smithi153.stdout:3/115: mkdir d1/d13/d25/d26 0 2024-09-12T01:42:56.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/101: link c10 d22/c29 0 2024-09-12T01:42:56.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/102: chown c10 343 1 2024-09-12T01:42:56.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/103: creat d22/f2a x:0 0 0 2024-09-12T01:42:56.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/104: readlink d22/l25 0 2024-09-12T01:42:56.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/105: write f8 [1533763,75010] 0 2024-09-12T01:42:56.894 INFO:tasks.workunit.client.1.smithi153.stdout:9/147: truncate f1 3400773 0 2024-09-12T01:42:56.894 INFO:tasks.workunit.client.1.smithi153.stdout:3/116: rename d1/fc to d1/d16/f27 0 2024-09-12T01:42:56.895 INFO:tasks.workunit.client.1.smithi153.stdout:9/148: fdatasync d3/f18 0 2024-09-12T01:42:56.896 INFO:tasks.workunit.client.1.smithi153.stdout:9/149: rename l2 to d3/l25 0 2024-09-12T01:42:56.899 INFO:tasks.workunit.client.1.smithi153.stdout:0/106: dread f4 [0,4194304] 0 2024-09-12T01:42:56.900 INFO:tasks.workunit.client.1.smithi153.stdout:0/107: truncate d22/f24 185169 0 2024-09-12T01:42:56.900 INFO:tasks.workunit.client.1.smithi153.stdout:0/108: creat d22/f2b x:0 0 0 2024-09-12T01:42:56.900 INFO:tasks.workunit.client.1.smithi153.stdout:0/109: creat d22/f2c x:0 0 0 2024-09-12T01:42:56.902 INFO:tasks.workunit.client.1.smithi153.stdout:0/110: symlink d22/l2d 0 2024-09-12T01:42:56.902 INFO:tasks.workunit.client.1.smithi153.stdout:3/117: dread d1/f2 [0,4194304] 0 2024-09-12T01:42:56.903 INFO:tasks.workunit.client.1.smithi153.stdout:0/111: mkdir d22/d2e 0 2024-09-12T01:42:56.903 INFO:tasks.workunit.client.1.smithi153.stdout:0/112: readlink l12 0 2024-09-12T01:42:56.903 INFO:tasks.workunit.client.1.smithi153.stdout:0/113: stat l1f 0 2024-09-12T01:42:56.904 INFO:tasks.workunit.client.1.smithi153.stdout:0/114: fsync f6 0 2024-09-12T01:42:56.904 INFO:tasks.workunit.client.1.smithi153.stdout:3/118: creat d1/d13/d25/f28 x:0 0 0 2024-09-12T01:42:56.905 INFO:tasks.workunit.client.1.smithi153.stdout:0/115: rmdir d22/d2e 0 2024-09-12T01:42:56.908 INFO:tasks.workunit.client.1.smithi153.stdout:7/100: dwrite d12/f16 [0,4194304] 0 2024-09-12T01:42:56.909 INFO:tasks.workunit.client.1.smithi153.stdout:7/101: fsync d12/f19 0 2024-09-12T01:42:56.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/101: fsync d6/d9/f25 0 2024-09-12T01:42:56.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/102: chown f4 17317 1 2024-09-12T01:42:56.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/103: chown d6/l1f 4 1 2024-09-12T01:42:56.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/104: dread - d6/d9/d11/f1c zero size 2024-09-12T01:42:56.911 INFO:tasks.workunit.client.1.smithi153.stdout:8/162: dwrite f15 [0,4194304] 0 2024-09-12T01:42:56.911 INFO:tasks.workunit.client.1.smithi153.stdout:2/99: dwrite d7/fe [0,4194304] 0 2024-09-12T01:42:56.911 INFO:tasks.workunit.client.1.smithi153.stdout:1/66: dwrite f0 [4194304,4194304] 0 2024-09-12T01:42:56.912 INFO:tasks.workunit.client.1.smithi153.stdout:8/163: mkdir d17/d1d/d27/d2d/d42 0 2024-09-12T01:42:56.915 INFO:tasks.workunit.client.1.smithi153.stdout:1/67: write d2/d9/f12 [2824127,15945] 0 2024-09-12T01:42:56.915 INFO:tasks.workunit.client.1.smithi153.stdout:1/68: chown d2/le 8100 1 2024-09-12T01:42:56.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/69: fdatasync d2/f10 0 2024-09-12T01:42:56.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/70: chown d2/d9/ca 1 1 2024-09-12T01:42:56.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/71: write d2/d9/fc [52840,115415] 0 2024-09-12T01:42:56.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/72: creat d2/d9/f19 x:0 0 0 2024-09-12T01:42:56.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/73: creat d2/d9/f1a x:0 0 0 2024-09-12T01:42:56.919 INFO:tasks.workunit.client.1.smithi153.stdout:2/100: dread f2 [0,4194304] 0 2024-09-12T01:42:56.919 INFO:tasks.workunit.client.1.smithi153.stdout:2/101: dread - d7/d17/f1b zero size 2024-09-12T01:42:56.919 INFO:tasks.workunit.client.1.smithi153.stdout:2/102: write f2 [2858009,39869] 0 2024-09-12T01:42:56.919 INFO:tasks.workunit.client.1.smithi153.stdout:2/103: read - d7/db/f15 zero size 2024-09-12T01:42:56.919 INFO:tasks.workunit.client.1.smithi153.stdout:9/150: dwrite d3/f18 [0,4194304] 0 2024-09-12T01:42:56.923 INFO:tasks.workunit.client.1.smithi153.stdout:7/102: write f10 [1677684,56597] 0 2024-09-12T01:42:56.924 INFO:tasks.workunit.client.1.smithi153.stdout:3/119: dwrite d1/f19 [4194304,4194304] 0 2024-09-12T01:42:56.924 INFO:tasks.workunit.client.1.smithi153.stdout:3/120: write d1/d16/d17/f1f [820884,2549] 0 2024-09-12T01:42:56.924 INFO:tasks.workunit.client.1.smithi153.stdout:3/121: read - d1/f1a zero size 2024-09-12T01:42:56.924 INFO:tasks.workunit.client.1.smithi153.stdout:3/122: truncate d1/f1a 100142 0 2024-09-12T01:42:56.925 INFO:tasks.workunit.client.1.smithi153.stdout:7/103: dread d12/f19 [0,4194304] 0 2024-09-12T01:42:56.937 INFO:tasks.workunit.client.1.smithi153.stdout:4/105: dwrite d6/d9/d11/d13/f18 [0,4194304] 0 2024-09-12T01:42:56.937 INFO:tasks.workunit.client.1.smithi153.stdout:4/106: chown d6/d15/l19 4 1 2024-09-12T01:42:56.949 INFO:tasks.workunit.client.1.smithi153.stdout:8/164: unlink d17/f3e 0 2024-09-12T01:42:56.955 INFO:tasks.workunit.client.1.smithi153.stdout:3/123: dwrite d1/d16/d17/f22 [0,4194304] 0 2024-09-12T01:42:56.956 INFO:tasks.workunit.client.1.smithi153.stdout:7/104: dwrite f7 [0,4194304] 0 2024-09-12T01:42:56.956 INFO:tasks.workunit.client.1.smithi153.stdout:7/105: chown d12/f1c 3 1 2024-09-12T01:42:56.959 INFO:tasks.workunit.client.1.smithi153.stdout:1/74: rename f0 to d2/d9/f1b 0 2024-09-12T01:42:56.960 INFO:tasks.workunit.client.1.smithi153.stdout:1/75: dread - d2/d9/f19 zero size 2024-09-12T01:42:56.962 INFO:tasks.workunit.client.1.smithi153.stdout:2/104: mkdir d7/db/d1d 0 2024-09-12T01:42:56.964 INFO:tasks.workunit.client.1.smithi153.stdout:0/116: rmdir d22 39 2024-09-12T01:42:56.964 INFO:tasks.workunit.client.1.smithi153.stdout:0/117: fsync d22/f2c 0 2024-09-12T01:42:56.968 INFO:tasks.workunit.client.1.smithi153.stdout:0/118: write f20 [486613,90378] 0 2024-09-12T01:42:56.968 INFO:tasks.workunit.client.1.smithi153.stdout:0/119: chown l17 48818727 1 2024-09-12T01:42:56.969 INFO:tasks.workunit.client.1.smithi153.stdout:0/120: write fd [222650,19025] 0 2024-09-12T01:42:56.984 INFO:tasks.workunit.client.1.smithi153.stdout:3/124: dwrite d1/d16/d17/f22 [0,4194304] 0 2024-09-12T01:42:56.984 INFO:tasks.workunit.client.1.smithi153.stdout:3/125: chown d1/lb 193 1 2024-09-12T01:42:56.985 INFO:tasks.workunit.client.1.smithi153.stdout:3/126: chown d1/d16/f1b 6 1 2024-09-12T01:42:56.985 INFO:tasks.workunit.client.1.smithi153.stdout:1/76: dwrite d2/f10 [0,4194304] 0 2024-09-12T01:42:56.991 INFO:tasks.workunit.client.1.smithi153.stdout:2/105: dwrite f2 [0,4194304] 0 2024-09-12T01:42:56.999 INFO:tasks.workunit.client.1.smithi153.stdout:3/127: dread d1/d16/d17/f22 [0,4194304] 0 2024-09-12T01:42:57.008 INFO:tasks.workunit.client.1.smithi153.stdout:6/133: sync 2024-09-12T01:42:57.008 INFO:tasks.workunit.client.1.smithi153.stdout:6/134: write d1/df/f26 [389142,47559] 0 2024-09-12T01:42:57.029 INFO:tasks.workunit.client.1.smithi153.stdout:4/107: unlink f4 0 2024-09-12T01:42:57.033 INFO:tasks.workunit.client.1.smithi153.stdout:8/165: truncate d17/d1f/f39 2254995 0 2024-09-12T01:42:57.034 INFO:tasks.workunit.client.1.smithi153.stdout:8/166: fsync d17/d1f/f26 0 2024-09-12T01:42:57.040 INFO:tasks.workunit.client.1.smithi153.stdout:0/121: getdents d22 0 2024-09-12T01:42:57.040 INFO:tasks.workunit.client.1.smithi153.stdout:0/122: stat d22/c28 0 2024-09-12T01:42:57.041 INFO:tasks.workunit.client.1.smithi153.stdout:0/123: write f21 [172699,20083] 0 2024-09-12T01:42:57.041 INFO:tasks.workunit.client.1.smithi153.stdout:0/124: fdatasync d22/f2c 0 2024-09-12T01:42:57.042 INFO:tasks.workunit.client.1.smithi153.stdout:1/77: symlink d2/d9/l1c 0 2024-09-12T01:42:57.043 INFO:tasks.workunit.client.1.smithi153.stdout:2/106: mkdir d7/db/d1d/d1e 0 2024-09-12T01:42:57.043 INFO:tasks.workunit.client.1.smithi153.stdout:2/107: dread - d7/d17/f1b zero size 2024-09-12T01:42:57.044 INFO:tasks.workunit.client.1.smithi153.stdout:3/128: mknod d1/d13/d25/c29 0 2024-09-12T01:42:57.044 INFO:tasks.workunit.client.1.smithi153.stdout:3/129: chown d1/d16/d1c 397279 1 2024-09-12T01:42:57.044 INFO:tasks.workunit.client.1.smithi153.stdout:3/130: readlink d1/l15 0 2024-09-12T01:42:57.044 INFO:tasks.workunit.client.1.smithi153.stdout:3/131: fsync d1/f5 0 2024-09-12T01:42:57.045 INFO:tasks.workunit.client.1.smithi153.stdout:4/108: dwrite d6/d9/d11/f1e [0,4194304] 0 2024-09-12T01:42:57.046 INFO:tasks.workunit.client.1.smithi153.stdout:8/167: rmdir d17/d21 39 2024-09-12T01:42:57.046 INFO:tasks.workunit.client.1.smithi153.stdout:6/135: link d1/f1d d1/d6/d23/f2b 0 2024-09-12T01:42:57.047 INFO:tasks.workunit.client.1.smithi153.stdout:7/106: dread fc [0,4194304] 0 2024-09-12T01:42:57.047 INFO:tasks.workunit.client.1.smithi153.stdout:7/107: write d12/f1c [748444,18553] 0 2024-09-12T01:42:57.048 INFO:tasks.workunit.client.1.smithi153.stdout:9/151: link d3/c12 d3/c26 0 2024-09-12T01:42:57.049 INFO:tasks.workunit.client.1.smithi153.stdout:0/125: truncate d22/f24 44846 0 2024-09-12T01:42:57.051 INFO:tasks.workunit.client.1.smithi153.stdout:1/78: unlink d2/d9/fc 0 2024-09-12T01:42:57.052 INFO:tasks.workunit.client.1.smithi153.stdout:2/108: mknod d7/db/d1d/d1e/c1f 0 2024-09-12T01:42:57.054 INFO:tasks.workunit.client.1.smithi153.stdout:6/136: mknod d1/d6/da/c2c 0 2024-09-12T01:42:57.055 INFO:tasks.workunit.client.1.smithi153.stdout:7/108: rename d12/f14 to d12/f20 0 2024-09-12T01:42:57.055 INFO:tasks.workunit.client.1.smithi153.stdout:7/109: fsync fb 0 2024-09-12T01:42:57.055 INFO:tasks.workunit.client.1.smithi153.stdout:7/110: chown d12/c1a 235587 1 2024-09-12T01:42:57.055 INFO:tasks.workunit.client.1.smithi153.stdout:7/111: fdatasync f4 0 2024-09-12T01:42:57.055 INFO:tasks.workunit.client.1.smithi153.stdout:8/168: dread d17/f24 [0,4194304] 0 2024-09-12T01:42:57.056 INFO:tasks.workunit.client.1.smithi153.stdout:8/169: chown d17/d1d/d27/c31 5 1 2024-09-12T01:42:57.057 INFO:tasks.workunit.client.1.smithi153.stdout:9/152: stat d3/c26 0 2024-09-12T01:42:57.059 INFO:tasks.workunit.client.1.smithi153.stdout:2/109: creat d7/d19/f20 x:0 0 0 2024-09-12T01:42:57.059 INFO:tasks.workunit.client.1.smithi153.stdout:2/110: chown d7/f11 78 1 2024-09-12T01:42:57.059 INFO:tasks.workunit.client.1.smithi153.stdout:2/111: chown f2 91615 1 2024-09-12T01:42:57.060 INFO:tasks.workunit.client.1.smithi153.stdout:1/79: dread d2/d9/f1b [4194304,4194304] 0 2024-09-12T01:42:57.061 INFO:tasks.workunit.client.1.smithi153.stdout:6/137: rename d1/f1b to d1/d6/f2d 0 2024-09-12T01:42:57.061 INFO:tasks.workunit.client.1.smithi153.stdout:6/138: stat d1/d6/da/d19/d1e/f20 0 2024-09-12T01:42:57.062 INFO:tasks.workunit.client.1.smithi153.stdout:6/139: fdatasync d1/df/f12 0 2024-09-12T01:42:57.062 INFO:tasks.workunit.client.1.smithi153.stdout:7/112: chown ca 1 1 2024-09-12T01:42:57.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/170: mknod d17/d21/d3a/c43 0 2024-09-12T01:42:57.065 INFO:tasks.workunit.client.1.smithi153.stdout:9/153: truncate d3/f11 227887 0 2024-09-12T01:42:57.065 INFO:tasks.workunit.client.1.smithi153.stdout:2/112: mkdir d7/db/d21 0 2024-09-12T01:42:57.066 INFO:tasks.workunit.client.1.smithi153.stdout:9/154: fsync d3/ff 0 2024-09-12T01:42:57.067 INFO:tasks.workunit.client.1.smithi153.stdout:2/113: symlink d7/db/d1d/l22 0 2024-09-12T01:42:57.070 INFO:tasks.workunit.client.1.smithi153.stdout:2/114: creat d7/db/d21/f23 x:0 0 0 2024-09-12T01:42:57.070 INFO:tasks.workunit.client.1.smithi153.stdout:2/115: write d7/db/d21/f23 [331998,60195] 0 2024-09-12T01:42:57.072 INFO:tasks.workunit.client.1.smithi153.stdout:1/80: dread d2/d9/f1b [0,4194304] 0 2024-09-12T01:42:57.072 INFO:tasks.workunit.client.1.smithi153.stdout:8/171: symlink d17/l44 0 2024-09-12T01:42:57.072 INFO:tasks.workunit.client.1.smithi153.stdout:1/81: write d2/d9/f1a [854337,108212] 0 2024-09-12T01:42:57.073 INFO:tasks.workunit.client.1.smithi153.stdout:2/116: symlink d7/db/l24 0 2024-09-12T01:42:57.074 INFO:tasks.workunit.client.1.smithi153.stdout:1/82: unlink d2/f10 0 2024-09-12T01:42:57.083 INFO:tasks.workunit.client.1.smithi153.stdout:2/117: dread f2 [0,4194304] 0 2024-09-12T01:42:57.088 INFO:tasks.workunit.client.1.smithi153.stdout:5/104: sync 2024-09-12T01:42:57.088 INFO:tasks.workunit.client.1.smithi153.stdout:5/105: creat d0/df/f21 x:0 0 0 2024-09-12T01:42:57.088 INFO:tasks.workunit.client.1.smithi153.stdout:2/118: read d7/db/d21/f23 [248165,41364] 0 2024-09-12T01:42:57.088 INFO:tasks.workunit.client.1.smithi153.stdout:2/119: fdatasync d7/db/f15 0 2024-09-12T01:42:57.091 INFO:tasks.workunit.client.1.smithi153.stdout:5/106: mkdir d0/df/d1c/d22 0 2024-09-12T01:42:57.091 INFO:tasks.workunit.client.1.smithi153.stdout:6/140: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:42:57.093 INFO:tasks.workunit.client.1.smithi153.stdout:2/120: unlink d7/db/d1d/d1e/c1f 0 2024-09-12T01:42:57.093 INFO:tasks.workunit.client.1.smithi153.stdout:2/121: fsync d7/fe 0 2024-09-12T01:42:57.093 INFO:tasks.workunit.client.1.smithi153.stdout:2/122: dread - d7/d17/f1b zero size 2024-09-12T01:42:57.094 INFO:tasks.workunit.client.1.smithi153.stdout:7/113: dwrite fe [0,4194304] 0 2024-09-12T01:42:57.095 INFO:tasks.workunit.client.1.smithi153.stdout:6/141: unlink d1/df/l18 0 2024-09-12T01:42:57.095 INFO:tasks.workunit.client.1.smithi153.stdout:6/142: rename d1/d6 to d1/d6/da/d19/d2e 22 2024-09-12T01:42:57.095 INFO:tasks.workunit.client.1.smithi153.stdout:6/143: creat d1/d6/da/f2f x:0 0 0 2024-09-12T01:42:57.096 INFO:tasks.workunit.client.1.smithi153.stdout:7/114: mkdir d12/d21 0 2024-09-12T01:42:57.097 INFO:tasks.workunit.client.1.smithi153.stdout:7/115: chown fd 284 1 2024-09-12T01:42:57.097 INFO:tasks.workunit.client.1.smithi153.stdout:5/107: write d0/df/f10 [1844537,117674] 0 2024-09-12T01:42:57.098 INFO:tasks.workunit.client.1.smithi153.stdout:5/108: fdatasync d0/df/f21 0 2024-09-12T01:42:57.098 INFO:tasks.workunit.client.1.smithi153.stdout:5/109: stat d0/c3 0 2024-09-12T01:42:57.098 INFO:tasks.workunit.client.1.smithi153.stdout:5/110: chown d0/df/f21 788 1 2024-09-12T01:42:57.099 INFO:tasks.workunit.client.1.smithi153.stdout:7/116: rename d12/f19 to d12/f22 0 2024-09-12T01:42:57.101 INFO:tasks.workunit.client.1.smithi153.stdout:5/111: symlink d0/df/l23 0 2024-09-12T01:42:57.101 INFO:tasks.workunit.client.1.smithi153.stdout:5/112: stat d0/df/l23 0 2024-09-12T01:42:57.101 INFO:tasks.workunit.client.1.smithi153.stdout:7/117: dread d12/f22 [0,4194304] 0 2024-09-12T01:42:57.112 INFO:tasks.workunit.client.1.smithi153.stdout:1/83: dwrite d2/d9/f1a [0,4194304] 0 2024-09-12T01:42:57.113 INFO:tasks.workunit.client.1.smithi153.stdout:1/84: truncate d2/d9/f19 968645 0 2024-09-12T01:42:57.113 INFO:tasks.workunit.client.1.smithi153.stdout:1/85: dread - d2/d9/f15 zero size 2024-09-12T01:42:57.113 INFO:tasks.workunit.client.1.smithi153.stdout:7/118: dread fe [0,4194304] 0 2024-09-12T01:42:57.114 INFO:tasks.workunit.client.1.smithi153.stdout:7/119: write fc [936523,53071] 0 2024-09-12T01:42:57.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/120: dread fe [0,4194304] 0 2024-09-12T01:42:57.126 INFO:tasks.workunit.client.1.smithi153.stdout:2/123: dwrite d7/d19/f20 [0,4194304] 0 2024-09-12T01:42:57.126 INFO:tasks.workunit.client.1.smithi153.stdout:2/124: chown d7/cd 69018 1 2024-09-12T01:42:57.126 INFO:tasks.workunit.client.1.smithi153.stdout:2/125: creat d7/db/f25 x:0 0 0 2024-09-12T01:42:57.126 INFO:tasks.workunit.client.1.smithi153.stdout:6/144: dwrite d1/df/f12 [0,4194304] 0 2024-09-12T01:42:57.128 INFO:tasks.workunit.client.1.smithi153.stdout:1/86: dread d2/f6 [0,4194304] 0 2024-09-12T01:42:57.129 INFO:tasks.workunit.client.1.smithi153.stdout:2/126: creat d7/db/d1d/d1e/f26 x:0 0 0 2024-09-12T01:42:57.132 INFO:tasks.workunit.client.1.smithi153.stdout:7/121: dwrite fb [0,4194304] 0 2024-09-12T01:42:57.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/87: dread d2/f6 [0,4194304] 0 2024-09-12T01:42:57.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/88: write d2/f6 [2003629,101160] 0 2024-09-12T01:42:57.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/89: chown d2/d9/d17 3 1 2024-09-12T01:42:57.134 INFO:tasks.workunit.client.1.smithi153.stdout:1/90: write d2/d9/f15 [915346,1439] 0 2024-09-12T01:42:57.134 INFO:tasks.workunit.client.1.smithi153.stdout:5/113: dwrite d0/f1f [0,4194304] 0 2024-09-12T01:42:57.134 INFO:tasks.workunit.client.1.smithi153.stdout:5/114: chown d0/df/c14 1 1 2024-09-12T01:42:57.142 INFO:tasks.workunit.client.1.smithi153.stdout:1/91: mkdir d2/d9/d1d 0 2024-09-12T01:42:57.142 INFO:tasks.workunit.client.1.smithi153.stdout:5/115: truncate d0/f12 287230 0 2024-09-12T01:42:57.145 INFO:tasks.workunit.client.1.smithi153.stdout:1/92: rename d2/d9/cd to d2/c1e 0 2024-09-12T01:42:57.145 INFO:tasks.workunit.client.1.smithi153.stdout:1/93: write d2/d9/f15 [935412,13004] 0 2024-09-12T01:42:57.146 INFO:tasks.workunit.client.1.smithi153.stdout:1/94: rename d2/d9/c14 to d2/d9/c1f 0 2024-09-12T01:42:57.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/95: mkdir d2/d20 0 2024-09-12T01:42:57.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/96: getdents d2/d9/d1d 0 2024-09-12T01:42:57.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/97: symlink d2/d9/d1d/l21 0 2024-09-12T01:42:57.148 INFO:tasks.workunit.client.1.smithi153.stdout:1/98: creat d2/d9/d1d/f22 x:0 0 0 2024-09-12T01:42:57.151 INFO:tasks.workunit.client.1.smithi153.stdout:1/99: write d2/d9/f1b [512106,4948] 0 2024-09-12T01:42:57.154 INFO:tasks.workunit.client.1.smithi153.stdout:6/145: dwrite d1/d6/f8 [4194304,4194304] 0 2024-09-12T01:42:57.155 INFO:tasks.workunit.client.1.smithi153.stdout:6/146: dread - d1/d6/da/f2f zero size 2024-09-12T01:42:57.155 INFO:tasks.workunit.client.1.smithi153.stdout:2/127: dwrite d7/fe [0,4194304] 0 2024-09-12T01:42:57.155 INFO:tasks.workunit.client.1.smithi153.stdout:1/100: fsync d2/f6 0 2024-09-12T01:42:57.155 INFO:tasks.workunit.client.1.smithi153.stdout:2/128: write d7/db/d1d/d1e/f26 [817049,114248] 0 2024-09-12T01:42:57.155 INFO:tasks.workunit.client.1.smithi153.stdout:2/129: write d7/db/f25 [708157,2444] 0 2024-09-12T01:42:57.156 INFO:tasks.workunit.client.1.smithi153.stdout:7/122: dwrite f10 [4194304,4194304] 0 2024-09-12T01:42:57.156 INFO:tasks.workunit.client.1.smithi153.stdout:1/101: creat d2/d9/d17/f23 x:0 0 0 2024-09-12T01:42:57.157 INFO:tasks.workunit.client.1.smithi153.stdout:2/130: mkdir d7/db/d27 0 2024-09-12T01:42:57.160 INFO:tasks.workunit.client.1.smithi153.stdout:6/147: dread d1/d6/f15 [0,4194304] 0 2024-09-12T01:42:57.160 INFO:tasks.workunit.client.1.smithi153.stdout:6/148: creat d1/df/f30 x:0 0 0 2024-09-12T01:42:57.160 INFO:tasks.workunit.client.1.smithi153.stdout:6/149: creat d1/d6/da/f31 x:0 0 0 2024-09-12T01:42:57.160 INFO:tasks.workunit.client.1.smithi153.stdout:6/150: write d1/d6/da/f31 [512028,13679] 0 2024-09-12T01:42:57.160 INFO:tasks.workunit.client.1.smithi153.stdout:6/151: chown d1/df/f26 21 1 2024-09-12T01:42:57.160 INFO:tasks.workunit.client.1.smithi153.stdout:6/152: chown d1/df/f12 22 1 2024-09-12T01:42:57.164 INFO:tasks.workunit.client.1.smithi153.stdout:2/131: dread f1 [0,4194304] 0 2024-09-12T01:42:57.166 INFO:tasks.workunit.client.1.smithi153.stdout:5/116: dread d0/f12 [0,4194304] 0 2024-09-12T01:42:57.172 INFO:tasks.workunit.client.1.smithi153.stdout:6/153: mkdir d1/d6/da/d32 0 2024-09-12T01:42:57.172 INFO:tasks.workunit.client.1.smithi153.stdout:2/132: creat d7/db/d1d/f28 x:0 0 0 2024-09-12T01:42:57.174 INFO:tasks.workunit.client.1.smithi153.stdout:6/154: mkdir d1/d6/da/d19/d1e/d33 0 2024-09-12T01:42:57.177 INFO:tasks.workunit.client.1.smithi153.stdout:7/123: dwrite d12/f17 [0,4194304] 0 2024-09-12T01:42:57.181 INFO:tasks.workunit.client.1.smithi153.stdout:7/124: creat d12/f23 x:0 0 0 2024-09-12T01:42:57.182 INFO:tasks.workunit.client.1.smithi153.stdout:1/102: truncate d2/d9/f1a 2372807 0 2024-09-12T01:42:57.183 INFO:tasks.workunit.client.1.smithi153.stdout:1/103: dread d2/d9/f19 [0,4194304] 0 2024-09-12T01:42:57.184 INFO:tasks.workunit.client.1.smithi153.stdout:1/104: creat d2/d9/d17/f24 x:0 0 0 2024-09-12T01:42:57.184 INFO:tasks.workunit.client.1.smithi153.stdout:2/133: dread d7/fe [0,4194304] 0 2024-09-12T01:42:57.189 INFO:tasks.workunit.client.1.smithi153.stdout:5/117: dwrite d0/fd [0,4194304] 0 2024-09-12T01:42:57.189 INFO:tasks.workunit.client.1.smithi153.stdout:4/109: sync 2024-09-12T01:42:57.189 INFO:tasks.workunit.client.1.smithi153.stdout:3/132: sync 2024-09-12T01:42:57.191 INFO:tasks.workunit.client.1.smithi153.stdout:6/155: dwrite d1/d6/d23/f29 [0,4194304] 0 2024-09-12T01:42:57.192 INFO:tasks.workunit.client.1.smithi153.stdout:7/125: truncate d12/f17 1645407 0 2024-09-12T01:42:57.194 INFO:tasks.workunit.client.1.smithi153.stdout:1/105: dread d2/f6 [0,4194304] 0 2024-09-12T01:42:57.196 INFO:tasks.workunit.client.1.smithi153.stdout:1/106: mkdir d2/d9/d1d/d25 0 2024-09-12T01:42:57.200 INFO:tasks.workunit.client.1.smithi153.stdout:4/110: write d6/d9/f25 [1545280,82166] 0 2024-09-12T01:42:57.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/107: dread d2/f6 [0,4194304] 0 2024-09-12T01:42:57.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/108: read - d2/d9/d17/f24 zero size 2024-09-12T01:42:57.200 INFO:tasks.workunit.client.1.smithi153.stdout:1/109: chown d2/d9/d1d/l21 47813795 1 2024-09-12T01:42:57.202 INFO:tasks.workunit.client.1.smithi153.stdout:4/111: unlink d6/fa 0 2024-09-12T01:42:57.204 INFO:tasks.workunit.client.1.smithi153.stdout:1/110: mknod d2/d9/c26 0 2024-09-12T01:42:57.204 INFO:tasks.workunit.client.1.smithi153.stdout:3/133: read d1/f19 [6375288,52627] 0 2024-09-12T01:42:57.205 INFO:tasks.workunit.client.1.smithi153.stdout:0/126: sync 2024-09-12T01:42:57.206 INFO:tasks.workunit.client.1.smithi153.stdout:9/155: sync 2024-09-12T01:42:57.206 INFO:tasks.workunit.client.1.smithi153.stdout:8/172: sync 2024-09-12T01:42:57.206 INFO:tasks.workunit.client.1.smithi153.stdout:1/111: dread d2/f6 [0,4194304] 0 2024-09-12T01:42:57.206 INFO:tasks.workunit.client.1.smithi153.stdout:1/112: getdents d2/d20 0 2024-09-12T01:42:57.206 INFO:tasks.workunit.client.1.smithi153.stdout:9/156: chown d3/c23 173341847 1 2024-09-12T01:42:57.207 INFO:tasks.workunit.client.1.smithi153.stdout:8/173: truncate d17/f1a 1176318 0 2024-09-12T01:42:57.208 INFO:tasks.workunit.client.1.smithi153.stdout:9/157: write d3/f24 [653455,94287] 0 2024-09-12T01:42:57.209 INFO:tasks.workunit.client.1.smithi153.stdout:1/113: symlink d2/l27 0 2024-09-12T01:42:57.209 INFO:tasks.workunit.client.1.smithi153.stdout:1/114: write d2/d9/f12 [2565992,57608] 0 2024-09-12T01:42:57.210 INFO:tasks.workunit.client.1.smithi153.stdout:8/174: chown ce 159071 1 2024-09-12T01:42:57.210 INFO:tasks.workunit.client.1.smithi153.stdout:8/175: fdatasync d17/f24 0 2024-09-12T01:42:57.210 INFO:tasks.workunit.client.1.smithi153.stdout:9/158: chown d3/f8 0 1 2024-09-12T01:42:57.211 INFO:tasks.workunit.client.1.smithi153.stdout:5/118: truncate d0/fd 2738571 0 2024-09-12T01:42:57.213 INFO:tasks.workunit.client.1.smithi153.stdout:1/115: mkdir d2/d9/d28 0 2024-09-12T01:42:57.213 INFO:tasks.workunit.client.1.smithi153.stdout:8/176: creat d17/d1d/d27/d2d/f45 x:0 0 0 2024-09-12T01:42:57.213 INFO:tasks.workunit.client.1.smithi153.stdout:8/177: write d17/d1f/f39 [2267783,1267] 0 2024-09-12T01:42:57.213 INFO:tasks.workunit.client.1.smithi153.stdout:8/178: creat d17/f46 x:0 0 0 2024-09-12T01:42:57.214 INFO:tasks.workunit.client.1.smithi153.stdout:8/179: chown d17/d1f/l2c 121765779 1 2024-09-12T01:42:57.216 INFO:tasks.workunit.client.1.smithi153.stdout:5/119: creat d0/d15/f24 x:0 0 0 2024-09-12T01:42:57.216 INFO:tasks.workunit.client.1.smithi153.stdout:5/120: chown d0/c3 22 1 2024-09-12T01:42:57.220 INFO:tasks.workunit.client.1.smithi153.stdout:1/116: dread d2/d9/f1a [0,4194304] 0 2024-09-12T01:42:57.220 INFO:tasks.workunit.client.1.smithi153.stdout:1/117: truncate d2/d9/d1d/f22 82221 0 2024-09-12T01:42:57.220 INFO:tasks.workunit.client.1.smithi153.stdout:1/118: chown d2/d9/d1d/f22 240999 1 2024-09-12T01:42:57.221 INFO:tasks.workunit.client.1.smithi153.stdout:1/119: creat d2/d9/d1d/d25/f29 x:0 0 0 2024-09-12T01:42:57.231 INFO:tasks.workunit.client.1.smithi153.stdout:7/126: dwrite fd [4194304,4194304] 0 2024-09-12T01:42:57.231 INFO:tasks.workunit.client.1.smithi153.stdout:9/159: dread d3/fc [0,4194304] 0 2024-09-12T01:42:57.232 INFO:tasks.workunit.client.1.smithi153.stdout:7/127: symlink d12/l24 0 2024-09-12T01:42:57.233 INFO:tasks.workunit.client.1.smithi153.stdout:6/156: dwrite d1/d6/f15 [0,4194304] 0 2024-09-12T01:42:57.233 INFO:tasks.workunit.client.1.smithi153.stdout:7/128: mknod d12/d21/c25 0 2024-09-12T01:42:57.234 INFO:tasks.workunit.client.1.smithi153.stdout:0/127: dwrite f18 [4194304,4194304] 0 2024-09-12T01:42:57.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/129: dread d12/f22 [0,4194304] 0 2024-09-12T01:42:57.237 INFO:tasks.workunit.client.1.smithi153.stdout:9/160: rename d3/ca to d3/c27 0 2024-09-12T01:42:57.240 INFO:tasks.workunit.client.1.smithi153.stdout:0/128: unlink c1d 0 2024-09-12T01:42:57.242 INFO:tasks.workunit.client.1.smithi153.stdout:7/130: unlink d12/f23 0 2024-09-12T01:42:57.243 INFO:tasks.workunit.client.1.smithi153.stdout:5/121: dread d0/df/f1e [0,4194304] 0 2024-09-12T01:42:57.246 INFO:tasks.workunit.client.1.smithi153.stdout:1/120: dwrite d2/d9/f1a [0,4194304] 0 2024-09-12T01:42:57.247 INFO:tasks.workunit.client.1.smithi153.stdout:5/122: rename d0/fc to d0/d15/f25 0 2024-09-12T01:42:57.250 INFO:tasks.workunit.client.1.smithi153.stdout:1/121: creat d2/d9/d28/f2a x:0 0 0 2024-09-12T01:42:57.250 INFO:tasks.workunit.client.1.smithi153.stdout:1/122: fdatasync d2/d9/d1d/f22 0 2024-09-12T01:42:57.250 INFO:tasks.workunit.client.1.smithi153.stdout:1/123: chown d2/d9/c26 26871 1 2024-09-12T01:42:57.251 INFO:tasks.workunit.client.1.smithi153.stdout:1/124: write d2/d9/f12 [1413899,92433] 0 2024-09-12T01:42:57.251 INFO:tasks.workunit.client.1.smithi153.stdout:1/125: chown d2 226747382 1 2024-09-12T01:42:57.251 INFO:tasks.workunit.client.1.smithi153.stdout:8/180: rmdir d17/d1d 39 2024-09-12T01:42:57.266 INFO:tasks.workunit.client.1.smithi153.stdout:5/123: write d0/d15/f25 [2610389,3155] 0 2024-09-12T01:42:57.266 INFO:tasks.workunit.client.1.smithi153.stdout:5/124: write d0/d15/f25 [2487085,24201] 0 2024-09-12T01:42:57.266 INFO:tasks.workunit.client.1.smithi153.stdout:5/125: chown d0/fd 15 1 2024-09-12T01:42:57.267 INFO:tasks.workunit.client.1.smithi153.stdout:5/126: creat d0/d20/f26 x:0 0 0 2024-09-12T01:42:57.267 INFO:tasks.workunit.client.1.smithi153.stdout:5/127: dread - d0/df/f1b zero size 2024-09-12T01:42:57.267 INFO:tasks.workunit.client.1.smithi153.stdout:5/128: read - d0/fe zero size 2024-09-12T01:42:57.269 INFO:tasks.workunit.client.1.smithi153.stdout:5/129: unlink d0/df/f1b 0 2024-09-12T01:42:57.269 INFO:tasks.workunit.client.1.smithi153.stdout:5/130: creat d0/df/f27 x:0 0 0 2024-09-12T01:42:57.269 INFO:tasks.workunit.client.1.smithi153.stdout:5/131: fdatasync d0/df/f27 0 2024-09-12T01:42:57.271 INFO:tasks.workunit.client.1.smithi153.stdout:5/132: symlink d0/d15/l28 0 2024-09-12T01:42:57.271 INFO:tasks.workunit.client.1.smithi153.stdout:5/133: creat d0/d15/f29 x:0 0 0 2024-09-12T01:42:57.271 INFO:tasks.workunit.client.1.smithi153.stdout:5/134: chown d0/df/l1d 0 1 2024-09-12T01:42:57.289 INFO:tasks.workunit.client.1.smithi153.stdout:9/161: dwrite d3/f1f [0,4194304] 0 2024-09-12T01:42:57.289 INFO:tasks.workunit.client.1.smithi153.stdout:4/112: dwrite f0 [0,4194304] 0 2024-09-12T01:42:57.289 INFO:tasks.workunit.client.1.smithi153.stdout:6/157: dwrite d1/d6/d23/f2b [0,4194304] 0 2024-09-12T01:42:57.289 INFO:tasks.workunit.client.1.smithi153.stdout:0/129: dwrite d22/f2b [0,4194304] 0 2024-09-12T01:42:57.291 INFO:tasks.workunit.client.1.smithi153.stdout:8/181: dwrite d17/d21/f30 [0,4194304] 0 2024-09-12T01:42:57.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/135: dwrite d0/fb [0,4194304] 0 2024-09-12T01:42:57.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/136: chown d0/f1f 24685 1 2024-09-12T01:42:57.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/137: chown d0/df/f21 1967124113 1 2024-09-12T01:42:57.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/138: chown d0/d20/f26 389 1 2024-09-12T01:42:57.291 INFO:tasks.workunit.client.1.smithi153.stdout:9/162: write d3/d19/f1e [4702054,16820] 0 2024-09-12T01:42:57.292 INFO:tasks.workunit.client.1.smithi153.stdout:7/131: getdents d12 0 2024-09-12T01:42:57.293 INFO:tasks.workunit.client.1.smithi153.stdout:0/130: dread f20 [0,4194304] 0 2024-09-12T01:42:57.293 INFO:tasks.workunit.client.1.smithi153.stdout:0/131: getdents d22 0 2024-09-12T01:42:57.294 INFO:tasks.workunit.client.1.smithi153.stdout:4/113: mkdir d6/d9/d26 0 2024-09-12T01:42:57.296 INFO:tasks.workunit.client.1.smithi153.stdout:7/132: dread fc [0,4194304] 0 2024-09-12T01:42:57.305 INFO:tasks.workunit.client.1.smithi153.stdout:0/132: dread f1b [0,4194304] 0 2024-09-12T01:42:57.305 INFO:tasks.workunit.client.1.smithi153.stdout:0/133: fdatasync fa 0 2024-09-12T01:42:57.307 INFO:tasks.workunit.client.1.smithi153.stdout:8/182: rename fa to d17/d1d/d27/d2d/d34/f47 0 2024-09-12T01:42:57.309 INFO:tasks.workunit.client.1.smithi153.stdout:9/163: readlink d3/lb 0 2024-09-12T01:42:57.309 INFO:tasks.workunit.client.1.smithi153.stdout:7/133: creat d12/f26 x:0 0 0 2024-09-12T01:42:57.311 INFO:tasks.workunit.client.1.smithi153.stdout:0/134: creat d22/f2f x:0 0 0 2024-09-12T01:42:57.312 INFO:tasks.workunit.client.1.smithi153.stdout:9/164: creat d3/f28 x:0 0 0 2024-09-12T01:42:57.315 INFO:tasks.workunit.client.1.smithi153.stdout:0/135: mkdir d22/d30 0 2024-09-12T01:42:57.318 INFO:tasks.workunit.client.1.smithi153.stdout:0/136: unlink f8 0 2024-09-12T01:42:57.318 INFO:tasks.workunit.client.1.smithi153.stdout:0/137: truncate d22/f2a 836338 0 2024-09-12T01:42:57.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/139: dwrite d0/fb [0,4194304] 0 2024-09-12T01:42:57.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/140: creat d0/d15/f2a x:0 0 0 2024-09-12T01:42:57.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/141: read d0/d15/f25 [3159195,118283] 0 2024-09-12T01:42:57.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/142: dread - d0/df/f27 zero size 2024-09-12T01:42:57.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/143: write d0/f8 [1873805,25197] 0 2024-09-12T01:42:57.319 INFO:tasks.workunit.client.1.smithi153.stdout:5/144: write d0/d15/f1a [24740,35512] 0 2024-09-12T01:42:57.320 INFO:tasks.workunit.client.1.smithi153.stdout:0/138: mknod d22/c31 0 2024-09-12T01:42:57.320 INFO:tasks.workunit.client.1.smithi153.stdout:0/139: creat d22/f32 x:0 0 0 2024-09-12T01:42:57.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/145: creat d0/df/d1c/d22/f2b x:0 0 0 2024-09-12T01:42:57.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/146: chown d0/d20 129186203 1 2024-09-12T01:42:57.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/147: stat d0/df/l13 0 2024-09-12T01:42:57.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/148: truncate d0/d15/f1a 760251 0 2024-09-12T01:42:57.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/149: chown d0/d15/f1a 1728367 1 2024-09-12T01:42:57.323 INFO:tasks.workunit.client.1.smithi153.stdout:6/158: dwrite d1/df/f26 [0,4194304] 0 2024-09-12T01:42:57.324 INFO:tasks.workunit.client.1.smithi153.stdout:4/114: dwrite f0 [0,4194304] 0 2024-09-12T01:42:57.325 INFO:tasks.workunit.client.1.smithi153.stdout:5/150: rename d0/df/l23 to d0/d20/l2c 0 2024-09-12T01:42:57.330 INFO:tasks.workunit.client.1.smithi153.stdout:7/134: write f10 [6893323,4465] 0 2024-09-12T01:42:57.330 INFO:tasks.workunit.client.1.smithi153.stdout:7/135: chown l3 3935043 1 2024-09-12T01:42:57.331 INFO:tasks.workunit.client.1.smithi153.stdout:5/151: rename d0/df/f1e to d0/df/f2d 0 2024-09-12T01:42:57.333 INFO:tasks.workunit.client.1.smithi153.stdout:6/159: rmdir d1/d6/d23 39 2024-09-12T01:42:57.334 INFO:tasks.workunit.client.1.smithi153.stdout:7/136: symlink d12/l27 0 2024-09-12T01:42:57.335 INFO:tasks.workunit.client.1.smithi153.stdout:7/137: stat f7 0 2024-09-12T01:42:57.335 INFO:tasks.workunit.client.1.smithi153.stdout:9/165: dwrite d3/f7 [0,4194304] 0 2024-09-12T01:42:57.335 INFO:tasks.workunit.client.1.smithi153.stdout:9/166: truncate d3/d19/f22 183545 0 2024-09-12T01:42:57.336 INFO:tasks.workunit.client.1.smithi153.stdout:6/160: truncate d1/d6/f8 4496892 0 2024-09-12T01:42:57.336 INFO:tasks.workunit.client.1.smithi153.stdout:6/161: write d1/d6/da/d19/d1e/f2a [4852344,122487] 0 2024-09-12T01:42:57.336 INFO:tasks.workunit.client.1.smithi153.stdout:7/138: truncate fe 3484407 0 2024-09-12T01:42:57.340 INFO:tasks.workunit.client.1.smithi153.stdout:0/140: dwrite d22/f2c [0,4194304] 0 2024-09-12T01:42:57.340 INFO:tasks.workunit.client.1.smithi153.stdout:7/139: unlink d12/l24 0 2024-09-12T01:42:57.340 INFO:tasks.workunit.client.1.smithi153.stdout:8/183: dwrite d17/d1f/f39 [0,4194304] 0 2024-09-12T01:42:57.343 INFO:tasks.workunit.client.1.smithi153.stdout:0/141: mkdir d22/d30/d33 0 2024-09-12T01:42:57.354 INFO:tasks.workunit.client.1.smithi153.stdout:8/184: creat d17/d1d/d27/d2d/d42/f48 x:0 0 0 2024-09-12T01:42:57.354 INFO:tasks.workunit.client.1.smithi153.stdout:6/162: rename d1/d6/da/d19/d1e to d1/d6/da/d19/d34 0 2024-09-12T01:42:57.355 INFO:tasks.workunit.client.1.smithi153.stdout:0/142: symlink d22/d30/l34 0 2024-09-12T01:42:57.355 INFO:tasks.workunit.client.1.smithi153.stdout:5/152: dwrite d0/f12 [0,4194304] 0 2024-09-12T01:42:57.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/143: write fd [19151,90584] 0 2024-09-12T01:42:57.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/144: dread - d22/f2f zero size 2024-09-12T01:42:57.357 INFO:tasks.workunit.client.1.smithi153.stdout:2/134: sync 2024-09-12T01:42:57.358 INFO:tasks.workunit.client.1.smithi153.stdout:4/115: truncate f0 3776303 0 2024-09-12T01:42:57.358 INFO:tasks.workunit.client.1.smithi153.stdout:4/116: getdents d6/d9/d11/d14 0 2024-09-12T01:42:57.359 INFO:tasks.workunit.client.1.smithi153.stdout:5/153: mkdir d0/d20/d2e 0 2024-09-12T01:42:57.360 INFO:tasks.workunit.client.1.smithi153.stdout:0/145: creat d22/d30/d33/f35 x:0 0 0 2024-09-12T01:42:57.362 INFO:tasks.workunit.client.1.smithi153.stdout:2/135: link d7/db/f25 d7/db/d27/f29 0 2024-09-12T01:42:57.364 INFO:tasks.workunit.client.1.smithi153.stdout:4/117: truncate d6/d9/f10 2745380 0 2024-09-12T01:42:57.364 INFO:tasks.workunit.client.1.smithi153.stdout:4/118: chown d6/d9/f25 897308174 1 2024-09-12T01:42:57.365 INFO:tasks.workunit.client.1.smithi153.stdout:5/154: mkdir d0/df/d1c/d22/d2f 0 2024-09-12T01:42:57.366 INFO:tasks.workunit.client.1.smithi153.stdout:0/146: rename d22/c29 to d22/c36 0 2024-09-12T01:42:57.367 INFO:tasks.workunit.client.1.smithi153.stdout:4/119: symlink d6/d9/dc/l27 0 2024-09-12T01:42:57.368 INFO:tasks.workunit.client.1.smithi153.stdout:6/163: write d1/d6/d23/f2b [1580772,42665] 0 2024-09-12T01:42:57.368 INFO:tasks.workunit.client.1.smithi153.stdout:6/164: write d1/d6/da/f2f [217555,38041] 0 2024-09-12T01:42:57.368 INFO:tasks.workunit.client.1.smithi153.stdout:6/165: read - d1/d6/da/d19/d34/f20 zero size 2024-09-12T01:42:57.369 INFO:tasks.workunit.client.1.smithi153.stdout:5/155: rename d0/df/l13 to d0/d20/d2e/l30 0 2024-09-12T01:42:57.369 INFO:tasks.workunit.client.1.smithi153.stdout:2/136: rmdir d7/d17 39 2024-09-12T01:42:57.369 INFO:tasks.workunit.client.1.smithi153.stdout:2/137: readlink d7/db/l24 0 2024-09-12T01:42:57.370 INFO:tasks.workunit.client.1.smithi153.stdout:4/120: rename d6/d9/d17/c1d to d6/d9/d11/d14/c28 0 2024-09-12T01:42:57.370 INFO:tasks.workunit.client.1.smithi153.stdout:2/138: symlink d7/d17/l2a 0 2024-09-12T01:42:57.371 INFO:tasks.workunit.client.1.smithi153.stdout:4/121: mknod d6/d15/c29 0 2024-09-12T01:42:57.371 INFO:tasks.workunit.client.1.smithi153.stdout:2/139: link d7/c10 d7/db/d21/c2b 0 2024-09-12T01:42:57.373 INFO:tasks.workunit.client.1.smithi153.stdout:4/122: creat d6/d9/d11/d14/f2a x:0 0 0 2024-09-12T01:42:57.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/140: unlink d7/d19/f20 0 2024-09-12T01:42:57.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/141: fdatasync d7/db/d27/f29 0 2024-09-12T01:42:57.375 INFO:tasks.workunit.client.1.smithi153.stdout:4/123: creat d6/d9/f2b x:0 0 0 2024-09-12T01:42:57.375 INFO:tasks.workunit.client.1.smithi153.stdout:4/124: chown d6/l1b 1176 1 2024-09-12T01:42:57.375 INFO:tasks.workunit.client.1.smithi153.stdout:7/140: dwrite d12/f26 [0,4194304] 0 2024-09-12T01:42:57.376 INFO:tasks.workunit.client.1.smithi153.stdout:2/142: mknod d7/db/c2c 0 2024-09-12T01:42:57.377 INFO:tasks.workunit.client.1.smithi153.stdout:9/167: dwrite d3/f11 [0,4194304] 0 2024-09-12T01:42:57.377 INFO:tasks.workunit.client.1.smithi153.stdout:0/147: write f6 [3276953,80250] 0 2024-09-12T01:42:57.379 INFO:tasks.workunit.client.1.smithi153.stdout:7/141: mknod d12/d21/c28 0 2024-09-12T01:42:57.380 INFO:tasks.workunit.client.1.smithi153.stdout:8/185: dwrite d17/d21/f30 [0,4194304] 0 2024-09-12T01:42:57.380 INFO:tasks.workunit.client.1.smithi153.stdout:8/186: truncate d17/f28 605117 0 2024-09-12T01:42:57.381 INFO:tasks.workunit.client.1.smithi153.stdout:2/143: rename d7/db/l1a to d7/db/d21/l2d 0 2024-09-12T01:42:57.381 INFO:tasks.workunit.client.1.smithi153.stdout:5/156: dread d0/d15/f1a [0,4194304] 0 2024-09-12T01:42:57.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/168: creat d3/f29 x:0 0 0 2024-09-12T01:42:57.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/169: creat d3/d19/f2a x:0 0 0 2024-09-12T01:42:57.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/170: write d3/ff [849641,64215] 0 2024-09-12T01:42:57.384 INFO:tasks.workunit.client.1.smithi153.stdout:7/142: mkdir d12/d21/d29 0 2024-09-12T01:42:57.386 INFO:tasks.workunit.client.1.smithi153.stdout:8/187: truncate d17/f24 827196 0 2024-09-12T01:42:57.389 INFO:tasks.workunit.client.1.smithi153.stdout:2/144: symlink d7/d17/l2e 0 2024-09-12T01:42:57.391 INFO:tasks.workunit.client.1.smithi153.stdout:5/157: truncate d0/f8 91775 0 2024-09-12T01:42:57.393 INFO:tasks.workunit.client.1.smithi153.stdout:1/126: sync 2024-09-12T01:42:57.395 INFO:tasks.workunit.client.1.smithi153.stdout:3/134: sync 2024-09-12T01:42:57.395 INFO:tasks.workunit.client.1.smithi153.stdout:3/135: chown d1/f12 12 1 2024-09-12T01:42:57.395 INFO:tasks.workunit.client.1.smithi153.stdout:9/171: dread d3/fc [0,4194304] 0 2024-09-12T01:42:57.396 INFO:tasks.workunit.client.1.smithi153.stdout:1/127: dread d2/d9/f19 [0,4194304] 0 2024-09-12T01:42:57.397 INFO:tasks.workunit.client.1.smithi153.stdout:7/143: rename l3 to d12/l2a 0 2024-09-12T01:42:57.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/145: unlink d7/db/f15 0 2024-09-12T01:42:57.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/146: readlink d7/db/d21/l2d 0 2024-09-12T01:42:57.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/147: chown d7/db/d1d 192946 1 2024-09-12T01:42:57.407 INFO:tasks.workunit.client.1.smithi153.stdout:0/148: dwrite d22/f2a [0,4194304] 0 2024-09-12T01:42:57.408 INFO:tasks.workunit.client.1.smithi153.stdout:5/158: link d0/df/l1d d0/d20/d2e/l31 0 2024-09-12T01:42:57.434 INFO:tasks.workunit.client.1.smithi153.stdout:6/166: dwrite d1/d6/da/d19/d34/f2a [4194304,4194304] 0 2024-09-12T01:42:57.435 INFO:tasks.workunit.client.1.smithi153.stdout:6/167: rmdir d1/d6/da/d19 39 2024-09-12T01:42:57.438 INFO:tasks.workunit.client.1.smithi153.stdout:5/159: dread d0/fb [0,4194304] 0 2024-09-12T01:42:57.438 INFO:tasks.workunit.client.1.smithi153.stdout:5/160: dread - d0/df/f21 zero size 2024-09-12T01:42:57.439 INFO:tasks.workunit.client.1.smithi153.stdout:5/161: creat d0/f32 x:0 0 0 2024-09-12T01:42:57.440 INFO:tasks.workunit.client.1.smithi153.stdout:5/162: dread - d0/df/f21 zero size 2024-09-12T01:42:57.440 INFO:tasks.workunit.client.1.smithi153.stdout:8/188: dwrite d17/d1d/d27/d2d/f45 [0,4194304] 0 2024-09-12T01:42:57.440 INFO:tasks.workunit.client.1.smithi153.stdout:8/189: read - d17/d1d/f36 zero size 2024-09-12T01:42:57.440 INFO:tasks.workunit.client.1.smithi153.stdout:7/144: dwrite d12/f20 [0,4194304] 0 2024-09-12T01:42:57.440 INFO:tasks.workunit.client.1.smithi153.stdout:1/128: dwrite d2/d9/d28/f2a [0,4194304] 0 2024-09-12T01:42:57.441 INFO:tasks.workunit.client.1.smithi153.stdout:5/163: symlink d0/d20/d2e/l33 0 2024-09-12T01:42:57.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/149: dwrite d22/f26 [0,4194304] 0 2024-09-12T01:42:57.442 INFO:tasks.workunit.client.1.smithi153.stdout:5/164: write d0/d15/f1a [560627,35189] 0 2024-09-12T01:42:57.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/168: write d1/d6/d23/f29 [6120454,90174] 0 2024-09-12T01:42:57.452 INFO:tasks.workunit.client.1.smithi153.stdout:7/145: mknod d12/c2b 0 2024-09-12T01:42:57.452 INFO:tasks.workunit.client.1.smithi153.stdout:7/146: read f10 [8089983,396] 0 2024-09-12T01:42:57.453 INFO:tasks.workunit.client.1.smithi153.stdout:1/129: mknod d2/d9/d28/c2b 0 2024-09-12T01:42:57.454 INFO:tasks.workunit.client.1.smithi153.stdout:2/148: getdents d7/d17 0 2024-09-12T01:42:57.454 INFO:tasks.workunit.client.1.smithi153.stdout:2/149: chown d7/db/d1d/f28 0 1 2024-09-12T01:42:57.457 INFO:tasks.workunit.client.1.smithi153.stdout:7/147: write fe [2565746,39620] 0 2024-09-12T01:42:57.458 INFO:tasks.workunit.client.1.smithi153.stdout:0/150: creat d22/d30/f37 x:0 0 0 2024-09-12T01:42:57.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/165: rename d0/df/l1d to d0/d20/d2e/l34 0 2024-09-12T01:42:57.461 INFO:tasks.workunit.client.1.smithi153.stdout:9/172: getdents d3/d19 0 2024-09-12T01:42:57.461 INFO:tasks.workunit.client.1.smithi153.stdout:9/173: fdatasync d3/f28 0 2024-09-12T01:42:57.463 INFO:tasks.workunit.client.1.smithi153.stdout:0/151: mknod d22/d30/c38 0 2024-09-12T01:42:57.463 INFO:tasks.workunit.client.1.smithi153.stdout:1/130: getdents d2/d9/d1d 0 2024-09-12T01:42:57.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/131: mkdir d2/d9/d17/d2c 0 2024-09-12T01:42:57.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/169: dwrite d1/d6/da/f2f [0,4194304] 0 2024-09-12T01:42:57.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/170: creat d1/d6/f35 x:0 0 0 2024-09-12T01:42:57.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/171: write d1/d6/f8 [5265365,25693] 0 2024-09-12T01:42:57.469 INFO:tasks.workunit.client.1.smithi153.stdout:1/132: rename d2/d9/f12 to d2/d9/d17/f2d 0 2024-09-12T01:42:57.469 INFO:tasks.workunit.client.1.smithi153.stdout:1/133: stat d2/d9/d17/f2d 0 2024-09-12T01:42:57.470 INFO:tasks.workunit.client.1.smithi153.stdout:1/134: creat d2/d9/f2e x:0 0 0 2024-09-12T01:42:57.470 INFO:tasks.workunit.client.1.smithi153.stdout:1/135: write d2/d9/d17/f2d [4106190,82377] 0 2024-09-12T01:42:57.473 INFO:tasks.workunit.client.1.smithi153.stdout:8/190: dwrite f15 [0,4194304] 0 2024-09-12T01:42:57.476 INFO:tasks.workunit.client.1.smithi153.stdout:1/136: mkdir d2/d9/d17/d2f 0 2024-09-12T01:42:57.485 INFO:tasks.workunit.client.1.smithi153.stdout:8/191: symlink d17/d21/d3a/l49 0 2024-09-12T01:42:57.485 INFO:tasks.workunit.client.1.smithi153.stdout:8/192: dread - d17/d1d/d27/d2d/d34/f40 zero size 2024-09-12T01:42:57.486 INFO:tasks.workunit.client.1.smithi153.stdout:8/193: truncate d17/d1d/f41 654584 0 2024-09-12T01:42:57.486 INFO:tasks.workunit.client.1.smithi153.stdout:8/194: truncate d17/f28 1012721 0 2024-09-12T01:42:57.486 INFO:tasks.workunit.client.1.smithi153.stdout:8/195: fdatasync f10 0 2024-09-12T01:42:57.486 INFO:tasks.workunit.client.1.smithi153.stdout:6/172: getdents d1 0 2024-09-12T01:42:57.487 INFO:tasks.workunit.client.1.smithi153.stdout:8/196: mkdir d17/d21/d4a 0 2024-09-12T01:42:57.487 INFO:tasks.workunit.client.1.smithi153.stdout:8/197: fsync d17/d1d/d27/d2d/f45 0 2024-09-12T01:42:57.488 INFO:tasks.workunit.client.1.smithi153.stdout:6/173: link d1/d6/f15 d1/d6/da/d32/f36 0 2024-09-12T01:42:57.488 INFO:tasks.workunit.client.1.smithi153.stdout:6/174: creat d1/d6/da/f37 x:0 0 0 2024-09-12T01:42:57.488 INFO:tasks.workunit.client.1.smithi153.stdout:8/198: mknod d17/d1d/d27/d2d/c4b 0 2024-09-12T01:42:57.490 INFO:tasks.workunit.client.1.smithi153.stdout:6/175: creat d1/f38 x:0 0 0 2024-09-12T01:42:57.491 INFO:tasks.workunit.client.1.smithi153.stdout:6/176: write d1/d6/d23/f29 [4772461,13814] 0 2024-09-12T01:42:57.492 INFO:tasks.workunit.client.1.smithi153.stdout:8/199: symlink d17/d21/d3a/l4c 0 2024-09-12T01:42:57.493 INFO:tasks.workunit.client.1.smithi153.stdout:6/177: mkdir d1/d6/d39 0 2024-09-12T01:42:57.499 INFO:tasks.workunit.client.1.smithi153.stdout:2/150: dwrite f2 [4194304,4194304] 0 2024-09-12T01:42:57.499 INFO:tasks.workunit.client.1.smithi153.stdout:0/152: dwrite f4 [0,4194304] 0 2024-09-12T01:42:57.499 INFO:tasks.workunit.client.1.smithi153.stdout:0/153: creat d22/f39 x:0 0 0 2024-09-12T01:42:57.499 INFO:tasks.workunit.client.1.smithi153.stdout:0/154: creat d22/d30/f3a x:0 0 0 2024-09-12T01:42:57.499 INFO:tasks.workunit.client.1.smithi153.stdout:7/148: dwrite fc [0,4194304] 0 2024-09-12T01:42:57.500 INFO:tasks.workunit.client.1.smithi153.stdout:2/151: read d7/db/d27/f29 [281204,4146] 0 2024-09-12T01:42:57.500 INFO:tasks.workunit.client.1.smithi153.stdout:2/152: fdatasync d7/db/f25 0 2024-09-12T01:42:57.504 INFO:tasks.workunit.client.1.smithi153.stdout:0/155: truncate f21 291155 0 2024-09-12T01:42:57.504 INFO:tasks.workunit.client.1.smithi153.stdout:0/156: chown d22/c36 15796359 1 2024-09-12T01:42:57.504 INFO:tasks.workunit.client.1.smithi153.stdout:0/157: rename d22/d30 to d22/d30/d3b 22 2024-09-12T01:42:57.504 INFO:tasks.workunit.client.1.smithi153.stdout:0/158: readlink d22/l27 0 2024-09-12T01:42:57.504 INFO:tasks.workunit.client.1.smithi153.stdout:5/166: dwrite d0/f12 [0,4194304] 0 2024-09-12T01:42:57.505 INFO:tasks.workunit.client.1.smithi153.stdout:2/153: dread d7/db/ff [0,4194304] 0 2024-09-12T01:42:57.507 INFO:tasks.workunit.client.1.smithi153.stdout:0/159: rename d22/d30/f3a to d22/f3c 0 2024-09-12T01:42:57.510 INFO:tasks.workunit.client.1.smithi153.stdout:9/174: dwrite f1 [0,4194304] 0 2024-09-12T01:42:57.512 INFO:tasks.workunit.client.1.smithi153.stdout:5/167: link d0/fd d0/df/f35 0 2024-09-12T01:42:57.512 INFO:tasks.workunit.client.1.smithi153.stdout:5/168: chown d0/f8 486496 1 2024-09-12T01:42:57.513 INFO:tasks.workunit.client.0.smithi066.stderr:++ readlink -f fsstress 2024-09-12T01:42:57.514 INFO:tasks.workunit.client.1.smithi153.stdout:7/149: write f7 [1857286,21882] 0 2024-09-12T01:42:57.514 INFO:tasks.workunit.client.1.smithi153.stdout:7/150: chown d12/c15 31109 1 2024-09-12T01:42:57.514 INFO:tasks.workunit.client.1.smithi153.stdout:2/154: mknod d7/d17/c2f 0 2024-09-12T01:42:57.514 INFO:tasks.workunit.client.0.smithi066.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-12T01:42:57.515 INFO:tasks.workunit.client.0.smithi066.stderr:+ popd 2024-09-12T01:42:57.515 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-12T01:42:57.515 INFO:tasks.workunit.client.0.smithi066.stderr:+ popd 2024-09-12T01:42:57.515 INFO:tasks.workunit.client.0.smithi066.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-12T01:42:57.516 INFO:tasks.workunit.client.0.smithi066.stderr:++ mktemp -d -p . 2024-09-12T01:42:57.516 INFO:tasks.workunit.client.1.smithi153.stdout:5/169: mkdir d0/d20/d2e/d36 0 2024-09-12T01:42:57.517 INFO:tasks.workunit.client.1.smithi153.stdout:5/170: creat d0/d20/f37 x:0 0 0 2024-09-12T01:42:57.517 INFO:tasks.workunit.client.1.smithi153.stdout:5/171: creat d0/df/d1c/d22/f38 x:0 0 0 2024-09-12T01:42:57.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/200: dwrite d17/f1b [0,4194304] 0 2024-09-12T01:42:57.518 INFO:tasks.workunit.client.1.smithi153.stdout:7/151: creat d12/d21/d29/f2c x:0 0 0 2024-09-12T01:42:57.518 INFO:tasks.workunit.client.1.smithi153.stdout:7/152: fdatasync d12/d21/d29/f2c 0 2024-09-12T01:42:57.519 INFO:tasks.workunit.client.0.smithi066.stderr:+ T=./tmp.zYu16165RL 2024-09-12T01:42:57.519 INFO:tasks.workunit.client.0.smithi066.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.zYu16165RL -l 1 -n 1000 -p 10 -v 2024-09-12T01:42:57.521 INFO:tasks.workunit.client.1.smithi153.stdout:9/175: link f1 d3/f2b 0 2024-09-12T01:42:57.523 INFO:tasks.workunit.client.0.smithi066.stdout:seed = 1726629657 2024-09-12T01:42:57.523 INFO:tasks.workunit.client.1.smithi153.stdout:4/125: sync 2024-09-12T01:42:57.524 INFO:tasks.workunit.client.1.smithi153.stdout:1/137: dwrite d2/d9/d17/f2d [0,4194304] 0 2024-09-12T01:42:57.526 INFO:tasks.workunit.client.1.smithi153.stdout:8/201: write d17/f2f [1061178,23705] 0 2024-09-12T01:42:57.528 INFO:tasks.workunit.client.1.smithi153.stdout:7/153: mkdir d12/d21/d29/d2d 0 2024-09-12T01:42:57.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/178: getdents d1 0 2024-09-12T01:42:57.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/179: readlink d1/d6/da/l1c 0 2024-09-12T01:42:57.532 INFO:tasks.workunit.client.1.smithi153.stdout:2/155: getdents d7/db/d21 0 2024-09-12T01:42:57.533 INFO:tasks.workunit.client.1.smithi153.stdout:0/160: dwrite d22/f2a [4194304,4194304] 0 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.1.smithi153.stdout:9/176: link d3/d19/f2a d3/d19/f2c 0 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/0: dread - no filename 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/1: write - no filename 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/2: write - no filename 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/3: fsync - no filename 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/4: dwrite - no filename 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/5: link - no file 2024-09-12T01:42:57.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/6: dread - no filename 2024-09-12T01:42:57.536 INFO:tasks.workunit.client.0.smithi066.stdout:1/7: write - no filename 2024-09-12T01:42:57.536 INFO:tasks.workunit.client.0.smithi066.stdout:1/8: dwrite - no filename 2024-09-12T01:42:57.536 INFO:tasks.workunit.client.1.smithi153.stdout:4/126: rename d6/d9/dc/l27 to d6/d9/d11/l2c 0 2024-09-12T01:42:57.538 INFO:tasks.workunit.client.0.smithi066.stdout:0/0: symlink l0 0 2024-09-12T01:42:57.539 INFO:tasks.workunit.client.1.smithi153.stdout:1/138: link d2/d9/f1b d2/d9/d1d/f30 0 2024-09-12T01:42:57.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/0: dread - no filename 2024-09-12T01:42:57.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/1: fsync - no filename 2024-09-12T01:42:57.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/2: unlink - no file 2024-09-12T01:42:57.545 INFO:tasks.workunit.client.0.smithi066.stdout:1/9: creat f0 x:0 0 0 2024-09-12T01:42:57.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/154: symlink d12/l2e 0 2024-09-12T01:42:57.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/155: readlink d12/l13 0 2024-09-12T01:42:57.546 INFO:tasks.workunit.client.1.smithi153.stdout:7/156: creat d12/f2f x:0 0 0 2024-09-12T01:42:57.547 INFO:tasks.workunit.client.0.smithi066.stdout:0/1: mkdir d1 0 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/0: readlink - no filename 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/1: write - no filename 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/2: chown . 2014877 1 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/3: write - no filename 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/4: fsync - no filename 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/5: chown . 3 1 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/6: dread - no filename 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/7: readlink - no filename 2024-09-12T01:42:57.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/8: chown . 674853 1 2024-09-12T01:42:57.550 INFO:tasks.workunit.client.1.smithi153.stdout:3/136: sync 2024-09-12T01:42:57.550 INFO:tasks.workunit.client.1.smithi153.stdout:9/177: dread f1 [0,4194304] 0 2024-09-12T01:42:57.550 INFO:tasks.workunit.client.0.smithi066.stdout:2/3: creat f0 x:0 0 0 2024-09-12T01:42:57.551 INFO:tasks.workunit.client.1.smithi153.stdout:6/180: dread d1/d6/da/f2f [0,4194304] 0 2024-09-12T01:42:57.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/2: mknod d1/c2 0 2024-09-12T01:42:57.555 INFO:tasks.workunit.client.1.smithi153.stdout:1/139: creat d2/d9/d17/d2f/f31 x:0 0 0 2024-09-12T01:42:57.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/140: chown d2/d9/d1d 364 1 2024-09-12T01:42:57.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/141: chown d2/d9/d17/d2c 235 1 2024-09-12T01:42:57.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/142: read - d2/d9/d17/f23 zero size 2024-09-12T01:42:57.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/143: fsync d2/d9/f15 0 2024-09-12T01:42:57.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/144: creat d2/d9/f32 x:0 0 0 2024-09-12T01:42:57.557 INFO:tasks.workunit.client.1.smithi153.stdout:2/156: dwrite d7/db/ff [0,4194304] 0 2024-09-12T01:42:57.557 INFO:tasks.workunit.client.1.smithi153.stdout:2/157: creat d7/db/f30 x:0 0 0 2024-09-12T01:42:57.558 INFO:tasks.workunit.client.0.smithi066.stdout:4/0: truncate - no filename 2024-09-12T01:42:57.558 INFO:tasks.workunit.client.1.smithi153.stdout:8/202: dwrite d17/d1d/f36 [0,4194304] 0 2024-09-12T01:42:57.560 INFO:tasks.workunit.client.0.smithi066.stdout:3/9: creat f0 x:0 0 0 2024-09-12T01:42:57.560 INFO:tasks.workunit.client.0.smithi066.stdout:3/10: dread - f0 zero size 2024-09-12T01:42:57.560 INFO:tasks.workunit.client.0.smithi066.stdout:3/11: chown f0 691171 1 2024-09-12T01:42:57.562 INFO:tasks.workunit.client.1.smithi153.stdout:3/137: unlink d1/d13/d25/f28 0 2024-09-12T01:42:57.562 INFO:tasks.workunit.client.1.smithi153.stdout:0/161: dread f4 [0,4194304] 0 2024-09-12T01:42:57.563 INFO:tasks.workunit.client.0.smithi066.stdout:0/3: creat d1/f3 x:0 0 0 2024-09-12T01:42:57.563 INFO:tasks.workunit.client.0.smithi066.stdout:0/4: chown l0 109 1 2024-09-12T01:42:57.563 INFO:tasks.workunit.client.0.smithi066.stdout:0/5: chown d1 76762 1 2024-09-12T01:42:57.564 INFO:tasks.workunit.client.1.smithi153.stdout:6/181: truncate d1/df/f26 829097 0 2024-09-12T01:42:57.566 INFO:tasks.workunit.client.0.smithi066.stdout:5/0: dread - no filename 2024-09-12T01:42:57.566 INFO:tasks.workunit.client.0.smithi066.stdout:5/1: rename - no filename 2024-09-12T01:42:57.566 INFO:tasks.workunit.client.0.smithi066.stdout:5/2: fsync - no filename 2024-09-12T01:42:57.570 INFO:tasks.workunit.client.1.smithi153.stdout:6/182: dread d1/d6/da/f1a [0,4194304] 0 2024-09-12T01:42:57.576 INFO:tasks.workunit.client.1.smithi153.stdout:1/145: mknod d2/d9/c33 0 2024-09-12T01:42:57.576 INFO:tasks.workunit.client.1.smithi153.stdout:1/146: chown d2/d9/c16 1209 1 2024-09-12T01:42:57.584 INFO:tasks.workunit.client.0.smithi066.stdout:4/1: symlink l0 0 2024-09-12T01:42:57.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/3: mkdir d0 0 2024-09-12T01:42:57.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/4: dwrite - no filename 2024-09-12T01:42:57.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/5: dread - no filename 2024-09-12T01:42:57.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/6: dwrite - no filename 2024-09-12T01:42:57.586 INFO:tasks.workunit.client.0.smithi066.stdout:3/12: symlink l1 0 2024-09-12T01:42:57.587 INFO:tasks.workunit.client.0.smithi066.stdout:1/10: fsync f0 0 2024-09-12T01:42:57.588 INFO:tasks.workunit.client.1.smithi153.stdout:9/178: dwrite d3/fc [0,4194304] 0 2024-09-12T01:42:57.590 INFO:tasks.workunit.client.1.smithi153.stdout:2/158: creat d7/db/d27/f31 x:0 0 0 2024-09-12T01:42:57.591 INFO:tasks.workunit.client.0.smithi066.stdout:4/2: symlink l1 0 2024-09-12T01:42:57.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/3: stat l1 0 2024-09-12T01:42:57.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/4: dread - no filename 2024-09-12T01:42:57.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/7: symlink d0/l1 0 2024-09-12T01:42:57.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/8: fdatasync - no filename 2024-09-12T01:42:57.596 INFO:tasks.workunit.client.0.smithi066.stdout:1/11: rename f0 to f1 0 2024-09-12T01:42:57.598 INFO:tasks.workunit.client.1.smithi153.stdout:8/203: mknod d17/d21/c4d 0 2024-09-12T01:42:57.598 INFO:tasks.workunit.client.1.smithi153.stdout:8/204: chown d17/d1d/f36 3 1 2024-09-12T01:42:57.598 INFO:tasks.workunit.client.1.smithi153.stdout:8/205: chown d17/d21/c37 30501984 1 2024-09-12T01:42:57.600 INFO:tasks.workunit.client.0.smithi066.stdout:5/9: creat d0/f2 x:0 0 0 2024-09-12T01:42:57.600 INFO:tasks.workunit.client.0.smithi066.stdout:5/10: truncate d0/f2 749888 0 2024-09-12T01:42:57.601 INFO:tasks.workunit.client.1.smithi153.stdout:3/138: creat d1/d1e/f2a x:0 0 0 2024-09-12T01:42:57.601 INFO:tasks.workunit.client.1.smithi153.stdout:3/139: write d1/d16/f1b [805666,114309] 0 2024-09-12T01:42:57.603 INFO:tasks.workunit.client.0.smithi066.stdout:5/11: symlink d0/l3 0 2024-09-12T01:42:57.607 INFO:tasks.workunit.client.1.smithi153.stdout:0/162: symlink d22/d30/d33/l3d 0 2024-09-12T01:42:57.607 INFO:tasks.workunit.client.1.smithi153.stdout:9/179: creat d3/f2d x:0 0 0 2024-09-12T01:42:57.607 INFO:tasks.workunit.client.1.smithi153.stdout:6/183: mkdir d1/d6/da/d19/d3a 0 2024-09-12T01:42:57.607 INFO:tasks.workunit.client.1.smithi153.stdout:6/184: chown d1/d6/da/d19/d34/d33 0 1 2024-09-12T01:42:57.608 INFO:tasks.workunit.client.1.smithi153.stdout:3/140: creat d1/d13/d23/f2b x:0 0 0 2024-09-12T01:42:57.610 INFO:tasks.workunit.client.1.smithi153.stdout:2/159: getdents d7/db/d1d 0 2024-09-12T01:42:57.610 INFO:tasks.workunit.client.1.smithi153.stdout:2/160: stat d7/d17/c18 0 2024-09-12T01:42:57.616 INFO:tasks.workunit.client.1.smithi153.stdout:0/163: unlink lc 0 2024-09-12T01:42:57.617 INFO:tasks.workunit.client.1.smithi153.stdout:9/180: truncate d3/d19/f1e 996286 0 2024-09-12T01:42:57.617 INFO:tasks.workunit.client.1.smithi153.stdout:3/141: creat d1/d13/d25/d26/f2c x:0 0 0 2024-09-12T01:42:57.619 INFO:tasks.workunit.client.1.smithi153.stdout:0/164: link f4 d22/f3e 0 2024-09-12T01:42:57.620 INFO:tasks.workunit.client.1.smithi153.stdout:9/181: fdatasync d3/fe 0 2024-09-12T01:42:57.622 INFO:tasks.workunit.client.1.smithi153.stdout:3/142: creat d1/d16/d1c/f2d x:0 0 0 2024-09-12T01:42:57.622 INFO:tasks.workunit.client.1.smithi153.stdout:3/143: dread - d1/d13/d25/d26/f2c zero size 2024-09-12T01:42:57.625 INFO:tasks.workunit.client.1.smithi153.stdout:9/182: chown d3/f1d 344522 1 2024-09-12T01:42:57.673 INFO:tasks.workunit.client.1.smithi153.stdout:1/147: rmdir d2/d9/d17 39 2024-09-12T01:42:57.673 INFO:tasks.workunit.client.1.smithi153.stdout:1/148: chown d2/d9/f19 58664784 1 2024-09-12T01:42:57.678 INFO:tasks.workunit.client.1.smithi153.stdout:1/149: mkdir d2/d34 0 2024-09-12T01:42:57.679 INFO:tasks.workunit.client.1.smithi153.stdout:1/150: creat d2/d9/d1d/d25/f35 x:0 0 0 2024-09-12T01:42:57.725 INFO:tasks.workunit.client.1.smithi153.stdout:7/157: dwrite f7 [0,4194304] 0 2024-09-12T01:42:57.733 INFO:tasks.workunit.client.1.smithi153.stdout:7/158: unlink l9 0 2024-09-12T01:42:57.738 INFO:tasks.workunit.client.1.smithi153.stdout:7/159: link d12/d21/d29/f2c d12/d21/d29/d2d/f30 0 2024-09-12T01:42:57.799 INFO:tasks.workunit.client.1.smithi153.stdout:0/165: dread d22/f2c [0,4194304] 0 2024-09-12T01:42:57.799 INFO:tasks.workunit.client.1.smithi153.stdout:0/166: creat d22/d30/d33/f3f x:0 0 0 2024-09-12T01:42:57.800 INFO:tasks.workunit.client.1.smithi153.stdout:3/144: dread d1/f11 [0,4194304] 0 2024-09-12T01:42:57.810 INFO:tasks.workunit.client.1.smithi153.stdout:2/161: dwrite d7/f11 [0,4194304] 0 2024-09-12T01:42:57.811 INFO:tasks.workunit.client.0.smithi066.stdout:5/12: getdents d0 0 2024-09-12T01:42:57.814 INFO:tasks.workunit.client.1.smithi153.stdout:3/145: rename d1/d13/d25/c29 to d1/d16/d1c/c2e 0 2024-09-12T01:42:57.820 INFO:tasks.workunit.client.1.smithi153.stdout:3/146: rename d1/d16/d17/f22 to d1/d1e/f2f 0 2024-09-12T01:42:57.989 INFO:tasks.workunit.client.1.smithi153.stdout:8/206: dwrite d17/d1d/d27/d2d/f45 [4194304,4194304] 0 2024-09-12T01:42:57.996 INFO:tasks.workunit.client.1.smithi153.stdout:1/151: getdents d2/d9/d1d/d25 0 2024-09-12T01:42:57.997 INFO:tasks.workunit.client.1.smithi153.stdout:1/152: write d2/f6 [2212400,58204] 0 2024-09-12T01:42:58.012 INFO:tasks.workunit.client.1.smithi153.stdout:8/207: truncate d17/d1f/f26 1484455 0 2024-09-12T01:42:58.012 INFO:tasks.workunit.client.1.smithi153.stdout:8/208: creat d17/d1d/d27/d2d/d42/f4e x:0 0 0 2024-09-12T01:42:58.015 INFO:tasks.workunit.client.0.smithi066.stdout:5/13: creat d0/f4 x:0 0 0 2024-09-12T01:42:58.018 INFO:tasks.workunit.client.1.smithi153.stdout:6/185: dwrite d1/d6/da/d32/f36 [0,4194304] 0 2024-09-12T01:42:58.022 INFO:tasks.workunit.client.1.smithi153.stdout:1/153: write d2/d9/d17/f2d [918839,81388] 0 2024-09-12T01:42:58.022 INFO:tasks.workunit.client.1.smithi153.stdout:1/154: truncate d2/d9/d1d/f22 1067003 0 2024-09-12T01:42:58.022 INFO:tasks.workunit.client.1.smithi153.stdout:1/155: chown d2/d9/d28 0 1 2024-09-12T01:42:58.023 INFO:tasks.workunit.client.1.smithi153.stdout:1/156: readlink d2/le 0 2024-09-12T01:42:58.028 INFO:tasks.workunit.client.1.smithi153.stdout:6/186: write d1/d6/da/f1a [534438,10988] 0 2024-09-12T01:42:58.028 INFO:tasks.workunit.client.1.smithi153.stdout:6/187: write d1/f4 [8972353,28666] 0 2024-09-12T01:42:58.039 INFO:tasks.workunit.client.1.smithi153.stdout:1/157: mknod d2/d9/d1d/d25/c36 0 2024-09-12T01:42:58.039 INFO:tasks.workunit.client.1.smithi153.stdout:1/158: dread - d2/d9/d17/f24 zero size 2024-09-12T01:42:58.048 INFO:tasks.workunit.client.1.smithi153.stdout:1/159: symlink d2/d9/d17/d2f/l37 0 2024-09-12T01:42:58.048 INFO:tasks.workunit.client.1.smithi153.stdout:1/160: write d2/d9/d17/d2f/f31 [646344,80240] 0 2024-09-12T01:42:58.048 INFO:tasks.workunit.client.1.smithi153.stdout:1/161: chown d2/d9/ca 273 1 2024-09-12T01:42:58.056 INFO:tasks.workunit.client.1.smithi153.stdout:1/162: dread d2/d9/d1d/f30 [4194304,4194304] 0 2024-09-12T01:42:58.056 INFO:tasks.workunit.client.1.smithi153.stdout:1/163: stat d2/l8 0 2024-09-12T01:42:58.061 INFO:tasks.workunit.client.0.smithi066.stdout:1/12: dwrite f1 [0,4194304] 0 2024-09-12T01:42:58.066 INFO:tasks.workunit.client.1.smithi153.stdout:1/164: rmdir d2/d20 0 2024-09-12T01:42:58.066 INFO:tasks.workunit.client.1.smithi153.stdout:1/165: fsync d2/d9/f2e 0 2024-09-12T01:42:58.066 INFO:tasks.workunit.client.1.smithi153.stdout:1/166: chown d2/d9/d17/f2d 1 1 2024-09-12T01:42:58.072 INFO:tasks.workunit.client.0.smithi066.stdout:1/13: dread f1 [0,4194304] 0 2024-09-12T01:42:58.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/167: getdents d2/d9/d28 0 2024-09-12T01:42:58.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/168: readlink d2/l4 0 2024-09-12T01:42:58.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/169: write d2/f6 [2339614,53520] 0 2024-09-12T01:42:58.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/170: readlink d2/d9/d1d/l21 0 2024-09-12T01:42:58.093 INFO:tasks.workunit.client.1.smithi153.stdout:3/147: link d1/d16/d1c/c2e d1/d16/c30 0 2024-09-12T01:42:58.111 INFO:tasks.workunit.client.1.smithi153.stdout:9/183: dread d3/f18 [0,4194304] 0 2024-09-12T01:42:58.114 INFO:tasks.workunit.client.1.smithi153.stdout:9/184: creat d3/d19/f2e x:0 0 0 2024-09-12T01:42:58.128 INFO:tasks.workunit.client.1.smithi153.stdout:3/148: dwrite d1/f19 [0,4194304] 0 2024-09-12T01:42:58.133 INFO:tasks.workunit.client.1.smithi153.stdout:3/149: dread d1/f1a [0,4194304] 0 2024-09-12T01:42:58.136 INFO:tasks.workunit.client.1.smithi153.stdout:3/150: mknod d1/d1e/c31 0 2024-09-12T01:42:58.136 INFO:tasks.workunit.client.1.smithi153.stdout:3/151: write d1/d1e/f2a [970122,53052] 0 2024-09-12T01:42:58.137 INFO:tasks.workunit.client.1.smithi153.stdout:0/167: dread d22/f2b [0,4194304] 0 2024-09-12T01:42:58.138 INFO:tasks.workunit.client.1.smithi153.stdout:3/152: mkdir d1/d16/d1c/d32 0 2024-09-12T01:42:58.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/153: link d1/d13/d25/d26/f2c d1/d16/d1c/f33 0 2024-09-12T01:42:58.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/154: creat d1/d13/d25/f34 x:0 0 0 2024-09-12T01:42:58.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/155: fsync d1/f1a 0 2024-09-12T01:42:58.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/156: chown d1/d16/d1c/l1d 0 1 2024-09-12T01:42:58.143 INFO:tasks.workunit.client.0.smithi066.stdout:5/14: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:42:58.145 INFO:tasks.workunit.client.1.smithi153.stdout:3/157: mknod d1/d16/d1c/d32/c35 0 2024-09-12T01:42:58.147 INFO:tasks.workunit.client.1.smithi153.stdout:9/185: dwrite d3/d19/f1a [0,4194304] 0 2024-09-12T01:42:58.148 INFO:tasks.workunit.client.1.smithi153.stdout:3/158: creat d1/d13/f36 x:0 0 0 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:6/0: getdents . 0 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:6/1: dread - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:6/2: read - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:8/0: dwrite - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:8/1: fdatasync - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:8/2: write - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:7/0: getdents . 0 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:7/1: dwrite - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:9/0: dwrite - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:9/1: dwrite - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:9/2: fsync - no filename 2024-09-12T01:42:58.152 INFO:tasks.workunit.client.0.smithi066.stdout:9/3: dread - no filename 2024-09-12T01:42:58.153 INFO:tasks.workunit.client.1.smithi153.stdout:0/168: read d22/f2a [4606777,60221] 0 2024-09-12T01:42:58.153 INFO:tasks.workunit.client.1.smithi153.stdout:0/169: dread - d22/f32 zero size 2024-09-12T01:42:58.156 INFO:tasks.workunit.client.1.smithi153.stdout:0/170: mknod d22/d30/c40 0 2024-09-12T01:42:58.156 INFO:tasks.workunit.client.1.smithi153.stdout:0/171: truncate f21 520456 0 2024-09-12T01:42:58.160 INFO:tasks.workunit.client.1.smithi153.stdout:2/162: dwrite d7/d17/f1b [0,4194304] 0 2024-09-12T01:42:58.160 INFO:tasks.workunit.client.1.smithi153.stdout:2/163: read d7/db/d21/f23 [249044,118566] 0 2024-09-12T01:42:58.160 INFO:tasks.workunit.client.1.smithi153.stdout:2/164: truncate d7/db/d27/f31 812431 0 2024-09-12T01:42:58.173 INFO:tasks.workunit.client.1.smithi153.stdout:2/165: link d7/d17/c18 d7/db/c32 0 2024-09-12T01:42:58.176 INFO:tasks.workunit.client.1.smithi153.stdout:2/166: symlink d7/db/d1d/d1e/l33 0 2024-09-12T01:42:58.188 INFO:tasks.workunit.client.1.smithi153.stdout:2/167: read d7/f11 [987227,50701] 0 2024-09-12T01:42:58.190 INFO:tasks.workunit.client.1.smithi153.stdout:6/188: write d1/d6/da/d19/d34/f2a [2819541,123633] 0 2024-09-12T01:42:58.191 INFO:tasks.workunit.client.1.smithi153.stdout:0/172: dwrite d22/f2b [0,4194304] 0 2024-09-12T01:42:58.195 INFO:tasks.workunit.client.1.smithi153.stdout:6/189: unlink d1/d6/da/d19/d34/f2a 0 2024-09-12T01:42:58.195 INFO:tasks.workunit.client.1.smithi153.stdout:6/190: chown d1/d6/d23 3343 1 2024-09-12T01:42:58.199 INFO:tasks.workunit.client.1.smithi153.stdout:6/191: unlink d1/d6/l17 0 2024-09-12T01:42:58.199 INFO:tasks.workunit.client.1.smithi153.stdout:6/192: write d1/d6/d23/f2b [3011372,63428] 0 2024-09-12T01:42:58.199 INFO:tasks.workunit.client.1.smithi153.stdout:6/193: chown d1/d6/da/d19/d34/d33 160448934 1 2024-09-12T01:42:58.217 INFO:tasks.workunit.client.1.smithi153.stdout:2/168: dwrite f1 [4194304,4194304] 0 2024-09-12T01:42:58.219 INFO:tasks.workunit.client.1.smithi153.stdout:3/159: write d1/f11 [1343221,16642] 0 2024-09-12T01:42:58.219 INFO:tasks.workunit.client.1.smithi153.stdout:3/160: creat d1/d13/f37 x:0 0 0 2024-09-12T01:42:58.220 INFO:tasks.workunit.client.1.smithi153.stdout:2/169: creat d7/db/d1d/f34 x:0 0 0 2024-09-12T01:42:58.224 INFO:tasks.workunit.client.1.smithi153.stdout:2/170: rename d7/db/d1d/f34 to d7/db/d1d/f35 0 2024-09-12T01:42:58.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/161: rmdir d1/d13/d23 39 2024-09-12T01:42:58.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/162: chown d1/ce 29 1 2024-09-12T01:42:58.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/163: chown d1/d13/d25/f34 0 1 2024-09-12T01:42:58.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/164: fsync d1/f19 0 2024-09-12T01:42:58.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/165: chown d1/l3 0 1 2024-09-12T01:42:58.227 INFO:tasks.workunit.client.1.smithi153.stdout:2/171: mkdir d7/db/d36 0 2024-09-12T01:42:58.230 INFO:tasks.workunit.client.1.smithi153.stdout:2/172: truncate d7/fe 1692760 0 2024-09-12T01:42:58.230 INFO:tasks.workunit.client.1.smithi153.stdout:2/173: read - d7/db/f30 zero size 2024-09-12T01:42:58.231 INFO:tasks.workunit.client.1.smithi153.stdout:2/174: write d7/db/f30 [726262,1288] 0 2024-09-12T01:42:58.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/166: getdents d1/d13/d25/d26 0 2024-09-12T01:42:58.233 INFO:tasks.workunit.client.1.smithi153.stdout:2/175: creat d7/db/d21/f37 x:0 0 0 2024-09-12T01:42:58.238 INFO:tasks.workunit.client.1.smithi153.stdout:3/167: dread d1/f2 [0,4194304] 0 2024-09-12T01:42:58.239 INFO:tasks.workunit.client.1.smithi153.stdout:3/168: fsync d1/f2 0 2024-09-12T01:42:58.250 INFO:tasks.workunit.client.1.smithi153.stdout:3/169: dwrite d1/f2 [4194304,4194304] 0 2024-09-12T01:42:58.266 INFO:tasks.workunit.client.1.smithi153.stdout:3/170: dwrite d1/f5 [0,4194304] 0 2024-09-12T01:42:58.268 INFO:tasks.workunit.client.1.smithi153.stdout:3/171: symlink d1/d16/l38 0 2024-09-12T01:42:58.268 INFO:tasks.workunit.client.1.smithi153.stdout:3/172: chown d1/d16/d1c/c2e 2038912743 1 2024-09-12T01:42:58.270 INFO:tasks.workunit.client.1.smithi153.stdout:3/173: link d1/l10 d1/d16/d1c/l39 0 2024-09-12T01:42:58.271 INFO:tasks.workunit.client.1.smithi153.stdout:3/174: symlink d1/d13/d23/l3a 0 2024-09-12T01:42:58.290 INFO:tasks.workunit.client.1.smithi153.stdout:3/175: dwrite d1/f1a [0,4194304] 0 2024-09-12T01:42:58.290 INFO:tasks.workunit.client.1.smithi153.stdout:3/176: truncate d1/d16/d1c/f2d 382921 0 2024-09-12T01:42:58.303 INFO:tasks.workunit.client.1.smithi153.stdout:3/177: dwrite d1/d1e/f2f [0,4194304] 0 2024-09-12T01:42:58.305 INFO:tasks.workunit.client.1.smithi153.stdout:3/178: mknod d1/d1e/c3b 0 2024-09-12T01:42:58.318 INFO:tasks.workunit.client.1.smithi153.stdout:3/179: dwrite d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:42:58.322 INFO:tasks.workunit.client.1.smithi153.stdout:3/180: mknod d1/d16/d1c/c3c 0 2024-09-12T01:42:58.324 INFO:tasks.workunit.client.1.smithi153.stdout:3/181: mknod d1/d1e/c3d 0 2024-09-12T01:42:58.326 INFO:tasks.workunit.client.1.smithi153.stdout:3/182: mkdir d1/d3e 0 2024-09-12T01:42:58.326 INFO:tasks.workunit.client.1.smithi153.stdout:3/183: chown d1/f2 325775522 1 2024-09-12T01:42:58.342 INFO:tasks.workunit.client.1.smithi153.stdout:8/209: rename d17/d1d/d27/d2d to d17/d1f/d4f 0 2024-09-12T01:42:58.343 INFO:tasks.workunit.client.1.smithi153.stdout:3/184: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:42:58.343 INFO:tasks.workunit.client.1.smithi153.stdout:3/185: dread - d1/d13/f36 zero size 2024-09-12T01:42:58.343 INFO:tasks.workunit.client.1.smithi153.stdout:3/186: readlink d1/l15 0 2024-09-12T01:42:58.344 INFO:tasks.workunit.client.1.smithi153.stdout:9/186: rename d3/f14 to d3/d19/f2f 0 2024-09-12T01:42:58.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/187: mknod d1/d3e/c3f 0 2024-09-12T01:42:58.349 INFO:tasks.workunit.client.1.smithi153.stdout:0/173: rename lf to d22/d30/l41 0 2024-09-12T01:42:58.349 INFO:tasks.workunit.client.1.smithi153.stdout:0/174: fdatasync d22/d30/d33/f3f 0 2024-09-12T01:42:58.351 INFO:tasks.workunit.client.1.smithi153.stdout:9/187: mkdir d3/d19/d30 0 2024-09-12T01:42:58.351 INFO:tasks.workunit.client.1.smithi153.stdout:9/188: write d3/d19/f2e [545335,32049] 0 2024-09-12T01:42:58.353 INFO:tasks.workunit.client.1.smithi153.stdout:6/194: rename d1/f1f to d1/d6/d39/f3b 0 2024-09-12T01:42:58.355 INFO:tasks.workunit.client.1.smithi153.stdout:9/189: creat d3/d19/d30/f31 x:0 0 0 2024-09-12T01:42:58.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/175: dread f6 [0,4194304] 0 2024-09-12T01:42:58.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/176: write d22/f2a [8355285,15534] 0 2024-09-12T01:42:58.359 INFO:tasks.workunit.client.1.smithi153.stdout:6/195: link d1/d6/f2d d1/d6/da/d19/d34/d33/f3c 0 2024-09-12T01:42:58.362 INFO:tasks.workunit.client.1.smithi153.stdout:8/210: dwrite fd [0,4194304] 0 2024-09-12T01:42:58.363 INFO:tasks.workunit.client.1.smithi153.stdout:6/196: mknod d1/d6/d23/c3d 0 2024-09-12T01:42:58.367 INFO:tasks.workunit.client.1.smithi153.stdout:0/177: write d22/f2a [1463310,96281] 0 2024-09-12T01:42:58.367 INFO:tasks.workunit.client.1.smithi153.stdout:0/178: write d22/d30/d33/f35 [1005823,130810] 0 2024-09-12T01:42:58.367 INFO:tasks.workunit.client.1.smithi153.stdout:0/179: truncate d22/d30/d33/f35 2045579 0 2024-09-12T01:42:58.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/171: truncate d2/d9/d17/d2f/f31 638208 0 2024-09-12T01:42:58.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/172: chown d2/d9/d28/c2b 12 1 2024-09-12T01:42:58.377 INFO:tasks.workunit.client.1.smithi153.stdout:1/173: write d2/d9/f1b [1535942,110601] 0 2024-09-12T01:42:58.380 INFO:tasks.workunit.client.1.smithi153.stdout:9/190: dwrite d3/f2d [0,4194304] 0 2024-09-12T01:42:58.397 INFO:tasks.workunit.client.1.smithi153.stdout:0/180: dwrite f20 [0,4194304] 0 2024-09-12T01:42:58.397 INFO:tasks.workunit.client.1.smithi153.stdout:6/197: dwrite d1/d6/f8 [0,4194304] 0 2024-09-12T01:42:58.397 INFO:tasks.workunit.client.1.smithi153.stdout:6/198: fsync d1/d6/d23/f29 0 2024-09-12T01:42:58.397 INFO:tasks.workunit.client.1.smithi153.stdout:0/181: read - d22/d30/d33/f3f zero size 2024-09-12T01:42:58.399 INFO:tasks.workunit.client.1.smithi153.stdout:0/182: dread fd [0,4194304] 0 2024-09-12T01:42:58.399 INFO:tasks.workunit.client.1.smithi153.stdout:0/183: truncate fd 257311 0 2024-09-12T01:42:58.399 INFO:tasks.workunit.client.1.smithi153.stdout:0/184: write d22/f39 [262747,14819] 0 2024-09-12T01:42:58.399 INFO:tasks.workunit.client.1.smithi153.stdout:0/185: creat d22/d30/f42 x:0 0 0 2024-09-12T01:42:58.403 INFO:tasks.workunit.client.1.smithi153.stdout:6/199: creat d1/d6/d39/f3e x:0 0 0 2024-09-12T01:42:58.405 INFO:tasks.workunit.client.1.smithi153.stdout:0/186: rename l17 to d22/d30/d33/l43 0 2024-09-12T01:42:58.416 INFO:tasks.workunit.client.1.smithi153.stdout:0/187: read f20 [1084967,91358] 0 2024-09-12T01:42:58.417 INFO:tasks.workunit.client.1.smithi153.stdout:6/200: dwrite d1/d6/da/d19/d34/f20 [0,4194304] 0 2024-09-12T01:42:58.418 INFO:tasks.workunit.client.1.smithi153.stdout:0/188: link d22/d30/f42 d22/d30/d33/f44 0 2024-09-12T01:42:58.426 INFO:tasks.workunit.client.1.smithi153.stdout:6/201: write d1/d6/da/d32/f36 [763179,124030] 0 2024-09-12T01:42:58.433 INFO:tasks.workunit.client.1.smithi153.stdout:0/189: dwrite d22/f32 [0,4194304] 0 2024-09-12T01:42:58.434 INFO:tasks.workunit.client.1.smithi153.stdout:0/190: dread f3 [0,4194304] 0 2024-09-12T01:42:58.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/191: dread f13 [0,4194304] 0 2024-09-12T01:42:58.440 INFO:tasks.workunit.client.1.smithi153.stdout:0/192: unlink fd 0 2024-09-12T01:42:58.443 INFO:tasks.workunit.client.1.smithi153.stdout:0/193: symlink d22/d30/d33/l45 0 2024-09-12T01:42:58.443 INFO:tasks.workunit.client.1.smithi153.stdout:0/194: creat d22/d30/d33/f46 x:0 0 0 2024-09-12T01:42:58.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/202: dwrite d1/d6/da/d19/d34/d33/f3c [0,4194304] 0 2024-09-12T01:42:58.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/203: read - d1/f38 zero size 2024-09-12T01:42:58.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/204: write d1/d6/da/d19/d34/f28 [4977057,80265] 0 2024-09-12T01:42:58.445 INFO:tasks.workunit.client.1.smithi153.stdout:6/205: truncate d1/d6/da/f1a 1403381 0 2024-09-12T01:42:58.448 INFO:tasks.workunit.client.1.smithi153.stdout:6/206: rename d1/d6/da/f2f to d1/d6/f3f 0 2024-09-12T01:42:58.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/207: mkdir d1/d6/d23/d40 0 2024-09-12T01:42:58.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/208: chown d1/d6/d23/f2b 2 1 2024-09-12T01:42:58.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/209: dread - d1/d6/da/f37 zero size 2024-09-12T01:42:58.451 INFO:tasks.workunit.client.1.smithi153.stdout:6/210: stat d1/d6/da/d19/l27 0 2024-09-12T01:42:58.454 INFO:tasks.workunit.client.1.smithi153.stdout:6/211: rmdir d1/d6/d23/d40 0 2024-09-12T01:42:58.456 INFO:tasks.workunit.client.1.smithi153.stdout:6/212: write d1/d6/f8 [4619764,113332] 0 2024-09-12T01:42:58.460 INFO:tasks.workunit.client.1.smithi153.stdout:6/213: rmdir d1/d6/d23 39 2024-09-12T01:42:58.461 INFO:tasks.workunit.client.1.smithi153.stdout:6/214: write d1/d6/da/d19/d34/f28 [6002351,29569] 0 2024-09-12T01:42:58.461 INFO:tasks.workunit.client.1.smithi153.stdout:6/215: symlink d1/d6/da/l41 0 2024-09-12T01:42:58.461 INFO:tasks.workunit.client.1.smithi153.stdout:6/216: write d1/df/f30 [743638,40174] 0 2024-09-12T01:42:58.462 INFO:tasks.workunit.client.1.smithi153.stdout:6/217: creat d1/d6/da/d19/d34/d33/f42 x:0 0 0 2024-09-12T01:42:58.462 INFO:tasks.workunit.client.1.smithi153.stdout:6/218: write d1/df/f30 [789309,119157] 0 2024-09-12T01:42:58.464 INFO:tasks.workunit.client.1.smithi153.stdout:6/219: fdatasync d1/df/f30 0 2024-09-12T01:42:58.483 INFO:tasks.workunit.client.1.smithi153.stdout:6/220: dwrite d1/df/f30 [0,4194304] 0 2024-09-12T01:42:58.636 INFO:tasks.workunit.client.1.smithi153.stdout:4/127: sync 2024-09-12T01:42:58.636 INFO:tasks.workunit.client.1.smithi153.stdout:5/172: sync 2024-09-12T01:42:58.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/173: mkdir d0/d20/d2e/d36/d39 0 2024-09-12T01:42:58.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/174: fsync d0/f1f 0 2024-09-12T01:42:58.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/175: write d0/d15/f1a [818697,100059] 0 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: pgmap v239: 65 pgs: 65 active+clean; 255 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 548 op/s 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: Standby manager daemon smithi153.jpnqza restarted 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:42:58.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:58 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:42:58.642 INFO:tasks.workunit.client.1.smithi153.stdout:5/176: link d0/df/f27 d0/df/d1c/d22/d2f/f3a 0 2024-09-12T01:42:58.646 INFO:tasks.workunit.client.1.smithi153.stdout:6/221: rename d1/d6/d39/f3b to d1/d6/da/d19/d34/d33/f43 0 2024-09-12T01:42:58.650 INFO:tasks.workunit.client.1.smithi153.stdout:4/128: dwrite d6/d9/d11/f1c [0,4194304] 0 2024-09-12T01:42:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: pgmap v239: 65 pgs: 65 active+clean; 255 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 548 op/s 2024-09-12T01:42:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:58.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza restarted 2024-09-12T01:42:58.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:42:58.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:42:58.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:42:58.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:42:58.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:58 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:42:58.657 INFO:tasks.workunit.client.1.smithi153.stdout:4/129: dread d6/d9/f10 [0,4194304] 0 2024-09-12T01:42:58.657 INFO:tasks.workunit.client.1.smithi153.stdout:4/130: write d6/fe [927758,97533] 0 2024-09-12T01:42:58.659 INFO:tasks.workunit.client.1.smithi153.stdout:4/131: symlink d6/d15/l2d 0 2024-09-12T01:42:58.660 INFO:tasks.workunit.client.1.smithi153.stdout:8/211: truncate fd 3590108 0 2024-09-12T01:42:58.660 INFO:tasks.workunit.client.1.smithi153.stdout:8/212: dread - d17/f46 zero size 2024-09-12T01:42:58.662 INFO:tasks.workunit.client.1.smithi153.stdout:4/132: unlink d6/d15/c29 0 2024-09-12T01:42:58.663 INFO:tasks.workunit.client.1.smithi153.stdout:8/213: rmdir d17/d21/d3a 39 2024-09-12T01:42:58.664 INFO:tasks.workunit.client.1.smithi153.stdout:4/133: mknod d6/d9/d11/d13/c2e 0 2024-09-12T01:42:58.666 INFO:tasks.workunit.client.1.smithi153.stdout:8/214: mknod d17/d21/d3a/c50 0 2024-09-12T01:42:58.666 INFO:tasks.workunit.client.1.smithi153.stdout:8/215: chown d17/d1f 5 1 2024-09-12T01:42:58.667 INFO:tasks.workunit.client.1.smithi153.stdout:5/177: dwrite d0/df/d1c/d22/d2f/f3a [0,4194304] 0 2024-09-12T01:42:58.667 INFO:tasks.workunit.client.1.smithi153.stdout:6/222: dwrite d1/df/f30 [0,4194304] 0 2024-09-12T01:42:58.667 INFO:tasks.workunit.client.1.smithi153.stdout:7/160: sync 2024-09-12T01:42:58.670 INFO:tasks.workunit.client.1.smithi153.stdout:8/216: symlink d17/d1f/l51 0 2024-09-12T01:42:58.670 INFO:tasks.workunit.client.1.smithi153.stdout:1/174: dread d2/d9/d17/d2f/f31 [0,4194304] 0 2024-09-12T01:42:58.680 INFO:tasks.workunit.client.1.smithi153.stdout:9/191: truncate d3/f2d 943619 0 2024-09-12T01:42:58.685 INFO:tasks.workunit.client.1.smithi153.stdout:1/175: link d2/d9/f1a d2/d9/d1d/d25/f38 0 2024-09-12T01:42:58.688 INFO:tasks.workunit.client.1.smithi153.stdout:1/176: rename d2/d9/d1d/d25/f29 to d2/d34/f39 0 2024-09-12T01:42:58.689 INFO:tasks.workunit.client.1.smithi153.stdout:8/217: read f15 [2111886,116378] 0 2024-09-12T01:42:58.690 INFO:tasks.workunit.client.1.smithi153.stdout:1/177: read d2/f6 [1922634,54540] 0 2024-09-12T01:42:58.691 INFO:tasks.workunit.client.1.smithi153.stdout:8/218: link d17/l3f d17/d1f/d4f/d34/l52 0 2024-09-12T01:42:58.692 INFO:tasks.workunit.client.1.smithi153.stdout:1/178: mknod d2/d9/d1d/c3a 0 2024-09-12T01:42:58.693 INFO:tasks.workunit.client.1.smithi153.stdout:1/179: chown d2/d9/d1d/d25/f38 31601875 1 2024-09-12T01:42:58.694 INFO:tasks.workunit.client.1.smithi153.stdout:8/219: getdents d17/d21 0 2024-09-12T01:42:58.694 INFO:tasks.workunit.client.1.smithi153.stdout:8/220: stat d17/d21/d3a 0 2024-09-12T01:42:58.694 INFO:tasks.workunit.client.1.smithi153.stdout:8/221: write d17/f28 [272835,86455] 0 2024-09-12T01:42:58.695 INFO:tasks.workunit.client.1.smithi153.stdout:1/180: rmdir d2/d9/d17/d2f 39 2024-09-12T01:42:58.698 INFO:tasks.workunit.client.1.smithi153.stdout:1/181: truncate d2/d9/f1a 2580857 0 2024-09-12T01:42:58.698 INFO:tasks.workunit.client.1.smithi153.stdout:1/182: stat d2/le 0 2024-09-12T01:42:58.698 INFO:tasks.workunit.client.1.smithi153.stdout:8/222: dread f10 [0,4194304] 0 2024-09-12T01:42:58.700 INFO:tasks.workunit.client.1.smithi153.stdout:8/223: rename d17/d21/c4d to d17/d21/d3a/c53 0 2024-09-12T01:42:58.702 INFO:tasks.workunit.client.1.smithi153.stdout:8/224: creat d17/d21/d3a/f54 x:0 0 0 2024-09-12T01:42:58.702 INFO:tasks.workunit.client.1.smithi153.stdout:8/225: chown fd 1615425 1 2024-09-12T01:42:58.702 INFO:tasks.workunit.client.1.smithi153.stdout:8/226: write d17/f1a [1764072,7884] 0 2024-09-12T01:42:58.705 INFO:tasks.workunit.client.1.smithi153.stdout:5/178: dwrite d0/df/d1c/d22/d2f/f3a [0,4194304] 0 2024-09-12T01:42:58.705 INFO:tasks.workunit.client.1.smithi153.stdout:5/179: chown d0/f8 314106205 1 2024-09-12T01:42:58.705 INFO:tasks.workunit.client.1.smithi153.stdout:5/180: dread - d0/d20/f37 zero size 2024-09-12T01:42:58.706 INFO:tasks.workunit.client.1.smithi153.stdout:7/161: dwrite d12/f22 [0,4194304] 0 2024-09-12T01:42:58.708 INFO:tasks.workunit.client.1.smithi153.stdout:1/183: read d2/d9/d28/f2a [2688421,45734] 0 2024-09-12T01:42:58.709 INFO:tasks.workunit.client.1.smithi153.stdout:5/181: creat d0/d20/d2e/d36/f3b x:0 0 0 2024-09-12T01:42:58.709 INFO:tasks.workunit.client.1.smithi153.stdout:5/182: chown d0/df/f27 231 1 2024-09-12T01:42:58.709 INFO:tasks.workunit.client.1.smithi153.stdout:5/183: readlink d0/d20/d2e/l31 0 2024-09-12T01:42:58.715 INFO:tasks.workunit.client.1.smithi153.stdout:1/184: write d2/d9/f1b [5273332,71315] 0 2024-09-12T01:42:58.719 INFO:tasks.workunit.client.1.smithi153.stdout:5/184: symlink d0/df/d1c/d22/l3c 0 2024-09-12T01:42:58.719 INFO:tasks.workunit.client.1.smithi153.stdout:5/185: fdatasync d0/d15/f16 0 2024-09-12T01:42:58.721 INFO:tasks.workunit.client.1.smithi153.stdout:8/227: dwrite f15 [0,4194304] 0 2024-09-12T01:42:58.723 INFO:tasks.workunit.client.1.smithi153.stdout:7/162: rmdir d12 39 2024-09-12T01:42:58.723 INFO:tasks.workunit.client.1.smithi153.stdout:7/163: stat ca 0 2024-09-12T01:42:58.733 INFO:tasks.workunit.client.1.smithi153.stdout:7/164: write fb [3038995,65437] 0 2024-09-12T01:42:58.734 INFO:tasks.workunit.client.1.smithi153.stdout:1/185: dwrite d2/d9/d1d/d25/f35 [0,4194304] 0 2024-09-12T01:42:58.734 INFO:tasks.workunit.client.1.smithi153.stdout:1/186: chown d2/d9/d28/c2b 27 1 2024-09-12T01:42:58.734 INFO:tasks.workunit.client.1.smithi153.stdout:1/187: readlink d2/l4 0 2024-09-12T01:42:58.736 INFO:tasks.workunit.client.1.smithi153.stdout:7/165: creat d12/f31 x:0 0 0 2024-09-12T01:42:58.744 INFO:tasks.workunit.client.1.smithi153.stdout:7/166: rename fb to d12/f32 0 2024-09-12T01:42:58.747 INFO:tasks.workunit.client.1.smithi153.stdout:7/167: rmdir d12/d21/d29/d2d 39 2024-09-12T01:42:58.750 INFO:tasks.workunit.client.1.smithi153.stdout:7/168: link fe d12/f33 0 2024-09-12T01:42:58.761 INFO:tasks.workunit.client.1.smithi153.stdout:0/195: getdents d22/d30/d33 0 2024-09-12T01:42:58.764 INFO:tasks.workunit.client.1.smithi153.stdout:0/196: rename d22/d30/d33/f44 to d22/d30/f47 0 2024-09-12T01:42:58.764 INFO:tasks.workunit.client.1.smithi153.stdout:0/197: write f6 [4949025,34730] 0 2024-09-12T01:42:58.764 INFO:tasks.workunit.client.1.smithi153.stdout:0/198: chown fa 86 1 2024-09-12T01:42:58.764 INFO:tasks.workunit.client.1.smithi153.stdout:0/199: readlink d22/l27 0 2024-09-12T01:42:58.766 INFO:tasks.workunit.client.1.smithi153.stdout:0/200: read f4 [978242,80929] 0 2024-09-12T01:42:58.766 INFO:tasks.workunit.client.1.smithi153.stdout:7/169: dwrite d12/f32 [0,4194304] 0 2024-09-12T01:42:58.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/201: chown d22/d30/d33/l45 2532713 1 2024-09-12T01:42:58.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/202: write f20 [2584605,14573] 0 2024-09-12T01:42:58.770 INFO:tasks.workunit.client.1.smithi153.stdout:0/203: truncate d22/d30/d33/f3f 651424 0 2024-09-12T01:42:58.772 INFO:tasks.workunit.client.1.smithi153.stdout:0/204: dread d22/f24 [0,4194304] 0 2024-09-12T01:42:58.772 INFO:tasks.workunit.client.1.smithi153.stdout:0/205: write f6 [1935210,74424] 0 2024-09-12T01:42:58.774 INFO:tasks.workunit.client.1.smithi153.stdout:0/206: creat d22/d30/d33/f48 x:0 0 0 2024-09-12T01:42:58.774 INFO:tasks.workunit.client.1.smithi153.stdout:7/170: dread d12/f22 [0,4194304] 0 2024-09-12T01:42:58.777 INFO:tasks.workunit.client.1.smithi153.stdout:7/171: unlink fd 0 2024-09-12T01:42:58.777 INFO:tasks.workunit.client.1.smithi153.stdout:7/172: write f4 [2471552,49577] 0 2024-09-12T01:42:58.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/207: symlink d22/d30/d33/l49 0 2024-09-12T01:42:58.784 INFO:tasks.workunit.client.1.smithi153.stdout:0/208: mknod d22/d30/d33/c4a 0 2024-09-12T01:42:58.803 INFO:tasks.workunit.client.0.smithi066.stdout:1/14: mknod c2 0 2024-09-12T01:42:58.809 INFO:tasks.workunit.client.0.smithi066.stdout:1/15: dread f1 [0,4194304] 0 2024-09-12T01:42:58.879 INFO:tasks.workunit.client.0.smithi066.stdout:5/15: symlink d0/l5 0 2024-09-12T01:42:58.884 INFO:tasks.workunit.client.0.smithi066.stdout:6/3: mknod c0 0 2024-09-12T01:42:58.884 INFO:tasks.workunit.client.0.smithi066.stdout:6/4: truncate - no filename 2024-09-12T01:42:58.885 INFO:tasks.workunit.client.0.smithi066.stdout:8/3: mknod c0 0 2024-09-12T01:42:58.886 INFO:tasks.workunit.client.0.smithi066.stdout:4/5: creat f2 x:0 0 0 2024-09-12T01:42:58.887 INFO:tasks.workunit.client.0.smithi066.stdout:4/6: dread - f2 zero size 2024-09-12T01:42:58.887 INFO:tasks.workunit.client.0.smithi066.stdout:9/4: mkdir d0 0 2024-09-12T01:42:58.888 INFO:tasks.workunit.client.0.smithi066.stdout:5/16: dread d0/f4 [0,4194304] 0 2024-09-12T01:42:58.903 INFO:tasks.workunit.client.0.smithi066.stdout:6/5: mknod c1 0 2024-09-12T01:42:58.904 INFO:tasks.workunit.client.0.smithi066.stdout:6/6: read - no filename 2024-09-12T01:42:58.904 INFO:tasks.workunit.client.0.smithi066.stdout:6/7: dwrite - no filename 2024-09-12T01:42:58.904 INFO:tasks.workunit.client.0.smithi066.stdout:8/4: mknod c1 0 2024-09-12T01:42:58.905 INFO:tasks.workunit.client.0.smithi066.stdout:4/7: unlink f2 0 2024-09-12T01:42:58.906 INFO:tasks.workunit.client.0.smithi066.stdout:4/8: creat f3 x:0 0 0 2024-09-12T01:42:58.906 INFO:tasks.workunit.client.0.smithi066.stdout:4/9: chown l0 1665 1 2024-09-12T01:42:58.906 INFO:tasks.workunit.client.0.smithi066.stdout:9/5: mknod d0/c1 0 2024-09-12T01:42:58.907 INFO:tasks.workunit.client.0.smithi066.stdout:9/6: truncate - no filename 2024-09-12T01:42:58.908 INFO:tasks.workunit.client.0.smithi066.stdout:5/17: rename d0/l5 to d0/l6 0 2024-09-12T01:42:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:5/18: chown d0 238 1 2024-09-12T01:42:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:6/8: mkdir d2 0 2024-09-12T01:42:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:6/9: getdents d2 0 2024-09-12T01:42:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:6/10: write - no filename 2024-09-12T01:42:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:6/11: chown d2 10333540 1 2024-09-12T01:42:58.909 INFO:tasks.workunit.client.0.smithi066.stdout:8/5: mknod c2 0 2024-09-12T01:42:58.910 INFO:tasks.workunit.client.0.smithi066.stdout:8/6: write - no filename 2024-09-12T01:42:58.910 INFO:tasks.workunit.client.0.smithi066.stdout:9/7: unlink d0/c1 0 2024-09-12T01:42:58.910 INFO:tasks.workunit.client.0.smithi066.stdout:9/8: truncate - no filename 2024-09-12T01:42:58.911 INFO:tasks.workunit.client.0.smithi066.stdout:9/9: dread - no filename 2024-09-12T01:42:58.911 INFO:tasks.workunit.client.0.smithi066.stdout:6/12: symlink d2/l3 0 2024-09-12T01:42:58.911 INFO:tasks.workunit.client.0.smithi066.stdout:6/13: rename d2 to d2/d4 22 2024-09-12T01:42:58.912 INFO:tasks.workunit.client.0.smithi066.stdout:6/14: dwrite - no filename 2024-09-12T01:42:58.912 INFO:tasks.workunit.client.0.smithi066.stdout:8/7: creat f3 x:0 0 0 2024-09-12T01:42:58.912 INFO:tasks.workunit.client.0.smithi066.stdout:8/8: readlink - no filename 2024-09-12T01:42:58.913 INFO:tasks.workunit.client.0.smithi066.stdout:9/10: creat d0/f2 x:0 0 0 2024-09-12T01:42:58.915 INFO:tasks.workunit.client.0.smithi066.stdout:6/15: creat d2/f5 x:0 0 0 2024-09-12T01:42:58.916 INFO:tasks.workunit.client.0.smithi066.stdout:8/9: symlink l4 0 2024-09-12T01:42:58.918 INFO:tasks.workunit.client.0.smithi066.stdout:6/16: mkdir d2/d6 0 2024-09-12T01:42:58.919 INFO:tasks.workunit.client.0.smithi066.stdout:8/10: link l4 l5 0 2024-09-12T01:42:58.919 INFO:tasks.workunit.client.0.smithi066.stdout:8/11: dread - f3 zero size 2024-09-12T01:42:58.920 INFO:tasks.workunit.client.0.smithi066.stdout:8/12: truncate f3 958535 0 2024-09-12T01:42:58.921 INFO:tasks.workunit.client.0.smithi066.stdout:6/17: rmdir d2/d6 0 2024-09-12T01:42:58.922 INFO:tasks.workunit.client.0.smithi066.stdout:4/10: dwrite f3 [0,4194304] 0 2024-09-12T01:42:58.922 INFO:tasks.workunit.client.0.smithi066.stdout:6/18: link d2/f5 d2/f7 0 2024-09-12T01:42:58.923 INFO:tasks.workunit.client.0.smithi066.stdout:6/19: chown d2/f5 86104 1 2024-09-12T01:42:58.925 INFO:tasks.workunit.client.0.smithi066.stdout:6/20: rename d2/l3 to d2/l8 0 2024-09-12T01:42:58.958 INFO:tasks.workunit.client.0.smithi066.stdout:1/16: write f1 [4345034,85519] 0 2024-09-12T01:42:58.961 INFO:tasks.workunit.client.1.smithi153.stdout:3/188: sync 2024-09-12T01:42:58.961 INFO:tasks.workunit.client.1.smithi153.stdout:4/134: sync 2024-09-12T01:42:58.961 INFO:tasks.workunit.client.1.smithi153.stdout:2/176: sync 2024-09-12T01:42:58.962 INFO:tasks.workunit.client.1.smithi153.stdout:4/135: stat d6/d9/f2b 0 2024-09-12T01:42:58.962 INFO:tasks.workunit.client.1.smithi153.stdout:3/189: fsync d1/d16/d17/f1f 0 2024-09-12T01:42:58.964 INFO:tasks.workunit.client.1.smithi153.stdout:4/136: creat d6/d9/d11/f2f x:0 0 0 2024-09-12T01:42:58.965 INFO:tasks.workunit.client.1.smithi153.stdout:3/190: getdents d1/d13/d25 0 2024-09-12T01:42:58.966 INFO:tasks.workunit.client.1.smithi153.stdout:4/137: mknod d6/d9/d11/d14/c30 0 2024-09-12T01:42:58.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/191: mknod d1/d3e/c40 0 2024-09-12T01:42:58.970 INFO:tasks.workunit.client.1.smithi153.stdout:4/138: rename d6/d9/d17 to d6/d9/dc/d31 0 2024-09-12T01:42:58.971 INFO:tasks.workunit.client.1.smithi153.stdout:3/192: symlink d1/d1e/l41 0 2024-09-12T01:42:58.972 INFO:tasks.workunit.client.1.smithi153.stdout:3/193: truncate d1/d16/d1c/f33 2820353 0 2024-09-12T01:42:58.980 INFO:tasks.workunit.client.0.smithi066.stdout:8/13: dwrite f3 [0,4194304] 0 2024-09-12T01:42:58.980 INFO:tasks.workunit.client.1.smithi153.stdout:2/177: write d7/d17/f1b [2934947,108098] 0 2024-09-12T01:42:58.983 INFO:tasks.workunit.client.0.smithi066.stdout:6/21: dwrite d2/f5 [0,4194304] 0 2024-09-12T01:42:58.984 INFO:tasks.workunit.client.1.smithi153.stdout:4/139: read d6/d9/d11/f1c [620778,55611] 0 2024-09-12T01:42:58.985 INFO:tasks.workunit.client.1.smithi153.stdout:2/178: rmdir d7/db/d1d 39 2024-09-12T01:42:58.985 INFO:tasks.workunit.client.1.smithi153.stdout:2/179: chown d7/db/ff 8154240 1 2024-09-12T01:42:58.985 INFO:tasks.workunit.client.1.smithi153.stdout:2/180: chown d7/l9 0 1 2024-09-12T01:42:58.986 INFO:tasks.workunit.client.0.smithi066.stdout:1/17: dwrite f1 [0,4194304] 0 2024-09-12T01:42:58.986 INFO:tasks.workunit.client.1.smithi153.stdout:3/194: dread d1/f5 [0,4194304] 0 2024-09-12T01:42:58.988 INFO:tasks.workunit.client.1.smithi153.stdout:3/195: creat d1/d13/d25/f42 x:0 0 0 2024-09-12T01:42:58.988 INFO:tasks.workunit.client.1.smithi153.stdout:3/196: fdatasync d1/d1e/f2f 0 2024-09-12T01:42:58.994 INFO:tasks.workunit.client.0.smithi066.stdout:1/18: write f1 [2158414,90380] 0 2024-09-12T01:42:58.994 INFO:tasks.workunit.client.0.smithi066.stdout:1/19: creat f3 x:0 0 0 2024-09-12T01:42:58.994 INFO:tasks.workunit.client.0.smithi066.stdout:1/20: creat f4 x:0 0 0 2024-09-12T01:42:58.995 INFO:tasks.workunit.client.1.smithi153.stdout:4/140: dread f0 [0,4194304] 0 2024-09-12T01:42:58.997 INFO:tasks.workunit.client.0.smithi066.stdout:1/21: mkdir d5 0 2024-09-12T01:42:58.998 INFO:tasks.workunit.client.0.smithi066.stdout:1/22: symlink d5/l6 0 2024-09-12T01:42:59.005 INFO:tasks.workunit.client.0.smithi066.stdout:5/19: truncate d0/f4 2341761 0 2024-09-12T01:42:59.005 INFO:tasks.workunit.client.0.smithi066.stdout:5/20: chown d0 73 1 2024-09-12T01:42:59.007 INFO:tasks.workunit.client.0.smithi066.stdout:8/14: write f3 [1677207,79868] 0 2024-09-12T01:42:59.018 INFO:tasks.workunit.client.0.smithi066.stdout:6/22: dwrite d2/f5 [0,4194304] 0 2024-09-12T01:42:59.019 INFO:tasks.workunit.client.0.smithi066.stdout:6/23: symlink d2/l9 0 2024-09-12T01:42:59.022 INFO:tasks.workunit.client.0.smithi066.stdout:9/11: rmdir d0 39 2024-09-12T01:42:59.023 INFO:tasks.workunit.client.0.smithi066.stdout:9/12: dread - d0/f2 zero size 2024-09-12T01:42:59.023 INFO:tasks.workunit.client.0.smithi066.stdout:9/13: dread - d0/f2 zero size 2024-09-12T01:42:59.023 INFO:tasks.workunit.client.0.smithi066.stdout:9/14: creat d0/f3 x:0 0 0 2024-09-12T01:42:59.023 INFO:tasks.workunit.client.0.smithi066.stdout:9/15: mknod d0/c4 0 2024-09-12T01:42:59.024 INFO:tasks.workunit.client.0.smithi066.stdout:9/16: unlink d0/f3 0 2024-09-12T01:42:59.032 INFO:tasks.workunit.client.1.smithi153.stdout:3/197: dwrite d1/f2 [8388608,4194304] 0 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.0.smithi066.stdout:8/15: fsync f3 0 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.0.smithi066.stdout:1/23: dwrite f4 [0,4194304] 0 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.1.smithi153.stdout:4/141: dwrite d6/d9/d11/f1c [0,4194304] 0 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.1.smithi153.stdout:4/142: dread - d6/d9/d11/d14/f2a zero size 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.1.smithi153.stdout:3/198: creat d1/d16/d1c/d32/f43 x:0 0 0 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.1.smithi153.stdout:3/199: readlink d1/l15 0 2024-09-12T01:42:59.034 INFO:tasks.workunit.client.1.smithi153.stdout:2/181: dwrite d7/db/d1d/f35 [0,4194304] 0 2024-09-12T01:42:59.036 INFO:tasks.workunit.client.1.smithi153.stdout:4/143: mknod d6/d15/c32 0 2024-09-12T01:42:59.037 INFO:tasks.workunit.client.0.smithi066.stdout:8/16: symlink l6 0 2024-09-12T01:42:59.041 INFO:tasks.workunit.client.0.smithi066.stdout:5/21: rmdir d0 39 2024-09-12T01:42:59.041 INFO:tasks.workunit.client.0.smithi066.stdout:5/22: truncate d0/f2 793556 0 2024-09-12T01:42:59.043 INFO:tasks.workunit.client.0.smithi066.stdout:6/24: truncate d2/f7 427337 0 2024-09-12T01:42:59.044 INFO:tasks.workunit.client.0.smithi066.stdout:8/17: mknod c7 0 2024-09-12T01:42:59.046 INFO:tasks.workunit.client.0.smithi066.stdout:5/23: mknod d0/c7 0 2024-09-12T01:42:59.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/17: getdents d0 0 2024-09-12T01:42:59.052 INFO:tasks.workunit.client.0.smithi066.stdout:9/18: mkdir d0/d5 0 2024-09-12T01:42:59.052 INFO:tasks.workunit.client.0.smithi066.stdout:9/19: chown d0/d5 6 1 2024-09-12T01:42:59.055 INFO:tasks.workunit.client.0.smithi066.stdout:9/20: mkdir d0/d6 0 2024-09-12T01:42:59.056 INFO:tasks.workunit.client.0.smithi066.stdout:9/21: creat d0/f7 x:0 0 0 2024-09-12T01:42:59.060 INFO:tasks.workunit.client.1.smithi153.stdout:3/200: dwrite d1/f4 [4194304,4194304] 0 2024-09-12T01:42:59.061 INFO:tasks.workunit.client.0.smithi066.stdout:8/18: dread f3 [0,4194304] 0 2024-09-12T01:42:59.061 INFO:tasks.workunit.client.1.smithi153.stdout:2/182: dwrite d7/db/f30 [0,4194304] 0 2024-09-12T01:42:59.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/201: rename d1/d13/f36 to d1/d13/d25/d26/f44 0 2024-09-12T01:42:59.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/202: write d1/d13/f37 [501491,116902] 0 2024-09-12T01:42:59.064 INFO:tasks.workunit.client.0.smithi066.stdout:1/24: truncate f1 3279107 0 2024-09-12T01:42:59.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/25: dread d2/f7 [0,4194304] 0 2024-09-12T01:42:59.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/26: write d2/f5 [1380302,86599] 0 2024-09-12T01:42:59.067 INFO:tasks.workunit.client.0.smithi066.stdout:6/27: chown d2/f7 0 1 2024-09-12T01:42:59.068 INFO:tasks.workunit.client.0.smithi066.stdout:1/25: getdents d5 0 2024-09-12T01:42:59.070 INFO:tasks.workunit.client.1.smithi153.stdout:2/183: link d7/l9 d7/db/d21/l38 0 2024-09-12T01:42:59.070 INFO:tasks.workunit.client.1.smithi153.stdout:2/184: fdatasync d7/db/d1d/f28 0 2024-09-12T01:42:59.070 INFO:tasks.workunit.client.1.smithi153.stdout:2/185: creat d7/db/f39 x:0 0 0 2024-09-12T01:42:59.071 INFO:tasks.workunit.client.1.smithi153.stdout:3/203: rename d1/d3e to d1/d45 0 2024-09-12T01:42:59.073 INFO:tasks.workunit.client.1.smithi153.stdout:2/186: truncate d7/fe 1529292 0 2024-09-12T01:42:59.076 INFO:tasks.workunit.client.1.smithi153.stdout:3/204: symlink d1/l46 0 2024-09-12T01:42:59.077 INFO:tasks.workunit.client.1.smithi153.stdout:2/187: link d7/f1c d7/db/d27/f3a 0 2024-09-12T01:42:59.077 INFO:tasks.workunit.client.1.smithi153.stdout:2/188: read d7/f1c [1479481,104333] 0 2024-09-12T01:42:59.077 INFO:tasks.workunit.client.1.smithi153.stdout:2/189: symlink d7/db/d27/l3b 0 2024-09-12T01:42:59.077 INFO:tasks.workunit.client.1.smithi153.stdout:7/173: sync 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:9/192: sync 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:6/223: sync 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:5/186: sync 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:0/209: sync 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:8/228: sync 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:0/210: creat d22/f4b x:0 0 0 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:2/190: creat d7/d17/f3c x:0 0 0 2024-09-12T01:42:59.078 INFO:tasks.workunit.client.1.smithi153.stdout:2/191: write d7/f11 [3454486,48370] 0 2024-09-12T01:42:59.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/193: rename d3/fc to d3/d19/f32 0 2024-09-12T01:42:59.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/194: stat d3/d19/l21 0 2024-09-12T01:42:59.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/195: creat d3/d19/d30/f33 x:0 0 0 2024-09-12T01:42:59.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/196: chown d3/f24 0 1 2024-09-12T01:42:59.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/197: chown d3/f7 16 1 2024-09-12T01:42:59.080 INFO:tasks.workunit.client.1.smithi153.stdout:9/198: chown d3/d19/f32 1834167 1 2024-09-12T01:42:59.080 INFO:tasks.workunit.client.1.smithi153.stdout:5/187: truncate d0/fb 71171 0 2024-09-12T01:42:59.081 INFO:tasks.workunit.client.1.smithi153.stdout:8/229: symlink d17/d21/d4a/l55 0 2024-09-12T01:42:59.082 INFO:tasks.workunit.client.1.smithi153.stdout:0/211: mkdir d22/d30/d4c 0 2024-09-12T01:42:59.083 INFO:tasks.workunit.client.1.smithi153.stdout:2/192: mknod d7/d17/c3d 0 2024-09-12T01:42:59.083 INFO:tasks.workunit.client.1.smithi153.stdout:2/193: write d7/db/d21/f23 [276535,62104] 0 2024-09-12T01:42:59.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/224: rename d1/f1d to d1/d6/f44 0 2024-09-12T01:42:59.084 INFO:tasks.workunit.client.1.smithi153.stdout:1/188: sync 2024-09-12T01:42:59.087 INFO:tasks.workunit.client.1.smithi153.stdout:9/199: unlink d3/d19/f1a 0 2024-09-12T01:42:59.087 INFO:tasks.workunit.client.1.smithi153.stdout:9/200: creat d3/d19/f34 x:0 0 0 2024-09-12T01:42:59.088 INFO:tasks.workunit.client.1.smithi153.stdout:5/188: mknod d0/d20/d2e/d36/c3d 0 2024-09-12T01:42:59.088 INFO:tasks.workunit.client.1.smithi153.stdout:5/189: dread - d0/df/d1c/d22/f2b zero size 2024-09-12T01:42:59.088 INFO:tasks.workunit.client.1.smithi153.stdout:4/144: dwrite d6/d9/d11/f2f [0,4194304] 0 2024-09-12T01:42:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:8/19: dwrite f3 [4194304,4194304] 0 2024-09-12T01:42:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:8/20: write f3 [510905,38221] 0 2024-09-12T01:42:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:8/21: chown c7 20 1 2024-09-12T01:42:59.089 INFO:tasks.workunit.client.0.smithi066.stdout:8/22: read f3 [2229455,78410] 0 2024-09-12T01:42:59.090 INFO:tasks.workunit.client.0.smithi066.stdout:8/23: stat c7 0 2024-09-12T01:42:59.090 INFO:tasks.workunit.client.1.smithi153.stdout:6/225: rename d1/d6/da/f31 to d1/d6/da/d19/d34/f45 0 2024-09-12T01:42:59.090 INFO:tasks.workunit.client.1.smithi153.stdout:6/226: dread - d1/f38 zero size 2024-09-12T01:42:59.091 INFO:tasks.workunit.client.1.smithi153.stdout:6/227: write d1/d6/da/d19/d34/d33/f42 [1002630,37428] 0 2024-09-12T01:42:59.091 INFO:tasks.workunit.client.1.smithi153.stdout:1/189: link d2/d9/d17/f2d d2/d9/d28/f3b 0 2024-09-12T01:42:59.091 INFO:tasks.workunit.client.1.smithi153.stdout:1/190: truncate d2/d9/f15 1503027 0 2024-09-12T01:42:59.091 INFO:tasks.workunit.client.1.smithi153.stdout:1/191: chown d2/d9/d17/f23 45434 1 2024-09-12T01:42:59.095 INFO:tasks.workunit.client.1.smithi153.stdout:7/174: dread f10 [0,4194304] 0 2024-09-12T01:42:59.095 INFO:tasks.workunit.client.1.smithi153.stdout:7/175: truncate fc 4208072 0 2024-09-12T01:42:59.095 INFO:tasks.workunit.client.1.smithi153.stdout:7/176: truncate d12/f33 4519037 0 2024-09-12T01:42:59.095 INFO:tasks.workunit.client.1.smithi153.stdout:7/177: write d12/f17 [2568069,40703] 0 2024-09-12T01:42:59.095 INFO:tasks.workunit.client.1.smithi153.stdout:1/192: dread d2/d9/d17/d2f/f31 [0,4194304] 0 2024-09-12T01:42:59.095 INFO:tasks.workunit.client.1.smithi153.stdout:1/193: chown d2/d9/l1c 84326 1 2024-09-12T01:42:59.097 INFO:tasks.workunit.client.1.smithi153.stdout:2/194: fdatasync d7/db/d27/f3a 0 2024-09-12T01:42:59.098 INFO:tasks.workunit.client.0.smithi066.stdout:9/22: dwrite d0/f7 [0,4194304] 0 2024-09-12T01:42:59.099 INFO:tasks.workunit.client.0.smithi066.stdout:5/24: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:42:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:6/28: truncate d2/f5 289058 0 2024-09-12T01:42:59.101 INFO:tasks.workunit.client.0.smithi066.stdout:6/29: creat d2/fa x:0 0 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:7/178: write d12/f22 [61895,66087] 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:9/201: mkdir d3/d35 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:4/145: creat d6/d9/dc/d31/f33 x:0 0 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:9/202: write d3/f29 [906914,113502] 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:9/203: chown d3/d19/f22 9233797 1 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:9/204: fdatasync d3/d19/f1e 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:4/146: creat d6/d9/dc/d31/f34 x:0 0 0 2024-09-12T01:42:59.102 INFO:tasks.workunit.client.1.smithi153.stdout:4/147: stat d6/d9/dc/d31/f24 0 2024-09-12T01:42:59.105 INFO:tasks.workunit.client.1.smithi153.stdout:2/195: rename d7/cd to d7/c3e 0 2024-09-12T01:42:59.105 INFO:tasks.workunit.client.1.smithi153.stdout:2/196: fsync d7/db/d21/f37 0 2024-09-12T01:42:59.105 INFO:tasks.workunit.client.1.smithi153.stdout:2/197: fsync d7/db/f25 0 2024-09-12T01:42:59.107 INFO:tasks.workunit.client.1.smithi153.stdout:6/228: rmdir d1/d6/d39 39 2024-09-12T01:42:59.109 INFO:tasks.workunit.client.0.smithi066.stdout:6/30: mkdir d2/db 0 2024-09-12T01:42:59.114 INFO:tasks.workunit.client.1.smithi153.stdout:7/179: creat d12/d21/f34 x:0 0 0 2024-09-12T01:42:59.116 INFO:tasks.workunit.client.1.smithi153.stdout:2/198: rename d7/d17/c3d to d7/d19/c3f 0 2024-09-12T01:42:59.117 INFO:tasks.workunit.client.1.smithi153.stdout:2/199: chown d7/d19 167 1 2024-09-12T01:42:59.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/180: mkdir d12/d21/d29/d35 0 2024-09-12T01:42:59.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/181: fdatasync d12/f31 0 2024-09-12T01:42:59.120 INFO:tasks.workunit.client.1.smithi153.stdout:7/182: link d12/f2f d12/f36 0 2024-09-12T01:42:59.120 INFO:tasks.workunit.client.1.smithi153.stdout:7/183: write d12/f36 [315900,85901] 0 2024-09-12T01:42:59.120 INFO:tasks.workunit.client.1.smithi153.stdout:7/184: readlink l11 0 2024-09-12T01:42:59.120 INFO:tasks.workunit.client.1.smithi153.stdout:7/185: dread - d12/d21/d29/d2d/f30 zero size 2024-09-12T01:42:59.120 INFO:tasks.workunit.client.1.smithi153.stdout:7/186: chown d12/l2e 1 1 2024-09-12T01:42:59.121 INFO:tasks.workunit.client.1.smithi153.stdout:2/200: rename d7/db/d21 to d7/d19/d40 0 2024-09-12T01:42:59.121 INFO:tasks.workunit.client.1.smithi153.stdout:2/201: readlink d7/d17/l2a 0 2024-09-12T01:42:59.134 INFO:tasks.workunit.client.0.smithi066.stdout:9/23: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:42:59.136 INFO:tasks.workunit.client.0.smithi066.stdout:9/24: mkdir d0/d8 0 2024-09-12T01:42:59.136 INFO:tasks.workunit.client.1.smithi153.stdout:6/229: dwrite d1/d6/da/d19/d34/f28 [4194304,4194304] 0 2024-09-12T01:42:59.137 INFO:tasks.workunit.client.1.smithi153.stdout:6/230: mkdir d1/d6/d46 0 2024-09-12T01:42:59.138 INFO:tasks.workunit.client.0.smithi066.stdout:9/25: rmdir d0/d8 0 2024-09-12T01:42:59.139 INFO:tasks.workunit.client.0.smithi066.stdout:9/26: fdatasync d0/f2 0 2024-09-12T01:42:59.139 INFO:tasks.workunit.client.1.smithi153.stdout:6/231: mkdir d1/d6/da/d19/d47 0 2024-09-12T01:42:59.140 INFO:tasks.workunit.client.0.smithi066.stdout:9/27: mkdir d0/d5/d9 0 2024-09-12T01:42:59.140 INFO:tasks.workunit.client.0.smithi066.stdout:9/28: readlink - no filename 2024-09-12T01:42:59.163 INFO:tasks.workunit.client.0.smithi066.stdout:9/29: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:42:59.164 INFO:tasks.workunit.client.1.smithi153.stdout:6/232: dwrite d1/f38 [0,4194304] 0 2024-09-12T01:42:59.164 INFO:tasks.workunit.client.1.smithi153.stdout:6/233: fdatasync d1/d6/da/d19/d34/f28 0 2024-09-12T01:42:59.164 INFO:tasks.workunit.client.1.smithi153.stdout:6/234: write d1/d6/d23/f2b [4817195,37116] 0 2024-09-12T01:42:59.170 INFO:tasks.workunit.client.1.smithi153.stdout:6/235: creat d1/d6/d23/f48 x:0 0 0 2024-09-12T01:42:59.170 INFO:tasks.workunit.client.1.smithi153.stdout:6/236: readlink d1/d6/l16 0 2024-09-12T01:42:59.173 INFO:tasks.workunit.client.1.smithi153.stdout:3/205: dwrite d1/f4 [4194304,4194304] 0 2024-09-12T01:42:59.175 INFO:tasks.workunit.client.1.smithi153.stdout:0/212: dwrite d22/f3e [4194304,4194304] 0 2024-09-12T01:42:59.175 INFO:tasks.workunit.client.1.smithi153.stdout:0/213: stat d22/f32 0 2024-09-12T01:42:59.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/194: dwrite d2/d9/d28/f3b [4194304,4194304] 0 2024-09-12T01:42:59.176 INFO:tasks.workunit.client.1.smithi153.stdout:5/190: dwrite d0/d20/f26 [0,4194304] 0 2024-09-12T01:42:59.179 INFO:tasks.workunit.client.1.smithi153.stdout:5/191: mknod d0/c3e 0 2024-09-12T01:42:59.179 INFO:tasks.workunit.client.1.smithi153.stdout:5/192: creat d0/df/d1c/d22/f3f x:0 0 0 2024-09-12T01:42:59.181 INFO:tasks.workunit.client.1.smithi153.stdout:8/230: rename d17/d21/d4a to d17/d21/d56 0 2024-09-12T01:42:59.182 INFO:tasks.workunit.client.1.smithi153.stdout:1/195: symlink d2/d9/d17/d2f/l3c 0 2024-09-12T01:42:59.182 INFO:tasks.workunit.client.1.smithi153.stdout:1/196: truncate d2/d9/f19 1898000 0 2024-09-12T01:42:59.182 INFO:tasks.workunit.client.1.smithi153.stdout:1/197: chown d2/d9/d28 6670116 1 2024-09-12T01:42:59.182 INFO:tasks.workunit.client.1.smithi153.stdout:1/198: read - d2/d9/f32 zero size 2024-09-12T01:42:59.186 INFO:tasks.workunit.client.1.smithi153.stdout:5/193: mknod d0/df/d1c/c40 0 2024-09-12T01:42:59.189 INFO:tasks.workunit.client.1.smithi153.stdout:0/214: write d22/f3e [7266505,106315] 0 2024-09-12T01:42:59.189 INFO:tasks.workunit.client.1.smithi153.stdout:7/187: dread d12/f2f [0,4194304] 0 2024-09-12T01:42:59.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/231: link d17/d1d/f36 d17/d1f/d4f/f57 0 2024-09-12T01:42:59.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/232: fsync f10 0 2024-09-12T01:42:59.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/233: write d17/d1d/d27/f35 [33176,92878] 0 2024-09-12T01:42:59.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/234: write d17/d1d/d27/f35 [980768,98317] 0 2024-09-12T01:42:59.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/235: stat ce 0 2024-09-12T01:42:59.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/236: creat d17/d21/d3a/f58 x:0 0 0 2024-09-12T01:42:59.192 INFO:tasks.workunit.client.0.smithi066.stdout:8/24: dread f3 [4194304,4194304] 0 2024-09-12T01:42:59.192 INFO:tasks.workunit.client.1.smithi153.stdout:5/194: truncate d0/f12 378824 0 2024-09-12T01:42:59.192 INFO:tasks.workunit.client.1.smithi153.stdout:5/195: truncate d0/df/d1c/d22/f2b 99950 0 2024-09-12T01:42:59.192 INFO:tasks.workunit.client.1.smithi153.stdout:5/196: readlink d0/d20/d2e/l34 0 2024-09-12T01:42:59.194 INFO:tasks.workunit.client.1.smithi153.stdout:0/215: dread - d22/d30/d33/f46 zero size 2024-09-12T01:42:59.195 INFO:tasks.workunit.client.1.smithi153.stdout:0/216: stat fa 0 2024-09-12T01:42:59.195 INFO:tasks.workunit.client.1.smithi153.stdout:0/217: readlink l2 0 2024-09-12T01:42:59.195 INFO:tasks.workunit.client.1.smithi153.stdout:0/218: fsync f13 0 2024-09-12T01:42:59.198 INFO:tasks.workunit.client.1.smithi153.stdout:8/237: rmdir d17/d1d 39 2024-09-12T01:42:59.198 INFO:tasks.workunit.client.1.smithi153.stdout:8/238: readlink d17/d1d/d27/l33 0 2024-09-12T01:42:59.199 INFO:tasks.workunit.client.1.smithi153.stdout:9/205: getdents d3/d19 0 2024-09-12T01:42:59.204 INFO:tasks.workunit.client.1.smithi153.stdout:0/219: link f1b d22/d30/d4c/f4d 0 2024-09-12T01:42:59.204 INFO:tasks.workunit.client.1.smithi153.stdout:0/220: chown c16 1578947351 1 2024-09-12T01:42:59.205 INFO:tasks.workunit.client.1.smithi153.stdout:0/221: chown d22/d30/d33/f46 6 1 2024-09-12T01:42:59.205 INFO:tasks.workunit.client.1.smithi153.stdout:0/222: truncate d22/d30/f47 303530 0 2024-09-12T01:42:59.205 INFO:tasks.workunit.client.1.smithi153.stdout:6/237: dwrite d1/d6/da/d19/d34/f28 [0,4194304] 0 2024-09-12T01:42:59.205 INFO:tasks.workunit.client.1.smithi153.stdout:3/206: dwrite d1/d13/d25/d26/f44 [0,4194304] 0 2024-09-12T01:42:59.206 INFO:tasks.workunit.client.0.smithi066.stdout:9/30: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:42:59.206 INFO:tasks.workunit.client.1.smithi153.stdout:7/188: dread f7 [0,4194304] 0 2024-09-12T01:42:59.208 INFO:tasks.workunit.client.1.smithi153.stdout:7/189: dread d12/f1c [0,4194304] 0 2024-09-12T01:42:59.208 INFO:tasks.workunit.client.1.smithi153.stdout:3/207: dread d1/d13/f37 [0,4194304] 0 2024-09-12T01:42:59.209 INFO:tasks.workunit.client.0.smithi066.stdout:9/31: link d0/f2 d0/d5/d9/fa 0 2024-09-12T01:42:59.209 INFO:tasks.workunit.client.0.smithi066.stdout:9/32: fdatasync d0/f7 0 2024-09-12T01:42:59.213 INFO:tasks.workunit.client.0.smithi066.stdout:9/33: creat d0/d6/fb x:0 0 0 2024-09-12T01:42:59.213 INFO:tasks.workunit.client.0.smithi066.stdout:9/34: readlink - no filename 2024-09-12T01:42:59.215 INFO:tasks.workunit.client.0.smithi066.stdout:5/25: truncate d0/f2 319340 0 2024-09-12T01:42:59.215 INFO:tasks.workunit.client.0.smithi066.stdout:5/26: stat d0/l1 0 2024-09-12T01:42:59.216 INFO:tasks.workunit.client.0.smithi066.stdout:5/27: chown d0/f2 1993426293 1 2024-09-12T01:42:59.216 INFO:tasks.workunit.client.0.smithi066.stdout:9/35: mkdir d0/d5/dc 0 2024-09-12T01:42:59.219 INFO:tasks.workunit.client.1.smithi153.stdout:9/206: symlink d3/d35/l36 0 2024-09-12T01:42:59.222 INFO:tasks.workunit.client.1.smithi153.stdout:6/238: rmdir d1/d6/da/d19/d47 0 2024-09-12T01:42:59.225 INFO:tasks.workunit.client.1.smithi153.stdout:7/190: mkdir d12/d21/d29/d35/d37 0 2024-09-12T01:42:59.227 INFO:tasks.workunit.client.1.smithi153.stdout:9/207: creat d3/d35/f37 x:0 0 0 2024-09-12T01:42:59.228 INFO:tasks.workunit.client.1.smithi153.stdout:9/208: write d3/ff [1692710,102064] 0 2024-09-12T01:42:59.230 INFO:tasks.workunit.client.1.smithi153.stdout:7/191: symlink d12/d21/d29/d35/d37/l38 0 2024-09-12T01:42:59.230 INFO:tasks.workunit.client.1.smithi153.stdout:7/192: chown ca 222 1 2024-09-12T01:42:59.230 INFO:tasks.workunit.client.1.smithi153.stdout:7/193: chown d12/f16 5188148 1 2024-09-12T01:42:59.230 INFO:tasks.workunit.client.1.smithi153.stdout:7/194: chown d12/l2e 11772 1 2024-09-12T01:42:59.231 INFO:tasks.workunit.client.1.smithi153.stdout:3/208: getdents d1/d16/d1c/d32 0 2024-09-12T01:42:59.233 INFO:tasks.workunit.client.1.smithi153.stdout:3/209: chown d1 601 1 2024-09-12T01:42:59.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/195: rename l6 to d12/l39 0 2024-09-12T01:42:59.236 INFO:tasks.workunit.client.1.smithi153.stdout:7/196: chown d12/d21/d29/d35 26196 1 2024-09-12T01:42:59.237 INFO:tasks.workunit.client.1.smithi153.stdout:3/210: mkdir d1/d13/d23/d47 0 2024-09-12T01:42:59.237 INFO:tasks.workunit.client.1.smithi153.stdout:7/197: mknod d12/d21/c3a 0 2024-09-12T01:42:59.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/223: dwrite d22/f3e [0,4194304] 0 2024-09-12T01:42:59.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/224: truncate d22/f24 302340 0 2024-09-12T01:42:59.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/225: chown d22/c36 1737 1 2024-09-12T01:42:59.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/226: stat l9 0 2024-09-12T01:42:59.243 INFO:tasks.workunit.client.1.smithi153.stdout:5/197: truncate d0/d20/f26 1446710 0 2024-09-12T01:42:59.243 INFO:tasks.workunit.client.1.smithi153.stdout:0/227: creat d22/d30/d33/f4e x:0 0 0 2024-09-12T01:42:59.244 INFO:tasks.workunit.client.1.smithi153.stdout:5/198: rmdir d0/d20/d2e 39 2024-09-12T01:42:59.247 INFO:tasks.workunit.client.1.smithi153.stdout:3/211: dread d1/d13/d25/d26/f2c [0,4194304] 0 2024-09-12T01:42:59.247 INFO:tasks.workunit.client.1.smithi153.stdout:3/212: stat d1/d16/d17/f1f 0 2024-09-12T01:42:59.247 INFO:tasks.workunit.client.1.smithi153.stdout:0/228: symlink d22/d30/d33/l4f 0 2024-09-12T01:42:59.249 INFO:tasks.workunit.client.0.smithi066.stdout:6/31: dwrite d2/f5 [0,4194304] 0 2024-09-12T01:42:59.249 INFO:tasks.workunit.client.0.smithi066.stdout:9/36: dwrite d0/f2 [4194304,4194304] 0 2024-09-12T01:42:59.249 INFO:tasks.workunit.client.0.smithi066.stdout:9/37: stat d0/d5/dc 0 2024-09-12T01:42:59.250 INFO:tasks.workunit.client.1.smithi153.stdout:9/209: dwrite d3/f8 [0,4194304] 0 2024-09-12T01:42:59.250 INFO:tasks.workunit.client.1.smithi153.stdout:3/213: dread d1/f11 [0,4194304] 0 2024-09-12T01:42:59.250 INFO:tasks.workunit.client.1.smithi153.stdout:7/198: read d12/f26 [3636307,51779] 0 2024-09-12T01:42:59.251 INFO:tasks.workunit.client.0.smithi066.stdout:5/28: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:42:59.251 INFO:tasks.workunit.client.0.smithi066.stdout:5/29: write d0/f4 [4853605,101296] 0 2024-09-12T01:42:59.263 INFO:tasks.workunit.client.1.smithi153.stdout:9/210: dread d3/d19/f32 [0,4194304] 0 2024-09-12T01:42:59.264 INFO:tasks.workunit.client.1.smithi153.stdout:3/214: read d1/d13/d25/d26/f44 [3001943,123693] 0 2024-09-12T01:42:59.265 INFO:tasks.workunit.client.1.smithi153.stdout:3/215: fdatasync d1/d16/d17/f1f 0 2024-09-12T01:42:59.265 INFO:tasks.workunit.client.1.smithi153.stdout:3/216: truncate d1/d13/d25/f34 353067 0 2024-09-12T01:42:59.265 INFO:tasks.workunit.client.0.smithi066.stdout:6/32: dread d2/f5 [0,4194304] 0 2024-09-12T01:42:59.270 INFO:tasks.workunit.client.1.smithi153.stdout:3/217: write d1/f4 [1304900,68365] 0 2024-09-12T01:42:59.273 INFO:tasks.workunit.client.1.smithi153.stdout:8/239: getdents d17/d1f/d4f 0 2024-09-12T01:42:59.280 INFO:tasks.workunit.client.0.smithi066.stdout:8/25: truncate f3 1760768 0 2024-09-12T01:42:59.288 INFO:tasks.workunit.client.1.smithi153.stdout:3/218: dwrite d1/f19 [0,4194304] 0 2024-09-12T01:42:59.294 INFO:tasks.workunit.client.1.smithi153.stdout:3/219: dread d1/d13/d25/d26/f44 [0,4194304] 0 2024-09-12T01:42:59.294 INFO:tasks.workunit.client.1.smithi153.stdout:3/220: fsync d1/d13/d25/f42 0 2024-09-12T01:42:59.294 INFO:tasks.workunit.client.1.smithi153.stdout:3/221: stat d1/d13/d23/l3a 0 2024-09-12T01:42:59.294 INFO:tasks.workunit.client.1.smithi153.stdout:3/222: write d1/f12 [268701,4896] 0 2024-09-12T01:42:59.399 INFO:tasks.workunit.client.1.smithi153.stdout:6/239: truncate d1/d6/da/d19/d34/d33/f3c 1004711 0 2024-09-12T01:42:59.403 INFO:tasks.workunit.client.1.smithi153.stdout:7/199: creat d12/d21/d29/f3b x:0 0 0 2024-09-12T01:42:59.405 INFO:tasks.workunit.client.1.smithi153.stdout:9/211: rename d3/c27 to d3/d19/c38 0 2024-09-12T01:42:59.405 INFO:tasks.workunit.client.1.smithi153.stdout:9/212: fsync f1 0 2024-09-12T01:42:59.405 INFO:tasks.workunit.client.1.smithi153.stdout:9/213: write d3/ff [1698105,130747] 0 2024-09-12T01:42:59.406 INFO:tasks.workunit.client.1.smithi153.stdout:9/214: creat d3/d19/d30/f39 x:0 0 0 2024-09-12T01:42:59.406 INFO:tasks.workunit.client.1.smithi153.stdout:9/215: read - d3/d19/f2a zero size 2024-09-12T01:42:59.406 INFO:tasks.workunit.client.1.smithi153.stdout:9/216: read d3/ff [1528345,58788] 0 2024-09-12T01:42:59.406 INFO:tasks.workunit.client.1.smithi153.stdout:9/217: chown d3/f24 4 1 2024-09-12T01:42:59.406 INFO:tasks.workunit.client.1.smithi153.stdout:9/218: chown d3/d19/c38 51687 1 2024-09-12T01:42:59.406 INFO:tasks.workunit.client.1.smithi153.stdout:0/229: symlink d22/d30/d33/l50 0 2024-09-12T01:42:59.409 INFO:tasks.workunit.client.1.smithi153.stdout:7/200: dread d12/f22 [0,4194304] 0 2024-09-12T01:42:59.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/223: mknod d1/d16/d1c/c48 0 2024-09-12T01:42:59.419 INFO:tasks.workunit.client.1.smithi153.stdout:6/240: rename d1/d6/f3f to d1/d6/da/d19/d34/f49 0 2024-09-12T01:42:59.424 INFO:tasks.workunit.client.1.smithi153.stdout:0/230: symlink d22/d30/d4c/l51 0 2024-09-12T01:42:59.426 INFO:tasks.workunit.client.1.smithi153.stdout:7/201: mkdir d12/d21/d29/d35/d3c 0 2024-09-12T01:42:59.430 INFO:tasks.workunit.client.1.smithi153.stdout:9/219: mkdir d3/d3a 0 2024-09-12T01:42:59.430 INFO:tasks.workunit.client.1.smithi153.stdout:9/220: chown d3/d19/l1c 1399 1 2024-09-12T01:42:59.430 INFO:tasks.workunit.client.1.smithi153.stdout:9/221: write d3/d19/f22 [1220437,46429] 0 2024-09-12T01:42:59.430 INFO:tasks.workunit.client.1.smithi153.stdout:9/222: fdatasync d3/d19/f2a 0 2024-09-12T01:42:59.431 INFO:tasks.workunit.client.1.smithi153.stdout:6/241: rmdir d1/d6/da/d19/d34/d33 39 2024-09-12T01:42:59.436 INFO:tasks.workunit.client.1.smithi153.stdout:9/223: rename d3/c12 to d3/d3a/c3b 0 2024-09-12T01:42:59.436 INFO:tasks.workunit.client.1.smithi153.stdout:9/224: chown d3/d19/d30 3 1 2024-09-12T01:42:59.436 INFO:tasks.workunit.client.0.smithi066.stdout:8/26: dread f3 [0,4194304] 0 2024-09-12T01:42:59.437 INFO:tasks.workunit.client.1.smithi153.stdout:7/202: write d12/f16 [1185198,99589] 0 2024-09-12T01:42:59.440 INFO:tasks.workunit.client.1.smithi153.stdout:6/242: getdents d1/d6/d23 0 2024-09-12T01:42:59.441 INFO:tasks.workunit.client.1.smithi153.stdout:6/243: getdents d1/d6/d39 0 2024-09-12T01:42:59.444 INFO:tasks.workunit.client.1.smithi153.stdout:8/240: sync 2024-09-12T01:42:59.444 INFO:tasks.workunit.client.1.smithi153.stdout:4/148: sync 2024-09-12T01:42:59.444 INFO:tasks.workunit.client.1.smithi153.stdout:5/199: sync 2024-09-12T01:42:59.444 INFO:tasks.workunit.client.1.smithi153.stdout:2/202: sync 2024-09-12T01:42:59.444 INFO:tasks.workunit.client.1.smithi153.stdout:1/199: sync 2024-09-12T01:42:59.444 INFO:tasks.workunit.client.1.smithi153.stdout:5/200: creat d0/d20/f41 x:0 0 0 2024-09-12T01:42:59.447 INFO:tasks.workunit.client.1.smithi153.stdout:8/241: creat d17/d1f/d4f/d42/f59 x:0 0 0 2024-09-12T01:42:59.449 INFO:tasks.workunit.client.1.smithi153.stdout:2/203: link d7/d19/d40/l2d d7/d19/d40/l41 0 2024-09-12T01:42:59.450 INFO:tasks.workunit.client.1.smithi153.stdout:1/200: mkdir d2/d34/d3d 0 2024-09-12T01:42:59.451 INFO:tasks.workunit.client.1.smithi153.stdout:1/201: fsync d2/d9/d28/f3b 0 2024-09-12T01:42:59.452 INFO:tasks.workunit.client.1.smithi153.stdout:4/149: mknod d6/d9/d20/c35 0 2024-09-12T01:42:59.453 INFO:tasks.workunit.client.1.smithi153.stdout:5/201: creat d0/d20/d2e/f42 x:0 0 0 2024-09-12T01:42:59.454 INFO:tasks.workunit.client.1.smithi153.stdout:8/242: creat d17/d1f/f5a x:0 0 0 2024-09-12T01:42:59.454 INFO:tasks.workunit.client.1.smithi153.stdout:8/243: readlink d17/d1f/d4f/d34/l38 0 2024-09-12T01:42:59.455 INFO:tasks.workunit.client.1.smithi153.stdout:2/204: creat d7/db/d36/f42 x:0 0 0 2024-09-12T01:42:59.456 INFO:tasks.workunit.client.1.smithi153.stdout:1/202: unlink d2/d9/d17/f24 0 2024-09-12T01:42:59.457 INFO:tasks.workunit.client.1.smithi153.stdout:4/150: mknod d6/d9/d11/d14/c36 0 2024-09-12T01:42:59.457 INFO:tasks.workunit.client.1.smithi153.stdout:4/151: fsync d6/d9/dc/d31/f24 0 2024-09-12T01:42:59.458 INFO:tasks.workunit.client.1.smithi153.stdout:8/244: unlink d17/d21/d56/l55 0 2024-09-12T01:42:59.461 INFO:tasks.workunit.client.1.smithi153.stdout:2/205: unlink d7/d17/f1b 0 2024-09-12T01:42:59.465 INFO:tasks.workunit.client.1.smithi153.stdout:4/152: symlink d6/d9/dc/d31/l37 0 2024-09-12T01:42:59.466 INFO:tasks.workunit.client.1.smithi153.stdout:2/206: mknod d7/d19/c43 0 2024-09-12T01:42:59.473 INFO:tasks.workunit.client.1.smithi153.stdout:5/202: dwrite d0/df/f27 [0,4194304] 0 2024-09-12T01:42:59.473 INFO:tasks.workunit.client.1.smithi153.stdout:5/203: write d0/df/d1c/d22/f3f [72785,96702] 0 2024-09-12T01:42:59.473 INFO:tasks.workunit.client.1.smithi153.stdout:5/204: readlink d0/d15/l28 0 2024-09-12T01:42:59.473 INFO:tasks.workunit.client.1.smithi153.stdout:5/205: chown d0/d20/d2e/d36/d39 44 1 2024-09-12T01:42:59.474 INFO:tasks.workunit.client.1.smithi153.stdout:5/206: mkdir d0/d43 0 2024-09-12T01:42:59.477 INFO:tasks.workunit.client.1.smithi153.stdout:2/207: write f2 [3378380,122319] 0 2024-09-12T01:42:59.478 INFO:tasks.workunit.client.1.smithi153.stdout:5/207: mknod d0/d20/d2e/c44 0 2024-09-12T01:42:59.480 INFO:tasks.workunit.client.1.smithi153.stdout:7/203: read f7 [2670644,94109] 0 2024-09-12T01:42:59.480 INFO:tasks.workunit.client.1.smithi153.stdout:7/204: fsync f10 0 2024-09-12T01:42:59.480 INFO:tasks.workunit.client.1.smithi153.stdout:7/205: fdatasync d12/f1c 0 2024-09-12T01:42:59.480 INFO:tasks.workunit.client.1.smithi153.stdout:0/231: dread f18 [4194304,4194304] 0 2024-09-12T01:42:59.481 INFO:tasks.workunit.client.1.smithi153.stdout:0/232: dread d22/d30/d33/f3f [0,4194304] 0 2024-09-12T01:42:59.481 INFO:tasks.workunit.client.1.smithi153.stdout:5/208: unlink d0/fb 0 2024-09-12T01:42:59.484 INFO:tasks.workunit.client.1.smithi153.stdout:5/209: read d0/f12 [17203,64390] 0 2024-09-12T01:42:59.485 INFO:tasks.workunit.client.1.smithi153.stdout:6/244: rmdir d1/d6 39 2024-09-12T01:42:59.485 INFO:tasks.workunit.client.1.smithi153.stdout:6/245: readlink d1/d6/da/l1c 0 2024-09-12T01:42:59.487 INFO:tasks.workunit.client.1.smithi153.stdout:2/208: dread d7/f11 [0,4194304] 0 2024-09-12T01:42:59.490 INFO:tasks.workunit.client.1.smithi153.stdout:5/210: mknod d0/d20/d2e/d36/c45 0 2024-09-12T01:42:59.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/206: getdents d12/d21 0 2024-09-12T01:42:59.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/207: readlink d12/l2a 0 2024-09-12T01:42:59.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/208: write f4 [3160256,73029] 0 2024-09-12T01:42:59.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/209: fsync d12/f32 0 2024-09-12T01:42:59.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/210: dread - d12/d21/d29/f2c zero size 2024-09-12T01:42:59.493 INFO:tasks.workunit.client.1.smithi153.stdout:7/211: fdatasync d12/f17 0 2024-09-12T01:42:59.496 INFO:tasks.workunit.client.1.smithi153.stdout:7/212: unlink d12/l27 0 2024-09-12T01:42:59.496 INFO:tasks.workunit.client.1.smithi153.stdout:7/213: stat ca 0 2024-09-12T01:42:59.499 INFO:tasks.workunit.client.1.smithi153.stdout:6/246: write d1/d6/da/d19/d34/f28 [4080692,122778] 0 2024-09-12T01:42:59.499 INFO:tasks.workunit.client.1.smithi153.stdout:6/247: link d1/df/f12 d1/df/f4a 0 2024-09-12T01:42:59.499 INFO:tasks.workunit.client.1.smithi153.stdout:2/209: dread d7/db/ff [0,4194304] 0 2024-09-12T01:42:59.499 INFO:tasks.workunit.client.1.smithi153.stdout:2/210: truncate d7/d19/d40/f37 975362 0 2024-09-12T01:42:59.500 INFO:tasks.workunit.client.1.smithi153.stdout:6/248: read d1/d6/da/f1a [572897,57617] 0 2024-09-12T01:42:59.500 INFO:tasks.workunit.client.1.smithi153.stdout:5/211: dread d0/f1f [0,4194304] 0 2024-09-12T01:42:59.502 INFO:tasks.workunit.client.1.smithi153.stdout:2/211: rename d7/d17/c2f to d7/d19/c44 0 2024-09-12T01:42:59.502 INFO:tasks.workunit.client.1.smithi153.stdout:2/212: truncate d7/d19/d40/f23 1263451 0 2024-09-12T01:42:59.505 INFO:tasks.workunit.client.1.smithi153.stdout:6/249: creat d1/d6/da/d19/d34/d33/f4b x:0 0 0 2024-09-12T01:42:59.506 INFO:tasks.workunit.client.1.smithi153.stdout:0/233: dwrite f21 [0,4194304] 0 2024-09-12T01:42:59.506 INFO:tasks.workunit.client.1.smithi153.stdout:0/234: read f15 [35686,40255] 0 2024-09-12T01:42:59.506 INFO:tasks.workunit.client.1.smithi153.stdout:0/235: stat d22/d30/d33/f46 0 2024-09-12T01:42:59.506 INFO:tasks.workunit.client.1.smithi153.stdout:0/236: write d22/f4b [222282,7020] 0 2024-09-12T01:42:59.507 INFO:tasks.workunit.client.1.smithi153.stdout:7/214: dread d12/f22 [0,4194304] 0 2024-09-12T01:42:59.507 INFO:tasks.workunit.client.1.smithi153.stdout:7/215: creat d12/d21/d29/f3d x:0 0 0 2024-09-12T01:42:59.508 INFO:tasks.workunit.client.1.smithi153.stdout:6/250: creat d1/d6/f4c x:0 0 0 2024-09-12T01:42:59.514 INFO:tasks.workunit.client.1.smithi153.stdout:7/216: mknod d12/c3e 0 2024-09-12T01:42:59.516 INFO:tasks.workunit.client.1.smithi153.stdout:5/212: dwrite d0/f1f [0,4194304] 0 2024-09-12T01:42:59.518 INFO:tasks.workunit.client.1.smithi153.stdout:6/251: link d1/d6/da/d19/d34/f20 d1/d6/da/d19/d3a/f4d 0 2024-09-12T01:42:59.520 INFO:tasks.workunit.client.1.smithi153.stdout:7/217: truncate d12/f22 2655353 0 2024-09-12T01:42:59.523 INFO:tasks.workunit.client.1.smithi153.stdout:6/252: creat d1/d6/da/d32/f4e x:0 0 0 2024-09-12T01:42:59.523 INFO:tasks.workunit.client.1.smithi153.stdout:6/253: dread - d1/d6/f35 zero size 2024-09-12T01:42:59.523 INFO:tasks.workunit.client.1.smithi153.stdout:5/213: write d0/fd [119770,80373] 0 2024-09-12T01:42:59.524 INFO:tasks.workunit.client.1.smithi153.stdout:5/214: dread - d0/fe zero size 2024-09-12T01:42:59.526 INFO:tasks.workunit.client.1.smithi153.stdout:1/203: rmdir d2 39 2024-09-12T01:42:59.526 INFO:tasks.workunit.client.1.smithi153.stdout:1/204: chown d2/d34/f39 1787021911 1 2024-09-12T01:42:59.527 INFO:tasks.workunit.client.1.smithi153.stdout:1/205: read d2/d9/d17/d2f/f31 [213067,104840] 0 2024-09-12T01:42:59.528 INFO:tasks.workunit.client.1.smithi153.stdout:7/218: read d12/f32 [4021244,33893] 0 2024-09-12T01:42:59.528 INFO:tasks.workunit.client.1.smithi153.stdout:7/219: creat d12/d21/d29/f3f x:0 0 0 2024-09-12T01:42:59.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/254: mkdir d1/d6/da/d32/d4f 0 2024-09-12T01:42:59.529 INFO:tasks.workunit.client.1.smithi153.stdout:6/255: chown d1 200 1 2024-09-12T01:42:59.532 INFO:tasks.workunit.client.1.smithi153.stdout:5/215: dread d0/df/f27 [0,4194304] 0 2024-09-12T01:42:59.532 INFO:tasks.workunit.client.1.smithi153.stdout:5/216: creat d0/d15/f46 x:0 0 0 2024-09-12T01:42:59.533 INFO:tasks.workunit.client.1.smithi153.stdout:5/217: rename d0/d20 to d0/d20/d2e/d47 22 2024-09-12T01:42:59.534 INFO:tasks.workunit.client.1.smithi153.stdout:1/206: unlink d2/d9/d1d/d25/c36 0 2024-09-12T01:42:59.539 INFO:tasks.workunit.client.1.smithi153.stdout:7/220: symlink d12/l40 0 2024-09-12T01:42:59.539 INFO:tasks.workunit.client.1.smithi153.stdout:7/221: rename d12 to d12/d21/d29/d35/d41 22 2024-09-12T01:42:59.541 INFO:tasks.workunit.client.1.smithi153.stdout:5/218: symlink d0/d43/l48 0 2024-09-12T01:42:59.541 INFO:tasks.workunit.client.1.smithi153.stdout:5/219: truncate d0/fe 229123 0 2024-09-12T01:42:59.542 INFO:tasks.workunit.client.1.smithi153.stdout:1/207: mknod d2/d9/d1d/d25/c3e 0 2024-09-12T01:42:59.545 INFO:tasks.workunit.client.1.smithi153.stdout:6/256: dwrite d1/d6/d23/f2b [0,4194304] 0 2024-09-12T01:42:59.547 INFO:tasks.workunit.client.1.smithi153.stdout:7/222: symlink d12/d21/d29/d2d/l42 0 2024-09-12T01:42:59.549 INFO:tasks.workunit.client.1.smithi153.stdout:1/208: mkdir d2/d9/d1d/d25/d3f 0 2024-09-12T01:42:59.551 INFO:tasks.workunit.client.1.smithi153.stdout:6/257: link d1/d6/f44 d1/df/f50 0 2024-09-12T01:42:59.553 INFO:tasks.workunit.client.1.smithi153.stdout:7/223: mkdir d12/d21/d29/d2d/d43 0 2024-09-12T01:42:59.553 INFO:tasks.workunit.client.1.smithi153.stdout:7/224: truncate d12/f1b 271439 0 2024-09-12T01:42:59.554 INFO:tasks.workunit.client.1.smithi153.stdout:7/225: fdatasync fe 0 2024-09-12T01:42:59.554 INFO:tasks.workunit.client.1.smithi153.stdout:1/209: creat d2/d9/d1d/d25/d3f/f40 x:0 0 0 2024-09-12T01:42:59.556 INFO:tasks.workunit.client.1.smithi153.stdout:7/226: link f7 d12/d21/f44 0 2024-09-12T01:42:59.558 INFO:tasks.workunit.client.1.smithi153.stdout:1/210: creat d2/d9/d17/f41 x:0 0 0 2024-09-12T01:42:59.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/211: rmdir d2 39 2024-09-12T01:42:59.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/212: fsync d2/d9/f19 0 2024-09-12T01:42:59.562 INFO:tasks.workunit.client.1.smithi153.stdout:6/258: write d1/d6/d23/f2b [3410939,72245] 0 2024-09-12T01:42:59.565 INFO:tasks.workunit.client.1.smithi153.stdout:6/259: rename d1/d6/da/d19/d34/d33/f4b to d1/df/f51 0 2024-09-12T01:42:59.567 INFO:tasks.workunit.client.1.smithi153.stdout:6/260: symlink d1/d6/da/d19/l52 0 2024-09-12T01:42:59.569 INFO:tasks.workunit.client.1.smithi153.stdout:6/261: mkdir d1/d6/da/d32/d53 0 2024-09-12T01:42:59.569 INFO:tasks.workunit.client.1.smithi153.stdout:6/262: fdatasync d1/df/f4a 0 2024-09-12T01:42:59.570 INFO:tasks.workunit.client.1.smithi153.stdout:5/220: dwrite d0/df/d1c/d22/f2b [0,4194304] 0 2024-09-12T01:42:59.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/221: chown d0/d20/d2e/l34 95319 1 2024-09-12T01:42:59.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/222: chown d0/d20/d2e/l33 5 1 2024-09-12T01:42:59.572 INFO:tasks.workunit.client.1.smithi153.stdout:6/263: symlink d1/df/l54 0 2024-09-12T01:42:59.573 INFO:tasks.workunit.client.1.smithi153.stdout:7/227: dwrite d12/f36 [0,4194304] 0 2024-09-12T01:42:59.576 INFO:tasks.workunit.client.1.smithi153.stdout:5/223: dread d0/d20/f26 [0,4194304] 0 2024-09-12T01:42:59.576 INFO:tasks.workunit.client.1.smithi153.stdout:5/224: stat d0/c3 0 2024-09-12T01:42:59.577 INFO:tasks.workunit.client.1.smithi153.stdout:5/225: dread - d0/d20/d2e/d36/f3b zero size 2024-09-12T01:42:59.583 INFO:tasks.workunit.client.1.smithi153.stdout:6/264: write d1/df/f30 [1595913,70951] 0 2024-09-12T01:42:59.586 INFO:tasks.workunit.client.1.smithi153.stdout:7/228: dwrite f10 [8388608,4194304] 0 2024-09-12T01:42:59.591 INFO:tasks.workunit.client.1.smithi153.stdout:5/226: rename d0/d20/d2e/l30 to d0/df/d1c/l49 0 2024-09-12T01:42:59.591 INFO:tasks.workunit.client.1.smithi153.stdout:5/227: creat d0/d20/f4a x:0 0 0 2024-09-12T01:42:59.591 INFO:tasks.workunit.client.1.smithi153.stdout:5/228: fdatasync d0/df/d1c/d22/f3f 0 2024-09-12T01:42:59.592 INFO:tasks.workunit.client.1.smithi153.stdout:6/265: unlink d1/d6/da/d19/d34/f45 0 2024-09-12T01:42:59.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/229: creat d12/d21/f45 x:0 0 0 2024-09-12T01:42:59.599 INFO:tasks.workunit.client.1.smithi153.stdout:5/229: mkdir d0/d20/d4b 0 2024-09-12T01:42:59.600 INFO:tasks.workunit.client.1.smithi153.stdout:6/266: symlink d1/d6/da/d19/l55 0 2024-09-12T01:42:59.601 INFO:tasks.workunit.client.1.smithi153.stdout:7/230: mkdir d12/d21/d29/d2d/d46 0 2024-09-12T01:42:59.601 INFO:tasks.workunit.client.1.smithi153.stdout:7/231: fdatasync d12/f26 0 2024-09-12T01:42:59.609 INFO:tasks.workunit.client.1.smithi153.stdout:6/267: write d1/d6/da/d19/d3a/f4d [1556535,77972] 0 2024-09-12T01:42:59.618 INFO:tasks.workunit.client.1.smithi153.stdout:1/213: getdents d2/d9/d1d/d25 0 2024-09-12T01:42:59.618 INFO:tasks.workunit.client.1.smithi153.stdout:1/214: stat d2/d9/l1c 0 2024-09-12T01:42:59.618 INFO:tasks.workunit.client.1.smithi153.stdout:1/215: read d2/d9/d17/f2d [3861927,102626] 0 2024-09-12T01:42:59.618 INFO:tasks.workunit.client.1.smithi153.stdout:7/232: dwrite d12/d21/f44 [4194304,4194304] 0 2024-09-12T01:42:59.625 INFO:tasks.workunit.client.1.smithi153.stdout:6/268: dread d1/d6/da/d19/d34/f28 [4194304,4194304] 0 2024-09-12T01:42:59.625 INFO:tasks.workunit.client.1.smithi153.stdout:6/269: write d1/d6/da/d19/d34/d33/f3c [4457416,130860] 0 2024-09-12T01:42:59.625 INFO:tasks.workunit.client.1.smithi153.stdout:6/270: write d1/d6/d23/f2b [3218801,93479] 0 2024-09-12T01:42:59.632 INFO:tasks.workunit.client.1.smithi153.stdout:1/216: read d2/d9/d1d/d25/f35 [2494073,54673] 0 2024-09-12T01:42:59.632 INFO:tasks.workunit.client.1.smithi153.stdout:1/217: stat d2/d9/d28/f3b 0 2024-09-12T01:42:59.638 INFO:tasks.workunit.client.1.smithi153.stdout:7/233: dwrite d12/f1c [0,4194304] 0 2024-09-12T01:42:59.638 INFO:tasks.workunit.client.1.smithi153.stdout:7/234: chown d12/d21/c25 4838 1 2024-09-12T01:42:59.642 INFO:tasks.workunit.client.1.smithi153.stdout:6/271: dread d1/d6/da/d19/d34/d33/f3c [0,4194304] 0 2024-09-12T01:42:59.646 INFO:tasks.workunit.client.1.smithi153.stdout:7/235: symlink d12/l47 0 2024-09-12T01:42:59.646 INFO:tasks.workunit.client.1.smithi153.stdout:7/236: chown d12/d21/d29/f3d 2387 1 2024-09-12T01:42:59.646 INFO:tasks.workunit.client.1.smithi153.stdout:1/218: dwrite d2/d9/f1b [0,4194304] 0 2024-09-12T01:42:59.647 INFO:tasks.workunit.client.1.smithi153.stdout:6/272: dread d1/d6/f44 [4194304,4194304] 0 2024-09-12T01:42:59.647 INFO:tasks.workunit.client.1.smithi153.stdout:6/273: fdatasync d1/d6/d23/f48 0 2024-09-12T01:42:59.648 INFO:tasks.workunit.client.1.smithi153.stdout:7/237: symlink d12/l48 0 2024-09-12T01:42:59.649 INFO:tasks.workunit.client.1.smithi153.stdout:1/219: link d2/d9/c33 d2/d9/d1d/c42 0 2024-09-12T01:42:59.651 INFO:tasks.workunit.client.1.smithi153.stdout:6/274: mknod d1/d6/da/d19/d34/d33/c56 0 2024-09-12T01:42:59.653 INFO:tasks.workunit.client.1.smithi153.stdout:7/238: rmdir d12/d21/d29/d2d/d46 0 2024-09-12T01:42:59.653 INFO:tasks.workunit.client.1.smithi153.stdout:5/230: rmdir d0/d20/d2e 39 2024-09-12T01:42:59.654 INFO:tasks.workunit.client.1.smithi153.stdout:6/275: dread d1/df/f26 [0,4194304] 0 2024-09-12T01:42:59.656 INFO:tasks.workunit.client.1.smithi153.stdout:7/239: rmdir d12/d21/d29/d35/d37 39 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:9/225: sync 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:4/153: sync 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:9/226: stat d3/f18 0 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:8/245: sync 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:9/227: dread - d3/f1d zero size 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:6/276: unlink d1/df/f12 0 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:3/224: sync 2024-09-12T01:42:59.658 INFO:tasks.workunit.client.1.smithi153.stdout:3/225: rename d1/d16 to d1/d16/d1c/d32/d49 22 2024-09-12T01:42:59.660 INFO:tasks.workunit.client.1.smithi153.stdout:3/226: read d1/d16/d17/f1f [700981,31845] 0 2024-09-12T01:42:59.661 INFO:tasks.workunit.client.1.smithi153.stdout:8/246: creat d17/d1d/f5b x:0 0 0 2024-09-12T01:42:59.664 INFO:tasks.workunit.client.1.smithi153.stdout:6/277: creat d1/d6/d39/f57 x:0 0 0 2024-09-12T01:42:59.664 INFO:tasks.workunit.client.1.smithi153.stdout:6/278: chown d1/d6/da/l41 1712318 1 2024-09-12T01:42:59.665 INFO:tasks.workunit.client.1.smithi153.stdout:3/227: dread d1/f12 [0,4194304] 0 2024-09-12T01:42:59.668 INFO:tasks.workunit.client.1.smithi153.stdout:6/279: mknod d1/d6/da/d32/d4f/c58 0 2024-09-12T01:42:59.668 INFO:tasks.workunit.client.1.smithi153.stdout:6/280: chown d1/d6/da/d19 177272 1 2024-09-12T01:42:59.668 INFO:tasks.workunit.client.1.smithi153.stdout:6/281: chown d1/d6/da/c2c 174107946 1 2024-09-12T01:42:59.670 INFO:tasks.workunit.client.1.smithi153.stdout:3/228: mknod d1/d16/c4a 0 2024-09-12T01:42:59.670 INFO:tasks.workunit.client.1.smithi153.stdout:1/220: dwrite d2/d9/f32 [0,4194304] 0 2024-09-12T01:42:59.671 INFO:tasks.workunit.client.1.smithi153.stdout:9/228: dread d3/f8 [0,4194304] 0 2024-09-12T01:42:59.672 INFO:tasks.workunit.client.1.smithi153.stdout:6/282: creat d1/d6/da/d32/d53/f59 x:0 0 0 2024-09-12T01:42:59.672 INFO:tasks.workunit.client.1.smithi153.stdout:6/283: chown d1/d6/da/d19/d34/f49 33 1 2024-09-12T01:42:59.672 INFO:tasks.workunit.client.1.smithi153.stdout:3/229: dread d1/d13/f37 [0,4194304] 0 2024-09-12T01:42:59.672 INFO:tasks.workunit.client.1.smithi153.stdout:3/230: chown d1/d16/d17 32 1 2024-09-12T01:42:59.672 INFO:tasks.workunit.client.1.smithi153.stdout:3/231: truncate d1/d16/d17/f18 986090 0 2024-09-12T01:42:59.676 INFO:tasks.workunit.client.1.smithi153.stdout:1/221: mknod d2/c43 0 2024-09-12T01:42:59.678 INFO:tasks.workunit.client.1.smithi153.stdout:5/231: dwrite d0/f1f [0,4194304] 0 2024-09-12T01:42:59.678 INFO:tasks.workunit.client.1.smithi153.stdout:6/284: creat d1/d6/da/f5a x:0 0 0 2024-09-12T01:42:59.678 INFO:tasks.workunit.client.1.smithi153.stdout:6/285: fdatasync d1/d6/f4c 0 2024-09-12T01:42:59.679 INFO:tasks.workunit.client.1.smithi153.stdout:3/232: mkdir d1/d13/d25/d26/d4b 0 2024-09-12T01:42:59.682 INFO:tasks.workunit.client.1.smithi153.stdout:1/222: creat d2/d9/d1d/d25/f44 x:0 0 0 2024-09-12T01:42:59.682 INFO:tasks.workunit.client.1.smithi153.stdout:1/223: chown d2/d9/d17/d2f/f31 411 1 2024-09-12T01:42:59.684 INFO:tasks.workunit.client.1.smithi153.stdout:9/229: dread d3/d19/f32 [0,4194304] 0 2024-09-12T01:42:59.684 INFO:tasks.workunit.client.1.smithi153.stdout:6/286: unlink d1/cb 0 2024-09-12T01:42:59.684 INFO:tasks.workunit.client.1.smithi153.stdout:6/287: fdatasync d1/d6/da/d19/d34/d33/f42 0 2024-09-12T01:42:59.684 INFO:tasks.workunit.client.1.smithi153.stdout:6/288: readlink d1/d6/da/l1c 0 2024-09-12T01:42:59.684 INFO:tasks.workunit.client.1.smithi153.stdout:6/289: chown d1/d6/da/f1a 6 1 2024-09-12T01:42:59.685 INFO:tasks.workunit.client.1.smithi153.stdout:7/240: dwrite d12/f2f [0,4194304] 0 2024-09-12T01:42:59.685 INFO:tasks.workunit.client.1.smithi153.stdout:7/241: write d12/f22 [886606,44109] 0 2024-09-12T01:42:59.685 INFO:tasks.workunit.client.1.smithi153.stdout:7/242: stat d12/l47 0 2024-09-12T01:42:59.689 INFO:tasks.workunit.client.1.smithi153.stdout:3/233: link d1/d16/d1c/f2d d1/d13/d25/f4c 0 2024-09-12T01:42:59.689 INFO:tasks.workunit.client.1.smithi153.stdout:2/213: sync 2024-09-12T01:42:59.689 INFO:tasks.workunit.client.1.smithi153.stdout:1/224: mknod d2/d9/d17/d2c/c45 0 2024-09-12T01:42:59.690 INFO:tasks.workunit.client.1.smithi153.stdout:2/214: creat d7/d19/f45 x:0 0 0 2024-09-12T01:42:59.690 INFO:tasks.workunit.client.1.smithi153.stdout:1/225: fsync d2/d9/d1d/f22 0 2024-09-12T01:42:59.690 INFO:tasks.workunit.client.1.smithi153.stdout:1/226: chown d2/le 149388 1 2024-09-12T01:42:59.690 INFO:tasks.workunit.client.1.smithi153.stdout:1/227: write d2/d9/f19 [2715642,65312] 0 2024-09-12T01:42:59.690 INFO:tasks.workunit.client.1.smithi153.stdout:5/232: write d0/df/d1c/d22/d2f/f3a [1378086,71620] 0 2024-09-12T01:42:59.691 INFO:tasks.workunit.client.1.smithi153.stdout:3/234: symlink d1/d13/d23/l4d 0 2024-09-12T01:42:59.696 INFO:tasks.workunit.client.1.smithi153.stdout:2/215: symlink d7/d19/l46 0 2024-09-12T01:42:59.698 INFO:tasks.workunit.client.1.smithi153.stdout:5/233: rename d0/f8 to d0/d20/d2e/f4c 0 2024-09-12T01:42:59.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/216: rename d7/c10 to d7/d19/c47 0 2024-09-12T01:42:59.703 INFO:tasks.workunit.client.1.smithi153.stdout:2/217: read d7/d19/d40/f37 [195095,68658] 0 2024-09-12T01:42:59.706 INFO:tasks.workunit.client.1.smithi153.stdout:8/247: dwrite d17/d1f/f5a [0,4194304] 0 2024-09-12T01:42:59.708 INFO:tasks.workunit.client.1.smithi153.stdout:0/237: sync 2024-09-12T01:42:59.714 INFO:tasks.workunit.client.1.smithi153.stdout:0/238: mknod d22/d30/d33/c52 0 2024-09-12T01:42:59.714 INFO:tasks.workunit.client.1.smithi153.stdout:0/239: fdatasync d22/d30/d33/f48 0 2024-09-12T01:42:59.716 INFO:tasks.workunit.client.1.smithi153.stdout:0/240: truncate d22/f2c 2119672 0 2024-09-12T01:42:59.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/290: dwrite d1/d6/da/f5a [0,4194304] 0 2024-09-12T01:42:59.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/291: chown d1/d6/d23 1698 1 2024-09-12T01:42:59.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/292: chown d1/d6/f8 7395 1 2024-09-12T01:42:59.731 INFO:tasks.workunit.client.1.smithi153.stdout:6/293: mknod d1/d6/da/d32/d4f/c5b 0 2024-09-12T01:42:59.731 INFO:tasks.workunit.client.1.smithi153.stdout:6/294: chown d1/d6/f8 6 1 2024-09-12T01:42:59.737 INFO:tasks.workunit.client.1.smithi153.stdout:9/230: dwrite d3/d19/f32 [0,4194304] 0 2024-09-12T01:42:59.738 INFO:tasks.workunit.client.1.smithi153.stdout:0/241: dread d22/f4b [0,4194304] 0 2024-09-12T01:42:59.740 INFO:tasks.workunit.client.1.smithi153.stdout:5/234: dwrite d0/df/f35 [0,4194304] 0 2024-09-12T01:42:59.740 INFO:tasks.workunit.client.1.smithi153.stdout:9/231: creat d3/d3a/f3c x:0 0 0 2024-09-12T01:42:59.740 INFO:tasks.workunit.client.1.smithi153.stdout:1/228: dwrite d2/d9/d1d/d25/f44 [0,4194304] 0 2024-09-12T01:42:59.740 INFO:tasks.workunit.client.1.smithi153.stdout:7/243: dwrite f10 [0,4194304] 0 2024-09-12T01:42:59.740 INFO:tasks.workunit.client.1.smithi153.stdout:7/244: creat d12/d21/f49 x:0 0 0 2024-09-12T01:42:59.741 INFO:tasks.workunit.client.1.smithi153.stdout:9/232: read d3/f24 [475078,56096] 0 2024-09-12T01:42:59.741 INFO:tasks.workunit.client.1.smithi153.stdout:0/242: creat d22/d30/d33/f53 x:0 0 0 2024-09-12T01:42:59.743 INFO:tasks.workunit.client.1.smithi153.stdout:5/235: mknod d0/d20/d2e/d36/c4d 0 2024-09-12T01:42:59.743 INFO:tasks.workunit.client.1.smithi153.stdout:5/236: creat d0/df/d1c/d22/f4e x:0 0 0 2024-09-12T01:42:59.743 INFO:tasks.workunit.client.1.smithi153.stdout:5/237: creat d0/df/f4f x:0 0 0 2024-09-12T01:42:59.748 INFO:tasks.workunit.client.1.smithi153.stdout:8/248: dwrite d17/f46 [0,4194304] 0 2024-09-12T01:42:59.748 INFO:tasks.workunit.client.1.smithi153.stdout:8/249: fsync d17/f1b 0 2024-09-12T01:42:59.749 INFO:tasks.workunit.client.1.smithi153.stdout:2/218: dwrite d7/d17/f3c [0,4194304] 0 2024-09-12T01:42:59.749 INFO:tasks.workunit.client.1.smithi153.stdout:6/295: dwrite d1/d6/f4c [0,4194304] 0 2024-09-12T01:42:59.749 INFO:tasks.workunit.client.1.smithi153.stdout:6/296: chown d1/d6/f35 1761 1 2024-09-12T01:42:59.750 INFO:tasks.workunit.client.1.smithi153.stdout:7/245: symlink d12/d21/d29/d2d/l4a 0 2024-09-12T01:42:59.752 INFO:tasks.workunit.client.1.smithi153.stdout:2/219: write d7/fe [949983,106680] 0 2024-09-12T01:42:59.752 INFO:tasks.workunit.client.1.smithi153.stdout:2/220: creat d7/d17/f48 x:0 0 0 2024-09-12T01:42:59.753 INFO:tasks.workunit.client.1.smithi153.stdout:9/233: link d3/lb d3/d19/d30/l3d 0 2024-09-12T01:42:59.755 INFO:tasks.workunit.client.1.smithi153.stdout:0/243: symlink d22/l54 0 2024-09-12T01:42:59.758 INFO:tasks.workunit.client.1.smithi153.stdout:7/246: write d12/f20 [4088839,65679] 0 2024-09-12T01:42:59.759 INFO:tasks.workunit.client.1.smithi153.stdout:7/247: fdatasync f10 0 2024-09-12T01:42:59.759 INFO:tasks.workunit.client.1.smithi153.stdout:7/248: write d12/f20 [2303373,25305] 0 2024-09-12T01:42:59.761 INFO:tasks.workunit.client.1.smithi153.stdout:5/238: mkdir d0/df/d50 0 2024-09-12T01:42:59.764 INFO:tasks.workunit.client.1.smithi153.stdout:1/229: rmdir d2/d9/d1d/d25/d3f 39 2024-09-12T01:42:59.764 INFO:tasks.workunit.client.1.smithi153.stdout:1/230: chown d2/d9/d1d/f22 492118 1 2024-09-12T01:42:59.764 INFO:tasks.workunit.client.1.smithi153.stdout:1/231: fsync d2/d9/f15 0 2024-09-12T01:42:59.764 INFO:tasks.workunit.client.1.smithi153.stdout:1/232: truncate d2/d9/f2e 492456 0 2024-09-12T01:42:59.764 INFO:tasks.workunit.client.1.smithi153.stdout:9/234: write d3/d19/f32 [1366935,122756] 0 2024-09-12T01:42:59.769 INFO:tasks.workunit.client.1.smithi153.stdout:8/250: creat d17/d1f/d4f/f5c x:0 0 0 2024-09-12T01:42:59.778 INFO:tasks.workunit.client.1.smithi153.stdout:6/297: symlink d1/d6/da/d32/d4f/l5c 0 2024-09-12T01:42:59.787 INFO:tasks.workunit.client.1.smithi153.stdout:0/244: rename d22/d30/d33/f4e to d22/d30/d4c/f55 0 2024-09-12T01:42:59.787 INFO:tasks.workunit.client.1.smithi153.stdout:3/235: getdents d1/d13/d23 0 2024-09-12T01:42:59.787 INFO:tasks.workunit.client.1.smithi153.stdout:3/236: fsync d1/d1e/f2a 0 2024-09-12T01:42:59.789 INFO:tasks.workunit.client.1.smithi153.stdout:7/249: symlink d12/l4b 0 2024-09-12T01:42:59.792 INFO:tasks.workunit.client.1.smithi153.stdout:9/235: unlink d3/d35/l36 0 2024-09-12T01:42:59.794 INFO:tasks.workunit.client.1.smithi153.stdout:8/251: rename d17/d1f/f26 to d17/d1f/f5d 0 2024-09-12T01:42:59.801 INFO:tasks.workunit.client.1.smithi153.stdout:2/221: truncate d7/db/d27/f3a 538460 0 2024-09-12T01:42:59.801 INFO:tasks.workunit.client.1.smithi153.stdout:2/222: fsync d7/fe 0 2024-09-12T01:42:59.811 INFO:tasks.workunit.client.1.smithi153.stdout:0/245: symlink d22/d30/d4c/l56 0 2024-09-12T01:42:59.811 INFO:tasks.workunit.client.1.smithi153.stdout:0/246: fdatasync d22/f2b 0 2024-09-12T01:42:59.813 INFO:tasks.workunit.client.1.smithi153.stdout:3/237: link d1/l10 d1/d16/d1c/d32/l4e 0 2024-09-12T01:42:59.814 INFO:tasks.workunit.client.1.smithi153.stdout:7/250: rmdir d12/d21/d29/d2d/d43 0 2024-09-12T01:42:59.815 INFO:tasks.workunit.client.1.smithi153.stdout:7/251: read d12/f16 [187789,12000] 0 2024-09-12T01:42:59.815 INFO:tasks.workunit.client.1.smithi153.stdout:3/238: dread d1/d1e/f2a [0,4194304] 0 2024-09-12T01:42:59.816 INFO:tasks.workunit.client.1.smithi153.stdout:3/239: dread d1/d16/d17/f18 [0,4194304] 0 2024-09-12T01:42:59.818 INFO:tasks.workunit.client.1.smithi153.stdout:9/236: creat d3/f3e x:0 0 0 2024-09-12T01:42:59.821 INFO:tasks.workunit.client.1.smithi153.stdout:2/223: mknod d7/db/c49 0 2024-09-12T01:42:59.824 INFO:tasks.workunit.client.1.smithi153.stdout:3/240: creat d1/d13/d25/d26/d4b/f4f x:0 0 0 2024-09-12T01:42:59.825 INFO:tasks.workunit.client.1.smithi153.stdout:8/252: getdents d17/d21/d3a 0 2024-09-12T01:42:59.826 INFO:tasks.workunit.client.1.smithi153.stdout:8/253: fsync d17/f24 0 2024-09-12T01:42:59.827 INFO:tasks.workunit.client.1.smithi153.stdout:2/224: rmdir d7/d19/d40 39 2024-09-12T01:42:59.829 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:59 smithi153 ceph-mon[34713]: mgrmap e20: smithi066.qdwcrh(active, since 6m), standbys: smithi153.jpnqza 2024-09-12T01:42:59.829 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:59 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:59.829 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:59 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:59.829 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:42:59 smithi153 ceph-mon[34713]: pgmap v240: 65 pgs: 65 active+clean; 350 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 25 MiB/s wr, 414 op/s 2024-09-12T01:42:59.830 INFO:tasks.workunit.client.1.smithi153.stdout:0/247: mknod d22/d30/d33/c57 0 2024-09-12T01:42:59.831 INFO:tasks.workunit.client.1.smithi153.stdout:3/241: symlink d1/d16/d17/l50 0 2024-09-12T01:42:59.832 INFO:tasks.workunit.client.1.smithi153.stdout:2/225: mkdir d7/db/d1d/d4a 0 2024-09-12T01:42:59.834 INFO:tasks.workunit.client.1.smithi153.stdout:0/248: creat d22/d30/d4c/f58 x:0 0 0 2024-09-12T01:42:59.835 INFO:tasks.workunit.client.1.smithi153.stdout:3/242: creat d1/d45/f51 x:0 0 0 2024-09-12T01:42:59.835 INFO:tasks.workunit.client.1.smithi153.stdout:3/243: chown d1/d13/d25/d26/d4b/f4f 649 1 2024-09-12T01:42:59.837 INFO:tasks.workunit.client.1.smithi153.stdout:0/249: unlink d22/d30/d33/f53 0 2024-09-12T01:42:59.837 INFO:tasks.workunit.client.1.smithi153.stdout:0/250: chown d22/f26 4131805 1 2024-09-12T01:42:59.838 INFO:tasks.workunit.client.1.smithi153.stdout:0/251: dread d22/f4b [0,4194304] 0 2024-09-12T01:42:59.840 INFO:tasks.workunit.client.1.smithi153.stdout:0/252: creat d22/d30/f59 x:0 0 0 2024-09-12T01:42:59.840 INFO:tasks.workunit.client.1.smithi153.stdout:0/253: creat d22/f5a x:0 0 0 2024-09-12T01:42:59.840 INFO:tasks.workunit.client.1.smithi153.stdout:0/254: write f6 [5154559,72348] 0 2024-09-12T01:42:59.842 INFO:tasks.workunit.client.1.smithi153.stdout:7/252: dwrite d12/f1c [0,4194304] 0 2024-09-12T01:42:59.842 INFO:tasks.workunit.client.1.smithi153.stdout:8/254: dwrite d17/d1f/d4f/d34/f40 [0,4194304] 0 2024-09-12T01:42:59.843 INFO:tasks.workunit.client.1.smithi153.stdout:2/226: dread d7/db/d1d/f35 [0,4194304] 0 2024-09-12T01:42:59.843 INFO:tasks.workunit.client.1.smithi153.stdout:0/255: mknod d22/c5b 0 2024-09-12T01:42:59.846 INFO:tasks.workunit.client.1.smithi153.stdout:7/253: mkdir d12/d21/d29/d35/d37/d4c 0 2024-09-12T01:42:59.849 INFO:tasks.workunit.client.1.smithi153.stdout:5/239: rename d0/d20/d2e to d0/d43/d51 0 2024-09-12T01:42:59.852 INFO:tasks.workunit.client.1.smithi153.stdout:0/256: write f1b [6694667,91905] 0 2024-09-12T01:42:59.853 INFO:tasks.workunit.client.1.smithi153.stdout:9/237: rename d3/d19/d30/f33 to d3/d35/f3f 0 2024-09-12T01:42:59.854 INFO:tasks.workunit.client.1.smithi153.stdout:8/255: rmdir d17/d1d 39 2024-09-12T01:42:59.855 INFO:tasks.workunit.client.1.smithi153.stdout:7/254: dread d12/f2f [0,4194304] 0 2024-09-12T01:42:59.858 INFO:tasks.workunit.client.1.smithi153.stdout:8/256: symlink d17/d21/d3a/l5e 0 2024-09-12T01:42:59.862 INFO:tasks.workunit.client.1.smithi153.stdout:7/255: mkdir d12/d21/d4d 0 2024-09-12T01:42:59.862 INFO:tasks.workunit.client.1.smithi153.stdout:9/238: read d3/f7 [4154693,36215] 0 2024-09-12T01:42:59.864 INFO:tasks.workunit.client.1.smithi153.stdout:8/257: creat d17/d1f/d4f/d34/f5f x:0 0 0 2024-09-12T01:42:59.864 INFO:tasks.workunit.client.1.smithi153.stdout:8/258: truncate d17/d1f/d4f/f57 4404091 0 2024-09-12T01:42:59.865 INFO:tasks.workunit.client.1.smithi153.stdout:8/259: chown d17/d21/c37 3676 1 2024-09-12T01:42:59.866 INFO:tasks.workunit.client.1.smithi153.stdout:9/239: dread d3/f7 [0,4194304] 0 2024-09-12T01:42:59.866 INFO:tasks.workunit.client.1.smithi153.stdout:9/240: truncate d3/fe 4907469 0 2024-09-12T01:42:59.872 INFO:tasks.workunit.client.1.smithi153.stdout:9/241: unlink d3/d3a/f3c 0 2024-09-12T01:42:59.874 INFO:tasks.workunit.client.1.smithi153.stdout:8/260: dread fd [0,4194304] 0 2024-09-12T01:42:59.879 INFO:tasks.workunit.client.1.smithi153.stdout:5/240: dwrite d0/d43/d51/f4c [0,4194304] 0 2024-09-12T01:42:59.882 INFO:tasks.workunit.client.1.smithi153.stdout:5/241: write d0/df/f2d [3495715,73914] 0 2024-09-12T01:42:59.886 INFO:tasks.workunit.client.1.smithi153.stdout:9/242: dread d3/f11 [0,4194304] 0 2024-09-12T01:42:59.886 INFO:tasks.workunit.client.1.smithi153.stdout:0/257: dwrite d22/f26 [0,4194304] 0 2024-09-12T01:42:59.886 INFO:tasks.workunit.client.1.smithi153.stdout:0/258: read - d22/f3c zero size 2024-09-12T01:42:59.886 INFO:tasks.workunit.client.1.smithi153.stdout:0/259: chown d22/d30/f47 2542385 1 2024-09-12T01:42:59.886 INFO:tasks.workunit.client.1.smithi153.stdout:9/243: write d3/d35/f3f [527675,101835] 0 2024-09-12T01:42:59.887 INFO:tasks.workunit.client.1.smithi153.stdout:0/260: dread d22/d30/f47 [0,4194304] 0 2024-09-12T01:42:59.887 INFO:tasks.workunit.client.1.smithi153.stdout:8/261: dread d17/d1f/f5a [0,4194304] 0 2024-09-12T01:42:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:59 smithi066 ceph-mon[27875]: mgrmap e20: smithi066.qdwcrh(active, since 6m), standbys: smithi153.jpnqza 2024-09-12T01:42:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:59 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:59 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:42:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:42:59 smithi066 ceph-mon[27875]: pgmap v240: 65 pgs: 65 active+clean; 350 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 25 MiB/s wr, 414 op/s 2024-09-12T01:42:59.889 INFO:tasks.workunit.client.1.smithi153.stdout:5/242: rename d0/df/d1c/d22/f3f to d0/df/f52 0 2024-09-12T01:42:59.891 INFO:tasks.workunit.client.1.smithi153.stdout:0/261: symlink d22/d30/d4c/l5c 0 2024-09-12T01:42:59.897 INFO:tasks.workunit.client.1.smithi153.stdout:8/262: mknod d17/d1f/d4f/d42/c60 0 2024-09-12T01:42:59.897 INFO:tasks.workunit.client.1.smithi153.stdout:8/263: chown f15 3 1 2024-09-12T01:42:59.897 INFO:tasks.workunit.client.1.smithi153.stdout:8/264: readlink d17/d21/d3a/l4c 0 2024-09-12T01:42:59.897 INFO:tasks.workunit.client.1.smithi153.stdout:0/262: symlink d22/d30/l5d 0 2024-09-12T01:42:59.897 INFO:tasks.workunit.client.1.smithi153.stdout:0/263: creat d22/f5e x:0 0 0 2024-09-12T01:42:59.898 INFO:tasks.workunit.client.1.smithi153.stdout:5/243: getdents d0/d15 0 2024-09-12T01:42:59.899 INFO:tasks.workunit.client.1.smithi153.stdout:7/256: truncate d12/f20 877885 0 2024-09-12T01:42:59.902 INFO:tasks.workunit.client.1.smithi153.stdout:5/244: creat d0/d15/f53 x:0 0 0 2024-09-12T01:42:59.902 INFO:tasks.workunit.client.1.smithi153.stdout:2/227: truncate d7/f1c 1455584 0 2024-09-12T01:42:59.902 INFO:tasks.workunit.client.1.smithi153.stdout:2/228: creat d7/d19/f4b x:0 0 0 2024-09-12T01:42:59.903 INFO:tasks.workunit.client.1.smithi153.stdout:2/229: write d7/d19/d40/f23 [1442539,79251] 0 2024-09-12T01:42:59.916 INFO:tasks.workunit.client.1.smithi153.stdout:1/233: truncate d2/d9/f1b 6297776 0 2024-09-12T01:42:59.922 INFO:tasks.workunit.client.1.smithi153.stdout:9/244: dwrite f1 [0,4194304] 0 2024-09-12T01:42:59.922 INFO:tasks.workunit.client.1.smithi153.stdout:9/245: write d3/f7 [205400,29209] 0 2024-09-12T01:42:59.922 INFO:tasks.workunit.client.1.smithi153.stdout:9/246: truncate d3/d19/f22 1822955 0 2024-09-12T01:42:59.922 INFO:tasks.workunit.client.1.smithi153.stdout:2/230: fsync d7/d19/d40/f23 0 2024-09-12T01:42:59.923 INFO:tasks.workunit.client.1.smithi153.stdout:0/264: dwrite f21 [0,4194304] 0 2024-09-12T01:42:59.935 INFO:tasks.workunit.client.1.smithi153.stdout:9/247: symlink d3/d3a/l40 0 2024-09-12T01:42:59.935 INFO:tasks.workunit.client.1.smithi153.stdout:9/248: read - d3/d19/f34 zero size 2024-09-12T01:42:59.937 INFO:tasks.workunit.client.1.smithi153.stdout:2/231: creat d7/db/d27/f4c x:0 0 0 2024-09-12T01:42:59.940 INFO:tasks.workunit.client.1.smithi153.stdout:2/232: fsync d7/db/d27/f31 0 2024-09-12T01:42:59.940 INFO:tasks.workunit.client.1.smithi153.stdout:2/233: stat d7/db/d1d/f35 0 2024-09-12T01:42:59.951 INFO:tasks.workunit.client.1.smithi153.stdout:7/257: dwrite d12/f16 [0,4194304] 0 2024-09-12T01:42:59.951 INFO:tasks.workunit.client.1.smithi153.stdout:5/245: dwrite d0/df/f21 [0,4194304] 0 2024-09-12T01:42:59.951 INFO:tasks.workunit.client.1.smithi153.stdout:5/246: chown d0/d20/d4b 4 1 2024-09-12T01:42:59.951 INFO:tasks.workunit.client.1.smithi153.stdout:7/258: fdatasync d12/d21/d29/f3b 0 2024-09-12T01:42:59.951 INFO:tasks.workunit.client.1.smithi153.stdout:5/247: creat d0/d15/f54 x:0 0 0 2024-09-12T01:42:59.951 INFO:tasks.workunit.client.1.smithi153.stdout:1/234: dwrite d2/d9/f19 [0,4194304] 0 2024-09-12T01:42:59.952 INFO:tasks.workunit.client.1.smithi153.stdout:0/265: dwrite d22/f3c [0,4194304] 0 2024-09-12T01:42:59.953 INFO:tasks.workunit.client.1.smithi153.stdout:0/266: truncate d22/f5a 316839 0 2024-09-12T01:42:59.953 INFO:tasks.workunit.client.1.smithi153.stdout:9/249: write f1 [4136354,46047] 0 2024-09-12T01:42:59.958 INFO:tasks.workunit.client.1.smithi153.stdout:1/235: write d2/d9/f32 [1913024,13459] 0 2024-09-12T01:42:59.958 INFO:tasks.workunit.client.1.smithi153.stdout:5/248: mkdir d0/df/d1c/d22/d2f/d55 0 2024-09-12T01:42:59.971 INFO:tasks.workunit.client.1.smithi153.stdout:1/236: rmdir d2/d9/d28 39 2024-09-12T01:42:59.972 INFO:tasks.workunit.client.1.smithi153.stdout:1/237: creat d2/d9/d17/f46 x:0 0 0 2024-09-12T01:42:59.972 INFO:tasks.workunit.client.1.smithi153.stdout:5/249: stat d0/d43/d51/l34 0 2024-09-12T01:42:59.975 INFO:tasks.workunit.client.1.smithi153.stdout:1/238: mknod d2/d9/d1d/d25/d3f/c47 0 2024-09-12T01:42:59.977 INFO:tasks.workunit.client.1.smithi153.stdout:5/250: creat d0/df/d1c/d22/d2f/d55/f56 x:0 0 0 2024-09-12T01:42:59.979 INFO:tasks.workunit.client.1.smithi153.stdout:1/239: rename d2/d9/d28/f2a to d2/d9/d17/f48 0 2024-09-12T01:42:59.979 INFO:tasks.workunit.client.1.smithi153.stdout:1/240: creat d2/d9/d1d/d25/f49 x:0 0 0 2024-09-12T01:42:59.979 INFO:tasks.workunit.client.1.smithi153.stdout:1/241: creat d2/d9/d1d/d25/f4a x:0 0 0 2024-09-12T01:42:59.980 INFO:tasks.workunit.client.1.smithi153.stdout:0/267: write d22/d30/d33/f35 [2029228,84530] 0 2024-09-12T01:42:59.980 INFO:tasks.workunit.client.1.smithi153.stdout:0/268: fdatasync d22/f2c 0 2024-09-12T01:42:59.985 INFO:tasks.workunit.client.1.smithi153.stdout:9/250: dwrite d3/f8 [0,4194304] 0 2024-09-12T01:42:59.986 INFO:tasks.workunit.client.1.smithi153.stdout:1/242: getdents d2 0 2024-09-12T01:42:59.986 INFO:tasks.workunit.client.1.smithi153.stdout:1/243: readlink d2/l4 0 2024-09-12T01:42:59.986 INFO:tasks.workunit.client.1.smithi153.stdout:1/244: truncate d2/d9/d17/f46 1030367 0 2024-09-12T01:42:59.988 INFO:tasks.workunit.client.1.smithi153.stdout:0/269: rename d22/d30/d33/f46 to d22/f5f 0 2024-09-12T01:42:59.988 INFO:tasks.workunit.client.1.smithi153.stdout:0/270: creat d22/d30/f60 x:0 0 0 2024-09-12T01:42:59.988 INFO:tasks.workunit.client.1.smithi153.stdout:0/271: chown f13 888543749 1 2024-09-12T01:43:00.001 INFO:tasks.workunit.client.1.smithi153.stdout:0/272: dread f4 [4194304,4194304] 0 2024-09-12T01:43:00.001 INFO:tasks.workunit.client.1.smithi153.stdout:0/273: write fa [538614,126969] 0 2024-09-12T01:43:00.003 INFO:tasks.workunit.client.1.smithi153.stdout:5/251: dwrite d0/d20/f41 [0,4194304] 0 2024-09-12T01:43:00.005 INFO:tasks.workunit.client.1.smithi153.stdout:0/274: dread d22/f39 [0,4194304] 0 2024-09-12T01:43:00.007 INFO:tasks.workunit.client.1.smithi153.stdout:5/252: mknod d0/d20/d4b/c57 0 2024-09-12T01:43:00.008 INFO:tasks.workunit.client.1.smithi153.stdout:0/275: dread f18 [4194304,4194304] 0 2024-09-12T01:43:00.009 INFO:tasks.workunit.client.1.smithi153.stdout:0/276: write d22/f2a [1778925,128737] 0 2024-09-12T01:43:00.009 INFO:tasks.workunit.client.1.smithi153.stdout:0/277: fdatasync d22/f26 0 2024-09-12T01:43:00.009 INFO:tasks.workunit.client.1.smithi153.stdout:0/278: write d22/d30/d33/f48 [1041322,23826] 0 2024-09-12T01:43:00.009 INFO:tasks.workunit.client.1.smithi153.stdout:5/253: mkdir d0/df/d50/d58 0 2024-09-12T01:43:00.010 INFO:tasks.workunit.client.1.smithi153.stdout:0/279: mknod d22/c61 0 2024-09-12T01:43:00.011 INFO:tasks.workunit.client.1.smithi153.stdout:9/251: dwrite d3/d19/f22 [0,4194304] 0 2024-09-12T01:43:00.011 INFO:tasks.workunit.client.1.smithi153.stdout:1/245: dwrite d2/d9/d1d/d25/f35 [0,4194304] 0 2024-09-12T01:43:00.013 INFO:tasks.workunit.client.1.smithi153.stdout:5/254: symlink d0/df/d1c/d22/l59 0 2024-09-12T01:43:00.019 INFO:tasks.workunit.client.1.smithi153.stdout:9/252: symlink d3/d19/l41 0 2024-09-12T01:43:00.019 INFO:tasks.workunit.client.1.smithi153.stdout:9/253: write d3/d35/f37 [779915,5239] 0 2024-09-12T01:43:00.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/154: sync 2024-09-12T01:43:00.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/155: write d6/d9/d11/d14/f2a [675896,66410] 0 2024-09-12T01:43:00.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/156: chown d6/d9/d26 732 1 2024-09-12T01:43:00.024 INFO:tasks.workunit.client.1.smithi153.stdout:1/246: rename d2/d9/d28/f3b to d2/d9/d1d/f4b 0 2024-09-12T01:43:00.024 INFO:tasks.workunit.client.1.smithi153.stdout:1/247: readlink d2/d9/d17/d2f/l3c 0 2024-09-12T01:43:00.024 INFO:tasks.workunit.client.1.smithi153.stdout:1/248: fsync d2/d9/d17/f41 0 2024-09-12T01:43:00.025 INFO:tasks.workunit.client.1.smithi153.stdout:5/255: truncate d0/df/d1c/d22/d2f/f3a 2727006 0 2024-09-12T01:43:00.025 INFO:tasks.workunit.client.1.smithi153.stdout:5/256: write d0/d20/f37 [201737,85998] 0 2024-09-12T01:43:00.031 INFO:tasks.workunit.client.1.smithi153.stdout:4/157: write d6/d9/d11/f1e [2421868,82800] 0 2024-09-12T01:43:00.032 INFO:tasks.workunit.client.1.smithi153.stdout:1/249: write d2/d9/f19 [494709,21889] 0 2024-09-12T01:43:00.040 INFO:tasks.workunit.client.1.smithi153.stdout:4/158: mkdir d6/d15/d38 0 2024-09-12T01:43:00.043 INFO:tasks.workunit.client.1.smithi153.stdout:1/250: creat d2/d9/d1d/d25/d3f/f4c x:0 0 0 2024-09-12T01:43:00.045 INFO:tasks.workunit.client.1.smithi153.stdout:4/159: mknod d6/d9/c39 0 2024-09-12T01:43:00.045 INFO:tasks.workunit.client.1.smithi153.stdout:4/160: chown d6/fe 2413 1 2024-09-12T01:43:00.047 INFO:tasks.workunit.client.1.smithi153.stdout:4/161: creat d6/d9/dc/f3a x:0 0 0 2024-09-12T01:43:00.047 INFO:tasks.workunit.client.1.smithi153.stdout:4/162: chown d6/d9/dc/d31/f33 0 1 2024-09-12T01:43:00.049 INFO:tasks.workunit.client.1.smithi153.stdout:4/163: getdents d6/d9/d11/d13 0 2024-09-12T01:43:00.052 INFO:tasks.workunit.client.1.smithi153.stdout:4/164: link d6/d9/f10 d6/d9/d26/f3b 0 2024-09-12T01:43:00.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/165: write d6/d9/f10 [1012702,66032] 0 2024-09-12T01:43:00.056 INFO:tasks.workunit.client.1.smithi153.stdout:1/251: dwrite d2/d34/f39 [0,4194304] 0 2024-09-12T01:43:00.058 INFO:tasks.workunit.client.1.smithi153.stdout:6/298: sync 2024-09-12T01:43:00.058 INFO:tasks.workunit.client.1.smithi153.stdout:3/244: sync 2024-09-12T01:43:00.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/245: rmdir d1/d45 39 2024-09-12T01:43:00.068 INFO:tasks.workunit.client.1.smithi153.stdout:3/246: mknod d1/d16/d1c/c52 0 2024-09-12T01:43:00.071 INFO:tasks.workunit.client.1.smithi153.stdout:3/247: write d1/d16/d1c/f33 [1067580,42834] 0 2024-09-12T01:43:00.072 INFO:tasks.workunit.client.1.smithi153.stdout:6/299: dread d1/d6/da/d19/d34/d33/f3c [0,4194304] 0 2024-09-12T01:43:00.073 INFO:tasks.workunit.client.1.smithi153.stdout:1/252: write d2/d9/d17/f2d [4557192,40295] 0 2024-09-12T01:43:00.075 INFO:tasks.workunit.client.1.smithi153.stdout:3/248: unlink d1/d16/c30 0 2024-09-12T01:43:00.077 INFO:tasks.workunit.client.1.smithi153.stdout:6/300: write d1/df/f30 [1894729,86179] 0 2024-09-12T01:43:00.079 INFO:tasks.workunit.client.1.smithi153.stdout:4/166: dwrite d6/d9/f10 [0,4194304] 0 2024-09-12T01:43:00.079 INFO:tasks.workunit.client.1.smithi153.stdout:1/253: creat d2/d9/d17/d2c/f4d x:0 0 0 2024-09-12T01:43:00.082 INFO:tasks.workunit.client.1.smithi153.stdout:6/301: mknod d1/d6/da/d32/d53/c5d 0 2024-09-12T01:43:00.091 INFO:tasks.workunit.client.1.smithi153.stdout:4/167: read d6/d9/d11/d13/f18 [1363334,22030] 0 2024-09-12T01:43:00.091 INFO:tasks.workunit.client.1.smithi153.stdout:4/168: creat d6/d9/d11/f3c x:0 0 0 2024-09-12T01:43:00.094 INFO:tasks.workunit.client.1.smithi153.stdout:4/169: symlink d6/d9/dc/d31/l3d 0 2024-09-12T01:43:00.095 INFO:tasks.workunit.client.1.smithi153.stdout:0/280: rmdir d22 39 2024-09-12T01:43:00.097 INFO:tasks.workunit.client.1.smithi153.stdout:4/170: unlink d6/d9/dc/d31/f33 0 2024-09-12T01:43:00.097 INFO:tasks.workunit.client.1.smithi153.stdout:4/171: dread - d6/d9/f2b zero size 2024-09-12T01:43:00.098 INFO:tasks.workunit.client.1.smithi153.stdout:0/281: mknod d22/d30/c62 0 2024-09-12T01:43:00.101 INFO:tasks.workunit.client.1.smithi153.stdout:0/282: mknod d22/d30/d33/c63 0 2024-09-12T01:43:00.105 INFO:tasks.workunit.client.1.smithi153.stdout:1/254: getdents d2/d9/d1d 0 2024-09-12T01:43:00.105 INFO:tasks.workunit.client.1.smithi153.stdout:1/255: stat d2/le 0 2024-09-12T01:43:00.105 INFO:tasks.workunit.client.1.smithi153.stdout:1/256: creat d2/d9/d17/f4e x:0 0 0 2024-09-12T01:43:00.105 INFO:tasks.workunit.client.1.smithi153.stdout:1/257: write d2/d9/d17/f48 [2864903,62395] 0 2024-09-12T01:43:00.105 INFO:tasks.workunit.client.1.smithi153.stdout:1/258: chown d2/d9/c16 15 1 2024-09-12T01:43:00.118 INFO:tasks.workunit.client.1.smithi153.stdout:5/257: dread d0/df/f27 [0,4194304] 0 2024-09-12T01:43:00.118 INFO:tasks.workunit.client.1.smithi153.stdout:5/258: write d0/d20/f4a [709169,107536] 0 2024-09-12T01:43:00.118 INFO:tasks.workunit.client.1.smithi153.stdout:5/259: stat d0/d20/d4b/c57 0 2024-09-12T01:43:00.118 INFO:tasks.workunit.client.1.smithi153.stdout:5/260: write d0/d15/f25 [4941319,23077] 0 2024-09-12T01:43:00.118 INFO:tasks.workunit.client.1.smithi153.stdout:5/261: write d0/df/f27 [2103315,49245] 0 2024-09-12T01:43:00.118 INFO:tasks.workunit.client.1.smithi153.stdout:5/262: chown d0/df/d1c/d22/d2f/d55/f56 3728 1 2024-09-12T01:43:00.119 INFO:tasks.workunit.client.1.smithi153.stdout:5/263: creat d0/d20/d4b/f5a x:0 0 0 2024-09-12T01:43:00.131 INFO:tasks.workunit.client.1.smithi153.stdout:0/283: dwrite d22/f24 [0,4194304] 0 2024-09-12T01:43:00.136 INFO:tasks.workunit.client.1.smithi153.stdout:1/259: dwrite d2/d9/d1d/f22 [0,4194304] 0 2024-09-12T01:43:00.138 INFO:tasks.workunit.client.1.smithi153.stdout:5/264: dwrite d0/f32 [0,4194304] 0 2024-09-12T01:43:00.138 INFO:tasks.workunit.client.1.smithi153.stdout:5/265: fsync d0/d15/f16 0 2024-09-12T01:43:00.141 INFO:tasks.workunit.client.1.smithi153.stdout:1/260: truncate d2/d9/d1d/d25/f44 1574778 0 2024-09-12T01:43:00.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/261: symlink d2/d34/d3d/l4f 0 2024-09-12T01:43:00.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/262: write d2/d9/f19 [2111105,89611] 0 2024-09-12T01:43:00.150 INFO:tasks.workunit.client.1.smithi153.stdout:5/266: dwrite d0/fe [0,4194304] 0 2024-09-12T01:43:00.151 INFO:tasks.workunit.client.1.smithi153.stdout:1/263: rename d2/d9/f19 to d2/d34/f50 0 2024-09-12T01:43:00.155 INFO:tasks.workunit.client.1.smithi153.stdout:5/267: truncate d0/f2 3935864 0 2024-09-12T01:43:00.155 INFO:tasks.workunit.client.1.smithi153.stdout:5/268: truncate d0/df/f4f 490382 0 2024-09-12T01:43:00.158 INFO:tasks.workunit.client.1.smithi153.stdout:5/269: rename d0/df/l11 to d0/df/l5b 0 2024-09-12T01:43:00.158 INFO:tasks.workunit.client.1.smithi153.stdout:5/270: write d0/d15/f25 [2225308,13544] 0 2024-09-12T01:43:00.161 INFO:tasks.workunit.client.1.smithi153.stdout:8/265: sync 2024-09-12T01:43:00.176 INFO:tasks.workunit.client.1.smithi153.stdout:0/284: getdents d22/d30 0 2024-09-12T01:43:00.204 INFO:tasks.workunit.client.1.smithi153.stdout:0/285: dread d22/f2b [0,4194304] 0 2024-09-12T01:43:00.207 INFO:tasks.workunit.client.1.smithi153.stdout:5/271: dwrite d0/df/d1c/d22/f4e [0,4194304] 0 2024-09-12T01:43:00.207 INFO:tasks.workunit.client.1.smithi153.stdout:5/272: write d0/d20/f37 [951573,75610] 0 2024-09-12T01:43:00.207 INFO:tasks.workunit.client.1.smithi153.stdout:0/286: symlink d22/d30/l64 0 2024-09-12T01:43:00.208 INFO:tasks.workunit.client.1.smithi153.stdout:8/266: dwrite d17/d1f/d4f/d34/f47 [0,4194304] 0 2024-09-12T01:43:00.217 INFO:tasks.workunit.client.1.smithi153.stdout:0/287: rename f21 to d22/f65 0 2024-09-12T01:43:00.217 INFO:tasks.workunit.client.1.smithi153.stdout:0/288: read d22/d30/d4c/f4d [4505460,52283] 0 2024-09-12T01:43:00.218 INFO:tasks.workunit.client.1.smithi153.stdout:0/289: dread d22/d30/f47 [0,4194304] 0 2024-09-12T01:43:00.220 INFO:tasks.workunit.client.1.smithi153.stdout:8/267: symlink d17/d1d/d27/l61 0 2024-09-12T01:43:00.222 INFO:tasks.workunit.client.1.smithi153.stdout:8/268: mknod d17/d21/d56/c62 0 2024-09-12T01:43:00.223 INFO:tasks.workunit.client.1.smithi153.stdout:5/273: dwrite d0/fe [0,4194304] 0 2024-09-12T01:43:00.224 INFO:tasks.workunit.client.1.smithi153.stdout:5/274: write d0/d15/f46 [785342,85339] 0 2024-09-12T01:43:00.229 INFO:tasks.workunit.client.1.smithi153.stdout:0/290: dread d22/f3c [0,4194304] 0 2024-09-12T01:43:00.232 INFO:tasks.workunit.client.1.smithi153.stdout:5/275: mknod d0/d43/d51/d36/c5c 0 2024-09-12T01:43:00.234 INFO:tasks.workunit.client.1.smithi153.stdout:8/269: dread f14 [0,4194304] 0 2024-09-12T01:43:00.236 INFO:tasks.workunit.client.1.smithi153.stdout:0/291: truncate d22/f26 1546586 0 2024-09-12T01:43:00.236 INFO:tasks.workunit.client.1.smithi153.stdout:0/292: write d22/d30/f42 [955707,31814] 0 2024-09-12T01:43:00.244 INFO:tasks.workunit.client.1.smithi153.stdout:0/293: write d22/f24 [3723167,18958] 0 2024-09-12T01:43:00.246 INFO:tasks.workunit.client.1.smithi153.stdout:0/294: truncate f1b 4533450 0 2024-09-12T01:43:00.248 INFO:tasks.workunit.client.1.smithi153.stdout:2/234: sync 2024-09-12T01:43:00.248 INFO:tasks.workunit.client.1.smithi153.stdout:2/235: chown d7/db/d27/f3a 82 1 2024-09-12T01:43:00.249 INFO:tasks.workunit.client.1.smithi153.stdout:0/295: rename d22/d30/l34 to d22/l66 0 2024-09-12T01:43:00.250 INFO:tasks.workunit.client.1.smithi153.stdout:2/236: truncate d7/f11 1929002 0 2024-09-12T01:43:00.251 INFO:tasks.workunit.client.1.smithi153.stdout:5/276: dread d0/df/f35 [0,4194304] 0 2024-09-12T01:43:00.251 INFO:tasks.workunit.client.1.smithi153.stdout:5/277: write d0/d15/f16 [3281271,106323] 0 2024-09-12T01:43:00.251 INFO:tasks.workunit.client.1.smithi153.stdout:5/278: write d0/df/d1c/d22/d2f/f3a [78160,88395] 0 2024-09-12T01:43:00.251 INFO:tasks.workunit.client.1.smithi153.stdout:8/270: dwrite d17/d1f/d4f/d42/f48 [0,4194304] 0 2024-09-12T01:43:00.252 INFO:tasks.workunit.client.1.smithi153.stdout:0/296: unlink f13 0 2024-09-12T01:43:00.254 INFO:tasks.workunit.client.1.smithi153.stdout:2/237: mkdir d7/d4d 0 2024-09-12T01:43:00.254 INFO:tasks.workunit.client.1.smithi153.stdout:2/238: chown d7/d19/l46 9731788 1 2024-09-12T01:43:00.255 INFO:tasks.workunit.client.1.smithi153.stdout:5/279: rmdir d0/df/d50 39 2024-09-12T01:43:00.255 INFO:tasks.workunit.client.1.smithi153.stdout:5/280: creat d0/df/f5d x:0 0 0 2024-09-12T01:43:00.258 INFO:tasks.workunit.client.1.smithi153.stdout:8/271: creat d17/d21/d56/f63 x:0 0 0 2024-09-12T01:43:00.261 INFO:tasks.workunit.client.1.smithi153.stdout:2/239: rename d7/l9 to d7/l4e 0 2024-09-12T01:43:00.261 INFO:tasks.workunit.client.1.smithi153.stdout:2/240: creat d7/d19/f4f x:0 0 0 2024-09-12T01:43:00.261 INFO:tasks.workunit.client.1.smithi153.stdout:2/241: creat d7/db/f50 x:0 0 0 2024-09-12T01:43:00.264 INFO:tasks.workunit.client.1.smithi153.stdout:5/281: mknod d0/d43/d51/c5e 0 2024-09-12T01:43:00.264 INFO:tasks.workunit.client.1.smithi153.stdout:5/282: write d0/d15/f2a [398844,75646] 0 2024-09-12T01:43:00.269 INFO:tasks.workunit.client.1.smithi153.stdout:2/242: link d7/d19/d40/f23 d7/f51 0 2024-09-12T01:43:00.270 INFO:tasks.workunit.client.1.smithi153.stdout:5/283: truncate d0/df/f2d 238366 0 2024-09-12T01:43:00.272 INFO:tasks.workunit.client.1.smithi153.stdout:8/272: dwrite d17/d1f/f5d [0,4194304] 0 2024-09-12T01:43:00.273 INFO:tasks.workunit.client.1.smithi153.stdout:5/284: mkdir d0/d5f 0 2024-09-12T01:43:00.276 INFO:tasks.workunit.client.1.smithi153.stdout:5/285: read d0/f2 [559085,107713] 0 2024-09-12T01:43:00.276 INFO:tasks.workunit.client.1.smithi153.stdout:5/286: write d0/df/f10 [5166036,49675] 0 2024-09-12T01:43:00.277 INFO:tasks.workunit.client.1.smithi153.stdout:5/287: fdatasync d0/d43/d51/d36/f3b 0 2024-09-12T01:43:00.289 INFO:tasks.workunit.client.1.smithi153.stdout:5/288: link d0/df/f35 d0/d43/d51/d36/d39/f60 0 2024-09-12T01:43:00.290 INFO:tasks.workunit.client.1.smithi153.stdout:8/273: rmdir d17/d1f/d4f/d34 39 2024-09-12T01:43:00.297 INFO:tasks.workunit.client.1.smithi153.stdout:5/289: symlink d0/d15/l61 0 2024-09-12T01:43:00.299 INFO:tasks.workunit.client.1.smithi153.stdout:8/274: symlink d17/d1f/l64 0 2024-09-12T01:43:00.299 INFO:tasks.workunit.client.1.smithi153.stdout:9/254: sync 2024-09-12T01:43:00.299 INFO:tasks.workunit.client.1.smithi153.stdout:7/259: sync 2024-09-12T01:43:00.299 INFO:tasks.workunit.client.1.smithi153.stdout:3/249: sync 2024-09-12T01:43:00.299 INFO:tasks.workunit.client.1.smithi153.stdout:9/255: truncate d3/d19/f2c 575408 0 2024-09-12T01:43:00.299 INFO:tasks.workunit.client.1.smithi153.stdout:7/260: fdatasync d12/f1b 0 2024-09-12T01:43:00.304 INFO:tasks.workunit.client.1.smithi153.stdout:9/256: unlink d3/f28 0 2024-09-12T01:43:00.304 INFO:tasks.workunit.client.1.smithi153.stdout:9/257: write d3/d19/d30/f39 [168745,108999] 0 2024-09-12T01:43:00.305 INFO:tasks.workunit.client.1.smithi153.stdout:7/261: mkdir d12/d4e 0 2024-09-12T01:43:00.307 INFO:tasks.workunit.client.1.smithi153.stdout:9/258: mkdir d3/d3a/d42 0 2024-09-12T01:43:00.307 INFO:tasks.workunit.client.1.smithi153.stdout:9/259: write d3/f3e [152324,124392] 0 2024-09-12T01:43:00.307 INFO:tasks.workunit.client.1.smithi153.stdout:9/260: chown d3/d35/f3f 294831 1 2024-09-12T01:43:00.308 INFO:tasks.workunit.client.1.smithi153.stdout:9/261: readlink d3/d19/d30/l3d 0 2024-09-12T01:43:00.308 INFO:tasks.workunit.client.1.smithi153.stdout:9/262: fdatasync d3/d19/f2e 0 2024-09-12T01:43:00.308 INFO:tasks.workunit.client.1.smithi153.stdout:3/250: write d1/f5 [2264667,13128] 0 2024-09-12T01:43:00.309 INFO:tasks.workunit.client.1.smithi153.stdout:7/262: mknod d12/d21/d29/d35/d3c/c4f 0 2024-09-12T01:43:00.311 INFO:tasks.workunit.client.1.smithi153.stdout:3/251: rename d1/f2 to d1/d16/f53 0 2024-09-12T01:43:00.311 INFO:tasks.workunit.client.1.smithi153.stdout:3/252: creat d1/f54 x:0 0 0 2024-09-12T01:43:00.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/263: chown l5 43 1 2024-09-12T01:43:00.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/264: read - d12/f31 zero size 2024-09-12T01:43:00.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/265: write d12/f33 [1837375,120824] 0 2024-09-12T01:43:00.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/266: write d12/f17 [2877184,67527] 0 2024-09-12T01:43:00.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/267: chown l5 136761307 1 2024-09-12T01:43:00.315 INFO:tasks.workunit.client.1.smithi153.stdout:9/263: dread d3/f7 [0,4194304] 0 2024-09-12T01:43:00.316 INFO:tasks.workunit.client.1.smithi153.stdout:0/297: fsync d22/d30/d4c/f4d 0 2024-09-12T01:43:00.318 INFO:tasks.workunit.client.1.smithi153.stdout:7/268: rename d12/d21/d29/d35/d3c/c4f to d12/d4e/c50 0 2024-09-12T01:43:00.320 INFO:tasks.workunit.client.1.smithi153.stdout:9/264: symlink d3/d3a/l43 0 2024-09-12T01:43:00.320 INFO:tasks.workunit.client.1.smithi153.stdout:3/253: write d1/d1e/f2f [998257,46088] 0 2024-09-12T01:43:00.321 INFO:tasks.workunit.client.1.smithi153.stdout:3/254: write d1/d13/d25/d26/f2c [2083904,35685] 0 2024-09-12T01:43:00.321 INFO:tasks.workunit.client.1.smithi153.stdout:5/290: dwrite d0/d20/f4a [0,4194304] 0 2024-09-12T01:43:00.322 INFO:tasks.workunit.client.1.smithi153.stdout:3/255: dread d1/d13/d25/f34 [0,4194304] 0 2024-09-12T01:43:00.322 INFO:tasks.workunit.client.1.smithi153.stdout:8/275: dwrite d17/f1b [4194304,4194304] 0 2024-09-12T01:43:00.322 INFO:tasks.workunit.client.1.smithi153.stdout:8/276: truncate d17/d1d/f41 1546882 0 2024-09-12T01:43:00.322 INFO:tasks.workunit.client.1.smithi153.stdout:3/256: write d1/f19 [9333753,17468] 0 2024-09-12T01:43:00.325 INFO:tasks.workunit.client.1.smithi153.stdout:7/269: link d12/c2b d12/d21/d29/d35/d37/c51 0 2024-09-12T01:43:00.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/291: symlink d0/d43/d51/d36/l62 0 2024-09-12T01:43:00.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/292: getdents d0/d5f 0 2024-09-12T01:43:00.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/293: write d0/f2 [3551674,24782] 0 2024-09-12T01:43:00.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/294: truncate d0/d15/f54 1043798 0 2024-09-12T01:43:00.332 INFO:tasks.workunit.client.1.smithi153.stdout:5/295: fsync d0/d15/f29 0 2024-09-12T01:43:00.337 INFO:tasks.workunit.client.1.smithi153.stdout:3/257: mknod d1/d16/d1c/c55 0 2024-09-12T01:43:00.338 INFO:tasks.workunit.client.1.smithi153.stdout:7/270: symlink d12/l52 0 2024-09-12T01:43:00.338 INFO:tasks.workunit.client.1.smithi153.stdout:7/271: chown d12/d21/d4d 16 1 2024-09-12T01:43:00.340 INFO:tasks.workunit.client.1.smithi153.stdout:9/265: rename d3/d19 to d3/d35/d44 0 2024-09-12T01:43:00.340 INFO:tasks.workunit.client.1.smithi153.stdout:0/298: dwrite d22/f5a [0,4194304] 0 2024-09-12T01:43:00.342 INFO:tasks.workunit.client.1.smithi153.stdout:2/243: rmdir d7 39 2024-09-12T01:43:00.350 INFO:tasks.workunit.client.1.smithi153.stdout:8/277: rmdir d17/d1f/d4f 39 2024-09-12T01:43:00.353 INFO:tasks.workunit.client.1.smithi153.stdout:7/272: rename d12/f32 to d12/f53 0 2024-09-12T01:43:00.359 INFO:tasks.workunit.client.1.smithi153.stdout:3/258: dwrite d1/d13/d25/f34 [0,4194304] 0 2024-09-12T01:43:00.360 INFO:tasks.workunit.client.1.smithi153.stdout:0/299: creat d22/d30/f67 x:0 0 0 2024-09-12T01:43:00.360 INFO:tasks.workunit.client.1.smithi153.stdout:0/300: fdatasync d22/d30/d4c/f58 0 2024-09-12T01:43:00.362 INFO:tasks.workunit.client.1.smithi153.stdout:5/296: truncate d0/df/f27 1037350 0 2024-09-12T01:43:00.362 INFO:tasks.workunit.client.1.smithi153.stdout:5/297: dread - d0/d43/d51/d36/f3b zero size 2024-09-12T01:43:00.362 INFO:tasks.workunit.client.1.smithi153.stdout:5/298: truncate d0/d43/d51/d36/d39/f60 4649358 0 2024-09-12T01:43:00.363 INFO:tasks.workunit.client.1.smithi153.stdout:8/278: rename d17/f2f to d17/d1f/d4f/f65 0 2024-09-12T01:43:00.368 INFO:tasks.workunit.client.1.smithi153.stdout:3/259: dread d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:00.375 INFO:tasks.workunit.client.1.smithi153.stdout:9/266: dwrite d3/d35/d44/f2c [0,4194304] 0 2024-09-12T01:43:00.376 INFO:tasks.workunit.client.1.smithi153.stdout:0/301: rename d22/d30/f37 to d22/f68 0 2024-09-12T01:43:00.376 INFO:tasks.workunit.client.1.smithi153.stdout:2/244: dwrite d7/db/ff [0,4194304] 0 2024-09-12T01:43:00.379 INFO:tasks.workunit.client.1.smithi153.stdout:3/260: symlink d1/l56 0 2024-09-12T01:43:00.379 INFO:tasks.workunit.client.1.smithi153.stdout:3/261: chown d1/d16/d1c/c52 184277990 1 2024-09-12T01:43:00.379 INFO:tasks.workunit.client.1.smithi153.stdout:3/262: chown d1/d13/d25/f34 4 1 2024-09-12T01:43:00.379 INFO:tasks.workunit.client.1.smithi153.stdout:3/263: chown d1/d16/f27 2 1 2024-09-12T01:43:00.379 INFO:tasks.workunit.client.1.smithi153.stdout:3/264: chown d1/d45/c3f 5071997 1 2024-09-12T01:43:00.379 INFO:tasks.workunit.client.1.smithi153.stdout:8/279: write d17/d1f/d4f/f45 [8272093,81617] 0 2024-09-12T01:43:00.382 INFO:tasks.workunit.client.1.smithi153.stdout:5/299: dwrite d0/d15/f1a [0,4194304] 0 2024-09-12T01:43:00.394 INFO:tasks.workunit.client.1.smithi153.stdout:8/280: creat d17/d1d/d27/f66 x:0 0 0 2024-09-12T01:43:00.394 INFO:tasks.workunit.client.1.smithi153.stdout:8/281: fdatasync d17/d21/d56/f63 0 2024-09-12T01:43:00.395 INFO:tasks.workunit.client.1.smithi153.stdout:6/302: sync 2024-09-12T01:43:00.396 INFO:tasks.workunit.client.1.smithi153.stdout:4/172: sync 2024-09-12T01:43:00.396 INFO:tasks.workunit.client.1.smithi153.stdout:1/264: sync 2024-09-12T01:43:00.403 INFO:tasks.workunit.client.1.smithi153.stdout:5/300: unlink d0/df/d1c/d22/f4e 0 2024-09-12T01:43:00.405 INFO:tasks.workunit.client.1.smithi153.stdout:0/302: rename l9 to d22/d30/d33/l69 0 2024-09-12T01:43:00.407 INFO:tasks.workunit.client.1.smithi153.stdout:9/267: dwrite d3/d35/d44/f34 [0,4194304] 0 2024-09-12T01:43:00.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/265: dwrite d1/d16/d1c/f2d [0,4194304] 0 2024-09-12T01:43:00.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/266: truncate d1/f12 291137 0 2024-09-12T01:43:00.408 INFO:tasks.workunit.client.1.smithi153.stdout:2/245: dwrite d7/d19/d40/f23 [0,4194304] 0 2024-09-12T01:43:00.408 INFO:tasks.workunit.client.1.smithi153.stdout:8/282: unlink d17/d1f/l2c 0 2024-09-12T01:43:00.408 INFO:tasks.workunit.client.1.smithi153.stdout:8/283: stat d17/f1b 0 2024-09-12T01:43:00.408 INFO:tasks.workunit.client.1.smithi153.stdout:1/265: getdents d2/d34/d3d 0 2024-09-12T01:43:00.408 INFO:tasks.workunit.client.1.smithi153.stdout:1/266: readlink d2/l4 0 2024-09-12T01:43:00.408 INFO:tasks.workunit.client.1.smithi153.stdout:1/267: readlink d2/l27 0 2024-09-12T01:43:00.411 INFO:tasks.workunit.client.1.smithi153.stdout:4/173: mkdir d6/d9/d11/d14/d3e 0 2024-09-12T01:43:00.411 INFO:tasks.workunit.client.1.smithi153.stdout:5/301: mkdir d0/d43/d51/d63 0 2024-09-12T01:43:00.412 INFO:tasks.workunit.client.1.smithi153.stdout:5/302: write d0/df/f52 [502074,20789] 0 2024-09-12T01:43:00.415 INFO:tasks.workunit.client.1.smithi153.stdout:5/303: dread d0/df/f10 [4194304,4194304] 0 2024-09-12T01:43:00.421 INFO:tasks.workunit.client.1.smithi153.stdout:2/246: creat d7/db/d1d/d4a/f52 x:0 0 0 2024-09-12T01:43:00.423 INFO:tasks.workunit.client.1.smithi153.stdout:8/284: getdents d17/d1f/d4f/d34 0 2024-09-12T01:43:00.423 INFO:tasks.workunit.client.1.smithi153.stdout:8/285: readlink d17/d1f/d4f/d34/l52 0 2024-09-12T01:43:00.425 INFO:tasks.workunit.client.1.smithi153.stdout:1/268: symlink d2/d9/d17/d2f/l51 0 2024-09-12T01:43:00.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/303: rename d1/df/f4a to d1/f5e 0 2024-09-12T01:43:00.429 INFO:tasks.workunit.client.1.smithi153.stdout:5/304: symlink d0/d20/d4b/l64 0 2024-09-12T01:43:00.431 INFO:tasks.workunit.client.1.smithi153.stdout:8/286: mkdir d17/d1f/d4f/d42/d67 0 2024-09-12T01:43:00.435 INFO:tasks.workunit.client.1.smithi153.stdout:1/269: creat d2/d9/d17/d2f/f52 x:0 0 0 2024-09-12T01:43:00.440 INFO:tasks.workunit.client.1.smithi153.stdout:1/270: creat d2/d34/f53 x:0 0 0 2024-09-12T01:43:00.442 INFO:tasks.workunit.client.1.smithi153.stdout:6/304: rmdir d1/d6/d39 39 2024-09-12T01:43:00.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/305: getdents d1/d6/da/d32 0 2024-09-12T01:43:00.448 INFO:tasks.workunit.client.1.smithi153.stdout:6/306: creat d1/df/f5f x:0 0 0 2024-09-12T01:43:00.473 INFO:tasks.workunit.client.1.smithi153.stdout:4/174: dwrite f0 [0,4194304] 0 2024-09-12T01:43:00.473 INFO:tasks.workunit.client.1.smithi153.stdout:4/175: write f0 [4827903,96325] 0 2024-09-12T01:43:00.473 INFO:tasks.workunit.client.1.smithi153.stdout:9/268: dwrite d3/f2b [4194304,4194304] 0 2024-09-12T01:43:00.473 INFO:tasks.workunit.client.1.smithi153.stdout:9/269: fsync d3/f7 0 2024-09-12T01:43:00.473 INFO:tasks.workunit.client.1.smithi153.stdout:2/247: dwrite f2 [0,4194304] 0 2024-09-12T01:43:00.474 INFO:tasks.workunit.client.1.smithi153.stdout:1/271: dwrite d2/d9/f15 [0,4194304] 0 2024-09-12T01:43:00.474 INFO:tasks.workunit.client.1.smithi153.stdout:1/272: stat d2/d9/d17/d2f/l3c 0 2024-09-12T01:43:00.474 INFO:tasks.workunit.client.1.smithi153.stdout:8/287: dwrite d17/d1f/f39 [0,4194304] 0 2024-09-12T01:43:00.474 INFO:tasks.workunit.client.1.smithi153.stdout:8/288: fsync d17/d1f/d4f/f45 0 2024-09-12T01:43:00.477 INFO:tasks.workunit.client.1.smithi153.stdout:6/307: read d1/d6/f4c [1544806,72979] 0 2024-09-12T01:43:00.477 INFO:tasks.workunit.client.1.smithi153.stdout:0/303: dwrite f18 [4194304,4194304] 0 2024-09-12T01:43:00.477 INFO:tasks.workunit.client.1.smithi153.stdout:3/267: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:43:00.477 INFO:tasks.workunit.client.1.smithi153.stdout:3/268: truncate d1/d16/d1c/d32/f43 811624 0 2024-09-12T01:43:00.478 INFO:tasks.workunit.client.1.smithi153.stdout:4/176: link d6/d15/f22 d6/d9/d11/d14/f3f 0 2024-09-12T01:43:00.480 INFO:tasks.workunit.client.1.smithi153.stdout:9/270: unlink d3/ff 0 2024-09-12T01:43:00.493 INFO:tasks.workunit.client.1.smithi153.stdout:6/308: mknod d1/d6/da/d32/c60 0 2024-09-12T01:43:00.496 INFO:tasks.workunit.client.1.smithi153.stdout:3/269: link d1/d16/d17/l50 d1/d13/d25/l57 0 2024-09-12T01:43:00.498 INFO:tasks.workunit.client.1.smithi153.stdout:8/289: dwrite d17/d1d/d27/f66 [0,4194304] 0 2024-09-12T01:43:00.498 INFO:tasks.workunit.client.1.smithi153.stdout:8/290: stat d17/d1f/f2a 0 2024-09-12T01:43:00.498 INFO:tasks.workunit.client.1.smithi153.stdout:8/291: chown d17/l2e 374872688 1 2024-09-12T01:43:00.498 INFO:tasks.workunit.client.1.smithi153.stdout:2/248: dwrite d7/db/d1d/f28 [0,4194304] 0 2024-09-12T01:43:00.498 INFO:tasks.workunit.client.1.smithi153.stdout:4/177: symlink d6/d9/d11/d14/d3e/l40 0 2024-09-12T01:43:00.498 INFO:tasks.workunit.client.1.smithi153.stdout:4/178: read - d6/d9/dc/d31/f24 zero size 2024-09-12T01:43:00.499 INFO:tasks.workunit.client.1.smithi153.stdout:9/271: symlink d3/d3a/d42/l45 0 2024-09-12T01:43:00.500 INFO:tasks.workunit.client.1.smithi153.stdout:1/273: getdents d2/d9/d17 0 2024-09-12T01:43:00.502 INFO:tasks.workunit.client.1.smithi153.stdout:6/309: creat d1/d6/da/d19/d34/f61 x:0 0 0 2024-09-12T01:43:00.502 INFO:tasks.workunit.client.1.smithi153.stdout:6/310: dread - d1/df/f5f zero size 2024-09-12T01:43:00.503 INFO:tasks.workunit.client.1.smithi153.stdout:0/304: mknod d22/d30/d33/c6a 0 2024-09-12T01:43:00.508 INFO:tasks.workunit.client.1.smithi153.stdout:8/292: symlink d17/d21/d56/l68 0 2024-09-12T01:43:00.508 INFO:tasks.workunit.client.1.smithi153.stdout:3/270: dwrite d1/d13/d25/d26/f2c [0,4194304] 0 2024-09-12T01:43:00.515 INFO:tasks.workunit.client.1.smithi153.stdout:2/249: rename d7/d19/d40/l41 to d7/db/d1d/d1e/l53 0 2024-09-12T01:43:00.515 INFO:tasks.workunit.client.1.smithi153.stdout:2/250: chown d7/db/c49 1982 1 2024-09-12T01:43:00.515 INFO:tasks.workunit.client.1.smithi153.stdout:2/251: fdatasync d7/d17/f48 0 2024-09-12T01:43:00.515 INFO:tasks.workunit.client.1.smithi153.stdout:2/252: stat d7/d19/l46 0 2024-09-12T01:43:00.516 INFO:tasks.workunit.client.1.smithi153.stdout:2/253: fdatasync d7/db/d27/f3a 0 2024-09-12T01:43:00.517 INFO:tasks.workunit.client.1.smithi153.stdout:4/179: mknod d6/d9/d11/d14/c41 0 2024-09-12T01:43:00.517 INFO:tasks.workunit.client.1.smithi153.stdout:4/180: write d6/d9/dc/d31/f34 [509140,125973] 0 2024-09-12T01:43:00.519 INFO:tasks.workunit.client.1.smithi153.stdout:1/274: unlink d2/d9/d1d/d25/f49 0 2024-09-12T01:43:00.519 INFO:tasks.workunit.client.1.smithi153.stdout:1/275: write d2/f6 [3157332,12608] 0 2024-09-12T01:43:00.520 INFO:tasks.workunit.client.1.smithi153.stdout:6/311: mkdir d1/d6/da/d32/d62 0 2024-09-12T01:43:00.523 INFO:tasks.workunit.client.1.smithi153.stdout:3/271: truncate d1/d13/d25/f4c 146857 0 2024-09-12T01:43:00.523 INFO:tasks.workunit.client.1.smithi153.stdout:3/272: chown d1/l46 10386 1 2024-09-12T01:43:00.523 INFO:tasks.workunit.client.1.smithi153.stdout:3/273: write d1/d13/d25/d26/d4b/f4f [13416,26535] 0 2024-09-12T01:43:00.524 INFO:tasks.workunit.client.1.smithi153.stdout:2/254: dread d7/d19/d40/f23 [0,4194304] 0 2024-09-12T01:43:00.525 INFO:tasks.workunit.client.1.smithi153.stdout:9/272: rename d3/d3a/c3b to d3/d35/c46 0 2024-09-12T01:43:00.525 INFO:tasks.workunit.client.1.smithi153.stdout:9/273: fsync d3/d35/d44/f22 0 2024-09-12T01:43:00.526 INFO:tasks.workunit.client.1.smithi153.stdout:4/181: mkdir d6/d9/dc/d42 0 2024-09-12T01:43:00.531 INFO:tasks.workunit.client.1.smithi153.stdout:1/276: mkdir d2/d9/d17/d54 0 2024-09-12T01:43:00.531 INFO:tasks.workunit.client.1.smithi153.stdout:2/255: write d7/f51 [1428199,83919] 0 2024-09-12T01:43:00.531 INFO:tasks.workunit.client.1.smithi153.stdout:1/277: truncate d2/d34/f53 898192 0 2024-09-12T01:43:00.531 INFO:tasks.workunit.client.1.smithi153.stdout:0/305: rename c14 to d22/c6b 0 2024-09-12T01:43:00.532 INFO:tasks.workunit.client.1.smithi153.stdout:0/306: fsync d22/f65 0 2024-09-12T01:43:00.532 INFO:tasks.workunit.client.1.smithi153.stdout:0/307: chown d22/f39 234105115 1 2024-09-12T01:43:00.533 INFO:tasks.workunit.client.1.smithi153.stdout:9/274: creat d3/d3a/d42/f47 x:0 0 0 2024-09-12T01:43:00.533 INFO:tasks.workunit.client.1.smithi153.stdout:9/275: creat d3/d3a/d42/f48 x:0 0 0 2024-09-12T01:43:00.534 INFO:tasks.workunit.client.1.smithi153.stdout:1/278: dread d2/d9/d17/d2f/f31 [0,4194304] 0 2024-09-12T01:43:00.535 INFO:tasks.workunit.client.1.smithi153.stdout:6/312: dread d1/d6/da/d19/d3a/f4d [0,4194304] 0 2024-09-12T01:43:00.535 INFO:tasks.workunit.client.1.smithi153.stdout:6/313: readlink d1/d6/da/d19/l27 0 2024-09-12T01:43:00.541 INFO:tasks.workunit.client.1.smithi153.stdout:8/293: rename d17/d1f/d4f/c4b to d17/d1d/d27/c69 0 2024-09-12T01:43:00.543 INFO:tasks.workunit.client.1.smithi153.stdout:3/274: dwrite d1/d45/f51 [0,4194304] 0 2024-09-12T01:43:00.543 INFO:tasks.workunit.client.1.smithi153.stdout:2/256: read d7/db/ff [2756813,71765] 0 2024-09-12T01:43:00.545 INFO:tasks.workunit.client.1.smithi153.stdout:9/276: creat d3/f49 x:0 0 0 2024-09-12T01:43:00.550 INFO:tasks.workunit.client.1.smithi153.stdout:8/294: rename f6 to d17/d21/d3a/f6a 0 2024-09-12T01:43:00.553 INFO:tasks.workunit.client.1.smithi153.stdout:2/257: write d7/db/f30 [727743,47142] 0 2024-09-12T01:43:00.556 INFO:tasks.workunit.client.1.smithi153.stdout:3/275: unlink d1/d16/f1b 0 2024-09-12T01:43:00.556 INFO:tasks.workunit.client.1.smithi153.stdout:3/276: write d1/d13/d23/f2b [102606,23885] 0 2024-09-12T01:43:00.557 INFO:tasks.workunit.client.1.smithi153.stdout:9/277: dread - d3/f13 zero size 2024-09-12T01:43:00.558 INFO:tasks.workunit.client.1.smithi153.stdout:8/295: dread d17/d1d/f36 [0,4194304] 0 2024-09-12T01:43:00.560 INFO:tasks.workunit.client.1.smithi153.stdout:2/258: mknod d7/d19/d40/c54 0 2024-09-12T01:43:00.562 INFO:tasks.workunit.client.1.smithi153.stdout:9/278: unlink f1 0 2024-09-12T01:43:00.562 INFO:tasks.workunit.client.1.smithi153.stdout:8/296: write d17/d1f/d4f/f57 [1594386,21730] 0 2024-09-12T01:43:00.563 INFO:tasks.workunit.client.1.smithi153.stdout:8/297: read f16 [556156,81872] 0 2024-09-12T01:43:00.565 INFO:tasks.workunit.client.1.smithi153.stdout:8/298: dread d17/f28 [0,4194304] 0 2024-09-12T01:43:00.565 INFO:tasks.workunit.client.1.smithi153.stdout:8/299: creat d17/d1d/d27/f6b x:0 0 0 2024-09-12T01:43:00.566 INFO:tasks.workunit.client.1.smithi153.stdout:9/279: creat d3/d35/d44/d30/f4a x:0 0 0 2024-09-12T01:43:00.574 INFO:tasks.workunit.client.1.smithi153.stdout:8/300: mkdir d17/d21/d3a/d6c 0 2024-09-12T01:43:00.575 INFO:tasks.workunit.client.1.smithi153.stdout:6/314: dwrite d1/d6/f44 [0,4194304] 0 2024-09-12T01:43:00.575 INFO:tasks.workunit.client.1.smithi153.stdout:0/308: dwrite d22/d30/d4c/f55 [0,4194304] 0 2024-09-12T01:43:00.575 INFO:tasks.workunit.client.1.smithi153.stdout:9/280: symlink d3/d35/d44/d30/l4b 0 2024-09-12T01:43:00.575 INFO:tasks.workunit.client.1.smithi153.stdout:4/182: dwrite d6/d9/f10 [0,4194304] 0 2024-09-12T01:43:00.576 INFO:tasks.workunit.client.1.smithi153.stdout:3/277: dread d1/d13/d25/f34 [0,4194304] 0 2024-09-12T01:43:00.576 INFO:tasks.workunit.client.1.smithi153.stdout:8/301: mknod d17/d1d/c6d 0 2024-09-12T01:43:00.581 INFO:tasks.workunit.client.1.smithi153.stdout:3/278: dread d1/d16/f53 [0,4194304] 0 2024-09-12T01:43:00.581 INFO:tasks.workunit.client.1.smithi153.stdout:3/279: write d1/d13/f37 [721399,65533] 0 2024-09-12T01:43:00.584 INFO:tasks.workunit.client.1.smithi153.stdout:7/273: sync 2024-09-12T01:43:00.584 INFO:tasks.workunit.client.1.smithi153.stdout:5/305: sync 2024-09-12T01:43:00.584 INFO:tasks.workunit.client.1.smithi153.stdout:5/306: creat d0/d20/f65 x:0 0 0 2024-09-12T01:43:00.584 INFO:tasks.workunit.client.1.smithi153.stdout:5/307: write d0/df/f4f [83403,29247] 0 2024-09-12T01:43:00.586 INFO:tasks.workunit.client.1.smithi153.stdout:2/259: dwrite d7/d19/f4b [0,4194304] 0 2024-09-12T01:43:00.591 INFO:tasks.workunit.client.1.smithi153.stdout:2/260: dread d7/db/ff [0,4194304] 0 2024-09-12T01:43:00.592 INFO:tasks.workunit.client.1.smithi153.stdout:4/183: rmdir d6/d9/d11/d14/d3e 39 2024-09-12T01:43:00.596 INFO:tasks.workunit.client.1.smithi153.stdout:9/281: dwrite d3/f29 [0,4194304] 0 2024-09-12T01:43:00.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/274: dread d12/f1c [0,4194304] 0 2024-09-12T01:43:00.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/275: write d12/d21/d29/f3f [986757,5337] 0 2024-09-12T01:43:00.596 INFO:tasks.workunit.client.1.smithi153.stdout:9/282: creat d3/d3a/d42/f4c x:0 0 0 2024-09-12T01:43:00.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/276: truncate d12/f20 1793022 0 2024-09-12T01:43:00.596 INFO:tasks.workunit.client.1.smithi153.stdout:3/280: creat d1/d45/f58 x:0 0 0 2024-09-12T01:43:00.601 INFO:tasks.workunit.client.1.smithi153.stdout:6/315: rename d1/df/f26 to d1/d6/d39/f63 0 2024-09-12T01:43:00.603 INFO:tasks.workunit.client.1.smithi153.stdout:2/261: creat d7/d17/f55 x:0 0 0 2024-09-12T01:43:00.603 INFO:tasks.workunit.client.1.smithi153.stdout:2/262: write d7/d19/f4f [894852,119734] 0 2024-09-12T01:43:00.604 INFO:tasks.workunit.client.1.smithi153.stdout:4/184: mkdir d6/d43 0 2024-09-12T01:43:00.607 INFO:tasks.workunit.client.1.smithi153.stdout:0/309: link d22/c6b d22/d30/c6c 0 2024-09-12T01:43:00.607 INFO:tasks.workunit.client.1.smithi153.stdout:4/185: dread d6/d9/d11/d14/f2a [0,4194304] 0 2024-09-12T01:43:00.611 INFO:tasks.workunit.client.1.smithi153.stdout:2/263: dread d7/d17/f3c [0,4194304] 0 2024-09-12T01:43:00.612 INFO:tasks.workunit.client.1.smithi153.stdout:2/264: readlink d7/d17/l2a 0 2024-09-12T01:43:00.612 INFO:tasks.workunit.client.1.smithi153.stdout:2/265: write d7/db/d1d/d4a/f52 [896288,83165] 0 2024-09-12T01:43:00.615 INFO:tasks.workunit.client.1.smithi153.stdout:2/266: dread d7/db/f30 [0,4194304] 0 2024-09-12T01:43:00.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/283: unlink d3/d35/d44/f2c 0 2024-09-12T01:43:00.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/284: dread - d3/f1d zero size 2024-09-12T01:43:00.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/285: write d3/d35/d44/f1e [1642564,2285] 0 2024-09-12T01:43:00.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/286: dread - d3/d35/d44/d30/f4a zero size 2024-09-12T01:43:00.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/287: readlink d3/d3a/l43 0 2024-09-12T01:43:00.624 INFO:tasks.workunit.client.1.smithi153.stdout:9/288: chown d3/f13 22730718 1 2024-09-12T01:43:00.626 INFO:tasks.workunit.client.1.smithi153.stdout:7/277: link d12/d21/c25 d12/d21/c54 0 2024-09-12T01:43:00.627 INFO:tasks.workunit.client.1.smithi153.stdout:3/281: truncate d1/f1a 1914169 0 2024-09-12T01:43:00.634 INFO:tasks.workunit.client.1.smithi153.stdout:6/316: creat d1/d6/da/d19/f64 x:0 0 0 2024-09-12T01:43:00.635 INFO:tasks.workunit.client.1.smithi153.stdout:6/317: fdatasync d1/f4 0 2024-09-12T01:43:00.635 INFO:tasks.workunit.client.1.smithi153.stdout:6/318: fsync d1/d6/f35 0 2024-09-12T01:43:00.637 INFO:tasks.workunit.client.1.smithi153.stdout:0/310: link d22/c23 d22/d30/c6d 0 2024-09-12T01:43:00.637 INFO:tasks.workunit.client.1.smithi153.stdout:0/311: read f20 [1260628,71313] 0 2024-09-12T01:43:00.637 INFO:tasks.workunit.client.1.smithi153.stdout:8/302: rmdir d17 39 2024-09-12T01:43:00.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/186: symlink d6/d9/dc/l44 0 2024-09-12T01:43:00.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/187: dread - d6/d9/d11/f3c zero size 2024-09-12T01:43:00.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/188: write d6/d9/d11/f3c [526030,128409] 0 2024-09-12T01:43:00.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/189: read d6/d9/d11/f1e [3231759,107922] 0 2024-09-12T01:43:00.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/190: creat d6/d9/d11/f45 x:0 0 0 2024-09-12T01:43:00.645 INFO:tasks.workunit.client.1.smithi153.stdout:3/282: dwrite d1/d13/d25/d26/f44 [0,4194304] 0 2024-09-12T01:43:00.645 INFO:tasks.workunit.client.1.smithi153.stdout:3/283: fdatasync d1/d16/d17/f1f 0 2024-09-12T01:43:00.645 INFO:tasks.workunit.client.1.smithi153.stdout:7/278: creat d12/d21/d29/d2d/f55 x:0 0 0 2024-09-12T01:43:00.645 INFO:tasks.workunit.client.1.smithi153.stdout:7/279: creat d12/f56 x:0 0 0 2024-09-12T01:43:00.645 INFO:tasks.workunit.client.1.smithi153.stdout:7/280: dread - d12/f31 zero size 2024-09-12T01:43:00.648 INFO:tasks.workunit.client.1.smithi153.stdout:6/319: mknod d1/d6/da/d32/d53/c65 0 2024-09-12T01:43:00.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/312: rename d22/d30/d33 to d22/d30/d4c/d6e 0 2024-09-12T01:43:00.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/313: stat d22/d30/c38 0 2024-09-12T01:43:00.651 INFO:tasks.workunit.client.1.smithi153.stdout:8/303: mkdir d17/d21/d3a/d6c/d6e 0 2024-09-12T01:43:00.654 INFO:tasks.workunit.client.1.smithi153.stdout:4/191: symlink d6/l46 0 2024-09-12T01:43:00.655 INFO:tasks.workunit.client.1.smithi153.stdout:4/192: write d6/d9/dc/d31/f34 [174940,4843] 0 2024-09-12T01:43:00.655 INFO:tasks.workunit.client.1.smithi153.stdout:2/267: getdents d7/db/d1d/d4a 0 2024-09-12T01:43:00.655 INFO:tasks.workunit.client.1.smithi153.stdout:2/268: stat d7/d19/f4b 0 2024-09-12T01:43:00.661 INFO:tasks.workunit.client.1.smithi153.stdout:7/281: creat d12/d21/d29/d35/d37/f57 x:0 0 0 2024-09-12T01:43:00.664 INFO:tasks.workunit.client.1.smithi153.stdout:0/314: truncate d22/d30/d4c/f55 1557210 0 2024-09-12T01:43:00.667 INFO:tasks.workunit.client.1.smithi153.stdout:8/304: mkdir d17/d1f/d4f/d34/d6f 0 2024-09-12T01:43:00.667 INFO:tasks.workunit.client.1.smithi153.stdout:8/305: chown d17/d1f/d4f/d42/d67 32 1 2024-09-12T01:43:00.667 INFO:tasks.workunit.client.1.smithi153.stdout:8/306: write d17/d1f/d4f/f57 [3815188,82557] 0 2024-09-12T01:43:00.669 INFO:tasks.workunit.client.1.smithi153.stdout:4/193: creat d6/d9/d26/f47 x:0 0 0 2024-09-12T01:43:00.671 INFO:tasks.workunit.client.1.smithi153.stdout:3/284: getdents d1/d13/d25 0 2024-09-12T01:43:00.675 INFO:tasks.workunit.client.1.smithi153.stdout:2/269: dwrite f2 [4194304,4194304] 0 2024-09-12T01:43:00.675 INFO:tasks.workunit.client.1.smithi153.stdout:2/270: read - d7/db/f50 zero size 2024-09-12T01:43:00.675 INFO:tasks.workunit.client.1.smithi153.stdout:6/320: unlink d1/df/c11 0 2024-09-12T01:43:00.676 INFO:tasks.workunit.client.1.smithi153.stdout:6/321: chown d1/d6/da/d19/d34/f28 116546681 1 2024-09-12T01:43:00.678 INFO:tasks.workunit.client.1.smithi153.stdout:0/315: mkdir d22/d30/d4c/d6f 0 2024-09-12T01:43:00.681 INFO:tasks.workunit.client.1.smithi153.stdout:3/285: mkdir d1/d59 0 2024-09-12T01:43:00.684 INFO:tasks.workunit.client.1.smithi153.stdout:8/307: dread d17/d1f/d4f/d42/f48 [0,4194304] 0 2024-09-12T01:43:00.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/282: dwrite d12/f33 [0,4194304] 0 2024-09-12T01:43:00.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/283: dread - d12/d21/d29/f2c zero size 2024-09-12T01:43:00.686 INFO:tasks.workunit.client.1.smithi153.stdout:6/322: rename d1/d6/da/d19/d34/d33/f43 to d1/d6/da/d32/d4f/f66 0 2024-09-12T01:43:00.686 INFO:tasks.workunit.client.1.smithi153.stdout:6/323: fdatasync d1/d6/d23/f2b 0 2024-09-12T01:43:00.688 INFO:tasks.workunit.client.1.smithi153.stdout:8/308: creat d17/d1f/d4f/d34/d6f/f70 x:0 0 0 2024-09-12T01:43:00.690 INFO:tasks.workunit.client.1.smithi153.stdout:7/284: mkdir d12/d21/d29/d35/d37/d58 0 2024-09-12T01:43:00.692 INFO:tasks.workunit.client.1.smithi153.stdout:6/324: unlink d1/d6/da/d32/d4f/c58 0 2024-09-12T01:43:00.692 INFO:tasks.workunit.client.1.smithi153.stdout:6/325: readlink d1/d6/da/l25 0 2024-09-12T01:43:00.695 INFO:tasks.workunit.client.1.smithi153.stdout:8/309: creat d17/d1f/d4f/f71 x:0 0 0 2024-09-12T01:43:00.700 INFO:tasks.workunit.client.1.smithi153.stdout:4/194: dwrite d6/d9/dc/d31/f24 [0,4194304] 0 2024-09-12T01:43:00.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/271: dwrite d7/f1c [0,4194304] 0 2024-09-12T01:43:00.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/272: truncate d7/db/d27/f4c 398777 0 2024-09-12T01:43:00.704 INFO:tasks.workunit.client.1.smithi153.stdout:7/285: dread d12/f33 [0,4194304] 0 2024-09-12T01:43:00.715 INFO:tasks.workunit.client.1.smithi153.stdout:8/310: dread d17/d1d/d27/f66 [0,4194304] 0 2024-09-12T01:43:00.719 INFO:tasks.workunit.client.1.smithi153.stdout:4/195: write d6/d9/d11/f2f [885317,30550] 0 2024-09-12T01:43:00.723 INFO:tasks.workunit.client.1.smithi153.stdout:0/316: dwrite d22/f65 [0,4194304] 0 2024-09-12T01:43:00.723 INFO:tasks.workunit.client.1.smithi153.stdout:6/326: dwrite d1/d6/da/d19/d34/f49 [0,4194304] 0 2024-09-12T01:43:00.723 INFO:tasks.workunit.client.1.smithi153.stdout:3/286: dwrite d1/d13/d25/f34 [0,4194304] 0 2024-09-12T01:43:00.724 INFO:tasks.workunit.client.1.smithi153.stdout:4/196: symlink d6/d9/l48 0 2024-09-12T01:43:00.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/327: truncate d1/d6/da/d19/d34/d33/f3c 376091 0 2024-09-12T01:43:00.729 INFO:tasks.workunit.client.1.smithi153.stdout:6/328: dread - d1/d6/d39/f3e zero size 2024-09-12T01:43:00.733 INFO:tasks.workunit.client.1.smithi153.stdout:8/311: dwrite d17/d21/d3a/f54 [0,4194304] 0 2024-09-12T01:43:00.735 INFO:tasks.workunit.client.1.smithi153.stdout:4/197: symlink d6/l49 0 2024-09-12T01:43:00.735 INFO:tasks.workunit.client.1.smithi153.stdout:4/198: creat d6/d9/d26/f4a x:0 0 0 2024-09-12T01:43:00.742 INFO:tasks.workunit.client.1.smithi153.stdout:7/286: getdents d12/d21/d29/d35/d37 0 2024-09-12T01:43:00.743 INFO:tasks.workunit.client.1.smithi153.stdout:4/199: unlink d6/d9/d11/f45 0 2024-09-12T01:43:00.747 INFO:tasks.workunit.client.1.smithi153.stdout:4/200: rename d6/d9/c39 to d6/d9/d11/c4b 0 2024-09-12T01:43:00.750 INFO:tasks.workunit.client.1.smithi153.stdout:4/201: rename d6/d9/d26/f4a to d6/d15/f4c 0 2024-09-12T01:43:00.752 INFO:tasks.workunit.client.1.smithi153.stdout:6/329: dread d1/d6/d23/f29 [4194304,4194304] 0 2024-09-12T01:43:00.754 INFO:tasks.workunit.client.1.smithi153.stdout:6/330: mknod d1/d6/da/d19/c67 0 2024-09-12T01:43:00.754 INFO:tasks.workunit.client.1.smithi153.stdout:6/331: chown d1/d6/d23/c24 477192805 1 2024-09-12T01:43:00.754 INFO:tasks.workunit.client.1.smithi153.stdout:6/332: fdatasync d1/d6/da/d19/d34/d33/f3c 0 2024-09-12T01:43:00.757 INFO:tasks.workunit.client.1.smithi153.stdout:1/279: sync 2024-09-12T01:43:00.757 INFO:tasks.workunit.client.1.smithi153.stdout:5/308: sync 2024-09-12T01:43:00.757 INFO:tasks.workunit.client.1.smithi153.stdout:1/280: creat d2/d34/f55 x:0 0 0 2024-09-12T01:43:00.760 INFO:tasks.workunit.client.1.smithi153.stdout:1/281: mkdir d2/d9/d17/d2f/d56 0 2024-09-12T01:43:00.761 INFO:tasks.workunit.client.1.smithi153.stdout:1/282: truncate d2/d9/d1d/d25/d3f/f40 978510 0 2024-09-12T01:43:00.761 INFO:tasks.workunit.client.1.smithi153.stdout:1/283: chown d2/d9/d17/d2f/d56 27332 1 2024-09-12T01:43:00.761 INFO:tasks.workunit.client.1.smithi153.stdout:2/273: truncate d7/db/d27/f3a 3548934 0 2024-09-12T01:43:00.762 INFO:tasks.workunit.client.1.smithi153.stdout:2/274: getdents d7/d19/d40 0 2024-09-12T01:43:00.766 INFO:tasks.workunit.client.1.smithi153.stdout:2/275: mkdir d7/db/d27/d56 0 2024-09-12T01:43:00.774 INFO:tasks.workunit.client.1.smithi153.stdout:5/309: write d0/fe [3352770,4133] 0 2024-09-12T01:43:00.776 INFO:tasks.workunit.client.1.smithi153.stdout:5/310: creat d0/df/d50/d58/f66 x:0 0 0 2024-09-12T01:43:00.776 INFO:tasks.workunit.client.1.smithi153.stdout:5/311: dread - d0/d20/d4b/f5a zero size 2024-09-12T01:43:00.777 INFO:tasks.workunit.client.1.smithi153.stdout:0/317: dwrite f15 [0,4194304] 0 2024-09-12T01:43:00.777 INFO:tasks.workunit.client.1.smithi153.stdout:3/287: dwrite d1/d45/f51 [0,4194304] 0 2024-09-12T01:43:00.782 INFO:tasks.workunit.client.1.smithi153.stdout:5/312: dread d0/d15/f46 [0,4194304] 0 2024-09-12T01:43:00.789 INFO:tasks.workunit.client.1.smithi153.stdout:8/312: dwrite d17/d1d/d27/f6b [0,4194304] 0 2024-09-12T01:43:00.789 INFO:tasks.workunit.client.1.smithi153.stdout:8/313: chown d17/d1f/d4f/f71 0 1 2024-09-12T01:43:00.789 INFO:tasks.workunit.client.1.smithi153.stdout:8/314: fsync d17/f28 0 2024-09-12T01:43:00.789 INFO:tasks.workunit.client.1.smithi153.stdout:7/287: dwrite d12/f26 [0,4194304] 0 2024-09-12T01:43:00.791 INFO:tasks.workunit.client.1.smithi153.stdout:4/202: dwrite d6/d9/d11/f1e [0,4194304] 0 2024-09-12T01:43:00.791 INFO:tasks.workunit.client.1.smithi153.stdout:0/318: read d22/f65 [3669626,123502] 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/333: dwrite d1/d6/da/d32/d4f/f66 [4194304,4194304] 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/334: readlink d1/d6/da/l21 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/335: write d1/d6/f35 [691748,93691] 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:1/284: dwrite d2/d9/d1d/f30 [0,4194304] 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:1/285: fdatasync d2/d9/d1d/d25/d3f/f40 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:1/286: write d2/d9/d17/f41 [309185,53104] 0 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:1/287: chown d2/d9/d1d/d25/c3e 3 1 2024-09-12T01:43:00.792 INFO:tasks.workunit.client.1.smithi153.stdout:1/288: write d2/d9/d17/f2d [2373781,9472] 0 2024-09-12T01:43:00.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/315: dread fd [0,4194304] 0 2024-09-12T01:43:00.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/316: fsync f14 0 2024-09-12T01:43:00.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/317: stat d17/d21/d56 0 2024-09-12T01:43:00.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/318: truncate d17/d1f/d4f/d42/f4e 1021192 0 2024-09-12T01:43:00.793 INFO:tasks.workunit.client.1.smithi153.stdout:8/319: chown d17/d1d/f36 1552433182 1 2024-09-12T01:43:00.794 INFO:tasks.workunit.client.1.smithi153.stdout:0/319: dread d22/d30/d4c/f55 [0,4194304] 0 2024-09-12T01:43:00.796 INFO:tasks.workunit.client.1.smithi153.stdout:7/288: creat d12/d21/d4d/f59 x:0 0 0 2024-09-12T01:43:00.799 INFO:tasks.workunit.client.1.smithi153.stdout:4/203: mknod d6/d9/d26/c4d 0 2024-09-12T01:43:00.799 INFO:tasks.workunit.client.1.smithi153.stdout:4/204: chown d6/d9/dc/d31/f34 14188 1 2024-09-12T01:43:00.801 INFO:tasks.workunit.client.1.smithi153.stdout:1/289: dread d2/d34/f50 [0,4194304] 0 2024-09-12T01:43:00.803 INFO:tasks.workunit.client.1.smithi153.stdout:6/336: truncate d1/d6/d39/f63 526548 0 2024-09-12T01:43:00.803 INFO:tasks.workunit.client.1.smithi153.stdout:6/337: write d1/d6/d23/f29 [1413799,110200] 0 2024-09-12T01:43:00.803 INFO:tasks.workunit.client.1.smithi153.stdout:6/338: dread - d1/df/f5f zero size 2024-09-12T01:43:00.803 INFO:tasks.workunit.client.1.smithi153.stdout:6/339: chown d1/d6/da/f37 31 1 2024-09-12T01:43:00.803 INFO:tasks.workunit.client.1.smithi153.stdout:5/313: dwrite d0/f1f [0,4194304] 0 2024-09-12T01:43:00.803 INFO:tasks.workunit.client.1.smithi153.stdout:5/314: creat d0/df/d50/d58/f67 x:0 0 0 2024-09-12T01:43:00.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/315: truncate d0/f1f 4947863 0 2024-09-12T01:43:00.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/316: chown d0/d43/d51/f42 62754 1 2024-09-12T01:43:00.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/317: fdatasync d0/d20/f65 0 2024-09-12T01:43:00.815 INFO:tasks.workunit.client.1.smithi153.stdout:0/320: creat d22/d30/d4c/d6f/f70 x:0 0 0 2024-09-12T01:43:00.815 INFO:tasks.workunit.client.1.smithi153.stdout:0/321: fdatasync d22/d30/d4c/f55 0 2024-09-12T01:43:00.818 INFO:tasks.workunit.client.1.smithi153.stdout:4/205: dwrite d6/d9/d26/f47 [0,4194304] 0 2024-09-12T01:43:00.818 INFO:tasks.workunit.client.1.smithi153.stdout:1/290: mknod d2/d9/c57 0 2024-09-12T01:43:00.818 INFO:tasks.workunit.client.1.smithi153.stdout:1/291: readlink d2/d34/d3d/l4f 0 2024-09-12T01:43:00.825 INFO:tasks.workunit.client.1.smithi153.stdout:5/318: truncate d0/d15/f54 829343 0 2024-09-12T01:43:00.825 INFO:tasks.workunit.client.1.smithi153.stdout:5/319: chown d0/d43/d51/d36/c5c 11 1 2024-09-12T01:43:00.827 INFO:tasks.workunit.client.1.smithi153.stdout:8/320: rename d17/d21/d3a/f54 to d17/f72 0 2024-09-12T01:43:00.831 INFO:tasks.workunit.client.1.smithi153.stdout:9/289: sync 2024-09-12T01:43:00.832 INFO:tasks.workunit.client.1.smithi153.stdout:1/292: dwrite d2/f6 [0,4194304] 0 2024-09-12T01:43:00.833 INFO:tasks.workunit.client.1.smithi153.stdout:1/293: write d2/d9/d17/f48 [232229,51376] 0 2024-09-12T01:43:00.833 INFO:tasks.workunit.client.1.smithi153.stdout:4/206: creat d6/d9/d11/d14/d3e/f4e x:0 0 0 2024-09-12T01:43:00.836 INFO:tasks.workunit.client.1.smithi153.stdout:5/320: unlink d0/c3e 0 2024-09-12T01:43:00.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/321: rename f13 to d17/d1d/f73 0 2024-09-12T01:43:00.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/322: fdatasync d17/d1f/d4f/d34/d6f/f70 0 2024-09-12T01:43:00.841 INFO:tasks.workunit.client.1.smithi153.stdout:9/290: write d3/d3a/d42/f47 [1024180,109208] 0 2024-09-12T01:43:00.845 INFO:tasks.workunit.client.1.smithi153.stdout:5/321: mkdir d0/d43/d68 0 2024-09-12T01:43:00.847 INFO:tasks.workunit.client.1.smithi153.stdout:8/323: truncate d17/f46 1757631 0 2024-09-12T01:43:00.848 INFO:tasks.workunit.client.1.smithi153.stdout:9/291: mknod d3/d3a/c4d 0 2024-09-12T01:43:00.851 INFO:tasks.workunit.client.1.smithi153.stdout:9/292: symlink d3/d3a/d42/l4e 0 2024-09-12T01:43:00.853 INFO:tasks.workunit.client.1.smithi153.stdout:8/324: dread d17/d1d/d27/f66 [0,4194304] 0 2024-09-12T01:43:00.855 INFO:tasks.workunit.client.1.smithi153.stdout:8/325: truncate d17/f28 366838 0 2024-09-12T01:43:00.857 INFO:tasks.workunit.client.1.smithi153.stdout:4/207: dwrite d6/d9/d11/f1e [0,4194304] 0 2024-09-12T01:43:00.860 INFO:tasks.workunit.client.1.smithi153.stdout:4/208: mknod d6/d9/d11/c4f 0 2024-09-12T01:43:00.863 INFO:tasks.workunit.client.1.smithi153.stdout:5/322: dwrite d0/d15/f29 [0,4194304] 0 2024-09-12T01:43:00.863 INFO:tasks.workunit.client.1.smithi153.stdout:9/293: read d3/f29 [1805429,13117] 0 2024-09-12T01:43:00.863 INFO:tasks.workunit.client.1.smithi153.stdout:5/323: fdatasync d0/df/d1c/d22/d2f/f3a 0 2024-09-12T01:43:00.863 INFO:tasks.workunit.client.1.smithi153.stdout:5/324: stat d0/df/f4f 0 2024-09-12T01:43:00.863 INFO:tasks.workunit.client.1.smithi153.stdout:5/325: fsync d0/d20/f4a 0 2024-09-12T01:43:00.867 INFO:tasks.workunit.client.1.smithi153.stdout:9/294: fdatasync d3/f24 0 2024-09-12T01:43:00.867 INFO:tasks.workunit.client.1.smithi153.stdout:9/295: chown d3/d3a/l40 42 1 2024-09-12T01:43:00.869 INFO:tasks.workunit.client.1.smithi153.stdout:9/296: chown d3/c15 8207871 1 2024-09-12T01:43:00.878 INFO:tasks.workunit.client.1.smithi153.stdout:4/209: dwrite d6/d15/f22 [0,4194304] 0 2024-09-12T01:43:00.880 INFO:tasks.workunit.client.0.smithi066.stdout:5/30: symlink d0/l8 0 2024-09-12T01:43:00.882 INFO:tasks.workunit.client.0.smithi066.stdout:6/33: creat d2/db/fc x:0 0 0 2024-09-12T01:43:00.883 INFO:tasks.workunit.client.1.smithi153.stdout:7/289: rmdir d12/d21/d4d 39 2024-09-12T01:43:00.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/297: dread d3/d35/d44/f2a [0,4194304] 0 2024-09-12T01:43:00.884 INFO:tasks.workunit.client.0.smithi066.stdout:8/27: symlink l8 0 2024-09-12T01:43:00.885 INFO:tasks.workunit.client.1.smithi153.stdout:7/290: getdents d12/d21/d4d 0 2024-09-12T01:43:00.887 INFO:tasks.workunit.client.1.smithi153.stdout:9/298: readlink d3/lb 0 2024-09-12T01:43:00.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/210: read d6/d15/f22 [1139628,82181] 0 2024-09-12T01:43:00.889 INFO:tasks.workunit.client.1.smithi153.stdout:7/291: link f7 d12/d21/d29/f5a 0 2024-09-12T01:43:00.890 INFO:tasks.workunit.client.1.smithi153.stdout:4/211: rename d6/d9/d11/d14/d3e/f4e to d6/d9/d11/d14/d3e/f50 0 2024-09-12T01:43:00.892 INFO:tasks.workunit.client.1.smithi153.stdout:7/292: mknod d12/d21/d29/d35/d3c/c5b 0 2024-09-12T01:43:00.893 INFO:tasks.workunit.client.1.smithi153.stdout:4/212: rmdir d6/d43 0 2024-09-12T01:43:00.894 INFO:tasks.workunit.client.0.smithi066.stdout:9/38: rmdir d0 39 2024-09-12T01:43:00.895 INFO:tasks.workunit.client.0.smithi066.stdout:5/31: mknod d0/c9 0 2024-09-12T01:43:00.895 INFO:tasks.workunit.client.0.smithi066.stdout:5/32: write d0/f4 [5360310,35255] 0 2024-09-12T01:43:00.895 INFO:tasks.workunit.client.0.smithi066.stdout:5/33: fsync d0/f2 0 2024-09-12T01:43:00.896 INFO:tasks.workunit.client.1.smithi153.stdout:9/299: dread d3/f29 [0,4194304] 0 2024-09-12T01:43:00.896 INFO:tasks.workunit.client.1.smithi153.stdout:4/213: symlink d6/d9/dc/l51 0 2024-09-12T01:43:00.897 INFO:tasks.workunit.client.0.smithi066.stdout:6/34: symlink d2/db/ld 0 2024-09-12T01:43:00.897 INFO:tasks.workunit.client.0.smithi066.stdout:6/35: creat d2/fe x:0 0 0 2024-09-12T01:43:00.897 INFO:tasks.workunit.client.0.smithi066.stdout:6/36: creat d2/ff x:0 0 0 2024-09-12T01:43:00.899 INFO:tasks.workunit.client.1.smithi153.stdout:4/214: unlink d6/l1b 0 2024-09-12T01:43:00.899 INFO:tasks.workunit.client.1.smithi153.stdout:4/215: chown d6/d9/l21 7309 1 2024-09-12T01:43:00.899 INFO:tasks.workunit.client.0.smithi066.stdout:9/39: creat d0/d5/fd x:0 0 0 2024-09-12T01:43:00.900 INFO:tasks.workunit.client.1.smithi153.stdout:7/293: dread fc [0,4194304] 0 2024-09-12T01:43:00.900 INFO:tasks.workunit.client.1.smithi153.stdout:0/322: fsync d22/d30/d4c/d6f/f70 0 2024-09-12T01:43:00.900 INFO:tasks.workunit.client.0.smithi066.stdout:5/34: dread d0/f4 [4194304,4194304] 0 2024-09-12T01:43:00.901 INFO:tasks.workunit.client.1.smithi153.stdout:4/216: symlink d6/d9/d11/d13/l52 0 2024-09-12T01:43:00.904 INFO:tasks.workunit.client.1.smithi153.stdout:7/294: mkdir d12/d21/d29/d35/d37/d4c/d5c 0 2024-09-12T01:43:00.906 INFO:tasks.workunit.client.0.smithi066.stdout:6/37: mknod d2/db/c10 0 2024-09-12T01:43:00.906 INFO:tasks.workunit.client.0.smithi066.stdout:6/38: write d2/ff [671664,46886] 0 2024-09-12T01:43:00.906 INFO:tasks.workunit.client.0.smithi066.stdout:6/39: creat d2/db/f11 x:0 0 0 2024-09-12T01:43:00.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/40: write d2/db/f11 [757164,130366] 0 2024-09-12T01:43:00.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/41: chown d2/db/c10 236 1 2024-09-12T01:43:00.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/42: readlink d2/l8 0 2024-09-12T01:43:00.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/43: stat d2/db/ld 0 2024-09-12T01:43:00.907 INFO:tasks.workunit.client.1.smithi153.stdout:4/217: creat d6/f53 x:0 0 0 2024-09-12T01:43:00.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/340: truncate d1/d6/d23/f29 3995950 0 2024-09-12T01:43:00.909 INFO:tasks.workunit.client.1.smithi153.stdout:0/323: write f1b [2254117,72402] 0 2024-09-12T01:43:00.910 INFO:tasks.workunit.client.1.smithi153.stdout:7/295: rename f10 to d12/d21/d4d/f5d 0 2024-09-12T01:43:00.910 INFO:tasks.workunit.client.0.smithi066.stdout:9/40: mkdir d0/d5/d9/de 0 2024-09-12T01:43:00.911 INFO:tasks.workunit.client.1.smithi153.stdout:4/218: truncate d6/d9/d11/d13/f18 2737912 0 2024-09-12T01:43:00.912 INFO:tasks.workunit.client.1.smithi153.stdout:4/219: write d6/d15/f4c [497642,4723] 0 2024-09-12T01:43:00.912 INFO:tasks.workunit.client.1.smithi153.stdout:4/220: chown d6/d9/dc/c1a 611190 1 2024-09-12T01:43:00.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/341: write d1/df/f51 [387290,118410] 0 2024-09-12T01:43:00.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/342: fdatasync d1/d6/da/d32/f4e 0 2024-09-12T01:43:00.916 INFO:tasks.workunit.client.1.smithi153.stdout:6/343: chown d1/d6/da/d32/f36 7 1 2024-09-12T01:43:00.917 INFO:tasks.workunit.client.0.smithi066.stdout:9/41: symlink d0/d5/d9/de/lf 0 2024-09-12T01:43:00.917 INFO:tasks.workunit.client.0.smithi066.stdout:6/44: dread d2/f7 [0,4194304] 0 2024-09-12T01:43:00.917 INFO:tasks.workunit.client.0.smithi066.stdout:6/45: stat c0 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:6/344: truncate d1/d6/f44 57421 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:6/345: write d1/d6/da/d19/d3a/f4d [3849884,26383] 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:9/300: dwrite d3/d3a/d42/f48 [0,4194304] 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:9/301: truncate d3/d35/d44/d30/f31 746574 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:9/302: creat d3/d3a/d42/f4f x:0 0 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:9/303: fsync d3/d35/d44/f2f 0 2024-09-12T01:43:00.918 INFO:tasks.workunit.client.1.smithi153.stdout:9/304: write d3/f29 [1314455,81011] 0 2024-09-12T01:43:00.919 INFO:tasks.workunit.client.0.smithi066.stdout:9/42: creat d0/d6/f10 x:0 0 0 2024-09-12T01:43:00.919 INFO:tasks.workunit.client.0.smithi066.stdout:9/43: readlink d0/d5/d9/de/lf 0 2024-09-12T01:43:00.919 INFO:tasks.workunit.client.0.smithi066.stdout:9/44: readlink d0/d5/d9/de/lf 0 2024-09-12T01:43:00.921 INFO:tasks.workunit.client.0.smithi066.stdout:6/46: mkdir d2/db/d12 0 2024-09-12T01:43:00.923 INFO:tasks.workunit.client.1.smithi153.stdout:6/346: rename d1/d6/f15 to d1/d6/da/d32/f68 0 2024-09-12T01:43:00.924 INFO:tasks.workunit.client.0.smithi066.stdout:9/45: creat d0/d5/dc/f11 x:0 0 0 2024-09-12T01:43:00.926 INFO:tasks.workunit.client.0.smithi066.stdout:6/47: stat d2/l8 0 2024-09-12T01:43:00.929 INFO:tasks.workunit.client.1.smithi153.stdout:9/305: symlink d3/d35/l50 0 2024-09-12T01:43:00.935 INFO:tasks.workunit.client.1.smithi153.stdout:8/326: fsync d17/f28 0 2024-09-12T01:43:00.937 INFO:tasks.workunit.client.1.smithi153.stdout:0/324: dwrite f18 [8388608,4194304] 0 2024-09-12T01:43:00.937 INFO:tasks.workunit.client.1.smithi153.stdout:0/325: truncate d22/d30/d4c/f58 831871 0 2024-09-12T01:43:00.937 INFO:tasks.workunit.client.1.smithi153.stdout:8/327: rename d17/d1d/c6d to d17/c74 0 2024-09-12T01:43:00.938 INFO:tasks.workunit.client.1.smithi153.stdout:8/328: chown d17/d1f/d4f/d34/l38 0 1 2024-09-12T01:43:00.938 INFO:tasks.workunit.client.1.smithi153.stdout:8/329: readlink d17/l1c 0 2024-09-12T01:43:00.938 INFO:tasks.workunit.client.1.smithi153.stdout:8/330: truncate d17/d1f/d4f/d42/f59 647150 0 2024-09-12T01:43:00.939 INFO:tasks.workunit.client.1.smithi153.stdout:7/296: dwrite d12/d21/d4d/f59 [0,4194304] 0 2024-09-12T01:43:00.939 INFO:tasks.workunit.client.1.smithi153.stdout:7/297: chown d12/f17 121662 1 2024-09-12T01:43:00.940 INFO:tasks.workunit.client.1.smithi153.stdout:7/298: truncate d12/d21/f34 732457 0 2024-09-12T01:43:00.940 INFO:tasks.workunit.client.1.smithi153.stdout:7/299: write d12/f2f [4666576,60511] 0 2024-09-12T01:43:00.940 INFO:tasks.workunit.client.1.smithi153.stdout:7/300: readlink d12/l39 0 2024-09-12T01:43:00.940 INFO:tasks.workunit.client.1.smithi153.stdout:7/301: truncate d12/d21/f49 727133 0 2024-09-12T01:43:00.941 INFO:tasks.workunit.client.1.smithi153.stdout:8/331: mkdir d17/d75 0 2024-09-12T01:43:00.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/302: write d12/f33 [2474238,34413] 0 2024-09-12T01:43:00.943 INFO:tasks.workunit.client.0.smithi066.stdout:9/46: write d0/f7 [3273270,111270] 0 2024-09-12T01:43:00.943 INFO:tasks.workunit.client.0.smithi066.stdout:9/47: write d0/d6/f10 [992308,27548] 0 2024-09-12T01:43:00.947 INFO:tasks.workunit.client.1.smithi153.stdout:0/326: dread d22/f2c [0,4194304] 0 2024-09-12T01:43:00.947 INFO:tasks.workunit.client.1.smithi153.stdout:0/327: chown d22/d30/d4c/d6e/l50 0 1 2024-09-12T01:43:00.947 INFO:tasks.workunit.client.1.smithi153.stdout:0/328: truncate d22/d30/d4c/d6e/f3f 1664601 0 2024-09-12T01:43:00.950 INFO:tasks.workunit.client.1.smithi153.stdout:8/332: rename d17/l2e to d17/d1f/d4f/d42/l76 0 2024-09-12T01:43:00.950 INFO:tasks.workunit.client.1.smithi153.stdout:8/333: readlink d17/d1d/d27/l61 0 2024-09-12T01:43:00.951 INFO:tasks.workunit.client.1.smithi153.stdout:7/303: symlink d12/d21/d29/d35/d37/d58/l5e 0 2024-09-12T01:43:00.951 INFO:tasks.workunit.client.1.smithi153.stdout:0/329: symlink d22/d30/l71 0 2024-09-12T01:43:00.951 INFO:tasks.workunit.client.1.smithi153.stdout:0/330: stat d22/d30/d4c/d6e/c52 0 2024-09-12T01:43:00.952 INFO:tasks.workunit.client.1.smithi153.stdout:8/334: symlink d17/d21/l77 0 2024-09-12T01:43:00.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/48: dwrite d2/f7 [0,4194304] 0 2024-09-12T01:43:00.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/49: chown d2/db/d12 0 1 2024-09-12T01:43:00.953 INFO:tasks.workunit.client.1.smithi153.stdout:8/335: getdents d17/d1f 0 2024-09-12T01:43:00.956 INFO:tasks.workunit.client.1.smithi153.stdout:8/336: link d17/d1d/d27/f35 d17/d1f/d4f/f78 0 2024-09-12T01:43:00.956 INFO:tasks.workunit.client.1.smithi153.stdout:9/306: dwrite d3/f5 [0,4194304] 0 2024-09-12T01:43:00.956 INFO:tasks.workunit.client.0.smithi066.stdout:6/50: symlink d2/db/l13 0 2024-09-12T01:43:00.960 INFO:tasks.workunit.client.0.smithi066.stdout:6/51: link d2/db/ld d2/l14 0 2024-09-12T01:43:00.960 INFO:tasks.workunit.client.0.smithi066.stdout:6/52: stat d2/db/c10 0 2024-09-12T01:43:00.961 INFO:tasks.workunit.client.1.smithi153.stdout:7/304: read f7 [5401766,56253] 0 2024-09-12T01:43:00.964 INFO:tasks.workunit.client.0.smithi066.stdout:8/28: getdents . 0 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:7/2: sync 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:2/4: sync 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:0/6: sync 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:1/26: sync 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:3/13: sync 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:2/5: chown f0 164744378 1 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:0/7: chown d1/c2 647364402 1 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/11: sync 2024-09-12T01:43:00.965 INFO:tasks.workunit.client.0.smithi066.stdout:7/3: chown . 0 1 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:7/4: rmdir - no directory 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/6: creat f1 x:0 0 0 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/7: fdatasync f0 0 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/8: rmdir - no directory 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:3/14: write f0 [617424,93640] 0 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/9: write f1 [911538,22871] 0 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:3/15: creat f2 x:0 0 0 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/10: write f0 [773164,97748] 0 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/11: chown f1 211 1 2024-09-12T01:43:00.966 INFO:tasks.workunit.client.0.smithi066.stdout:8/29: symlink l9 0 2024-09-12T01:43:00.967 INFO:tasks.workunit.client.1.smithi153.stdout:8/337: dread d17/d1f/d4f/d34/f47 [0,4194304] 0 2024-09-12T01:43:00.967 INFO:tasks.workunit.client.0.smithi066.stdout:0/8: unlink d1/f3 0 2024-09-12T01:43:00.967 INFO:tasks.workunit.client.0.smithi066.stdout:0/9: truncate - no filename 2024-09-12T01:43:00.967 INFO:tasks.workunit.client.0.smithi066.stdout:0/10: dread - no filename 2024-09-12T01:43:00.967 INFO:tasks.workunit.client.0.smithi066.stdout:0/11: chown d1/c2 948449 1 2024-09-12T01:43:00.967 INFO:tasks.workunit.client.0.smithi066.stdout:0/12: dwrite - no filename 2024-09-12T01:43:00.970 INFO:tasks.workunit.client.0.smithi066.stdout:4/12: mkdir d4 0 2024-09-12T01:43:00.970 INFO:tasks.workunit.client.0.smithi066.stdout:4/13: readlink l0 0 2024-09-12T01:43:00.971 INFO:tasks.workunit.client.1.smithi153.stdout:9/307: write d3/f18 [2409165,56557] 0 2024-09-12T01:43:00.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/13: symlink d1/l4 0 2024-09-12T01:43:00.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/14: truncate - no filename 2024-09-12T01:43:00.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/15: chown l0 167 1 2024-09-12T01:43:00.976 INFO:tasks.workunit.client.0.smithi066.stdout:5/35: getdents d0 0 2024-09-12T01:43:00.976 INFO:tasks.workunit.client.0.smithi066.stdout:5/36: fsync d0/f4 0 2024-09-12T01:43:00.977 INFO:tasks.workunit.client.1.smithi153.stdout:9/308: truncate d3/f49 875904 0 2024-09-12T01:43:00.977 INFO:tasks.workunit.client.0.smithi066.stdout:6/53: dread d2/f7 [0,4194304] 0 2024-09-12T01:43:00.979 INFO:tasks.workunit.client.0.smithi066.stdout:4/14: symlink d4/l5 0 2024-09-12T01:43:00.980 INFO:tasks.workunit.client.0.smithi066.stdout:3/16: write f0 [564198,104760] 0 2024-09-12T01:43:00.981 INFO:tasks.workunit.client.0.smithi066.stdout:3/17: creat f3 x:0 0 0 2024-09-12T01:43:00.981 INFO:tasks.workunit.client.0.smithi066.stdout:3/18: chown l1 12331330 1 2024-09-12T01:43:00.981 INFO:tasks.workunit.client.0.smithi066.stdout:3/19: chown l1 935099 1 2024-09-12T01:43:00.981 INFO:tasks.workunit.client.0.smithi066.stdout:3/20: creat f4 x:0 0 0 2024-09-12T01:43:00.981 INFO:tasks.workunit.client.0.smithi066.stdout:8/30: unlink c0 0 2024-09-12T01:43:00.986 INFO:tasks.workunit.client.0.smithi066.stdout:6/54: link d2/f7 d2/db/d12/f15 0 2024-09-12T01:43:00.988 INFO:tasks.workunit.client.0.smithi066.stdout:4/15: mkdir d4/d6 0 2024-09-12T01:43:00.988 INFO:tasks.workunit.client.0.smithi066.stdout:4/16: rename d4 to d4/d7 22 2024-09-12T01:43:00.989 INFO:tasks.workunit.client.1.smithi153.stdout:0/331: dwrite d22/f68 [0,4194304] 0 2024-09-12T01:43:00.991 INFO:tasks.workunit.client.0.smithi066.stdout:6/55: dread d2/ff [0,4194304] 0 2024-09-12T01:43:00.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/12: dread f1 [0,4194304] 0 2024-09-12T01:43:00.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/13: creat f2 x:0 0 0 2024-09-12T01:43:00.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/14: write f2 [246367,81044] 0 2024-09-12T01:43:00.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/15: fsync f0 0 2024-09-12T01:43:00.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/16: truncate f1 1087102 0 2024-09-12T01:43:00.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/17: fdatasync f0 0 2024-09-12T01:43:00.996 INFO:tasks.workunit.client.0.smithi066.stdout:4/17: mkdir d4/d6/d8 0 2024-09-12T01:43:00.999 INFO:tasks.workunit.client.0.smithi066.stdout:1/27: dwrite f1 [0,4194304] 0 2024-09-12T01:43:00.999 INFO:tasks.workunit.client.0.smithi066.stdout:1/28: fdatasync f3 0 2024-09-12T01:43:00.999 INFO:tasks.workunit.client.0.smithi066.stdout:6/56: rename d2/db/ld to d2/db/d12/l16 0 2024-09-12T01:43:01.001 INFO:tasks.workunit.client.0.smithi066.stdout:6/57: read d2/ff [298290,99328] 0 2024-09-12T01:43:01.002 INFO:tasks.workunit.client.1.smithi153.stdout:6/347: fsync d1/d6/f44 0 2024-09-12T01:43:01.002 INFO:tasks.workunit.client.1.smithi153.stdout:6/348: truncate d1/d6/f44 975143 0 2024-09-12T01:43:01.004 INFO:tasks.workunit.client.0.smithi066.stdout:2/18: symlink l3 0 2024-09-12T01:43:01.004 INFO:tasks.workunit.client.0.smithi066.stdout:2/19: creat f4 x:0 0 0 2024-09-12T01:43:01.004 INFO:tasks.workunit.client.0.smithi066.stdout:2/20: creat f5 x:0 0 0 2024-09-12T01:43:01.004 INFO:tasks.workunit.client.0.smithi066.stdout:2/21: creat f6 x:0 0 0 2024-09-12T01:43:01.004 INFO:tasks.workunit.client.0.smithi066.stdout:2/22: write f6 [779377,22795] 0 2024-09-12T01:43:01.005 INFO:tasks.workunit.client.1.smithi153.stdout:8/338: dwrite d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:01.005 INFO:tasks.workunit.client.0.smithi066.stdout:8/31: mknod ca 0 2024-09-12T01:43:01.007 INFO:tasks.workunit.client.0.smithi066.stdout:1/29: creat d5/f7 x:0 0 0 2024-09-12T01:43:01.007 INFO:tasks.workunit.client.0.smithi066.stdout:1/30: chown f3 1 1 2024-09-12T01:43:01.007 INFO:tasks.workunit.client.0.smithi066.stdout:5/37: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:43:01.008 INFO:tasks.workunit.client.1.smithi153.stdout:9/309: dwrite d3/f5 [0,4194304] 0 2024-09-12T01:43:01.009 INFO:tasks.workunit.client.0.smithi066.stdout:3/21: dwrite f2 [0,4194304] 0 2024-09-12T01:43:01.010 INFO:tasks.workunit.client.1.smithi153.stdout:0/332: creat d22/d30/d4c/d6e/f72 x:0 0 0 2024-09-12T01:43:01.010 INFO:tasks.workunit.client.1.smithi153.stdout:0/333: creat d22/d30/d4c/d6f/f73 x:0 0 0 2024-09-12T01:43:01.011 INFO:tasks.workunit.client.1.smithi153.stdout:6/349: mkdir d1/d6/da/d32/d53/d69 0 2024-09-12T01:43:01.011 INFO:tasks.workunit.client.1.smithi153.stdout:6/350: creat d1/d6/da/d32/d53/f6a x:0 0 0 2024-09-12T01:43:01.013 INFO:tasks.workunit.client.1.smithi153.stdout:8/339: mkdir d17/d1f/d4f/d42/d79 0 2024-09-12T01:43:01.014 INFO:tasks.workunit.client.1.smithi153.stdout:8/340: chown d17/d1f/l64 1833952 1 2024-09-12T01:43:01.014 INFO:tasks.workunit.client.1.smithi153.stdout:8/341: fdatasync d17/d1d/d27/f6b 0 2024-09-12T01:43:01.015 INFO:tasks.workunit.client.0.smithi066.stdout:4/18: write f3 [2259426,45939] 0 2024-09-12T01:43:01.016 INFO:tasks.workunit.client.1.smithi153.stdout:0/334: dread d22/f3e [4194304,4194304] 0 2024-09-12T01:43:01.016 INFO:tasks.workunit.client.1.smithi153.stdout:0/335: readlink d22/l66 0 2024-09-12T01:43:01.018 INFO:tasks.workunit.client.0.smithi066.stdout:2/23: mknod c7 0 2024-09-12T01:43:01.019 INFO:tasks.workunit.client.0.smithi066.stdout:2/24: creat f8 x:0 0 0 2024-09-12T01:43:01.019 INFO:tasks.workunit.client.0.smithi066.stdout:2/25: write f5 [418663,63154] 0 2024-09-12T01:43:01.019 INFO:tasks.workunit.client.0.smithi066.stdout:2/26: chown f8 1342215 1 2024-09-12T01:43:01.019 INFO:tasks.workunit.client.0.smithi066.stdout:2/27: creat f9 x:0 0 0 2024-09-12T01:43:01.020 INFO:tasks.workunit.client.0.smithi066.stdout:8/32: stat c7 0 2024-09-12T01:43:01.020 INFO:tasks.workunit.client.0.smithi066.stdout:8/33: chown l9 0 1 2024-09-12T01:43:01.021 INFO:tasks.workunit.client.1.smithi153.stdout:8/342: read d17/d1f/f5a [3344854,43181] 0 2024-09-12T01:43:01.022 INFO:tasks.workunit.client.1.smithi153.stdout:9/310: getdents d3/d35 0 2024-09-12T01:43:01.022 INFO:tasks.workunit.client.1.smithi153.stdout:3/288: sync 2024-09-12T01:43:01.022 INFO:tasks.workunit.client.1.smithi153.stdout:2/276: sync 2024-09-12T01:43:01.024 INFO:tasks.workunit.client.0.smithi066.stdout:1/31: dread f4 [0,4194304] 0 2024-09-12T01:43:01.025 INFO:tasks.workunit.client.1.smithi153.stdout:0/336: creat d22/f74 x:0 0 0 2024-09-12T01:43:01.028 INFO:tasks.workunit.client.0.smithi066.stdout:4/19: dread f3 [0,4194304] 0 2024-09-12T01:43:01.032 INFO:tasks.workunit.client.1.smithi153.stdout:2/277: symlink d7/db/d27/l57 0 2024-09-12T01:43:01.033 INFO:tasks.workunit.client.1.smithi153.stdout:0/337: mknod d22/d30/d4c/d6e/c75 0 2024-09-12T01:43:01.034 INFO:tasks.workunit.client.1.smithi153.stdout:0/338: fsync d22/f5a 0 2024-09-12T01:43:01.034 INFO:tasks.workunit.client.1.smithi153.stdout:0/339: fsync d22/d30/f59 0 2024-09-12T01:43:01.034 INFO:tasks.workunit.client.1.smithi153.stdout:0/340: dread - d22/f5e zero size 2024-09-12T01:43:01.035 INFO:tasks.workunit.client.1.smithi153.stdout:2/278: link d7/c3e d7/d19/c58 0 2024-09-12T01:43:01.035 INFO:tasks.workunit.client.1.smithi153.stdout:2/279: write d7/d19/d40/f37 [637831,119623] 0 2024-09-12T01:43:01.035 INFO:tasks.workunit.client.1.smithi153.stdout:2/280: chown f1 10 1 2024-09-12T01:43:01.035 INFO:tasks.workunit.client.1.smithi153.stdout:8/343: dread d17/d21/f30 [0,4194304] 0 2024-09-12T01:43:01.037 INFO:tasks.workunit.client.1.smithi153.stdout:2/281: mkdir d7/db/d1d/d59 0 2024-09-12T01:43:01.039 INFO:tasks.workunit.client.1.smithi153.stdout:8/344: symlink d17/d1f/d4f/d42/l7a 0 2024-09-12T01:43:01.040 INFO:tasks.workunit.client.1.smithi153.stdout:9/311: dread d3/f7 [0,4194304] 0 2024-09-12T01:43:01.040 INFO:tasks.workunit.client.0.smithi066.stdout:8/34: write f3 [1759631,86368] 0 2024-09-12T01:43:01.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/345: symlink d17/d21/d3a/l7b 0 2024-09-12T01:43:01.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/346: fdatasync d17/d1f/d4f/f57 0 2024-09-12T01:43:01.045 INFO:tasks.workunit.client.0.smithi066.stdout:4/20: rmdir d4 39 2024-09-12T01:43:01.047 INFO:tasks.workunit.client.1.smithi153.stdout:9/312: creat d3/f51 x:0 0 0 2024-09-12T01:43:01.048 INFO:tasks.workunit.client.1.smithi153.stdout:6/351: dwrite d1/d6/d23/f29 [0,4194304] 0 2024-09-12T01:43:01.050 INFO:tasks.workunit.client.1.smithi153.stdout:9/313: symlink d3/d35/d44/l52 0 2024-09-12T01:43:01.051 INFO:tasks.workunit.client.0.smithi066.stdout:4/21: symlink d4/d6/l9 0 2024-09-12T01:43:01.051 INFO:tasks.workunit.client.0.smithi066.stdout:4/22: read f3 [3317451,14971] 0 2024-09-12T01:43:01.053 INFO:tasks.workunit.client.0.smithi066.stdout:4/23: creat d4/d6/d8/fa x:0 0 0 2024-09-12T01:43:01.053 INFO:tasks.workunit.client.0.smithi066.stdout:4/24: fdatasync d4/d6/d8/fa 0 2024-09-12T01:43:01.054 INFO:tasks.workunit.client.1.smithi153.stdout:9/314: truncate d3/f3e 184247 0 2024-09-12T01:43:01.055 INFO:tasks.workunit.client.1.smithi153.stdout:9/315: symlink d3/d3a/d42/l53 0 2024-09-12T01:43:01.055 INFO:tasks.workunit.client.1.smithi153.stdout:9/316: chown d3 0 1 2024-09-12T01:43:01.055 INFO:tasks.workunit.client.0.smithi066.stdout:8/35: fsync f3 0 2024-09-12T01:43:01.056 INFO:tasks.workunit.client.0.smithi066.stdout:2/28: dwrite f2 [0,4194304] 0 2024-09-12T01:43:01.056 INFO:tasks.workunit.client.0.smithi066.stdout:2/29: creat fa x:0 0 0 2024-09-12T01:43:01.058 INFO:tasks.workunit.client.1.smithi153.stdout:8/347: write d17/d1f/f5d [3368400,11458] 0 2024-09-12T01:43:01.058 INFO:tasks.workunit.client.1.smithi153.stdout:3/289: dwrite d1/d13/d25/f4c [0,4194304] 0 2024-09-12T01:43:01.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/22: getdents . 0 2024-09-12T01:43:01.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/23: read - f3 zero size 2024-09-12T01:43:01.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/24: read - f4 zero size 2024-09-12T01:43:01.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/25: chown f0 0 1 2024-09-12T01:43:01.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/26: write f4 [1038755,107747] 0 2024-09-12T01:43:01.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/27: chown f0 307516538 1 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/28: write f3 [998519,123720] 0 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/29: readlink l1 0 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/30: write f0 [35715,108278] 0 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/31: chown f4 1832 1 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.0.smithi066.stdout:3/32: chown f2 684555934 1 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.1.smithi153.stdout:9/317: rename d3/f2b to d3/d3a/f54 0 2024-09-12T01:43:01.060 INFO:tasks.workunit.client.1.smithi153.stdout:6/352: write d1/f38 [3253961,108719] 0 2024-09-12T01:43:01.061 INFO:tasks.workunit.client.1.smithi153.stdout:0/341: dwrite d22/f65 [0,4194304] 0 2024-09-12T01:43:01.063 INFO:tasks.workunit.client.0.smithi066.stdout:6/58: getdents d2/db 0 2024-09-12T01:43:01.063 INFO:tasks.workunit.client.1.smithi153.stdout:2/282: dwrite d7/f11 [0,4194304] 0 2024-09-12T01:43:01.064 INFO:tasks.workunit.client.1.smithi153.stdout:5/326: sync 2024-09-12T01:43:01.064 INFO:tasks.workunit.client.1.smithi153.stdout:1/294: sync 2024-09-12T01:43:01.064 INFO:tasks.workunit.client.1.smithi153.stdout:1/295: write d2/d9/d17/f4e [969053,31628] 0 2024-09-12T01:43:01.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/348: symlink d17/d1f/l7c 0 2024-09-12T01:43:01.067 INFO:tasks.workunit.client.0.smithi066.stdout:8/36: dread f3 [0,4194304] 0 2024-09-12T01:43:01.071 INFO:tasks.workunit.client.0.smithi066.stdout:6/59: symlink d2/db/l17 0 2024-09-12T01:43:01.071 INFO:tasks.workunit.client.0.smithi066.stdout:1/32: rmdir d5 39 2024-09-12T01:43:01.074 INFO:tasks.workunit.client.0.smithi066.stdout:8/37: chown l5 135 1 2024-09-12T01:43:01.076 INFO:tasks.workunit.client.0.smithi066.stdout:1/33: link f3 d5/f8 0 2024-09-12T01:43:01.077 INFO:tasks.workunit.client.0.smithi066.stdout:6/60: dread d2/f5 [0,4194304] 0 2024-09-12T01:43:01.078 INFO:tasks.workunit.client.0.smithi066.stdout:8/38: chown c1 3085 1 2024-09-12T01:43:01.079 INFO:tasks.workunit.client.1.smithi153.stdout:2/283: truncate d7/db/f30 3963390 0 2024-09-12T01:43:01.081 INFO:tasks.workunit.client.1.smithi153.stdout:1/296: unlink d2/c18 0 2024-09-12T01:43:01.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/353: dwrite d1/d6/da/d32/d53/f6a [0,4194304] 0 2024-09-12T01:43:01.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/354: chown d1/d6/da/d32/f4e 7313 1 2024-09-12T01:43:01.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/355: read - d1/d6/da/d32/d53/f59 zero size 2024-09-12T01:43:01.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/356: truncate d1/df/f5f 713097 0 2024-09-12T01:43:01.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/357: write d1/d6/da/d19/d34/f20 [3860399,24261] 0 2024-09-12T01:43:01.085 INFO:tasks.workunit.client.0.smithi066.stdout:8/39: getdents . 0 2024-09-12T01:43:01.085 INFO:tasks.workunit.client.0.smithi066.stdout:8/40: fdatasync f3 0 2024-09-12T01:43:01.085 INFO:tasks.workunit.client.0.smithi066.stdout:8/41: chown l6 25204547 1 2024-09-12T01:43:01.085 INFO:tasks.workunit.client.0.smithi066.stdout:8/42: chown l6 621754 1 2024-09-12T01:43:01.087 INFO:tasks.workunit.client.0.smithi066.stdout:8/43: creat fb x:0 0 0 2024-09-12T01:43:01.088 INFO:tasks.workunit.client.1.smithi153.stdout:0/342: mknod d22/d30/d4c/d6e/c76 0 2024-09-12T01:43:01.091 INFO:tasks.workunit.client.1.smithi153.stdout:3/290: dwrite d1/d13/d25/f4c [0,4194304] 0 2024-09-12T01:43:01.093 INFO:tasks.workunit.client.1.smithi153.stdout:3/291: dread d1/d13/d25/d26/d4b/f4f [0,4194304] 0 2024-09-12T01:43:01.094 INFO:tasks.workunit.client.1.smithi153.stdout:2/284: mknod d7/d19/c5a 0 2024-09-12T01:43:01.094 INFO:tasks.workunit.client.1.smithi153.stdout:2/285: dread - d7/db/f39 zero size 2024-09-12T01:43:01.097 INFO:tasks.workunit.client.1.smithi153.stdout:6/358: truncate d1/d6/da/d19/d34/f28 924919 0 2024-09-12T01:43:01.097 INFO:tasks.workunit.client.1.smithi153.stdout:6/359: creat d1/d6/da/d19/f6b x:0 0 0 2024-09-12T01:43:01.097 INFO:tasks.workunit.client.1.smithi153.stdout:6/360: stat d1/d6/da/d19/d34/d33/c56 0 2024-09-12T01:43:01.098 INFO:tasks.workunit.client.1.smithi153.stdout:0/343: mknod d22/c77 0 2024-09-12T01:43:01.101 INFO:tasks.workunit.client.1.smithi153.stdout:9/318: rename d3/d35/d44 to d3/d55 0 2024-09-12T01:43:01.102 INFO:tasks.workunit.client.1.smithi153.stdout:2/286: creat d7/db/d27/d56/f5b x:0 0 0 2024-09-12T01:43:01.102 INFO:tasks.workunit.client.1.smithi153.stdout:2/287: chown d7/d19/d40/l38 4114841 1 2024-09-12T01:43:01.105 INFO:tasks.workunit.client.1.smithi153.stdout:9/319: stat d3/d55/c38 0 2024-09-12T01:43:01.106 INFO:tasks.workunit.client.1.smithi153.stdout:2/288: mknod d7/d19/c5c 0 2024-09-12T01:43:01.107 INFO:tasks.workunit.client.1.smithi153.stdout:8/349: rename cc to d17/d1f/d4f/d42/d79/c7d 0 2024-09-12T01:43:01.107 INFO:tasks.workunit.client.1.smithi153.stdout:8/350: chown d17/d1f/d4f/d42/f48 11 1 2024-09-12T01:43:01.107 INFO:tasks.workunit.client.1.smithi153.stdout:8/351: stat d17/d1f 0 2024-09-12T01:43:01.109 INFO:tasks.workunit.client.1.smithi153.stdout:9/320: symlink d3/d3a/d42/l56 0 2024-09-12T01:43:01.109 INFO:tasks.workunit.client.1.smithi153.stdout:9/321: readlink d3/d55/l52 0 2024-09-12T01:43:01.109 INFO:tasks.workunit.client.1.smithi153.stdout:2/289: creat d7/db/d1d/f5d x:0 0 0 2024-09-12T01:43:01.110 INFO:tasks.workunit.client.0.smithi066.stdout:2/30: getdents . 0 2024-09-12T01:43:01.112 INFO:tasks.workunit.client.1.smithi153.stdout:0/344: rename d22/l27 to d22/d30/d4c/d6f/l78 0 2024-09-12T01:43:01.113 INFO:tasks.workunit.client.0.smithi066.stdout:2/31: mknod cb 0 2024-09-12T01:43:01.113 INFO:tasks.workunit.client.0.smithi066.stdout:6/61: dwrite d2/f7 [0,4194304] 0 2024-09-12T01:43:01.114 INFO:tasks.workunit.client.1.smithi153.stdout:8/352: creat d17/d1d/d27/f7e x:0 0 0 2024-09-12T01:43:01.114 INFO:tasks.workunit.client.1.smithi153.stdout:1/297: dwrite d2/d34/f39 [0,4194304] 0 2024-09-12T01:43:01.114 INFO:tasks.workunit.client.1.smithi153.stdout:1/298: truncate d2/d9/f2e 1263180 0 2024-09-12T01:43:01.115 INFO:tasks.workunit.client.0.smithi066.stdout:1/34: dwrite d5/f8 [0,4194304] 0 2024-09-12T01:43:01.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/292: dwrite d1/d16/d1c/f2d [0,4194304] 0 2024-09-12T01:43:01.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/293: dread - d1/d45/f58 zero size 2024-09-12T01:43:01.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/294: write d1/d16/f53 [2943191,121208] 0 2024-09-12T01:43:01.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/295: readlink d1/d13/d25/l57 0 2024-09-12T01:43:01.116 INFO:tasks.workunit.client.0.smithi066.stdout:3/33: truncate f4 417529 0 2024-09-12T01:43:01.117 INFO:tasks.workunit.client.0.smithi066.stdout:2/32: chown f4 3 1 2024-09-12T01:43:01.117 INFO:tasks.workunit.client.0.smithi066.stdout:2/33: truncate f4 658487 0 2024-09-12T01:43:01.117 INFO:tasks.workunit.client.1.smithi153.stdout:9/322: creat d3/d55/f57 x:0 0 0 2024-09-12T01:43:01.120 INFO:tasks.workunit.client.0.smithi066.stdout:2/34: dread f4 [0,4194304] 0 2024-09-12T01:43:01.123 INFO:tasks.workunit.client.1.smithi153.stdout:3/296: creat d1/d13/d25/d26/f5a x:0 0 0 2024-09-12T01:43:01.123 INFO:tasks.workunit.client.1.smithi153.stdout:3/297: chown d1/d16/d1c/f2d 2827378 1 2024-09-12T01:43:01.123 INFO:tasks.workunit.client.1.smithi153.stdout:3/298: truncate d1/d13/d23/f2b 770482 0 2024-09-12T01:43:01.124 INFO:tasks.workunit.client.0.smithi066.stdout:1/35: write d5/f8 [1783255,80288] 0 2024-09-12T01:43:01.127 INFO:tasks.workunit.client.1.smithi153.stdout:9/323: unlink d3/d3a/d42/l53 0 2024-09-12T01:43:01.127 INFO:tasks.workunit.client.1.smithi153.stdout:9/324: creat d3/d3a/d42/f58 x:0 0 0 2024-09-12T01:43:01.127 INFO:tasks.workunit.client.1.smithi153.stdout:9/325: readlink d3/d55/l52 0 2024-09-12T01:43:01.128 INFO:tasks.workunit.client.0.smithi066.stdout:3/34: mkdir d5 0 2024-09-12T01:43:01.129 INFO:tasks.workunit.client.1.smithi153.stdout:3/299: symlink d1/d16/l5b 0 2024-09-12T01:43:01.130 INFO:tasks.workunit.client.0.smithi066.stdout:6/62: rename d2/db/d12/f15 to d2/db/d12/f18 0 2024-09-12T01:43:01.133 INFO:tasks.workunit.client.0.smithi066.stdout:8/44: getdents . 0 2024-09-12T01:43:01.137 INFO:tasks.workunit.client.1.smithi153.stdout:9/326: rename d3/d55/f2f to d3/d55/f59 0 2024-09-12T01:43:01.137 INFO:tasks.workunit.client.1.smithi153.stdout:9/327: creat d3/d3a/f5a x:0 0 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/36: creat d5/f9 x:0 0 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/37: write d5/f7 [600716,16497] 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/38: stat d5/f8 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/39: creat d5/fa x:0 0 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/40: readlink d5/l6 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/41: write d5/f9 [545905,104190] 0 2024-09-12T01:43:01.139 INFO:tasks.workunit.client.0.smithi066.stdout:1/42: dread - d5/fa zero size 2024-09-12T01:43:01.140 INFO:tasks.workunit.client.1.smithi153.stdout:6/361: dwrite d1/d6/f8 [0,4194304] 0 2024-09-12T01:43:01.140 INFO:tasks.workunit.client.0.smithi066.stdout:6/63: mknod d2/db/d12/c19 0 2024-09-12T01:43:01.140 INFO:tasks.workunit.client.0.smithi066.stdout:6/64: creat d2/f1a x:0 0 0 2024-09-12T01:43:01.146 INFO:tasks.workunit.client.1.smithi153.stdout:9/328: mkdir d3/d55/d30/d5b 0 2024-09-12T01:43:01.147 INFO:tasks.workunit.client.0.smithi066.stdout:1/43: mknod d5/cb 0 2024-09-12T01:43:01.147 INFO:tasks.workunit.client.0.smithi066.stdout:1/44: readlink d5/l6 0 2024-09-12T01:43:01.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/362: mkdir d1/d6/da/d32/d53/d6c 0 2024-09-12T01:43:01.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/363: truncate d1/d6/da/d19/d34/f61 628760 0 2024-09-12T01:43:01.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/364: write d1/d6/f35 [1604668,85218] 0 2024-09-12T01:43:01.148 INFO:tasks.workunit.client.1.smithi153.stdout:6/365: getdents d1/d6/da/d32/d53/d69 0 2024-09-12T01:43:01.150 INFO:tasks.workunit.client.1.smithi153.stdout:9/329: creat d3/d35/f5c x:0 0 0 2024-09-12T01:43:01.152 INFO:tasks.workunit.client.0.smithi066.stdout:8/45: rename l9 to lc 0 2024-09-12T01:43:01.152 INFO:tasks.workunit.client.0.smithi066.stdout:8/46: chown f3 7790174 1 2024-09-12T01:43:01.153 INFO:tasks.workunit.client.1.smithi153.stdout:1/299: dwrite d2/d9/f15 [4194304,4194304] 0 2024-09-12T01:43:01.155 INFO:tasks.workunit.client.0.smithi066.stdout:2/35: link f8 fc 0 2024-09-12T01:43:01.157 INFO:tasks.workunit.client.0.smithi066.stdout:1/45: mkdir d5/dc 0 2024-09-12T01:43:01.157 INFO:tasks.workunit.client.0.smithi066.stdout:1/46: chown f4 827039 1 2024-09-12T01:43:01.157 INFO:tasks.workunit.client.1.smithi153.stdout:1/300: rmdir d2/d9/d17 39 2024-09-12T01:43:01.159 INFO:tasks.workunit.client.1.smithi153.stdout:6/366: write d1/f4 [7845388,56974] 0 2024-09-12T01:43:01.159 INFO:tasks.workunit.client.1.smithi153.stdout:6/367: dread - d1/d6/d39/f57 zero size 2024-09-12T01:43:01.161 INFO:tasks.workunit.client.1.smithi153.stdout:1/301: truncate d2/d9/d1d/d25/f38 2234804 0 2024-09-12T01:43:01.161 INFO:tasks.workunit.client.0.smithi066.stdout:2/36: fsync f0 0 2024-09-12T01:43:01.162 INFO:tasks.workunit.client.0.smithi066.stdout:3/35: dwrite f2 [4194304,4194304] 0 2024-09-12T01:43:01.162 INFO:tasks.workunit.client.0.smithi066.stdout:3/36: chown f2 4 1 2024-09-12T01:43:01.162 INFO:tasks.workunit.client.1.smithi153.stdout:3/300: dwrite d1/d13/d23/f2b [0,4194304] 0 2024-09-12T01:43:01.163 INFO:tasks.workunit.client.0.smithi066.stdout:1/47: read f4 [3803755,34619] 0 2024-09-12T01:43:01.163 INFO:tasks.workunit.client.0.smithi066.stdout:6/65: rename d2/db/l13 to d2/db/l1b 0 2024-09-12T01:43:01.165 INFO:tasks.workunit.client.1.smithi153.stdout:3/301: dread d1/f19 [8388608,4194304] 0 2024-09-12T01:43:01.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/368: rename d1/d6/da/d32/f4e to d1/d6/f6d 0 2024-09-12T01:43:01.166 INFO:tasks.workunit.client.0.smithi066.stdout:8/47: mknod cd 0 2024-09-12T01:43:01.166 INFO:tasks.workunit.client.0.smithi066.stdout:8/48: write f3 [542356,106189] 0 2024-09-12T01:43:01.166 INFO:tasks.workunit.client.0.smithi066.stdout:8/49: chown l4 273 1 2024-09-12T01:43:01.167 INFO:tasks.workunit.client.0.smithi066.stdout:2/37: chown c7 60 1 2024-09-12T01:43:01.172 INFO:tasks.workunit.client.1.smithi153.stdout:3/302: creat d1/d13/d23/d47/f5c x:0 0 0 2024-09-12T01:43:01.172 INFO:tasks.workunit.client.0.smithi066.stdout:3/37: mkdir d5/d6 0 2024-09-12T01:43:01.172 INFO:tasks.workunit.client.0.smithi066.stdout:3/38: chown d5 1323208110 1 2024-09-12T01:43:01.172 INFO:tasks.workunit.client.0.smithi066.stdout:3/39: write f0 [689679,64461] 0 2024-09-12T01:43:01.173 INFO:tasks.workunit.client.0.smithi066.stdout:1/48: mkdir d5/dc/dd 0 2024-09-12T01:43:01.173 INFO:tasks.workunit.client.1.smithi153.stdout:1/302: dread d2/d34/f39 [0,4194304] 0 2024-09-12T01:43:01.173 INFO:tasks.workunit.client.1.smithi153.stdout:1/303: readlink d2/d9/d1d/l21 0 2024-09-12T01:43:01.173 INFO:tasks.workunit.client.1.smithi153.stdout:8/353: dwrite d17/f24 [0,4194304] 0 2024-09-12T01:43:01.173 INFO:tasks.workunit.client.1.smithi153.stdout:4/221: sync 2024-09-12T01:43:01.174 INFO:tasks.workunit.client.1.smithi153.stdout:4/222: creat d6/d9/d11/d14/d3e/f54 x:0 0 0 2024-09-12T01:43:01.174 INFO:tasks.workunit.client.1.smithi153.stdout:3/303: symlink d1/d13/d25/l5d 0 2024-09-12T01:43:01.174 INFO:tasks.workunit.client.1.smithi153.stdout:3/304: chown d1/d16/d1c/c55 657 1 2024-09-12T01:43:01.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/304: unlink d2/d9/d17/d2f/f52 0 2024-09-12T01:43:01.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/305: stat d2/d9/d17/d2c 0 2024-09-12T01:43:01.176 INFO:tasks.workunit.client.0.smithi066.stdout:2/38: readlink l3 0 2024-09-12T01:43:01.177 INFO:tasks.workunit.client.0.smithi066.stdout:6/66: dread d2/db/d12/f18 [0,4194304] 0 2024-09-12T01:43:01.178 INFO:tasks.workunit.client.0.smithi066.stdout:8/50: dread f3 [0,4194304] 0 2024-09-12T01:43:01.178 INFO:tasks.workunit.client.0.smithi066.stdout:8/51: write f3 [1239890,19865] 0 2024-09-12T01:43:01.180 INFO:tasks.workunit.client.1.smithi153.stdout:8/354: mkdir d17/d21/d3a/d6c/d6e/d7f 0 2024-09-12T01:43:01.181 INFO:tasks.workunit.client.0.smithi066.stdout:1/49: mknod d5/dc/ce 0 2024-09-12T01:43:01.182 INFO:tasks.workunit.client.1.smithi153.stdout:6/369: dwrite d1/d6/d23/f29 [0,4194304] 0 2024-09-12T01:43:01.183 INFO:tasks.workunit.client.1.smithi153.stdout:4/223: symlink d6/d9/d20/l55 0 2024-09-12T01:43:01.184 INFO:tasks.workunit.client.1.smithi153.stdout:4/224: readlink d6/d15/l19 0 2024-09-12T01:43:01.186 INFO:tasks.workunit.client.1.smithi153.stdout:3/305: rename d1/f4 to d1/d1e/f5e 0 2024-09-12T01:43:01.186 INFO:tasks.workunit.client.1.smithi153.stdout:9/330: rmdir d3/d35 39 2024-09-12T01:43:01.187 INFO:tasks.workunit.client.0.smithi066.stdout:1/50: rmdir d5/dc 39 2024-09-12T01:43:01.188 INFO:tasks.workunit.client.0.smithi066.stdout:3/40: dread f3 [0,4194304] 0 2024-09-12T01:43:01.189 INFO:tasks.workunit.client.0.smithi066.stdout:2/39: dread f5 [0,4194304] 0 2024-09-12T01:43:01.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/306: mkdir d2/d9/d58 0 2024-09-12T01:43:01.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/307: write d2/d9/f32 [2720669,83398] 0 2024-09-12T01:43:01.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/308: write d2/d34/f55 [698803,67179] 0 2024-09-12T01:43:01.190 INFO:tasks.workunit.client.1.smithi153.stdout:8/355: rmdir d17/d1f/d4f/d42 39 2024-09-12T01:43:01.190 INFO:tasks.workunit.client.0.smithi066.stdout:1/51: mknod d5/dc/cf 0 2024-09-12T01:43:01.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/40: unlink fc 0 2024-09-12T01:43:01.196 INFO:tasks.workunit.client.1.smithi153.stdout:4/225: mknod d6/d9/dc/c56 0 2024-09-12T01:43:01.196 INFO:tasks.workunit.client.1.smithi153.stdout:4/226: creat d6/d9/d11/d14/f57 x:0 0 0 2024-09-12T01:43:01.198 INFO:tasks.workunit.client.1.smithi153.stdout:3/306: rename d1/d13/d23/d47/f5c to d1/d16/d1c/d32/f5f 0 2024-09-12T01:43:01.198 INFO:tasks.workunit.client.1.smithi153.stdout:3/307: chown d1/l56 324 1 2024-09-12T01:43:01.199 INFO:tasks.workunit.client.0.smithi066.stdout:2/41: creat fd x:0 0 0 2024-09-12T01:43:01.200 INFO:tasks.workunit.client.1.smithi153.stdout:9/331: creat d3/d35/f5d x:0 0 0 2024-09-12T01:43:01.201 INFO:tasks.workunit.client.1.smithi153.stdout:1/309: creat d2/d34/d3d/f59 x:0 0 0 2024-09-12T01:43:01.201 INFO:tasks.workunit.client.0.smithi066.stdout:8/52: getdents . 0 2024-09-12T01:43:01.201 INFO:tasks.workunit.client.0.smithi066.stdout:8/53: rmdir - no directory 2024-09-12T01:43:01.202 INFO:tasks.workunit.client.0.smithi066.stdout:2/42: write f6 [1198392,25271] 0 2024-09-12T01:43:01.203 INFO:tasks.workunit.client.1.smithi153.stdout:8/356: creat d17/d21/d3a/d6c/f80 x:0 0 0 2024-09-12T01:43:01.205 INFO:tasks.workunit.client.0.smithi066.stdout:2/43: fsync fa 0 2024-09-12T01:43:01.206 INFO:tasks.workunit.client.1.smithi153.stdout:4/227: mknod d6/d15/d38/c58 0 2024-09-12T01:43:01.206 INFO:tasks.workunit.client.1.smithi153.stdout:4/228: fdatasync d6/d9/d11/d14/f2a 0 2024-09-12T01:43:01.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/67: dwrite d2/f7 [0,4194304] 0 2024-09-12T01:43:01.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/68: readlink d2/db/l17 0 2024-09-12T01:43:01.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/69: truncate d2/f1a 806159 0 2024-09-12T01:43:01.207 INFO:tasks.workunit.client.0.smithi066.stdout:8/54: rename l6 to le 0 2024-09-12T01:43:01.208 INFO:tasks.workunit.client.1.smithi153.stdout:3/308: mknod d1/d1e/c60 0 2024-09-12T01:43:01.210 INFO:tasks.workunit.client.0.smithi066.stdout:1/52: dread d5/f7 [0,4194304] 0 2024-09-12T01:43:01.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/41: dwrite f4 [0,4194304] 0 2024-09-12T01:43:01.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/42: write f3 [2164676,67399] 0 2024-09-12T01:43:01.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/43: chown f3 2928 1 2024-09-12T01:43:01.211 INFO:tasks.workunit.client.1.smithi153.stdout:6/370: dwrite d1/d6/da/d19/d34/f28 [0,4194304] 0 2024-09-12T01:43:01.211 INFO:tasks.workunit.client.1.smithi153.stdout:9/332: creat d3/d55/d30/f5e x:0 0 0 2024-09-12T01:43:01.212 INFO:tasks.workunit.client.0.smithi066.stdout:6/70: rmdir d2/db 39 2024-09-12T01:43:01.212 INFO:tasks.workunit.client.1.smithi153.stdout:6/371: read d1/d6/da/d19/d34/d33/f42 [315267,85104] 0 2024-09-12T01:43:01.212 INFO:tasks.workunit.client.1.smithi153.stdout:6/372: chown d1/d6/f44 8250316 1 2024-09-12T01:43:01.213 INFO:tasks.workunit.client.0.smithi066.stdout:8/55: creat ff x:0 0 0 2024-09-12T01:43:01.213 INFO:tasks.workunit.client.0.smithi066.stdout:8/56: read f3 [665597,7226] 0 2024-09-12T01:43:01.214 INFO:tasks.workunit.client.1.smithi153.stdout:8/357: rename d17/d1f/d4f/d34/l3b to d17/d21/d3a/d6c/l81 0 2024-09-12T01:43:01.215 INFO:tasks.workunit.client.0.smithi066.stdout:2/44: mkdir de 0 2024-09-12T01:43:01.216 INFO:tasks.workunit.client.1.smithi153.stdout:3/309: truncate d1/d13/d25/d26/f2c 3738813 0 2024-09-12T01:43:01.216 INFO:tasks.workunit.client.1.smithi153.stdout:3/310: creat d1/d45/f61 x:0 0 0 2024-09-12T01:43:01.218 INFO:tasks.workunit.client.1.smithi153.stdout:6/373: dread d1/d6/f4c [0,4194304] 0 2024-09-12T01:43:01.220 INFO:tasks.workunit.client.1.smithi153.stdout:4/229: rename d6/d9/d11/d14/d3e/f54 to d6/d9/d20/f59 0 2024-09-12T01:43:01.220 INFO:tasks.workunit.client.1.smithi153.stdout:4/230: chown d6/d9/d11/f2f 8081567 1 2024-09-12T01:43:01.220 INFO:tasks.workunit.client.1.smithi153.stdout:4/231: creat d6/f5a x:0 0 0 2024-09-12T01:43:01.222 INFO:tasks.workunit.client.1.smithi153.stdout:3/311: rename d1/l46 to d1/d13/d25/d26/l62 0 2024-09-12T01:43:01.222 INFO:tasks.workunit.client.0.smithi066.stdout:8/57: creat f10 x:0 0 0 2024-09-12T01:43:01.222 INFO:tasks.workunit.client.0.smithi066.stdout:8/58: read - fb zero size 2024-09-12T01:43:01.225 INFO:tasks.workunit.client.0.smithi066.stdout:2/45: rename f0 to de/ff 0 2024-09-12T01:43:01.225 INFO:tasks.workunit.client.0.smithi066.stdout:2/46: readlink l3 0 2024-09-12T01:43:01.227 INFO:tasks.workunit.client.1.smithi153.stdout:8/358: dread d17/f24 [0,4194304] 0 2024-09-12T01:43:01.228 INFO:tasks.workunit.client.1.smithi153.stdout:6/374: rename d1/d6/da/d19/d34/f49 to d1/d6/d23/f6e 0 2024-09-12T01:43:01.228 INFO:tasks.workunit.client.0.smithi066.stdout:3/44: dread f3 [0,4194304] 0 2024-09-12T01:43:01.228 INFO:tasks.workunit.client.0.smithi066.stdout:6/71: truncate d2/db/f11 633850 0 2024-09-12T01:43:01.229 INFO:tasks.workunit.client.1.smithi153.stdout:6/375: write d1/d6/d23/f2b [442309,12422] 0 2024-09-12T01:43:01.229 INFO:tasks.workunit.client.1.smithi153.stdout:3/312: symlink d1/d13/d25/l63 0 2024-09-12T01:43:01.231 INFO:tasks.workunit.client.1.smithi153.stdout:8/359: creat d17/d21/d56/f82 x:0 0 0 2024-09-12T01:43:01.233 INFO:tasks.workunit.client.1.smithi153.stdout:4/232: dread d6/d9/d26/f3b [0,4194304] 0 2024-09-12T01:43:01.233 INFO:tasks.workunit.client.0.smithi066.stdout:2/47: rename c7 to de/c10 0 2024-09-12T01:43:01.234 INFO:tasks.workunit.client.0.smithi066.stdout:2/48: chown de 837505 1 2024-09-12T01:43:01.235 INFO:tasks.workunit.client.1.smithi153.stdout:3/313: mkdir d1/d64 0 2024-09-12T01:43:01.235 INFO:tasks.workunit.client.1.smithi153.stdout:3/314: write d1/f19 [6262973,7877] 0 2024-09-12T01:43:01.235 INFO:tasks.workunit.client.1.smithi153.stdout:3/315: write d1/d16/d1c/d32/f43 [773624,83006] 0 2024-09-12T01:43:01.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/233: mknod d6/d15/d38/c5b 0 2024-09-12T01:43:01.239 INFO:tasks.workunit.client.0.smithi066.stdout:3/45: creat d5/d6/f7 x:0 0 0 2024-09-12T01:43:01.239 INFO:tasks.workunit.client.0.smithi066.stdout:3/46: write d5/d6/f7 [677061,116183] 0 2024-09-12T01:43:01.240 INFO:tasks.workunit.client.0.smithi066.stdout:6/72: creat d2/db/f1c x:0 0 0 2024-09-12T01:43:01.241 INFO:tasks.workunit.client.0.smithi066.stdout:1/53: dwrite d5/fa [0,4194304] 0 2024-09-12T01:43:01.241 INFO:tasks.workunit.client.1.smithi153.stdout:9/333: dwrite d3/d3a/d42/f58 [0,4194304] 0 2024-09-12T01:43:01.241 INFO:tasks.workunit.client.1.smithi153.stdout:9/334: fsync d3/d35/f3f 0 2024-09-12T01:43:01.241 INFO:tasks.workunit.client.1.smithi153.stdout:3/316: fsync d1/d16/f27 0 2024-09-12T01:43:01.245 INFO:tasks.workunit.client.1.smithi153.stdout:6/376: dread d1/d6/da/d19/d34/f28 [0,4194304] 0 2024-09-12T01:43:01.248 INFO:tasks.workunit.client.0.smithi066.stdout:3/47: link l1 d5/d6/l8 0 2024-09-12T01:43:01.254 INFO:tasks.workunit.client.0.smithi066.stdout:6/73: mkdir d2/db/d12/d1d 0 2024-09-12T01:43:01.254 INFO:tasks.workunit.client.0.smithi066.stdout:6/74: truncate d2/db/f1c 277822 0 2024-09-12T01:43:01.255 INFO:tasks.workunit.client.0.smithi066.stdout:6/75: write d2/fe [151640,10350] 0 2024-09-12T01:43:01.255 INFO:tasks.workunit.client.0.smithi066.stdout:6/76: rename d2 to d2/db/d12/d1d/d1e 22 2024-09-12T01:43:01.255 INFO:tasks.workunit.client.0.smithi066.stdout:6/77: write d2/fe [418954,112274] 0 2024-09-12T01:43:01.255 INFO:tasks.workunit.client.0.smithi066.stdout:6/78: chown d2/db/d12/c19 804 1 2024-09-12T01:43:01.257 INFO:tasks.workunit.client.0.smithi066.stdout:1/54: read d5/fa [3946418,116222] 0 2024-09-12T01:43:01.264 INFO:tasks.workunit.client.0.smithi066.stdout:1/55: rename d5/f8 to d5/dc/f10 0 2024-09-12T01:43:01.265 INFO:tasks.workunit.client.1.smithi153.stdout:1/310: truncate d2/d9/d1d/d25/f38 106380 0 2024-09-12T01:43:01.266 INFO:tasks.workunit.client.1.smithi153.stdout:9/335: mkdir d3/d5f 0 2024-09-12T01:43:01.266 INFO:tasks.workunit.client.1.smithi153.stdout:9/336: creat d3/d3a/f60 x:0 0 0 2024-09-12T01:43:01.267 INFO:tasks.workunit.client.1.smithi153.stdout:6/377: rename d1/d6/f6d to d1/df/f6f 0 2024-09-12T01:43:01.267 INFO:tasks.workunit.client.1.smithi153.stdout:1/311: link d2/d9/d1d/f30 d2/d9/f5a 0 2024-09-12T01:43:01.268 INFO:tasks.workunit.client.1.smithi153.stdout:9/337: mknod d3/d3a/c61 0 2024-09-12T01:43:01.269 INFO:tasks.workunit.client.1.smithi153.stdout:6/378: mknod d1/d6/c70 0 2024-09-12T01:43:01.270 INFO:tasks.workunit.client.1.smithi153.stdout:6/379: rmdir d1/d6/da/d32/d53/d6c 0 2024-09-12T01:43:01.277 INFO:tasks.workunit.client.0.smithi066.stdout:1/56: dread f1 [0,4194304] 0 2024-09-12T01:43:01.277 INFO:tasks.workunit.client.0.smithi066.stdout:1/57: readlink d5/l6 0 2024-09-12T01:43:01.291 INFO:tasks.workunit.client.1.smithi153.stdout:4/234: dwrite d6/d9/dc/d31/f24 [0,4194304] 0 2024-09-12T01:43:01.291 INFO:tasks.workunit.client.1.smithi153.stdout:4/235: chown d6/d15 3668 1 2024-09-12T01:43:01.291 INFO:tasks.workunit.client.1.smithi153.stdout:4/236: mknod d6/d9/d11/c5c 0 2024-09-12T01:43:01.292 INFO:tasks.workunit.client.0.smithi066.stdout:2/49: dwrite f2 [0,4194304] 0 2024-09-12T01:43:01.293 INFO:tasks.workunit.client.0.smithi066.stdout:6/79: dwrite d2/f5 [0,4194304] 0 2024-09-12T01:43:01.293 INFO:tasks.workunit.client.0.smithi066.stdout:6/80: creat d2/f1f x:0 0 0 2024-09-12T01:43:01.293 INFO:tasks.workunit.client.0.smithi066.stdout:3/48: dwrite d5/d6/f7 [0,4194304] 0 2024-09-12T01:43:01.295 INFO:tasks.workunit.client.0.smithi066.stdout:6/81: symlink d2/db/d12/l20 0 2024-09-12T01:43:01.295 INFO:tasks.workunit.client.1.smithi153.stdout:3/317: dwrite d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:01.296 INFO:tasks.workunit.client.1.smithi153.stdout:1/312: dread d2/d9/f5a [0,4194304] 0 2024-09-12T01:43:01.296 INFO:tasks.workunit.client.1.smithi153.stdout:3/318: fdatasync d1/d13/d25/d26/f44 0 2024-09-12T01:43:01.301 INFO:tasks.workunit.client.1.smithi153.stdout:1/313: link d2/le d2/d9/d1d/d25/l5b 0 2024-09-12T01:43:01.301 INFO:tasks.workunit.client.1.smithi153.stdout:1/314: write d2/d9/f2e [5302,127063] 0 2024-09-12T01:43:01.301 INFO:tasks.workunit.client.1.smithi153.stdout:1/315: truncate d2/d34/d3d/f59 259161 0 2024-09-12T01:43:01.302 INFO:tasks.workunit.client.0.smithi066.stdout:2/50: dread f2 [0,4194304] 0 2024-09-12T01:43:01.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/319: dread d1/d16/f53 [0,4194304] 0 2024-09-12T01:43:01.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/320: chown d1/ce 16745 1 2024-09-12T01:43:01.304 INFO:tasks.workunit.client.0.smithi066.stdout:2/51: symlink de/l11 0 2024-09-12T01:43:01.305 INFO:tasks.workunit.client.0.smithi066.stdout:3/49: write f4 [1359521,17170] 0 2024-09-12T01:43:01.306 INFO:tasks.workunit.client.1.smithi153.stdout:1/316: getdents d2/d9/d17/d2c 0 2024-09-12T01:43:01.306 INFO:tasks.workunit.client.1.smithi153.stdout:1/317: stat d2/d9/d17/d2f/f31 0 2024-09-12T01:43:01.309 INFO:tasks.workunit.client.1.smithi153.stdout:3/321: getdents d1/d16/d17 0 2024-09-12T01:43:01.310 INFO:tasks.workunit.client.1.smithi153.stdout:3/322: chown d1/d13/d25/d26/f5a 7360 1 2024-09-12T01:43:01.317 INFO:tasks.workunit.client.1.smithi153.stdout:4/237: dwrite d6/f5a [0,4194304] 0 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.1.smithi153.stdout:0/345: sync 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.1.smithi153.stdout:5/327: sync 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.1.smithi153.stdout:2/290: sync 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.1.smithi153.stdout:7/305: sync 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.1.smithi153.stdout:0/346: write f15 [4694533,60558] 0 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.0.smithi066.stdout:3/50: dread f2 [0,4194304] 0 2024-09-12T01:43:01.318 INFO:tasks.workunit.client.0.smithi066.stdout:3/51: write f0 [952515,40740] 0 2024-09-12T01:43:01.320 INFO:tasks.workunit.client.1.smithi153.stdout:5/328: dread d0/d15/f46 [0,4194304] 0 2024-09-12T01:43:01.321 INFO:tasks.workunit.client.1.smithi153.stdout:4/238: symlink d6/d9/dc/d42/l5d 0 2024-09-12T01:43:01.321 INFO:tasks.workunit.client.1.smithi153.stdout:2/291: getdents d7/db/d36 0 2024-09-12T01:43:01.324 INFO:tasks.workunit.client.1.smithi153.stdout:7/306: mkdir d12/d21/d5f 0 2024-09-12T01:43:01.324 INFO:tasks.workunit.client.1.smithi153.stdout:3/323: write d1/f1a [400776,34635] 0 2024-09-12T01:43:01.325 INFO:tasks.workunit.client.1.smithi153.stdout:3/324: fdatasync d1/d13/d25/f4c 0 2024-09-12T01:43:01.327 INFO:tasks.workunit.client.0.smithi066.stdout:6/82: dwrite d2/db/f1c [0,4194304] 0 2024-09-12T01:43:01.329 INFO:tasks.workunit.client.1.smithi153.stdout:3/325: unlink d1/l3 0 2024-09-12T01:43:01.329 INFO:tasks.workunit.client.1.smithi153.stdout:3/326: truncate d1/f54 280112 0 2024-09-12T01:43:01.333 INFO:tasks.workunit.client.0.smithi066.stdout:2/52: dwrite f2 [4194304,4194304] 0 2024-09-12T01:43:01.333 INFO:tasks.workunit.client.0.smithi066.stdout:3/52: dread f2 [0,4194304] 0 2024-09-12T01:43:01.333 INFO:tasks.workunit.client.1.smithi153.stdout:1/318: dwrite d2/d34/f53 [0,4194304] 0 2024-09-12T01:43:01.341 INFO:tasks.workunit.client.0.smithi066.stdout:3/53: dread f3 [0,4194304] 0 2024-09-12T01:43:01.343 INFO:tasks.workunit.client.1.smithi153.stdout:4/239: dread d6/d9/d11/d13/f18 [0,4194304] 0 2024-09-12T01:43:01.345 INFO:tasks.workunit.client.1.smithi153.stdout:3/327: rename d1/d16/d1c/d32/l4e to d1/d64/l65 0 2024-09-12T01:43:01.346 INFO:tasks.workunit.client.0.smithi066.stdout:2/53: link de/ff de/f12 0 2024-09-12T01:43:01.349 INFO:tasks.workunit.client.0.smithi066.stdout:3/54: rename f0 to d5/d6/f9 0 2024-09-12T01:43:01.350 INFO:tasks.workunit.client.0.smithi066.stdout:2/54: rmdir de 39 2024-09-12T01:43:01.350 INFO:tasks.workunit.client.1.smithi153.stdout:7/307: rmdir d12/d21 39 2024-09-12T01:43:01.351 INFO:tasks.workunit.client.1.smithi153.stdout:7/308: write d12/f53 [3656981,42071] 0 2024-09-12T01:43:01.351 INFO:tasks.workunit.client.0.smithi066.stdout:3/55: creat d5/fa x:0 0 0 2024-09-12T01:43:01.354 INFO:tasks.workunit.client.0.smithi066.stdout:2/55: mkdir de/d13 0 2024-09-12T01:43:01.354 INFO:tasks.workunit.client.0.smithi066.stdout:2/56: chown fa 228 1 2024-09-12T01:43:01.354 INFO:tasks.workunit.client.0.smithi066.stdout:2/57: chown f4 679548170 1 2024-09-12T01:43:01.356 INFO:tasks.workunit.client.1.smithi153.stdout:3/328: unlink d1/d16/d1c/c2e 0 2024-09-12T01:43:01.357 INFO:tasks.workunit.client.1.smithi153.stdout:7/309: mknod d12/d21/d29/d2d/c60 0 2024-09-12T01:43:01.357 INFO:tasks.workunit.client.1.smithi153.stdout:7/310: readlink d12/d21/d29/d2d/l4a 0 2024-09-12T01:43:01.357 INFO:tasks.workunit.client.1.smithi153.stdout:7/311: chown d12/d21/c28 73769 1 2024-09-12T01:43:01.357 INFO:tasks.workunit.client.1.smithi153.stdout:3/329: creat d1/d59/f66 x:0 0 0 2024-09-12T01:43:01.360 INFO:tasks.workunit.client.0.smithi066.stdout:2/58: dread f6 [0,4194304] 0 2024-09-12T01:43:01.361 INFO:tasks.workunit.client.0.smithi066.stdout:2/59: creat de/f14 x:0 0 0 2024-09-12T01:43:01.361 INFO:tasks.workunit.client.0.smithi066.stdout:2/60: truncate f8 535292 0 2024-09-12T01:43:01.364 INFO:tasks.workunit.client.0.smithi066.stdout:2/61: dread f5 [0,4194304] 0 2024-09-12T01:43:01.364 INFO:tasks.workunit.client.0.smithi066.stdout:2/62: getdents de/d13 0 2024-09-12T01:43:01.365 INFO:tasks.workunit.client.0.smithi066.stdout:2/63: link de/ff de/f15 0 2024-09-12T01:43:01.365 INFO:tasks.workunit.client.0.smithi066.stdout:2/64: write de/f14 [780739,49598] 0 2024-09-12T01:43:01.365 INFO:tasks.workunit.client.0.smithi066.stdout:2/65: chown f9 20953654 1 2024-09-12T01:43:01.371 INFO:tasks.workunit.client.0.smithi066.stdout:3/56: read f2 [4659209,116990] 0 2024-09-12T01:43:01.373 INFO:tasks.workunit.client.1.smithi153.stdout:4/240: dread d6/d9/d26/f47 [0,4194304] 0 2024-09-12T01:43:01.373 INFO:tasks.workunit.client.1.smithi153.stdout:5/329: dwrite d0/d43/d51/f4c [4194304,4194304] 0 2024-09-12T01:43:01.374 INFO:tasks.workunit.client.1.smithi153.stdout:4/241: unlink d6/d9/f25 0 2024-09-12T01:43:01.375 INFO:tasks.workunit.client.1.smithi153.stdout:5/330: read d0/d20/f26 [820940,92181] 0 2024-09-12T01:43:01.376 INFO:tasks.workunit.client.1.smithi153.stdout:5/331: mkdir d0/df/d1c/d69 0 2024-09-12T01:43:01.378 INFO:tasks.workunit.client.0.smithi066.stdout:3/57: getdents d5/d6 0 2024-09-12T01:43:01.378 INFO:tasks.workunit.client.0.smithi066.stdout:3/58: creat d5/fb x:0 0 0 2024-09-12T01:43:01.378 INFO:tasks.workunit.client.0.smithi066.stdout:3/59: dread - d5/fb zero size 2024-09-12T01:43:01.378 INFO:tasks.workunit.client.0.smithi066.stdout:6/83: dwrite d2/db/f1c [0,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:2/292: dwrite d7/db/d27/f3a [0,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:2/293: fsync d7/f51 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:5/332: dread d0/d15/f54 [0,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:1/319: dwrite d2/d9/f1b [4194304,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:3/330: dwrite d1/d13/f37 [0,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:0/347: dwrite f18 [0,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/242: dread d6/d9/d11/d13/f18 [0,4194304] 0 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/243: chown d6/d15/f4c 39 1 2024-09-12T01:43:01.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/244: creat d6/d9/d11/d14/d3e/f5e x:0 0 0 2024-09-12T01:43:01.380 INFO:tasks.workunit.client.1.smithi153.stdout:4/245: write d6/d9/d11/d14/f3f [3850698,111399] 0 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:1/320: dread d2/d9/d1d/d25/f38 [0,4194304] 0 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:2/294: mknod d7/db/c5e 0 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:2/295: truncate d7/d17/f48 883855 0 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:2/296: write d7/d19/d40/f23 [41230,47028] 0 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:2/297: chown d7/db/d36/f42 1926473 1 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:9/338: sync 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:6/380: sync 2024-09-12T01:43:01.381 INFO:tasks.workunit.client.1.smithi153.stdout:8/360: sync 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/361: fdatasync d17/d21/d3a/d6c/f80 0 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/362: chown d17/d21/l77 881479582 1 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/363: chown d17/d1f/d4f/d42/d67 9262 1 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/364: write d17/f28 [617378,37973] 0 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.1.smithi153.stdout:1/321: dread d2/d9/d17/d2f/f31 [0,4194304] 0 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.1.smithi153.stdout:1/322: chown d2/d9/d1d/c42 918409 1 2024-09-12T01:43:01.382 INFO:tasks.workunit.client.0.smithi066.stdout:3/60: mknod d5/d6/cc 0 2024-09-12T01:43:01.383 INFO:tasks.workunit.client.0.smithi066.stdout:6/84: mkdir d2/d21 0 2024-09-12T01:43:01.383 INFO:tasks.workunit.client.0.smithi066.stdout:6/85: readlink d2/db/l17 0 2024-09-12T01:43:01.385 INFO:tasks.workunit.client.1.smithi153.stdout:5/333: creat d0/df/d50/f6a x:0 0 0 2024-09-12T01:43:01.385 INFO:tasks.workunit.client.1.smithi153.stdout:5/334: write d0/f12 [714288,52219] 0 2024-09-12T01:43:01.387 INFO:tasks.workunit.client.0.smithi066.stdout:6/86: dread - d2/db/fc zero size 2024-09-12T01:43:01.387 INFO:tasks.workunit.client.0.smithi066.stdout:6/87: getdents d2/db/d12/d1d 0 2024-09-12T01:43:01.387 INFO:tasks.workunit.client.0.smithi066.stdout:3/61: write f2 [1009923,12218] 0 2024-09-12T01:43:01.388 INFO:tasks.workunit.client.0.smithi066.stdout:6/88: dread d2/f1a [0,4194304] 0 2024-09-12T01:43:01.390 INFO:tasks.workunit.client.0.smithi066.stdout:3/62: truncate d5/d6/f9 1471157 0 2024-09-12T01:43:01.391 INFO:tasks.workunit.client.1.smithi153.stdout:3/331: unlink d1/d13/d25/d26/l62 0 2024-09-12T01:43:01.391 INFO:tasks.workunit.client.1.smithi153.stdout:3/332: getdents d1/d16/d17 0 2024-09-12T01:43:01.392 INFO:tasks.workunit.client.1.smithi153.stdout:0/348: mkdir d22/d79 0 2024-09-12T01:43:01.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/246: rename d6/d9/ld to d6/d9/dc/l5f 0 2024-09-12T01:43:01.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/247: truncate d6/d9/dc/f3a 565163 0 2024-09-12T01:43:01.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/298: creat d7/db/d1d/d4a/f5f x:0 0 0 2024-09-12T01:43:01.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/299: write d7/fe [619525,5579] 0 2024-09-12T01:43:01.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/300: truncate d7/d19/f4f 1430181 0 2024-09-12T01:43:01.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/301: chown d7/d17/f48 695354 1 2024-09-12T01:43:01.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/302: stat d7/d19/d40/f37 0 2024-09-12T01:43:01.397 INFO:tasks.workunit.client.1.smithi153.stdout:9/339: mkdir d3/d5f/d62 0 2024-09-12T01:43:01.399 INFO:tasks.workunit.client.1.smithi153.stdout:8/365: dwrite d17/d1d/d27/f35 [0,4194304] 0 2024-09-12T01:43:01.401 INFO:tasks.workunit.client.1.smithi153.stdout:6/381: symlink d1/d6/d23/l71 0 2024-09-12T01:43:01.401 INFO:tasks.workunit.client.1.smithi153.stdout:6/382: rename d1/d6 to d1/d6/da/d32/d53/d69/d72 22 2024-09-12T01:43:01.402 INFO:tasks.workunit.client.1.smithi153.stdout:9/340: dread d3/d55/d30/f39 [0,4194304] 0 2024-09-12T01:43:01.402 INFO:tasks.workunit.client.1.smithi153.stdout:1/323: creat d2/d9/d17/d2f/d56/f5c x:0 0 0 2024-09-12T01:43:01.403 INFO:tasks.workunit.client.1.smithi153.stdout:5/335: creat d0/d43/f6b x:0 0 0 2024-09-12T01:43:01.404 INFO:tasks.workunit.client.1.smithi153.stdout:5/336: dread - d0/df/d50/f6a zero size 2024-09-12T01:43:01.404 INFO:tasks.workunit.client.1.smithi153.stdout:5/337: chown d0/d43/d51/l31 0 1 2024-09-12T01:43:01.406 INFO:tasks.workunit.client.1.smithi153.stdout:4/248: symlink d6/d9/dc/l60 0 2024-09-12T01:43:01.407 INFO:tasks.workunit.client.1.smithi153.stdout:4/249: creat d6/d9/d11/d14/d3e/f61 x:0 0 0 2024-09-12T01:43:01.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/366: mknod d17/d1f/c83 0 2024-09-12T01:43:01.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/367: chown d17/d21/c2b 30766 1 2024-09-12T01:43:01.409 INFO:tasks.workunit.client.1.smithi153.stdout:4/250: write d6/d9/dc/f3a [187892,87742] 0 2024-09-12T01:43:01.410 INFO:tasks.workunit.client.1.smithi153.stdout:6/383: mkdir d1/d6/d46/d73 0 2024-09-12T01:43:01.411 INFO:tasks.workunit.client.1.smithi153.stdout:9/341: creat d3/f63 x:0 0 0 2024-09-12T01:43:01.412 INFO:tasks.workunit.client.0.smithi066.stdout:6/89: write d2/f5 [3967847,105890] 0 2024-09-12T01:43:01.412 INFO:tasks.workunit.client.0.smithi066.stdout:6/90: creat d2/f22 x:0 0 0 2024-09-12T01:43:01.413 INFO:tasks.workunit.client.0.smithi066.stdout:6/91: write d2/f1f [27012,79097] 0 2024-09-12T01:43:01.414 INFO:tasks.workunit.client.1.smithi153.stdout:1/324: truncate d2/d9/f2e 584828 0 2024-09-12T01:43:01.416 INFO:tasks.workunit.client.1.smithi153.stdout:5/338: truncate d0/d15/f54 797290 0 2024-09-12T01:43:01.416 INFO:tasks.workunit.client.1.smithi153.stdout:5/339: read - d0/d20/f65 zero size 2024-09-12T01:43:01.418 INFO:tasks.workunit.client.0.smithi066.stdout:6/92: symlink d2/d21/l23 0 2024-09-12T01:43:01.418 INFO:tasks.workunit.client.0.smithi066.stdout:6/93: write d2/db/fc [355945,92188] 0 2024-09-12T01:43:01.418 INFO:tasks.workunit.client.0.smithi066.stdout:6/94: chown d2/db 484 1 2024-09-12T01:43:01.426 INFO:tasks.workunit.client.1.smithi153.stdout:8/368: truncate f14 3272064 0 2024-09-12T01:43:01.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/384: symlink d1/d6/da/d32/d62/l74 0 2024-09-12T01:43:01.428 INFO:tasks.workunit.client.1.smithi153.stdout:3/333: dwrite d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:01.429 INFO:tasks.workunit.client.1.smithi153.stdout:6/385: mknod d1/d6/da/d32/d53/d69/c75 0 2024-09-12T01:43:01.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/349: dwrite d22/d30/d4c/d6e/f48 [0,4194304] 0 2024-09-12T01:43:01.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/350: dread - d22/d30/f67 zero size 2024-09-12T01:43:01.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/351: creat d22/f7a x:0 0 0 2024-09-12T01:43:01.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/352: chown d22/f26 7030285 1 2024-09-12T01:43:01.439 INFO:tasks.workunit.client.0.smithi066.stdout:3/63: dwrite f2 [4194304,4194304] 0 2024-09-12T01:43:01.441 INFO:tasks.workunit.client.1.smithi153.stdout:0/353: creat d22/d30/d4c/d6e/f7b x:0 0 0 2024-09-12T01:43:01.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/354: symlink d22/d79/l7c 0 2024-09-12T01:43:01.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/355: stat d22/d30/d4c/d6e/f3f 0 2024-09-12T01:43:01.442 INFO:tasks.workunit.client.1.smithi153.stdout:0/356: chown d22/d30/d4c/d6e/c4a 355 1 2024-09-12T01:43:01.443 INFO:tasks.workunit.client.1.smithi153.stdout:3/334: write d1/d16/f53 [5964133,130891] 0 2024-09-12T01:43:01.443 INFO:tasks.workunit.client.1.smithi153.stdout:3/335: fdatasync d1/d13/d25/d26/f2c 0 2024-09-12T01:43:01.454 INFO:tasks.workunit.client.1.smithi153.stdout:2/303: dwrite f2 [0,4194304] 0 2024-09-12T01:43:01.454 INFO:tasks.workunit.client.1.smithi153.stdout:1/325: dwrite d2/d34/f39 [4194304,4194304] 0 2024-09-12T01:43:01.455 INFO:tasks.workunit.client.1.smithi153.stdout:2/304: getdents d7/db/d27/d56 0 2024-09-12T01:43:01.462 INFO:tasks.workunit.client.1.smithi153.stdout:3/336: dread d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:01.463 INFO:tasks.workunit.client.1.smithi153.stdout:6/386: dwrite d1/d6/da/f5a [4194304,4194304] 0 2024-09-12T01:43:01.463 INFO:tasks.workunit.client.1.smithi153.stdout:9/342: dwrite d3/d3a/f5a [0,4194304] 0 2024-09-12T01:43:01.463 INFO:tasks.workunit.client.1.smithi153.stdout:9/343: chown d3/f5 259914510 1 2024-09-12T01:43:01.463 INFO:tasks.workunit.client.1.smithi153.stdout:9/344: write d3/d55/f57 [136627,80200] 0 2024-09-12T01:43:01.463 INFO:tasks.workunit.client.1.smithi153.stdout:9/345: readlink d3/d3a/d42/l4e 0 2024-09-12T01:43:01.464 INFO:tasks.workunit.client.0.smithi066.stdout:6/95: dwrite d2/f5 [0,4194304] 0 2024-09-12T01:43:01.466 INFO:tasks.workunit.client.1.smithi153.stdout:2/305: dread d7/db/d1d/d1e/f26 [0,4194304] 0 2024-09-12T01:43:01.466 INFO:tasks.workunit.client.1.smithi153.stdout:2/306: creat d7/db/d1d/f60 x:0 0 0 2024-09-12T01:43:01.466 INFO:tasks.workunit.client.1.smithi153.stdout:2/307: truncate d7/db/d1d/f5d 678704 0 2024-09-12T01:43:01.468 INFO:tasks.workunit.client.1.smithi153.stdout:1/326: write d2/d9/d1d/d25/f35 [594975,96390] 0 2024-09-12T01:43:01.475 INFO:tasks.workunit.client.1.smithi153.stdout:2/308: symlink d7/d19/d40/l61 0 2024-09-12T01:43:01.478 INFO:tasks.workunit.client.1.smithi153.stdout:1/327: symlink d2/d34/l5d 0 2024-09-12T01:43:01.480 INFO:tasks.workunit.client.1.smithi153.stdout:1/328: mknod d2/d9/d58/c5e 0 2024-09-12T01:43:01.486 INFO:tasks.workunit.client.0.smithi066.stdout:6/96: dwrite d2/ff [0,4194304] 0 2024-09-12T01:43:01.488 INFO:tasks.workunit.client.1.smithi153.stdout:3/337: dwrite d1/f11 [0,4194304] 0 2024-09-12T01:43:01.488 INFO:tasks.workunit.client.0.smithi066.stdout:6/97: mknod d2/db/d12/c24 0 2024-09-12T01:43:01.488 INFO:tasks.workunit.client.0.smithi066.stdout:6/98: write d2/f1a [904330,1446] 0 2024-09-12T01:43:01.491 INFO:tasks.workunit.client.0.smithi066.stdout:6/99: rename d2/db/d12/f18 to d2/d21/f25 0 2024-09-12T01:43:01.493 INFO:tasks.workunit.client.0.smithi066.stdout:6/100: creat d2/db/d12/d1d/f26 x:0 0 0 2024-09-12T01:43:01.495 INFO:tasks.workunit.client.0.smithi066.stdout:6/101: link d2/f1a d2/db/f27 0 2024-09-12T01:43:01.495 INFO:tasks.workunit.client.0.smithi066.stdout:6/102: readlink d2/db/d12/l20 0 2024-09-12T01:43:01.506 INFO:tasks.workunit.client.1.smithi153.stdout:6/387: dwrite d1/d6/f4c [4194304,4194304] 0 2024-09-12T01:43:01.507 INFO:tasks.workunit.client.1.smithi153.stdout:6/388: readlink d1/d6/da/d32/d62/l74 0 2024-09-12T01:43:01.509 INFO:tasks.workunit.client.1.smithi153.stdout:6/389: rename d1/d6/da/d19/d34/d33 to d1/d6/d39/d76 0 2024-09-12T01:43:01.509 INFO:tasks.workunit.client.1.smithi153.stdout:6/390: creat d1/d6/da/d32/d53/f77 x:0 0 0 2024-09-12T01:43:01.509 INFO:tasks.workunit.client.1.smithi153.stdout:6/391: read d1/f4 [7341651,72728] 0 2024-09-12T01:43:01.509 INFO:tasks.workunit.client.1.smithi153.stdout:6/392: creat d1/d6/da/d32/d53/f78 x:0 0 0 2024-09-12T01:43:01.510 INFO:tasks.workunit.client.1.smithi153.stdout:2/309: dwrite f2 [4194304,4194304] 0 2024-09-12T01:43:01.510 INFO:tasks.workunit.client.1.smithi153.stdout:3/338: dread d1/d16/d1c/f2d [0,4194304] 0 2024-09-12T01:43:01.511 INFO:tasks.workunit.client.1.smithi153.stdout:1/329: dwrite d2/d9/d17/d2c/f4d [0,4194304] 0 2024-09-12T01:43:01.511 INFO:tasks.workunit.client.1.smithi153.stdout:3/339: chown d1/d45/f51 1563336054 1 2024-09-12T01:43:01.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/393: getdents d1/d6/da/d19/d3a 0 2024-09-12T01:43:01.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/394: write d1/f38 [4925574,101744] 0 2024-09-12T01:43:01.513 INFO:tasks.workunit.client.1.smithi153.stdout:2/310: dread d7/db/f30 [0,4194304] 0 2024-09-12T01:43:01.514 INFO:tasks.workunit.client.0.smithi066.stdout:6/103: getdents d2/db/d12 0 2024-09-12T01:43:01.516 INFO:tasks.workunit.client.1.smithi153.stdout:1/330: write d2/d9/d1d/d25/f44 [933443,79619] 0 2024-09-12T01:43:01.516 INFO:tasks.workunit.client.1.smithi153.stdout:1/331: truncate d2/d9/f1a 963533 0 2024-09-12T01:43:01.516 INFO:tasks.workunit.client.1.smithi153.stdout:1/332: creat d2/d9/d1d/d25/f5f x:0 0 0 2024-09-12T01:43:01.517 INFO:tasks.workunit.client.1.smithi153.stdout:3/340: creat d1/d16/d17/f67 x:0 0 0 2024-09-12T01:43:01.519 INFO:tasks.workunit.client.1.smithi153.stdout:6/395: creat d1/d6/d39/d76/f79 x:0 0 0 2024-09-12T01:43:01.521 INFO:tasks.workunit.client.1.smithi153.stdout:2/311: mkdir d7/db/d62 0 2024-09-12T01:43:01.523 INFO:tasks.workunit.client.1.smithi153.stdout:1/333: symlink d2/d9/d28/l60 0 2024-09-12T01:43:01.524 INFO:tasks.workunit.client.1.smithi153.stdout:3/341: mkdir d1/d16/d1c/d68 0 2024-09-12T01:43:01.525 INFO:tasks.workunit.client.1.smithi153.stdout:3/342: read d1/d16/d17/f18 [680803,110495] 0 2024-09-12T01:43:01.525 INFO:tasks.workunit.client.1.smithi153.stdout:6/396: mknod d1/d6/d39/d76/c7a 0 2024-09-12T01:43:01.526 INFO:tasks.workunit.client.1.smithi153.stdout:1/334: symlink d2/d34/l61 0 2024-09-12T01:43:01.529 INFO:tasks.workunit.client.0.smithi066.stdout:6/104: dwrite d2/f22 [0,4194304] 0 2024-09-12T01:43:01.529 INFO:tasks.workunit.client.1.smithi153.stdout:1/335: creat d2/d9/d1d/f62 x:0 0 0 2024-09-12T01:43:01.531 INFO:tasks.workunit.client.0.smithi066.stdout:6/105: mknod d2/db/c28 0 2024-09-12T01:43:01.531 INFO:tasks.workunit.client.0.smithi066.stdout:6/106: truncate d2/db/d12/d1d/f26 631857 0 2024-09-12T01:43:01.531 INFO:tasks.workunit.client.1.smithi153.stdout:7/312: sync 2024-09-12T01:43:01.531 INFO:tasks.workunit.client.1.smithi153.stdout:3/343: read d1/d16/d1c/f33 [2045964,117510] 0 2024-09-12T01:43:01.531 INFO:tasks.workunit.client.1.smithi153.stdout:3/344: read - d1/d45/f58 zero size 2024-09-12T01:43:01.531 INFO:tasks.workunit.client.1.smithi153.stdout:3/345: read d1/f5 [1548103,14908] 0 2024-09-12T01:43:01.532 INFO:tasks.workunit.client.0.smithi066.stdout:6/107: link d2/l8 d2/db/d12/l29 0 2024-09-12T01:43:01.532 INFO:tasks.workunit.client.0.smithi066.stdout:6/108: creat d2/f2a x:0 0 0 2024-09-12T01:43:01.532 INFO:tasks.workunit.client.1.smithi153.stdout:7/313: symlink d12/d21/d29/d35/d37/l61 0 2024-09-12T01:43:01.532 INFO:tasks.workunit.client.1.smithi153.stdout:7/314: chown d12/l4b 159459427 1 2024-09-12T01:43:01.532 INFO:tasks.workunit.client.1.smithi153.stdout:7/315: chown d12/d21/d29/d35/d3c/c5b 7133947 1 2024-09-12T01:43:01.533 INFO:tasks.workunit.client.1.smithi153.stdout:3/346: rename d1/d13/d25/d26/f2c to d1/d16/f69 0 2024-09-12T01:43:01.534 INFO:tasks.workunit.client.0.smithi066.stdout:6/109: rename d2/ff to d2/db/d12/d1d/f2b 0 2024-09-12T01:43:01.544 INFO:tasks.workunit.client.1.smithi153.stdout:1/336: dread d2/d34/f39 [0,4194304] 0 2024-09-12T01:43:01.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/337: unlink d2/d9/l1c 0 2024-09-12T01:43:01.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/338: truncate d2/d9/d17/d2f/f31 1365811 0 2024-09-12T01:43:01.552 INFO:tasks.workunit.client.1.smithi153.stdout:7/316: write d12/f16 [3213808,72445] 0 2024-09-12T01:43:01.552 INFO:tasks.workunit.client.1.smithi153.stdout:7/317: truncate d12/d21/d29/f3f 1893616 0 2024-09-12T01:43:01.554 INFO:tasks.workunit.client.1.smithi153.stdout:7/318: creat d12/d21/d29/d35/d37/d4c/f62 x:0 0 0 2024-09-12T01:43:01.554 INFO:tasks.workunit.client.1.smithi153.stdout:7/319: chown d12/d21/d29/d35/d37/d58/l5e 2362 1 2024-09-12T01:43:01.554 INFO:tasks.workunit.client.1.smithi153.stdout:7/320: chown d12/d21/d29/d35/d37/c51 495328 1 2024-09-12T01:43:01.560 INFO:tasks.workunit.client.1.smithi153.stdout:6/397: dwrite d1/d6/da/f5a [4194304,4194304] 0 2024-09-12T01:43:01.561 INFO:tasks.workunit.client.1.smithi153.stdout:2/312: dwrite d7/d19/d40/f37 [0,4194304] 0 2024-09-12T01:43:01.561 INFO:tasks.workunit.client.1.smithi153.stdout:2/313: creat d7/db/d1d/d4a/f63 x:0 0 0 2024-09-12T01:43:01.562 INFO:tasks.workunit.client.1.smithi153.stdout:6/398: dread d1/d6/f44 [0,4194304] 0 2024-09-12T01:43:01.563 INFO:tasks.workunit.client.0.smithi066.stdout:6/110: dwrite d2/db/d12/d1d/f26 [0,4194304] 0 2024-09-12T01:43:01.568 INFO:tasks.workunit.client.0.smithi066.stdout:6/111: rename d2/db/fc to d2/d21/f2c 0 2024-09-12T01:43:01.572 INFO:tasks.workunit.client.1.smithi153.stdout:2/314: link d7/db/f39 d7/db/f64 0 2024-09-12T01:43:01.572 INFO:tasks.workunit.client.1.smithi153.stdout:2/315: read d7/db/d27/f4c [394147,60862] 0 2024-09-12T01:43:01.572 INFO:tasks.workunit.client.1.smithi153.stdout:2/316: getdents d7/db/d27/d56 0 2024-09-12T01:43:01.573 INFO:tasks.workunit.client.1.smithi153.stdout:6/399: truncate d1/df/f50 686582 0 2024-09-12T01:43:01.578 INFO:tasks.workunit.client.1.smithi153.stdout:2/317: dread d7/f51 [0,4194304] 0 2024-09-12T01:43:01.579 INFO:tasks.workunit.client.1.smithi153.stdout:7/321: dwrite d12/f1b [0,4194304] 0 2024-09-12T01:43:01.579 INFO:tasks.workunit.client.1.smithi153.stdout:7/322: dread - d12/d21/d29/f3b zero size 2024-09-12T01:43:01.580 INFO:tasks.workunit.client.1.smithi153.stdout:1/339: dwrite d2/d9/d17/f48 [4194304,4194304] 0 2024-09-12T01:43:01.583 INFO:tasks.workunit.client.1.smithi153.stdout:7/323: rename d12/f16 to d12/d21/d29/d35/d37/d58/f63 0 2024-09-12T01:43:01.585 INFO:tasks.workunit.client.1.smithi153.stdout:7/324: mknod d12/d4e/c64 0 2024-09-12T01:43:01.589 INFO:tasks.workunit.client.1.smithi153.stdout:4/251: sync 2024-09-12T01:43:01.590 INFO:tasks.workunit.client.1.smithi153.stdout:4/252: creat d6/d9/d26/f62 x:0 0 0 2024-09-12T01:43:01.590 INFO:tasks.workunit.client.1.smithi153.stdout:4/253: truncate d6/d9/dc/f3a 645969 0 2024-09-12T01:43:01.590 INFO:tasks.workunit.client.1.smithi153.stdout:4/254: stat d6/d9/d11/d14/f2a 0 2024-09-12T01:43:01.590 INFO:tasks.workunit.client.1.smithi153.stdout:4/255: readlink d6/d9/d20/l55 0 2024-09-12T01:43:01.590 INFO:tasks.workunit.client.0.smithi066.stdout:6/112: dread d2/d21/f25 [0,4194304] 0 2024-09-12T01:43:01.592 INFO:tasks.workunit.client.1.smithi153.stdout:5/340: sync 2024-09-12T01:43:01.592 INFO:tasks.workunit.client.0.smithi066.stdout:6/113: creat d2/db/f2d x:0 0 0 2024-09-12T01:43:01.592 INFO:tasks.workunit.client.0.smithi066.stdout:6/114: rename d2 to d2/db/d12/d1d/d2e 22 2024-09-12T01:43:01.595 INFO:tasks.workunit.client.0.smithi066.stdout:6/115: symlink d2/db/d12/l2f 0 2024-09-12T01:43:01.595 INFO:tasks.workunit.client.1.smithi153.stdout:7/325: dread d12/d21/d4d/f5d [8388608,4194304] 0 2024-09-12T01:43:01.610 INFO:tasks.workunit.client.0.smithi066.stdout:6/116: write d2/f22 [1067661,83598] 0 2024-09-12T01:43:01.611 INFO:tasks.workunit.client.1.smithi153.stdout:5/341: dread d0/f1f [0,4194304] 0 2024-09-12T01:43:01.611 INFO:tasks.workunit.client.0.smithi066.stdout:6/117: creat d2/d21/f30 x:0 0 0 2024-09-12T01:43:01.611 INFO:tasks.workunit.client.0.smithi066.stdout:6/118: readlink d2/db/d12/l2f 0 2024-09-12T01:43:01.613 INFO:tasks.workunit.client.1.smithi153.stdout:2/318: dwrite d7/f1c [0,4194304] 0 2024-09-12T01:43:01.613 INFO:tasks.workunit.client.1.smithi153.stdout:2/319: rmdir d7/db 39 2024-09-12T01:43:01.620 INFO:tasks.workunit.client.1.smithi153.stdout:6/400: dread d1/df/f50 [0,4194304] 0 2024-09-12T01:43:01.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/342: dread d0/df/f4f [0,4194304] 0 2024-09-12T01:43:01.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/343: fsync d0/f12 0 2024-09-12T01:43:01.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/344: creat d0/d43/f6c x:0 0 0 2024-09-12T01:43:01.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/345: chown d0/df/d50/d58 115619091 1 2024-09-12T01:43:01.621 INFO:tasks.workunit.client.1.smithi153.stdout:1/340: dwrite d2/d9/d17/f48 [0,4194304] 0 2024-09-12T01:43:01.621 INFO:tasks.workunit.client.1.smithi153.stdout:4/256: dwrite d6/d9/d11/d14/f3f [0,4194304] 0 2024-09-12T01:43:01.621 INFO:tasks.workunit.client.1.smithi153.stdout:4/257: creat d6/f63 x:0 0 0 2024-09-12T01:43:01.621 INFO:tasks.workunit.client.1.smithi153.stdout:4/258: write d6/d9/d11/d14/f57 [188488,34374] 0 2024-09-12T01:43:01.622 INFO:tasks.workunit.client.1.smithi153.stdout:6/401: symlink d1/d6/d39/d76/l7b 0 2024-09-12T01:43:01.622 INFO:tasks.workunit.client.1.smithi153.stdout:7/326: dwrite d12/d21/d29/f3b [0,4194304] 0 2024-09-12T01:43:01.622 INFO:tasks.workunit.client.1.smithi153.stdout:7/327: write d12/d21/f49 [1075227,93310] 0 2024-09-12T01:43:01.627 INFO:tasks.workunit.client.0.smithi066.stdout:6/119: write d2/db/d12/d1d/f2b [3613608,39511] 0 2024-09-12T01:43:01.629 INFO:tasks.workunit.client.0.smithi066.stdout:6/120: mkdir d2/d31 0 2024-09-12T01:43:01.629 INFO:tasks.workunit.client.0.smithi066.stdout:6/121: stat d2/db/d12/d1d/f26 0 2024-09-12T01:43:01.629 INFO:tasks.workunit.client.0.smithi066.stdout:6/122: chown d2/db/f2d 15 1 2024-09-12T01:43:01.633 INFO:tasks.workunit.client.1.smithi153.stdout:7/328: dread d12/f26 [0,4194304] 0 2024-09-12T01:43:01.633 INFO:tasks.workunit.client.1.smithi153.stdout:7/329: fsync fe 0 2024-09-12T01:43:01.634 INFO:tasks.workunit.client.0.smithi066.stdout:6/123: rmdir d2/db/d12/d1d 39 2024-09-12T01:43:01.638 INFO:tasks.workunit.client.1.smithi153.stdout:1/341: dread d2/d34/f53 [0,4194304] 0 2024-09-12T01:43:01.639 INFO:tasks.workunit.client.1.smithi153.stdout:5/346: rmdir d0/df 39 2024-09-12T01:43:01.640 INFO:tasks.workunit.client.1.smithi153.stdout:5/347: fdatasync d0/d20/f4a 0 2024-09-12T01:43:01.640 INFO:tasks.workunit.client.1.smithi153.stdout:6/402: rmdir d1/d6/da/d19 39 2024-09-12T01:43:01.641 INFO:tasks.workunit.client.1.smithi153.stdout:6/403: dread - d1/df/f6f zero size 2024-09-12T01:43:01.641 INFO:tasks.workunit.client.1.smithi153.stdout:5/348: dread d0/d15/f54 [0,4194304] 0 2024-09-12T01:43:01.641 INFO:tasks.workunit.client.1.smithi153.stdout:5/349: chown d0/d43/f6b 663 1 2024-09-12T01:43:01.641 INFO:tasks.workunit.client.0.smithi066.stdout:6/124: fsync d2/db/f27 0 2024-09-12T01:43:01.641 INFO:tasks.workunit.client.0.smithi066.stdout:6/125: fdatasync d2/f1f 0 2024-09-12T01:43:01.642 INFO:tasks.workunit.client.1.smithi153.stdout:1/342: mknod d2/d9/d17/d54/c63 0 2024-09-12T01:43:01.642 INFO:tasks.workunit.client.1.smithi153.stdout:1/343: truncate d2/d9/d17/f41 1259025 0 2024-09-12T01:43:01.642 INFO:tasks.workunit.client.1.smithi153.stdout:6/404: mkdir d1/d6/da/d32/d53/d69/d7c 0 2024-09-12T01:43:01.643 INFO:tasks.workunit.client.1.smithi153.stdout:5/350: symlink d0/df/d1c/d69/l6d 0 2024-09-12T01:43:01.643 INFO:tasks.workunit.client.1.smithi153.stdout:5/351: write d0/d15/f54 [27439,88527] 0 2024-09-12T01:43:01.645 INFO:tasks.workunit.client.1.smithi153.stdout:6/405: rmdir d1/d6/da/d32/d62 39 2024-09-12T01:43:01.645 INFO:tasks.workunit.client.1.smithi153.stdout:1/344: creat d2/d9/f64 x:0 0 0 2024-09-12T01:43:01.647 INFO:tasks.workunit.client.1.smithi153.stdout:2/320: dwrite d7/db/d36/f42 [0,4194304] 0 2024-09-12T01:43:01.648 INFO:tasks.workunit.client.1.smithi153.stdout:2/321: dread d7/db/d27/f4c [0,4194304] 0 2024-09-12T01:43:01.649 INFO:tasks.workunit.client.1.smithi153.stdout:9/346: sync 2024-09-12T01:43:01.649 INFO:tasks.workunit.client.1.smithi153.stdout:0/357: sync 2024-09-12T01:43:01.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/369: sync 2024-09-12T01:43:01.649 INFO:tasks.workunit.client.1.smithi153.stdout:3/347: sync 2024-09-12T01:43:01.649 INFO:tasks.workunit.client.1.smithi153.stdout:4/259: dwrite d6/d9/d26/f3b [0,4194304] 0 2024-09-12T01:43:01.650 INFO:tasks.workunit.client.1.smithi153.stdout:2/322: link d7/d19/f4f d7/d17/f65 0 2024-09-12T01:43:01.650 INFO:tasks.workunit.client.1.smithi153.stdout:9/347: truncate d3/d55/f32 3378508 0 2024-09-12T01:43:01.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/358: mknod d22/c7d 0 2024-09-12T01:43:01.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/359: write d22/d30/d4c/d6f/f70 [309641,124406] 0 2024-09-12T01:43:01.653 INFO:tasks.workunit.client.1.smithi153.stdout:8/370: getdents d17/d1f/d4f/d42 0 2024-09-12T01:43:01.653 INFO:tasks.workunit.client.1.smithi153.stdout:8/371: fdatasync d17/d1f/d4f/f5c 0 2024-09-12T01:43:01.653 INFO:tasks.workunit.client.1.smithi153.stdout:8/372: chown d17/d1d/f41 8037668 1 2024-09-12T01:43:01.653 INFO:tasks.workunit.client.1.smithi153.stdout:8/373: creat d17/d21/d56/f84 x:0 0 0 2024-09-12T01:43:01.653 INFO:tasks.workunit.client.1.smithi153.stdout:8/374: truncate d17/f28 1186865 0 2024-09-12T01:43:01.654 INFO:tasks.workunit.client.1.smithi153.stdout:3/348: mknod d1/d64/c6a 0 2024-09-12T01:43:01.655 INFO:tasks.workunit.client.0.smithi066.stdout:6/126: truncate d2/f5 3710119 0 2024-09-12T01:43:01.655 INFO:tasks.workunit.client.0.smithi066.stdout:6/127: dread - d2/f2a zero size 2024-09-12T01:43:01.656 INFO:tasks.workunit.client.0.smithi066.stdout:6/128: readlink d2/db/d12/l29 0 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:6/406: read d1/f5e [2866359,24754] 0 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:6/407: chown d1/d6/da/d32/d4f/c5b 84256825 1 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/330: dwrite d12/f33 [0,4194304] 0 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/331: readlink d12/d21/d29/d2d/l42 0 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/323: rmdir d7/d19 39 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:2/324: chown d7/db/f30 31687300 1 2024-09-12T01:43:01.657 INFO:tasks.workunit.client.1.smithi153.stdout:4/260: write f0 [4709664,901] 0 2024-09-12T01:43:01.658 INFO:tasks.workunit.client.1.smithi153.stdout:0/360: symlink d22/d30/l7e 0 2024-09-12T01:43:01.658 INFO:tasks.workunit.client.1.smithi153.stdout:0/361: chown d22/d30/f67 0 1 2024-09-12T01:43:01.659 INFO:tasks.workunit.client.1.smithi153.stdout:8/375: creat d17/f85 x:0 0 0 2024-09-12T01:43:01.659 INFO:tasks.workunit.client.1.smithi153.stdout:8/376: fsync d17/d1d/f73 0 2024-09-12T01:43:01.659 INFO:tasks.workunit.client.1.smithi153.stdout:8/377: fdatasync d17/d21/d3a/d6c/f80 0 2024-09-12T01:43:01.660 INFO:tasks.workunit.client.1.smithi153.stdout:3/349: mknod d1/d45/c6b 0 2024-09-12T01:43:01.662 INFO:tasks.workunit.client.1.smithi153.stdout:6/408: creat d1/d6/da/d32/d53/d69/f7d x:0 0 0 2024-09-12T01:43:01.665 INFO:tasks.workunit.client.1.smithi153.stdout:2/325: truncate d7/fe 27147 0 2024-09-12T01:43:01.668 INFO:tasks.workunit.client.1.smithi153.stdout:8/378: creat d17/d1f/d4f/d42/f86 x:0 0 0 2024-09-12T01:43:01.669 INFO:tasks.workunit.client.1.smithi153.stdout:8/379: fdatasync d17/f28 0 2024-09-12T01:43:01.669 INFO:tasks.workunit.client.1.smithi153.stdout:2/326: dread d7/d17/f65 [0,4194304] 0 2024-09-12T01:43:01.669 INFO:tasks.workunit.client.1.smithi153.stdout:9/348: write d3/f5 [3747589,120698] 0 2024-09-12T01:43:01.669 INFO:tasks.workunit.client.1.smithi153.stdout:9/349: truncate d3/d55/d30/f31 1604119 0 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:0/362: dread d22/d30/f42 [0,4194304] 0 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:0/363: write f6 [5579303,23929] 0 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:2/327: write d7/db/d1d/f5d [389988,13549] 0 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:2/328: chown d7/db/d27 0 1 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:2/329: chown d7/d19/c44 19808 1 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:6/409: rename d1/d6/d39/f57 to d1/d6/da/d19/d3a/f7e 0 2024-09-12T01:43:01.670 INFO:tasks.workunit.client.1.smithi153.stdout:8/380: write d17/d1f/d4f/d42/f4e [691137,105688] 0 2024-09-12T01:43:01.671 INFO:tasks.workunit.client.1.smithi153.stdout:8/381: write d17/d1f/d4f/f65 [3771010,42512] 0 2024-09-12T01:43:01.672 INFO:tasks.workunit.client.1.smithi153.stdout:6/410: mkdir d1/d6/da/d32/d53/d69/d7c/d7f 0 2024-09-12T01:43:01.673 INFO:tasks.workunit.client.1.smithi153.stdout:5/352: dwrite d0/df/f10 [0,4194304] 0 2024-09-12T01:43:01.673 INFO:tasks.workunit.client.1.smithi153.stdout:5/353: truncate d0/df/d50/d58/f66 242591 0 2024-09-12T01:43:01.673 INFO:tasks.workunit.client.1.smithi153.stdout:5/354: fdatasync d0/d15/f29 0 2024-09-12T01:43:01.674 INFO:tasks.workunit.client.1.smithi153.stdout:8/382: getdents d17/d21/d3a 0 2024-09-12T01:43:01.674 INFO:tasks.workunit.client.1.smithi153.stdout:1/345: dwrite d2/d9/f1b [4194304,4194304] 0 2024-09-12T01:43:01.674 INFO:tasks.workunit.client.1.smithi153.stdout:1/346: chown d2/d9/d1d/d25/d3f/f40 2342 1 2024-09-12T01:43:01.675 INFO:tasks.workunit.client.1.smithi153.stdout:1/347: fdatasync d2/d9/d1d/d25/f5f 0 2024-09-12T01:43:01.676 INFO:tasks.workunit.client.1.smithi153.stdout:5/355: truncate d0/d20/f41 4109668 0 2024-09-12T01:43:01.678 INFO:tasks.workunit.client.1.smithi153.stdout:8/383: mkdir d17/d21/d3a/d6c/d6e/d7f/d87 0 2024-09-12T01:43:01.678 INFO:tasks.workunit.client.1.smithi153.stdout:8/384: read d17/d1d/f73 [748301,109852] 0 2024-09-12T01:43:01.678 INFO:tasks.workunit.client.1.smithi153.stdout:8/385: truncate d17/d1f/d4f/d42/f48 4397798 0 2024-09-12T01:43:01.679 INFO:tasks.workunit.client.1.smithi153.stdout:1/348: symlink d2/d9/l65 0 2024-09-12T01:43:01.679 INFO:tasks.workunit.client.1.smithi153.stdout:1/349: stat d2/d9/d17/f41 0 2024-09-12T01:43:01.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/356: mkdir d0/df/d1c/d22/d6e 0 2024-09-12T01:43:01.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/357: fsync d0/fe 0 2024-09-12T01:43:01.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/358: creat d0/d15/f6f x:0 0 0 2024-09-12T01:43:01.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/359: dread - d0/df/d50/d58/f67 zero size 2024-09-12T01:43:01.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/360: stat d0/d15/f54 0 2024-09-12T01:43:01.681 INFO:tasks.workunit.client.1.smithi153.stdout:6/411: write d1/d6/da/f1a [906755,56101] 0 2024-09-12T01:43:01.681 INFO:tasks.workunit.client.1.smithi153.stdout:8/386: creat d17/d21/f88 x:0 0 0 2024-09-12T01:43:01.682 INFO:tasks.workunit.client.1.smithi153.stdout:1/350: truncate d2/d9/d17/f2d 1119537 0 2024-09-12T01:43:01.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/387: mkdir d17/d21/d3a/d6c/d89 0 2024-09-12T01:43:01.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/388: chown d17/d1f/d4f/d34/f40 127113429 1 2024-09-12T01:43:01.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/389: chown d17/d1f/d4f/d42 886579 1 2024-09-12T01:43:01.685 INFO:tasks.workunit.client.1.smithi153.stdout:8/390: creat d17/d21/d3a/f8a x:0 0 0 2024-09-12T01:43:01.685 INFO:tasks.workunit.client.1.smithi153.stdout:8/391: chown d17/d21/d56/l68 31739116 1 2024-09-12T01:43:01.685 INFO:tasks.workunit.client.1.smithi153.stdout:8/392: chown d17/d21/d56/f82 3 1 2024-09-12T01:43:01.690 INFO:tasks.workunit.client.1.smithi153.stdout:0/364: dread f20 [0,4194304] 0 2024-09-12T01:43:01.690 INFO:tasks.workunit.client.1.smithi153.stdout:0/365: chown d22/c7d 7923285 1 2024-09-12T01:43:01.691 INFO:tasks.workunit.client.1.smithi153.stdout:0/366: mkdir d22/d30/d4c/d6e/d7f 0 2024-09-12T01:43:01.693 INFO:tasks.workunit.client.1.smithi153.stdout:0/367: rename d22/d30/d4c/d6e/c75 to d22/d30/d4c/c80 0 2024-09-12T01:43:01.695 INFO:tasks.workunit.client.1.smithi153.stdout:0/368: creat d22/d30/d4c/f81 x:0 0 0 2024-09-12T01:43:01.697 INFO:tasks.workunit.client.1.smithi153.stdout:0/369: mkdir d22/d82 0 2024-09-12T01:43:01.698 INFO:tasks.workunit.client.1.smithi153.stdout:0/370: link f6 d22/f83 0 2024-09-12T01:43:01.698 INFO:tasks.workunit.client.1.smithi153.stdout:0/371: stat l1f 0 2024-09-12T01:43:01.698 INFO:tasks.workunit.client.1.smithi153.stdout:0/372: creat d22/f84 x:0 0 0 2024-09-12T01:43:01.699 INFO:tasks.workunit.client.1.smithi153.stdout:0/373: fsync d22/d30/f47 0 2024-09-12T01:43:01.699 INFO:tasks.workunit.client.1.smithi153.stdout:0/374: mknod d22/d30/d4c/d6e/c85 0 2024-09-12T01:43:01.718 INFO:tasks.workunit.client.1.smithi153.stdout:6/412: write d1/d6/d23/f6e [2084187,1755] 0 2024-09-12T01:43:01.718 INFO:tasks.workunit.client.1.smithi153.stdout:6/413: readlink d1/d6/l16 0 2024-09-12T01:43:01.718 INFO:tasks.workunit.client.1.smithi153.stdout:1/351: read d2/d9/d1d/f30 [3932131,52489] 0 2024-09-12T01:43:01.719 INFO:tasks.workunit.client.1.smithi153.stdout:7/332: dwrite d12/d21/d29/f3d [0,4194304] 0 2024-09-12T01:43:01.720 INFO:tasks.workunit.client.1.smithi153.stdout:3/350: dwrite d1/d59/f66 [0,4194304] 0 2024-09-12T01:43:01.720 INFO:tasks.workunit.client.1.smithi153.stdout:4/261: dwrite d6/f5a [0,4194304] 0 2024-09-12T01:43:01.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/350: dwrite d3/f63 [0,4194304] 0 2024-09-12T01:43:01.721 INFO:tasks.workunit.client.1.smithi153.stdout:9/351: fdatasync d3/f29 0 2024-09-12T01:43:01.722 INFO:tasks.workunit.client.1.smithi153.stdout:0/375: dwrite d22/d30/d4c/f58 [0,4194304] 0 2024-09-12T01:43:01.722 INFO:tasks.workunit.client.1.smithi153.stdout:0/376: truncate d22/d30/f67 426151 0 2024-09-12T01:43:01.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/414: mkdir d1/d80 0 2024-09-12T01:43:01.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/415: truncate d1/f5e 4981989 0 2024-09-12T01:43:01.722 INFO:tasks.workunit.client.1.smithi153.stdout:5/361: dwrite d0/df/d50/d58/f67 [0,4194304] 0 2024-09-12T01:43:01.727 INFO:tasks.workunit.client.0.smithi066.stdout:6/129: dread d2/f7 [0,4194304] 0 2024-09-12T01:43:01.727 INFO:tasks.workunit.client.0.smithi066.stdout:6/130: truncate d2/d21/f25 4041558 0 2024-09-12T01:43:01.727 INFO:tasks.workunit.client.0.smithi066.stdout:6/131: readlink d2/l14 0 2024-09-12T01:43:01.730 INFO:tasks.workunit.client.1.smithi153.stdout:4/262: dread d6/d9/d26/f47 [0,4194304] 0 2024-09-12T01:43:01.730 INFO:tasks.workunit.client.1.smithi153.stdout:3/351: mkdir d1/d13/d23/d47/d6c 0 2024-09-12T01:43:01.731 INFO:tasks.workunit.client.1.smithi153.stdout:4/263: creat d6/d9/dc/f64 x:0 0 0 2024-09-12T01:43:01.734 INFO:tasks.workunit.client.1.smithi153.stdout:8/393: dwrite f16 [0,4194304] 0 2024-09-12T01:43:01.734 INFO:tasks.workunit.client.1.smithi153.stdout:9/352: link d3/d55/f22 d3/d5f/d62/f64 0 2024-09-12T01:43:01.734 INFO:tasks.workunit.client.1.smithi153.stdout:9/353: write d3/d5f/d62/f64 [4576789,97007] 0 2024-09-12T01:43:01.741 INFO:tasks.workunit.client.1.smithi153.stdout:6/416: symlink d1/d6/d46/l81 0 2024-09-12T01:43:01.747 INFO:tasks.workunit.client.1.smithi153.stdout:4/264: write d6/d15/f22 [2075047,65403] 0 2024-09-12T01:43:01.755 INFO:tasks.workunit.client.1.smithi153.stdout:9/354: mknod d3/d55/d30/c65 0 2024-09-12T01:43:01.755 INFO:tasks.workunit.client.1.smithi153.stdout:9/355: write d3/d55/f32 [2783257,118713] 0 2024-09-12T01:43:01.755 INFO:tasks.workunit.client.1.smithi153.stdout:4/265: creat d6/d9/d11/d13/f65 x:0 0 0 2024-09-12T01:43:01.758 INFO:tasks.workunit.client.1.smithi153.stdout:4/266: mkdir d6/d9/d11/d14/d3e/d66 0 2024-09-12T01:43:01.758 INFO:tasks.workunit.client.1.smithi153.stdout:9/356: mkdir d3/d66 0 2024-09-12T01:43:01.760 INFO:tasks.workunit.client.1.smithi153.stdout:9/357: rename d3/l20 to d3/d66/l67 0 2024-09-12T01:43:01.767 INFO:tasks.workunit.client.1.smithi153.stdout:9/358: dread d3/d35/f37 [0,4194304] 0 2024-09-12T01:43:01.768 INFO:tasks.workunit.client.1.smithi153.stdout:9/359: dread d3/f49 [0,4194304] 0 2024-09-12T01:43:01.768 INFO:tasks.workunit.client.1.smithi153.stdout:9/360: write d3/d3a/d42/f4f [1048300,120852] 0 2024-09-12T01:43:01.769 INFO:tasks.workunit.client.1.smithi153.stdout:9/361: chown d3/d35/l50 9285161 1 2024-09-12T01:43:01.769 INFO:tasks.workunit.client.1.smithi153.stdout:9/362: stat d3/d55/c38 0 2024-09-12T01:43:01.770 INFO:tasks.workunit.client.1.smithi153.stdout:9/363: unlink d3/d55/l21 0 2024-09-12T01:43:01.770 INFO:tasks.workunit.client.1.smithi153.stdout:9/364: chown d3/d55 161483341 1 2024-09-12T01:43:01.770 INFO:tasks.workunit.client.1.smithi153.stdout:9/365: truncate d3/f51 184051 0 2024-09-12T01:43:01.773 INFO:tasks.workunit.client.1.smithi153.stdout:0/377: rmdir d22/d30/d4c/d6e 39 2024-09-12T01:43:01.774 INFO:tasks.workunit.client.1.smithi153.stdout:5/362: dwrite d0/df/f5d [0,4194304] 0 2024-09-12T01:43:01.774 INFO:tasks.workunit.client.1.smithi153.stdout:5/363: readlink d0/d43/d51/l34 0 2024-09-12T01:43:01.774 INFO:tasks.workunit.client.1.smithi153.stdout:7/333: dwrite d12/f26 [0,4194304] 0 2024-09-12T01:43:01.774 INFO:tasks.workunit.client.1.smithi153.stdout:7/334: chown d12/d21/f45 6299 1 2024-09-12T01:43:01.776 INFO:tasks.workunit.client.1.smithi153.stdout:1/352: dwrite d2/d34/f39 [4194304,4194304] 0 2024-09-12T01:43:01.776 INFO:tasks.workunit.client.1.smithi153.stdout:8/394: dwrite d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:01.776 INFO:tasks.workunit.client.1.smithi153.stdout:6/417: dwrite d1/d6/f44 [0,4194304] 0 2024-09-12T01:43:01.776 INFO:tasks.workunit.client.1.smithi153.stdout:0/378: unlink d22/d30/d4c/d6e/c6a 0 2024-09-12T01:43:01.777 INFO:tasks.workunit.client.0.smithi066.stdout:6/132: dwrite d2/db/d12/d1d/f2b [0,4194304] 0 2024-09-12T01:43:01.778 INFO:tasks.workunit.client.1.smithi153.stdout:7/335: write fc [2756069,43794] 0 2024-09-12T01:43:01.780 INFO:tasks.workunit.client.0.smithi066.stdout:6/133: mknod d2/d31/c32 0 2024-09-12T01:43:01.782 INFO:tasks.workunit.client.1.smithi153.stdout:6/418: link d1/d6/da/d32/d53/d69/f7d d1/d6/d46/f82 0 2024-09-12T01:43:01.782 INFO:tasks.workunit.client.1.smithi153.stdout:6/419: write d1/d6/da/d19/d34/f20 [4270804,3430] 0 2024-09-12T01:43:01.783 INFO:tasks.workunit.client.1.smithi153.stdout:8/395: creat d17/d21/d3a/d6c/d6e/d7f/f8b x:0 0 0 2024-09-12T01:43:01.784 INFO:tasks.workunit.client.1.smithi153.stdout:1/353: dread d2/d34/f50 [0,4194304] 0 2024-09-12T01:43:01.789 INFO:tasks.workunit.client.1.smithi153.stdout:3/352: rmdir d1/d13 39 2024-09-12T01:43:01.791 INFO:tasks.workunit.client.1.smithi153.stdout:7/336: creat d12/d21/d29/d35/d37/d4c/d5c/f65 x:0 0 0 2024-09-12T01:43:01.793 INFO:tasks.workunit.client.1.smithi153.stdout:6/420: creat d1/d6/da/d32/d4f/f83 x:0 0 0 2024-09-12T01:43:01.794 INFO:tasks.workunit.client.1.smithi153.stdout:8/396: rename d17/d21/d3a/c50 to d17/d21/d56/c8c 0 2024-09-12T01:43:01.795 INFO:tasks.workunit.client.1.smithi153.stdout:1/354: link d2/d9/d28/l60 d2/d34/d3d/l66 0 2024-09-12T01:43:01.795 INFO:tasks.workunit.client.1.smithi153.stdout:1/355: creat d2/d9/f67 x:0 0 0 2024-09-12T01:43:01.797 INFO:tasks.workunit.client.1.smithi153.stdout:9/366: dwrite d3/d35/f5d [0,4194304] 0 2024-09-12T01:43:01.797 INFO:tasks.workunit.client.1.smithi153.stdout:9/367: creat d3/d3a/d42/f68 x:0 0 0 2024-09-12T01:43:01.797 INFO:tasks.workunit.client.1.smithi153.stdout:9/368: fdatasync d3/d55/f57 0 2024-09-12T01:43:01.798 INFO:tasks.workunit.client.1.smithi153.stdout:7/337: symlink d12/d21/d29/d35/d37/d4c/l66 0 2024-09-12T01:43:01.798 INFO:tasks.workunit.client.1.smithi153.stdout:7/338: chown d12/c1e 295 1 2024-09-12T01:43:01.799 INFO:tasks.workunit.client.1.smithi153.stdout:6/421: getdents d1/d6/da/d19/d34 0 2024-09-12T01:43:01.799 INFO:tasks.workunit.client.1.smithi153.stdout:8/397: readlink l4 0 2024-09-12T01:43:01.803 INFO:tasks.workunit.client.1.smithi153.stdout:3/353: write d1/d13/d25/d26/f44 [3975006,31346] 0 2024-09-12T01:43:01.803 INFO:tasks.workunit.client.1.smithi153.stdout:9/369: symlink d3/d55/l69 0 2024-09-12T01:43:01.806 INFO:tasks.workunit.client.1.smithi153.stdout:7/339: link d12/l52 d12/d21/d29/d35/d37/d58/l67 0 2024-09-12T01:43:01.807 INFO:tasks.workunit.client.1.smithi153.stdout:8/398: dread d17/d1f/d4f/d34/f40 [0,4194304] 0 2024-09-12T01:43:01.807 INFO:tasks.workunit.client.1.smithi153.stdout:5/364: dwrite d0/df/f27 [0,4194304] 0 2024-09-12T01:43:01.807 INFO:tasks.workunit.client.1.smithi153.stdout:0/379: dwrite d22/f2f [0,4194304] 0 2024-09-12T01:43:01.807 INFO:tasks.workunit.client.1.smithi153.stdout:0/380: write f4 [5847738,7918] 0 2024-09-12T01:43:01.808 INFO:tasks.workunit.client.1.smithi153.stdout:6/422: mkdir d1/d6/da/d32/d62/d84 0 2024-09-12T01:43:01.808 INFO:tasks.workunit.client.1.smithi153.stdout:6/423: creat d1/d6/da/d32/d53/f85 x:0 0 0 2024-09-12T01:43:01.809 INFO:tasks.workunit.client.1.smithi153.stdout:0/381: dread f3 [0,4194304] 0 2024-09-12T01:43:01.810 INFO:tasks.workunit.client.1.smithi153.stdout:3/354: creat d1/d13/d23/d47/d6c/f6d x:0 0 0 2024-09-12T01:43:01.811 INFO:tasks.workunit.client.1.smithi153.stdout:1/356: dread d2/d9/f5a [4194304,4194304] 0 2024-09-12T01:43:01.811 INFO:tasks.workunit.client.1.smithi153.stdout:9/370: rmdir d3/d66 39 2024-09-12T01:43:01.812 INFO:tasks.workunit.client.1.smithi153.stdout:7/340: truncate d12/d21/f49 1055724 0 2024-09-12T01:43:01.812 INFO:tasks.workunit.client.1.smithi153.stdout:7/341: read - d12/d21/d29/f2c zero size 2024-09-12T01:43:01.813 INFO:tasks.workunit.client.1.smithi153.stdout:8/399: creat d17/d75/f8d x:0 0 0 2024-09-12T01:43:01.815 INFO:tasks.workunit.client.1.smithi153.stdout:5/365: rmdir d0/df/d50/d58 39 2024-09-12T01:43:01.821 INFO:tasks.workunit.client.1.smithi153.stdout:6/424: mknod d1/d80/c86 0 2024-09-12T01:43:01.822 INFO:tasks.workunit.client.1.smithi153.stdout:0/382: truncate d22/f65 2759280 0 2024-09-12T01:43:01.822 INFO:tasks.workunit.client.1.smithi153.stdout:0/383: creat d22/d30/d4c/f86 x:0 0 0 2024-09-12T01:43:01.823 INFO:tasks.workunit.client.1.smithi153.stdout:0/384: chown d22/d30/d4c/f55 164 1 2024-09-12T01:43:01.823 INFO:tasks.workunit.client.1.smithi153.stdout:3/355: mknod d1/d64/c6e 0 2024-09-12T01:43:01.823 INFO:tasks.workunit.client.1.smithi153.stdout:5/366: write d0/d15/f1a [3974916,34705] 0 2024-09-12T01:43:01.824 INFO:tasks.workunit.client.1.smithi153.stdout:5/367: dread d0/df/f4f [0,4194304] 0 2024-09-12T01:43:01.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/357: mkdir d2/d68 0 2024-09-12T01:43:01.827 INFO:tasks.workunit.client.1.smithi153.stdout:9/371: creat d3/f6a x:0 0 0 2024-09-12T01:43:01.829 INFO:tasks.workunit.client.1.smithi153.stdout:8/400: rename d17/d21/d3a/d6c/d6e/d7f/f8b to d17/d21/d3a/d6c/d89/f8e 0 2024-09-12T01:43:01.830 INFO:tasks.workunit.client.1.smithi153.stdout:6/425: creat d1/d6/da/d19/f87 x:0 0 0 2024-09-12T01:43:01.830 INFO:tasks.workunit.client.1.smithi153.stdout:6/426: stat d1/d6/da/d32/d53/d69/c75 0 2024-09-12T01:43:01.832 INFO:tasks.workunit.client.1.smithi153.stdout:0/385: creat d22/d30/d4c/d6e/f87 x:0 0 0 2024-09-12T01:43:01.833 INFO:tasks.workunit.client.1.smithi153.stdout:0/386: stat d22/d30/d4c/f81 0 2024-09-12T01:43:01.834 INFO:tasks.workunit.client.1.smithi153.stdout:3/356: creat d1/d16/f6f x:0 0 0 2024-09-12T01:43:01.835 INFO:tasks.workunit.client.1.smithi153.stdout:7/342: dwrite d12/f33 [4194304,4194304] 0 2024-09-12T01:43:01.835 INFO:tasks.workunit.client.1.smithi153.stdout:5/368: dread d0/d43/d51/d36/d39/f60 [0,4194304] 0 2024-09-12T01:43:01.836 INFO:tasks.workunit.client.1.smithi153.stdout:9/372: creat d3/d55/f6b x:0 0 0 2024-09-12T01:43:01.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/401: rename d17/d1d/d27/f66 to d17/d21/d56/f8f 0 2024-09-12T01:43:01.841 INFO:tasks.workunit.client.1.smithi153.stdout:0/387: truncate d22/f39 263700 0 2024-09-12T01:43:01.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/373: symlink d3/d55/d30/l6c 0 2024-09-12T01:43:01.845 INFO:tasks.workunit.client.1.smithi153.stdout:5/369: getdents d0/d20/d4b 0 2024-09-12T01:43:01.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/370: rename d0/d20/d4b to d0/df/d50/d58/d70 0 2024-09-12T01:43:01.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/371: write d0/d15/f25 [242435,62447] 0 2024-09-12T01:43:01.851 INFO:tasks.workunit.client.1.smithi153.stdout:2/330: sync 2024-09-12T01:43:01.854 INFO:tasks.workunit.client.1.smithi153.stdout:2/331: rename d7/d17/f65 to d7/db/d1d/d4a/f66 0 2024-09-12T01:43:01.857 INFO:tasks.workunit.client.1.smithi153.stdout:3/357: write d1/d13/f37 [886012,34550] 0 2024-09-12T01:43:01.857 INFO:tasks.workunit.client.1.smithi153.stdout:3/358: readlink d1/d13/d25/l57 0 2024-09-12T01:43:01.858 INFO:tasks.workunit.client.1.smithi153.stdout:1/358: dwrite d2/d9/f15 [0,4194304] 0 2024-09-12T01:43:01.860 INFO:tasks.workunit.client.1.smithi153.stdout:1/359: dread d2/d9/d17/d2f/f31 [0,4194304] 0 2024-09-12T01:43:01.860 INFO:tasks.workunit.client.1.smithi153.stdout:1/360: chown d2/d34/d3d/l66 14 1 2024-09-12T01:43:01.862 INFO:tasks.workunit.client.1.smithi153.stdout:1/361: mkdir d2/d9/d17/d69 0 2024-09-12T01:43:01.862 INFO:tasks.workunit.client.1.smithi153.stdout:1/362: creat d2/d9/d17/d2f/d56/f6a x:0 0 0 2024-09-12T01:43:01.862 INFO:tasks.workunit.client.1.smithi153.stdout:1/363: stat d2/d9/d1d/d25/f38 0 2024-09-12T01:43:01.863 INFO:tasks.workunit.client.1.smithi153.stdout:1/364: mkdir d2/d68/d6b 0 2024-09-12T01:43:01.864 INFO:tasks.workunit.client.1.smithi153.stdout:7/343: dread d12/f53 [0,4194304] 0 2024-09-12T01:43:01.864 INFO:tasks.workunit.client.1.smithi153.stdout:7/344: dread - d12/d21/d29/f2c zero size 2024-09-12T01:43:01.865 INFO:tasks.workunit.client.1.smithi153.stdout:1/365: link d2/d9/d17/d2f/f31 d2/d9/d1d/d25/d3f/f6c 0 2024-09-12T01:43:01.875 INFO:tasks.workunit.client.1.smithi153.stdout:6/427: dwrite d1/f38 [4194304,4194304] 0 2024-09-12T01:43:01.875 INFO:tasks.workunit.client.1.smithi153.stdout:6/428: fdatasync d1/d6/f8 0 2024-09-12T01:43:01.882 INFO:tasks.workunit.client.1.smithi153.stdout:1/366: write d2/f6 [2089883,4621] 0 2024-09-12T01:43:01.883 INFO:tasks.workunit.client.1.smithi153.stdout:2/332: rmdir d7/d17 39 2024-09-12T01:43:01.883 INFO:tasks.workunit.client.1.smithi153.stdout:2/333: chown d7/d17/f48 1116 1 2024-09-12T01:43:01.885 INFO:tasks.workunit.client.1.smithi153.stdout:2/334: mknod d7/db/c67 0 2024-09-12T01:43:01.886 INFO:tasks.workunit.client.1.smithi153.stdout:2/335: creat d7/d4d/f68 x:0 0 0 2024-09-12T01:43:01.886 INFO:tasks.workunit.client.1.smithi153.stdout:2/336: truncate d7/db/f39 979608 0 2024-09-12T01:43:01.886 INFO:tasks.workunit.client.1.smithi153.stdout:4/267: sync 2024-09-12T01:43:01.887 INFO:tasks.workunit.client.1.smithi153.stdout:9/374: dwrite d3/d35/f5c [0,4194304] 0 2024-09-12T01:43:01.890 INFO:tasks.workunit.client.1.smithi153.stdout:9/375: link d3/d5f/d62/f64 d3/d55/d30/d5b/f6d 0 2024-09-12T01:43:01.890 INFO:tasks.workunit.client.1.smithi153.stdout:4/268: getdents d6 0 2024-09-12T01:43:01.890 INFO:tasks.workunit.client.1.smithi153.stdout:4/269: truncate d6/d9/f10 5168428 0 2024-09-12T01:43:01.891 INFO:tasks.workunit.client.1.smithi153.stdout:9/376: mknod d3/d5f/c6e 0 2024-09-12T01:43:01.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/377: creat d3/d66/f6f x:0 0 0 2024-09-12T01:43:01.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/378: write d3/d3a/d42/f47 [1663428,128999] 0 2024-09-12T01:43:01.894 INFO:tasks.workunit.client.1.smithi153.stdout:9/379: mknod d3/d5f/d62/c70 0 2024-09-12T01:43:01.894 INFO:tasks.workunit.client.1.smithi153.stdout:9/380: chown d3/d55/d30/c65 457 1 2024-09-12T01:43:01.895 INFO:tasks.workunit.client.1.smithi153.stdout:5/372: dwrite d0/df/d50/d58/f66 [0,4194304] 0 2024-09-12T01:43:01.895 INFO:tasks.workunit.client.1.smithi153.stdout:9/381: mknod d3/d5f/c71 0 2024-09-12T01:43:01.896 INFO:tasks.workunit.client.1.smithi153.stdout:9/382: write d3/d3a/d42/f48 [4200559,98861] 0 2024-09-12T01:43:01.897 INFO:tasks.workunit.client.1.smithi153.stdout:3/359: dwrite d1/d13/d25/f34 [0,4194304] 0 2024-09-12T01:43:01.897 INFO:tasks.workunit.client.1.smithi153.stdout:0/388: dwrite d22/f2c [0,4194304] 0 2024-09-12T01:43:01.897 INFO:tasks.workunit.client.1.smithi153.stdout:7/345: dwrite fc [0,4194304] 0 2024-09-12T01:43:01.899 INFO:tasks.workunit.client.1.smithi153.stdout:5/373: mkdir d0/df/d50/d58/d71 0 2024-09-12T01:43:01.899 INFO:tasks.workunit.client.1.smithi153.stdout:5/374: write d0/df/d1c/d22/f38 [699271,46271] 0 2024-09-12T01:43:01.902 INFO:tasks.workunit.client.1.smithi153.stdout:2/337: write d7/f11 [667157,123910] 0 2024-09-12T01:43:01.902 INFO:tasks.workunit.client.1.smithi153.stdout:2/338: chown d7/db/f64 42774470 1 2024-09-12T01:43:01.902 INFO:tasks.workunit.client.1.smithi153.stdout:0/389: mkdir d22/d30/d4c/d6f/d88 0 2024-09-12T01:43:01.904 INFO:tasks.workunit.client.1.smithi153.stdout:9/383: dread d3/d55/f57 [0,4194304] 0 2024-09-12T01:43:01.904 INFO:tasks.workunit.client.1.smithi153.stdout:7/346: rmdir d12/d21/d4d 39 2024-09-12T01:43:01.904 INFO:tasks.workunit.client.1.smithi153.stdout:7/347: chown d12/l2e 393 1 2024-09-12T01:43:01.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/270: write d6/d9/d11/f1c [1832194,56289] 0 2024-09-12T01:43:01.906 INFO:tasks.workunit.client.1.smithi153.stdout:5/375: unlink d0/c7 0 2024-09-12T01:43:01.906 INFO:tasks.workunit.client.1.smithi153.stdout:5/376: fsync d0/d15/f24 0 2024-09-12T01:43:01.908 INFO:tasks.workunit.client.1.smithi153.stdout:2/339: link d7/d19/d40/c54 d7/d19/c69 0 2024-09-12T01:43:01.908 INFO:tasks.workunit.client.1.smithi153.stdout:2/340: write d7/db/f30 [2654173,77328] 0 2024-09-12T01:43:01.908 INFO:tasks.workunit.client.1.smithi153.stdout:2/341: write d7/fe [130615,107047] 0 2024-09-12T01:43:01.908 INFO:tasks.workunit.client.1.smithi153.stdout:2/342: fsync d7/f51 0 2024-09-12T01:43:01.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/429: dwrite d1/d6/f8 [0,4194304] 0 2024-09-12T01:43:01.910 INFO:tasks.workunit.client.1.smithi153.stdout:4/271: getdents d6/d9/d20 0 2024-09-12T01:43:01.910 INFO:tasks.workunit.client.1.smithi153.stdout:3/360: dread d1/d16/f27 [4194304,4194304] 0 2024-09-12T01:43:01.911 INFO:tasks.workunit.client.1.smithi153.stdout:3/361: read - d1/d16/d17/f67 zero size 2024-09-12T01:43:01.911 INFO:tasks.workunit.client.1.smithi153.stdout:3/362: readlink d1/l10 0 2024-09-12T01:43:01.911 INFO:tasks.workunit.client.1.smithi153.stdout:3/363: write d1/f5 [3554074,51613] 0 2024-09-12T01:43:01.913 INFO:tasks.workunit.client.1.smithi153.stdout:3/364: truncate d1/d1e/f2f 3430162 0 2024-09-12T01:43:01.913 INFO:tasks.workunit.client.1.smithi153.stdout:3/365: fdatasync d1/d1e/f5e 0 2024-09-12T01:43:01.913 INFO:tasks.workunit.client.1.smithi153.stdout:3/366: readlink d1/d13/d23/l3a 0 2024-09-12T01:43:01.919 INFO:tasks.workunit.client.1.smithi153.stdout:1/367: dwrite d2/d9/d1d/d25/f5f [0,4194304] 0 2024-09-12T01:43:01.923 INFO:tasks.workunit.client.1.smithi153.stdout:9/384: dread d3/f8 [0,4194304] 0 2024-09-12T01:43:01.925 INFO:tasks.workunit.client.1.smithi153.stdout:9/385: write d3/d35/f3f [79459,76706] 0 2024-09-12T01:43:01.926 INFO:tasks.workunit.client.1.smithi153.stdout:5/377: dread d0/f32 [0,4194304] 0 2024-09-12T01:43:01.926 INFO:tasks.workunit.client.1.smithi153.stdout:5/378: write d0/d15/f54 [269557,63531] 0 2024-09-12T01:43:01.926 INFO:tasks.workunit.client.1.smithi153.stdout:5/379: write d0/d43/d51/d36/d39/f60 [3104808,93326] 0 2024-09-12T01:43:01.929 INFO:tasks.workunit.client.1.smithi153.stdout:4/272: write f0 [2345124,111559] 0 2024-09-12T01:43:01.929 INFO:tasks.workunit.client.1.smithi153.stdout:4/273: fsync d6/d9/d11/d13/f18 0 2024-09-12T01:43:01.934 INFO:tasks.workunit.client.1.smithi153.stdout:6/430: dwrite d1/d6/da/f1a [0,4194304] 0 2024-09-12T01:43:01.938 INFO:tasks.workunit.client.1.smithi153.stdout:4/274: write d6/d9/d26/f47 [195936,92180] 0 2024-09-12T01:43:01.940 INFO:tasks.workunit.client.1.smithi153.stdout:1/368: dread d2/d34/f39 [4194304,4194304] 0 2024-09-12T01:43:01.956 INFO:tasks.workunit.client.1.smithi153.stdout:0/390: rmdir d22 39 2024-09-12T01:43:01.957 INFO:tasks.workunit.client.1.smithi153.stdout:4/275: dwrite d6/f5a [0,4194304] 0 2024-09-12T01:43:01.957 INFO:tasks.workunit.client.1.smithi153.stdout:4/276: chown d6/d9/d11/d14/c41 132534839 1 2024-09-12T01:43:01.965 INFO:tasks.workunit.client.1.smithi153.stdout:9/386: mkdir d3/d3a/d42/d72 0 2024-09-12T01:43:01.971 INFO:tasks.workunit.client.1.smithi153.stdout:0/391: dwrite d22/d30/f60 [0,4194304] 0 2024-09-12T01:43:01.984 INFO:tasks.workunit.client.1.smithi153.stdout:6/431: link d1/d6/da/d32/c60 d1/d6/da/d32/d53/d69/d7c/c88 0 2024-09-12T01:43:02.017 INFO:tasks.workunit.client.1.smithi153.stdout:1/369: truncate d2/d9/d1d/f4b 603847 0 2024-09-12T01:43:02.018 INFO:tasks.workunit.client.1.smithi153.stdout:4/277: link d6/d9/dc/l44 d6/d9/dc/d42/l67 0 2024-09-12T01:43:02.019 INFO:tasks.workunit.client.1.smithi153.stdout:3/367: link d1/d1e/f2f d1/d13/d25/d26/d4b/f70 0 2024-09-12T01:43:02.021 INFO:tasks.workunit.client.1.smithi153.stdout:9/387: stat d3/f1f 0 2024-09-12T01:43:02.021 INFO:tasks.workunit.client.1.smithi153.stdout:9/388: creat d3/d55/d30/f73 x:0 0 0 2024-09-12T01:43:02.022 INFO:tasks.workunit.client.1.smithi153.stdout:5/380: link d0/df/d50/d58/f66 d0/d43/d51/d36/d39/f72 0 2024-09-12T01:43:02.024 INFO:tasks.workunit.client.1.smithi153.stdout:0/392: creat d22/d30/d4c/d6f/d88/f89 x:0 0 0 2024-09-12T01:43:02.030 INFO:tasks.workunit.client.1.smithi153.stdout:6/432: creat d1/d6/da/d32/d62/f89 x:0 0 0 2024-09-12T01:43:02.031 INFO:tasks.workunit.client.1.smithi153.stdout:1/370: truncate d2/d34/f55 658424 0 2024-09-12T01:43:02.032 INFO:tasks.workunit.client.1.smithi153.stdout:3/368: mkdir d1/d13/d23/d47/d71 0 2024-09-12T01:43:02.035 INFO:tasks.workunit.client.1.smithi153.stdout:5/381: symlink d0/d43/d51/l73 0 2024-09-12T01:43:02.035 INFO:tasks.workunit.client.1.smithi153.stdout:0/393: mkdir d22/d30/d4c/d8a 0 2024-09-12T01:43:02.037 INFO:tasks.workunit.client.1.smithi153.stdout:1/371: truncate d2/d34/f39 3197216 0 2024-09-12T01:43:02.037 INFO:tasks.workunit.client.1.smithi153.stdout:1/372: dread - d2/d9/d17/d2f/d56/f6a zero size 2024-09-12T01:43:02.038 INFO:tasks.workunit.client.1.smithi153.stdout:3/369: symlink d1/d13/d25/d26/l72 0 2024-09-12T01:43:02.039 INFO:tasks.workunit.client.1.smithi153.stdout:5/382: rename d0/d15/f24 to d0/d43/d51/d36/d39/f74 0 2024-09-12T01:43:02.039 INFO:tasks.workunit.client.1.smithi153.stdout:5/383: readlink d0/d43/l48 0 2024-09-12T01:43:02.040 INFO:tasks.workunit.client.1.smithi153.stdout:0/394: symlink d22/d30/d4c/d6f/l8b 0 2024-09-12T01:43:02.040 INFO:tasks.workunit.client.1.smithi153.stdout:0/395: fdatasync d22/f4b 0 2024-09-12T01:43:02.040 INFO:tasks.workunit.client.1.smithi153.stdout:0/396: stat d22/f3e 0 2024-09-12T01:43:02.041 INFO:tasks.workunit.client.1.smithi153.stdout:1/373: unlink d2/d9/f2e 0 2024-09-12T01:43:02.041 INFO:tasks.workunit.client.1.smithi153.stdout:3/370: symlink d1/d16/d1c/d68/l73 0 2024-09-12T01:43:02.042 INFO:tasks.workunit.client.1.smithi153.stdout:0/397: rmdir d22/d30/d4c/d6e 39 2024-09-12T01:43:02.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/374: dread d2/d9/f32 [0,4194304] 0 2024-09-12T01:43:02.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/375: chown d2/c5 73 1 2024-09-12T01:43:02.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/376: chown d2/d9/d17/d2f/d56/f5c 3 1 2024-09-12T01:43:02.056 INFO:tasks.workunit.client.1.smithi153.stdout:0/398: write d22/d30/d4c/f55 [695676,20934] 0 2024-09-12T01:43:02.056 INFO:tasks.workunit.client.1.smithi153.stdout:0/399: chown d22/d30 1052340855 1 2024-09-12T01:43:02.057 INFO:tasks.workunit.client.1.smithi153.stdout:0/400: truncate f15 1919048 0 2024-09-12T01:43:02.059 INFO:tasks.workunit.client.1.smithi153.stdout:0/401: mknod d22/d30/d4c/c8c 0 2024-09-12T01:43:02.064 INFO:tasks.workunit.client.1.smithi153.stdout:5/384: dwrite d0/df/f4f [0,4194304] 0 2024-09-12T01:43:02.070 INFO:tasks.workunit.client.1.smithi153.stdout:4/278: getdents d6/d9/dc/d42 0 2024-09-12T01:43:02.073 INFO:tasks.workunit.client.1.smithi153.stdout:5/385: rename d0/df/d50 to d0/d43/d51/d63/d75 0 2024-09-12T01:43:02.074 INFO:tasks.workunit.client.1.smithi153.stdout:5/386: symlink d0/d43/d51/d63/d75/l76 0 2024-09-12T01:43:02.074 INFO:tasks.workunit.client.1.smithi153.stdout:3/371: dwrite d1/d59/f66 [0,4194304] 0 2024-09-12T01:43:02.076 INFO:tasks.workunit.client.1.smithi153.stdout:5/387: creat d0/df/d1c/d22/f77 x:0 0 0 2024-09-12T01:43:02.081 INFO:tasks.workunit.client.1.smithi153.stdout:0/402: dwrite d22/f4b [0,4194304] 0 2024-09-12T01:43:02.081 INFO:tasks.workunit.client.1.smithi153.stdout:1/377: dwrite d2/d9/d1d/f62 [0,4194304] 0 2024-09-12T01:43:02.086 INFO:tasks.workunit.client.1.smithi153.stdout:0/403: mknod d22/d30/d4c/d6f/d88/c8d 0 2024-09-12T01:43:02.089 INFO:tasks.workunit.client.1.smithi153.stdout:0/404: mkdir d22/d79/d8e 0 2024-09-12T01:43:02.091 INFO:tasks.workunit.client.1.smithi153.stdout:0/405: rename d22/d30/d4c/d6e/f72 to d22/d30/d4c/d6e/f8f 0 2024-09-12T01:43:02.091 INFO:tasks.workunit.client.1.smithi153.stdout:0/406: creat d22/d30/d4c/d6f/d88/f90 x:0 0 0 2024-09-12T01:43:02.092 INFO:tasks.workunit.client.1.smithi153.stdout:9/389: rmdir d3 39 2024-09-12T01:43:02.094 INFO:tasks.workunit.client.1.smithi153.stdout:0/407: link c1a d22/d30/d4c/d6f/c91 0 2024-09-12T01:43:02.098 INFO:tasks.workunit.client.1.smithi153.stdout:4/279: dwrite d6/d15/f22 [0,4194304] 0 2024-09-12T01:43:02.099 INFO:tasks.workunit.client.1.smithi153.stdout:4/280: write d6/d9/d11/d14/d3e/f5e [120268,3585] 0 2024-09-12T01:43:02.112 INFO:tasks.workunit.client.1.smithi153.stdout:5/388: dwrite d0/d20/f65 [0,4194304] 0 2024-09-12T01:43:02.114 INFO:tasks.workunit.client.1.smithi153.stdout:1/378: dwrite d2/d9/d17/d2f/d56/f6a [0,4194304] 0 2024-09-12T01:43:02.117 INFO:tasks.workunit.client.1.smithi153.stdout:9/390: dread d3/d35/f5d [0,4194304] 0 2024-09-12T01:43:02.172 INFO:tasks.workunit.client.1.smithi153.stdout:4/281: creat d6/d15/d38/f68 x:0 0 0 2024-09-12T01:43:02.174 INFO:tasks.workunit.client.1.smithi153.stdout:5/389: mknod d0/df/d1c/d22/d2f/d55/c78 0 2024-09-12T01:43:02.174 INFO:tasks.workunit.client.1.smithi153.stdout:5/390: chown d0/d15/f2a 3 1 2024-09-12T01:43:02.181 INFO:tasks.workunit.client.1.smithi153.stdout:5/391: dread d0/fd [0,4194304] 0 2024-09-12T01:43:02.234 INFO:tasks.workunit.client.1.smithi153.stdout:1/379: symlink d2/d68/l6d 0 2024-09-12T01:43:02.237 INFO:tasks.workunit.client.1.smithi153.stdout:1/380: mknod d2/d9/d17/d54/c6e 0 2024-09-12T01:43:02.237 INFO:tasks.workunit.client.1.smithi153.stdout:1/381: fdatasync d2/d9/d1d/d25/d3f/f6c 0 2024-09-12T01:43:02.238 INFO:tasks.workunit.client.1.smithi153.stdout:6/433: unlink d1/d6/da/l21 0 2024-09-12T01:43:02.240 INFO:tasks.workunit.client.1.smithi153.stdout:1/382: symlink d2/d9/d28/l6f 0 2024-09-12T01:43:02.240 INFO:tasks.workunit.client.1.smithi153.stdout:1/383: fsync d2/d9/d1d/d25/f4a 0 2024-09-12T01:43:02.240 INFO:tasks.workunit.client.1.smithi153.stdout:5/392: mkdir d0/d79 0 2024-09-12T01:43:02.243 INFO:tasks.workunit.client.1.smithi153.stdout:9/391: rename d3/f3e to d3/d3a/d42/d72/f74 0 2024-09-12T01:43:02.244 INFO:tasks.workunit.client.1.smithi153.stdout:3/372: mknod d1/c74 0 2024-09-12T01:43:02.244 INFO:tasks.workunit.client.1.smithi153.stdout:3/373: chown d1/d16/d1c/f2d 68687 1 2024-09-12T01:43:02.244 INFO:tasks.workunit.client.1.smithi153.stdout:3/374: dread - d1/d45/f58 zero size 2024-09-12T01:43:02.244 INFO:tasks.workunit.client.1.smithi153.stdout:3/375: chown d1/d13/d25/l57 1276 1 2024-09-12T01:43:02.244 INFO:tasks.workunit.client.1.smithi153.stdout:3/376: read - d1/d13/d25/d26/f5a zero size 2024-09-12T01:43:02.246 INFO:tasks.workunit.client.1.smithi153.stdout:4/282: rename d6/d9/f2b to d6/d9/d20/f69 0 2024-09-12T01:43:02.246 INFO:tasks.workunit.client.1.smithi153.stdout:4/283: dread - d6/d9/d11/d14/d3e/f50 zero size 2024-09-12T01:43:02.247 INFO:tasks.workunit.client.1.smithi153.stdout:4/284: fsync d6/f53 0 2024-09-12T01:43:02.247 INFO:tasks.workunit.client.1.smithi153.stdout:4/285: chown d6/d9/d11/d14/d3e/l40 11831 1 2024-09-12T01:43:02.249 INFO:tasks.workunit.client.1.smithi153.stdout:4/286: mkdir d6/d6a 0 2024-09-12T01:43:02.249 INFO:tasks.workunit.client.1.smithi153.stdout:4/287: chown d6/d9/d26/f47 189636 1 2024-09-12T01:43:02.250 INFO:tasks.workunit.client.1.smithi153.stdout:9/392: truncate d3/f4 4146994 0 2024-09-12T01:43:02.252 INFO:tasks.workunit.client.1.smithi153.stdout:4/288: creat d6/d9/dc/d42/f6b x:0 0 0 2024-09-12T01:43:02.255 INFO:tasks.workunit.client.1.smithi153.stdout:9/393: link d3/d55/d30/d5b/f6d d3/d35/f75 0 2024-09-12T01:43:02.255 INFO:tasks.workunit.client.1.smithi153.stdout:9/394: stat d3/d3a/d42/l4e 0 2024-09-12T01:43:02.255 INFO:tasks.workunit.client.1.smithi153.stdout:9/395: stat d3/d55/d30/f31 0 2024-09-12T01:43:02.256 INFO:tasks.workunit.client.1.smithi153.stdout:6/434: rename d1/d6/da/d32/d62 to d1/d6/d46/d73/d8a 0 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:9/48: sync 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:0/16: sync 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/5: sync 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/6: stat - no entries 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/7: stat - no entries 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/8: readlink - no filename 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/9: chown . 234363 1 2024-09-12T01:43:02.257 INFO:tasks.workunit.client.0.smithi066.stdout:7/10: readlink - no filename 2024-09-12T01:43:02.258 INFO:tasks.workunit.client.1.smithi153.stdout:4/289: creat d6/d9/d11/f6c x:0 0 0 2024-09-12T01:43:02.259 INFO:tasks.workunit.client.1.smithi153.stdout:9/396: creat d3/d5f/f76 x:0 0 0 2024-09-12T01:43:02.261 INFO:tasks.workunit.client.0.smithi066.stdout:0/17: link d1/c2 d1/c5 0 2024-09-12T01:43:02.264 INFO:tasks.workunit.client.1.smithi153.stdout:4/290: mknod d6/d15/c6d 0 2024-09-12T01:43:02.266 INFO:tasks.workunit.client.0.smithi066.stdout:9/49: mkdir d0/d5/d12 0 2024-09-12T01:43:02.266 INFO:tasks.workunit.client.0.smithi066.stdout:9/50: creat d0/d6/f13 x:0 0 0 2024-09-12T01:43:02.267 INFO:tasks.workunit.client.0.smithi066.stdout:7/11: symlink l0 0 2024-09-12T01:43:02.267 INFO:tasks.workunit.client.0.smithi066.stdout:7/12: dread - no filename 2024-09-12T01:43:02.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/18: mknod d1/c6 0 2024-09-12T01:43:02.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/19: chown d1/l4 20 1 2024-09-12T01:43:02.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/20: chown d1/l4 1117264 1 2024-09-12T01:43:02.269 INFO:tasks.workunit.client.0.smithi066.stdout:0/21: dread - no filename 2024-09-12T01:43:02.270 INFO:tasks.workunit.client.0.smithi066.stdout:9/51: unlink d0/d5/fd 0 2024-09-12T01:43:02.270 INFO:tasks.workunit.client.0.smithi066.stdout:9/52: creat d0/d5/f14 x:0 0 0 2024-09-12T01:43:02.271 INFO:tasks.workunit.client.0.smithi066.stdout:7/13: rename l0 to l1 0 2024-09-12T01:43:02.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/22: mknod d1/c7 0 2024-09-12T01:43:02.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/23: rename d1/c7 to d1/c8 0 2024-09-12T01:43:02.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/24: creat d1/f9 x:0 0 0 2024-09-12T01:43:02.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/25: creat d1/fa x:0 0 0 2024-09-12T01:43:02.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/26: write d1/fa [320648,61862] 0 2024-09-12T01:43:02.276 INFO:tasks.workunit.client.0.smithi066.stdout:0/27: mknod d1/cb 0 2024-09-12T01:43:02.277 INFO:tasks.workunit.client.0.smithi066.stdout:0/28: mkdir d1/dc 0 2024-09-12T01:43:02.281 INFO:tasks.workunit.client.1.smithi153.stdout:3/377: dwrite d1/d13/d25/d26/d4b/f4f [0,4194304] 0 2024-09-12T01:43:02.281 INFO:tasks.workunit.client.1.smithi153.stdout:3/378: chown d1/d16/d17/f67 111262025 1 2024-09-12T01:43:02.281 INFO:tasks.workunit.client.1.smithi153.stdout:5/393: dwrite d0/df/f21 [0,4194304] 0 2024-09-12T01:43:02.281 INFO:tasks.workunit.client.1.smithi153.stdout:1/384: dwrite d2/d9/d1d/d25/d3f/f6c [0,4194304] 0 2024-09-12T01:43:02.282 INFO:tasks.workunit.client.1.smithi153.stdout:7/348: sync 2024-09-12T01:43:02.282 INFO:tasks.workunit.client.1.smithi153.stdout:8/402: sync 2024-09-12T01:43:02.282 INFO:tasks.workunit.client.1.smithi153.stdout:7/349: stat d12/c1f 0 2024-09-12T01:43:02.282 INFO:tasks.workunit.client.1.smithi153.stdout:2/343: sync 2024-09-12T01:43:02.283 INFO:tasks.workunit.client.1.smithi153.stdout:4/291: getdents d6/d9 0 2024-09-12T01:43:02.286 INFO:tasks.workunit.client.1.smithi153.stdout:3/379: creat d1/d16/d1c/d68/f75 x:0 0 0 2024-09-12T01:43:02.286 INFO:tasks.workunit.client.1.smithi153.stdout:3/380: stat d1/d1e/f2f 0 2024-09-12T01:43:02.287 INFO:tasks.workunit.client.0.smithi066.stdout:0/29: dread d1/fa [0,4194304] 0 2024-09-12T01:43:02.288 INFO:tasks.workunit.client.1.smithi153.stdout:9/397: write d3/fe [4025112,36065] 0 2024-09-12T01:43:02.289 INFO:tasks.workunit.client.1.smithi153.stdout:1/385: creat d2/d9/d17/d69/f70 x:0 0 0 2024-09-12T01:43:02.290 INFO:tasks.workunit.client.1.smithi153.stdout:4/292: mknod d6/c6e 0 2024-09-12T01:43:02.290 INFO:tasks.workunit.client.1.smithi153.stdout:4/293: readlink d6/l46 0 2024-09-12T01:43:02.294 INFO:tasks.workunit.client.0.smithi066.stdout:9/53: dwrite d0/f7 [0,4194304] 0 2024-09-12T01:43:02.296 INFO:tasks.workunit.client.1.smithi153.stdout:4/294: link d6/d9/dc/d42/l67 d6/d9/d20/l6f 0 2024-09-12T01:43:02.296 INFO:tasks.workunit.client.1.smithi153.stdout:4/295: creat d6/d9/dc/d31/f70 x:0 0 0 2024-09-12T01:43:02.299 INFO:tasks.workunit.client.1.smithi153.stdout:5/394: read d0/df/f21 [2444184,44075] 0 2024-09-12T01:43:02.303 INFO:tasks.workunit.client.1.smithi153.stdout:4/296: truncate d6/d15/f22 3540634 0 2024-09-12T01:43:02.305 INFO:tasks.workunit.client.1.smithi153.stdout:4/297: symlink d6/l71 0 2024-09-12T01:43:02.305 INFO:tasks.workunit.client.1.smithi153.stdout:4/298: truncate d6/d9/d20/f69 1026082 0 2024-09-12T01:43:02.305 INFO:tasks.workunit.client.1.smithi153.stdout:4/299: read - d6/d9/d11/f6c zero size 2024-09-12T01:43:02.310 INFO:tasks.workunit.client.0.smithi066.stdout:7/14: unlink l1 0 2024-09-12T01:43:02.310 INFO:tasks.workunit.client.0.smithi066.stdout:7/15: readlink - no filename 2024-09-12T01:43:02.314 INFO:tasks.workunit.client.0.smithi066.stdout:7/16: mkdir d2 0 2024-09-12T01:43:02.316 INFO:tasks.workunit.client.0.smithi066.stdout:7/17: mkdir d2/d3 0 2024-09-12T01:43:02.316 INFO:tasks.workunit.client.0.smithi066.stdout:7/18: dwrite - no filename 2024-09-12T01:43:02.317 INFO:tasks.workunit.client.0.smithi066.stdout:0/30: rmdir d1 39 2024-09-12T01:43:02.318 INFO:tasks.workunit.client.0.smithi066.stdout:0/31: fdatasync d1/f9 0 2024-09-12T01:43:02.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/32: symlink d1/ld 0 2024-09-12T01:43:02.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/33: fdatasync d1/f9 0 2024-09-12T01:43:02.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/34: stat d1/f9 0 2024-09-12T01:43:02.321 INFO:tasks.workunit.client.0.smithi066.stdout:0/35: mkdir d1/dc/de 0 2024-09-12T01:43:02.321 INFO:tasks.workunit.client.0.smithi066.stdout:0/36: truncate d1/f9 1000110 0 2024-09-12T01:43:02.322 INFO:tasks.workunit.client.0.smithi066.stdout:9/54: write d0/f7 [1143183,28707] 0 2024-09-12T01:43:02.322 INFO:tasks.workunit.client.0.smithi066.stdout:9/55: dread - d0/d6/f13 zero size 2024-09-12T01:43:02.322 INFO:tasks.workunit.client.0.smithi066.stdout:0/37: read d1/fa [305961,74184] 0 2024-09-12T01:43:02.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/38: mkdir d1/dc/df 0 2024-09-12T01:43:02.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/39: write d1/f9 [1947612,6234] 0 2024-09-12T01:43:02.326 INFO:tasks.workunit.client.0.smithi066.stdout:0/40: write d1/f9 [1394592,58508] 0 2024-09-12T01:43:02.326 INFO:tasks.workunit.client.0.smithi066.stdout:0/41: write d1/fa [1409994,113971] 0 2024-09-12T01:43:02.327 INFO:tasks.workunit.client.0.smithi066.stdout:0/42: chown d1/ld 1011160 1 2024-09-12T01:43:02.337 INFO:tasks.workunit.client.1.smithi153.stdout:8/403: dwrite d17/d21/d3a/d6c/f80 [0,4194304] 0 2024-09-12T01:43:02.337 INFO:tasks.workunit.client.1.smithi153.stdout:8/404: fsync d17/d1d/f73 0 2024-09-12T01:43:02.337 INFO:tasks.workunit.client.1.smithi153.stdout:8/405: read d17/d1d/f73 [100103,33353] 0 2024-09-12T01:43:02.340 INFO:tasks.workunit.client.1.smithi153.stdout:8/406: write d17/d1f/d4f/d34/f40 [2891389,59537] 0 2024-09-12T01:43:02.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/344: dwrite f2 [0,4194304] 0 2024-09-12T01:43:02.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/345: dread - d7/d19/f45 zero size 2024-09-12T01:43:02.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/346: symlink d7/db/d62/l6a 0 2024-09-12T01:43:02.344 INFO:tasks.workunit.client.1.smithi153.stdout:2/347: mkdir d7/d19/d6b 0 2024-09-12T01:43:02.345 INFO:tasks.workunit.client.1.smithi153.stdout:2/348: mkdir d7/db/d6c 0 2024-09-12T01:43:02.346 INFO:tasks.workunit.client.1.smithi153.stdout:2/349: mkdir d7/db/d1d/d1e/d6d 0 2024-09-12T01:43:02.349 INFO:tasks.workunit.client.1.smithi153.stdout:7/350: dwrite d12/f53 [0,4194304] 0 2024-09-12T01:43:02.349 INFO:tasks.workunit.client.1.smithi153.stdout:7/351: fdatasync d12/f33 0 2024-09-12T01:43:02.350 INFO:tasks.workunit.client.0.smithi066.stdout:9/56: truncate d0/f7 2669510 0 2024-09-12T01:43:02.350 INFO:tasks.workunit.client.1.smithi153.stdout:3/381: dwrite d1/d13/d25/d26/d4b/f4f [0,4194304] 0 2024-09-12T01:43:02.351 INFO:tasks.workunit.client.1.smithi153.stdout:1/386: dwrite d2/d9/d1d/d25/f4a [0,4194304] 0 2024-09-12T01:43:02.352 INFO:tasks.workunit.client.1.smithi153.stdout:9/398: dwrite d3/d55/f1e [0,4194304] 0 2024-09-12T01:43:02.352 INFO:tasks.workunit.client.1.smithi153.stdout:4/300: dwrite d6/d9/d26/f62 [0,4194304] 0 2024-09-12T01:43:02.353 INFO:tasks.workunit.client.1.smithi153.stdout:4/301: fsync d6/d9/d11/d13/f65 0 2024-09-12T01:43:02.357 INFO:tasks.workunit.client.1.smithi153.stdout:8/407: dread d17/d21/d3a/d6c/f80 [0,4194304] 0 2024-09-12T01:43:02.357 INFO:tasks.workunit.client.1.smithi153.stdout:5/395: dwrite d0/f12 [0,4194304] 0 2024-09-12T01:43:02.359 INFO:tasks.workunit.client.1.smithi153.stdout:1/387: mkdir d2/d9/d17/d2f/d56/d71 0 2024-09-12T01:43:02.360 INFO:tasks.workunit.client.1.smithi153.stdout:9/399: rename d3/d55/f34 to d3/d55/f77 0 2024-09-12T01:43:02.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/350: dread d7/d19/d40/f37 [0,4194304] 0 2024-09-12T01:43:02.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/351: readlink d7/db/d62/l6a 0 2024-09-12T01:43:02.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/396: getdents d0/d43/d51/d63 0 2024-09-12T01:43:02.364 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:01 smithi153 ceph-mon[34713]: pgmap v241: 65 pgs: 65 active+clean; 488 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 45 MiB/s wr, 504 op/s 2024-09-12T01:43:02.364 INFO:tasks.workunit.client.1.smithi153.stdout:9/400: symlink d3/d55/l78 0 2024-09-12T01:43:02.365 INFO:tasks.workunit.client.1.smithi153.stdout:9/401: chown d3/f11 15552931 1 2024-09-12T01:43:02.366 INFO:tasks.workunit.client.1.smithi153.stdout:9/402: creat d3/d35/f79 x:0 0 0 2024-09-12T01:43:02.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/397: write d0/df/d1c/d22/f38 [3177,33418] 0 2024-09-12T01:43:02.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/398: truncate d0/df/f2d 988158 0 2024-09-12T01:43:02.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/399: chown d0/d43/d51/d63/d75/d58/f67 13676 1 2024-09-12T01:43:02.369 INFO:tasks.workunit.client.1.smithi153.stdout:8/408: dread d17/d1d/f73 [0,4194304] 0 2024-09-12T01:43:02.369 INFO:tasks.workunit.client.1.smithi153.stdout:8/409: readlink d17/d21/l77 0 2024-09-12T01:43:02.373 INFO:tasks.workunit.client.1.smithi153.stdout:4/302: dread d6/d9/d11/f1e [0,4194304] 0 2024-09-12T01:43:02.375 INFO:tasks.workunit.client.1.smithi153.stdout:1/388: read d2/d34/f53 [2813698,80560] 0 2024-09-12T01:43:02.378 INFO:tasks.workunit.client.1.smithi153.stdout:9/403: link d3/f4 d3/d3a/f7a 0 2024-09-12T01:43:02.378 INFO:tasks.workunit.client.1.smithi153.stdout:5/400: link d0/d43/d51/f42 d0/df/d1c/d22/d6e/f7a 0 2024-09-12T01:43:02.378 INFO:tasks.workunit.client.1.smithi153.stdout:5/401: fsync d0/d20/f37 0 2024-09-12T01:43:02.378 INFO:tasks.workunit.client.1.smithi153.stdout:9/404: dread - d3/d66/f6f zero size 2024-09-12T01:43:02.378 INFO:tasks.workunit.client.1.smithi153.stdout:2/352: dread d7/db/ff [0,4194304] 0 2024-09-12T01:43:02.378 INFO:tasks.workunit.client.1.smithi153.stdout:7/352: dwrite d12/d21/d29/d35/d37/f57 [0,4194304] 0 2024-09-12T01:43:02.379 INFO:tasks.workunit.client.1.smithi153.stdout:7/353: readlink l11 0 2024-09-12T01:43:02.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/303: symlink d6/d9/d11/d14/d3e/d66/l72 0 2024-09-12T01:43:02.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/304: fdatasync d6/d9/dc/d31/f70 0 2024-09-12T01:43:02.380 INFO:tasks.workunit.client.1.smithi153.stdout:4/305: stat d6/d9/d11/d14/f2a 0 2024-09-12T01:43:02.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/402: mkdir d0/d43/d51/d63/d7b 0 2024-09-12T01:43:02.380 INFO:tasks.workunit.client.1.smithi153.stdout:9/405: mkdir d3/d55/d30/d7b 0 2024-09-12T01:43:02.384 INFO:tasks.workunit.client.1.smithi153.stdout:5/403: creat d0/d43/d51/d63/d75/d58/d71/f7c x:0 0 0 2024-09-12T01:43:02.387 INFO:tasks.workunit.client.1.smithi153.stdout:5/404: creat d0/d43/d51/d36/f7d x:0 0 0 2024-09-12T01:43:02.388 INFO:tasks.workunit.client.1.smithi153.stdout:3/382: dwrite d1/d45/f51 [0,4194304] 0 2024-09-12T01:43:02.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:01 smithi066 ceph-mon[27875]: pgmap v241: 65 pgs: 65 active+clean; 488 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 45 MiB/s wr, 504 op/s 2024-09-12T01:43:02.390 INFO:tasks.workunit.client.1.smithi153.stdout:0/408: sync 2024-09-12T01:43:02.390 INFO:tasks.workunit.client.1.smithi153.stdout:0/409: write d22/d30/f47 [1462758,11121] 0 2024-09-12T01:43:02.390 INFO:tasks.workunit.client.1.smithi153.stdout:0/410: write d22/f74 [774288,9167] 0 2024-09-12T01:43:02.390 INFO:tasks.workunit.client.1.smithi153.stdout:0/411: chown c10 11 1 2024-09-12T01:43:02.392 INFO:tasks.workunit.client.1.smithi153.stdout:5/405: unlink d0/d43/d51/d63/d75/d58/f67 0 2024-09-12T01:43:02.392 INFO:tasks.workunit.client.1.smithi153.stdout:1/389: dread d2/d9/d1d/f62 [0,4194304] 0 2024-09-12T01:43:02.392 INFO:tasks.workunit.client.1.smithi153.stdout:1/390: write d2/d34/f50 [471266,54017] 0 2024-09-12T01:43:02.392 INFO:tasks.workunit.client.0.smithi066.stdout:9/57: dwrite d0/d5/d9/fa [4194304,4194304] 0 2024-09-12T01:43:02.393 INFO:tasks.workunit.client.1.smithi153.stdout:2/353: read d7/db/d36/f42 [1602321,100511] 0 2024-09-12T01:43:02.393 INFO:tasks.workunit.client.1.smithi153.stdout:3/383: mknod d1/d16/d1c/d68/c76 0 2024-09-12T01:43:02.394 INFO:tasks.workunit.client.0.smithi066.stdout:0/43: dwrite d1/f9 [0,4194304] 0 2024-09-12T01:43:02.396 INFO:tasks.workunit.client.1.smithi153.stdout:5/406: link d0/d15/f2a d0/d43/d51/d63/d75/d58/d71/f7e 0 2024-09-12T01:43:02.396 INFO:tasks.workunit.client.1.smithi153.stdout:1/391: truncate d2/d34/f53 590191 0 2024-09-12T01:43:02.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/354: unlink d7/d19/f45 0 2024-09-12T01:43:02.398 INFO:tasks.workunit.client.0.smithi066.stdout:0/44: symlink d1/dc/df/l10 0 2024-09-12T01:43:02.399 INFO:tasks.workunit.client.0.smithi066.stdout:0/45: chown d1/ld 954 1 2024-09-12T01:43:02.400 INFO:tasks.workunit.client.1.smithi153.stdout:3/384: truncate d1/f11 1045631 0 2024-09-12T01:43:02.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/46: rename d1/dc/df/l10 to d1/l11 0 2024-09-12T01:43:02.402 INFO:tasks.workunit.client.1.smithi153.stdout:5/407: rename d0/df/f2d to d0/d43/d51/f7f 0 2024-09-12T01:43:02.403 INFO:tasks.workunit.client.1.smithi153.stdout:2/355: unlink f2 0 2024-09-12T01:43:02.403 INFO:tasks.workunit.client.1.smithi153.stdout:5/408: creat d0/df/d1c/d69/f80 x:0 0 0 2024-09-12T01:43:02.403 INFO:tasks.workunit.client.1.smithi153.stdout:3/385: creat d1/d13/f77 x:0 0 0 2024-09-12T01:43:02.403 INFO:tasks.workunit.client.1.smithi153.stdout:3/386: chown d1/d16/d1c/d68/l73 40458548 1 2024-09-12T01:43:02.404 INFO:tasks.workunit.client.1.smithi153.stdout:5/409: mkdir d0/df/d1c/d22/d2f/d55/d81 0 2024-09-12T01:43:02.404 INFO:tasks.workunit.client.1.smithi153.stdout:9/406: dread d3/d55/f77 [0,4194304] 0 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/387: unlink d1/d13/d25/d26/d4b/f70 0 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/388: chown d1/d16/d17/f18 51298 1 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/389: stat d1/d13/d25/f42 0 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/390: creat d1/d59/f78 x:0 0 0 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.1.smithi153.stdout:3/391: chown d1/d13/d25/d26/l72 1033232711 1 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.0.smithi066.stdout:9/58: dread d0/f7 [0,4194304] 0 2024-09-12T01:43:02.407 INFO:tasks.workunit.client.0.smithi066.stdout:9/59: write d0/d5/f14 [602513,87504] 0 2024-09-12T01:43:02.409 INFO:tasks.workunit.client.0.smithi066.stdout:9/60: link d0/d5/d9/de/lf d0/d5/d9/de/l15 0 2024-09-12T01:43:02.410 INFO:tasks.workunit.client.0.smithi066.stdout:9/61: rename d0 to d0/d5/d12/d16 22 2024-09-12T01:43:02.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/392: mkdir d1/d16/d1c/d68/d79 0 2024-09-12T01:43:02.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/393: write d1/d16/d17/f18 [1718149,99281] 0 2024-09-12T01:43:02.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/394: write d1/d45/f58 [581061,57356] 0 2024-09-12T01:43:02.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/395: dread - d1/d16/d17/f67 zero size 2024-09-12T01:43:02.411 INFO:tasks.workunit.client.1.smithi153.stdout:3/396: fdatasync d1/d16/f6f 0 2024-09-12T01:43:02.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/62: mkdir d0/d6/d17 0 2024-09-12T01:43:02.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/63: creat d0/d6/d17/f18 x:0 0 0 2024-09-12T01:43:02.412 INFO:tasks.workunit.client.0.smithi066.stdout:9/64: link d0/d5/f14 d0/d5/f19 0 2024-09-12T01:43:02.414 INFO:tasks.workunit.client.0.smithi066.stdout:9/65: unlink d0/d5/d9/de/lf 0 2024-09-12T01:43:02.418 INFO:tasks.workunit.client.0.smithi066.stdout:0/47: dread d1/fa [0,4194304] 0 2024-09-12T01:43:02.418 INFO:tasks.workunit.client.0.smithi066.stdout:0/48: chown d1/ld 1 1 2024-09-12T01:43:02.429 INFO:tasks.workunit.client.0.smithi066.stdout:9/66: dread d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:02.430 INFO:tasks.workunit.client.0.smithi066.stdout:9/67: mkdir d0/d5/dc/d1a 0 2024-09-12T01:43:02.437 INFO:tasks.workunit.client.1.smithi153.stdout:7/354: dwrite d12/f20 [0,4194304] 0 2024-09-12T01:43:02.438 INFO:tasks.workunit.client.1.smithi153.stdout:7/355: creat d12/d21/d29/d35/d3c/f68 x:0 0 0 2024-09-12T01:43:02.438 INFO:tasks.workunit.client.1.smithi153.stdout:7/356: fsync d12/f53 0 2024-09-12T01:43:02.439 INFO:tasks.workunit.client.1.smithi153.stdout:7/357: mknod d12/d21/d4d/c69 0 2024-09-12T01:43:02.439 INFO:tasks.workunit.client.1.smithi153.stdout:7/358: write f4 [584240,45419] 0 2024-09-12T01:43:02.440 INFO:tasks.workunit.client.1.smithi153.stdout:7/359: creat d12/d21/d29/d35/f6a x:0 0 0 2024-09-12T01:43:02.440 INFO:tasks.workunit.client.1.smithi153.stdout:7/360: fsync f7 0 2024-09-12T01:43:02.447 INFO:tasks.workunit.client.1.smithi153.stdout:4/306: dwrite d6/d9/d11/f3c [0,4194304] 0 2024-09-12T01:43:02.448 INFO:tasks.workunit.client.1.smithi153.stdout:7/361: read d12/d21/d29/f3b [1634532,12094] 0 2024-09-12T01:43:02.450 INFO:tasks.workunit.client.1.smithi153.stdout:9/407: getdents d3/d55/d30 0 2024-09-12T01:43:02.451 INFO:tasks.workunit.client.1.smithi153.stdout:7/362: dread d12/d21/d29/f5a [4194304,4194304] 0 2024-09-12T01:43:02.455 INFO:tasks.workunit.client.1.smithi153.stdout:6/435: sync 2024-09-12T01:43:02.460 INFO:tasks.workunit.client.0.smithi066.stdout:0/49: dwrite d1/fa [0,4194304] 0 2024-09-12T01:43:02.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/410: dwrite d0/df/d1c/d22/d6e/f7a [0,4194304] 0 2024-09-12T01:43:02.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/411: fsync d0/f2 0 2024-09-12T01:43:02.461 INFO:tasks.workunit.client.1.smithi153.stdout:1/392: dwrite d2/d9/d17/f23 [0,4194304] 0 2024-09-12T01:43:02.461 INFO:tasks.workunit.client.1.smithi153.stdout:1/393: write d2/d9/f67 [986075,21753] 0 2024-09-12T01:43:02.461 INFO:tasks.workunit.client.1.smithi153.stdout:0/412: dwrite d22/f84 [0,4194304] 0 2024-09-12T01:43:02.461 INFO:tasks.workunit.client.1.smithi153.stdout:0/413: chown d22/d30/d4c/f4d 0 1 2024-09-12T01:43:02.462 INFO:tasks.workunit.client.1.smithi153.stdout:2/356: dwrite d7/d19/d40/f37 [0,4194304] 0 2024-09-12T01:43:02.462 INFO:tasks.workunit.client.0.smithi066.stdout:0/50: mknod d1/dc/c12 0 2024-09-12T01:43:02.464 INFO:tasks.workunit.client.1.smithi153.stdout:5/412: rmdir d0/d43/d51/d63 39 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:4/307: read d6/f5a [987640,30292] 0 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:4/308: read d6/d9/dc/d31/f34 [627008,107711] 0 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:4/309: write d6/fe [1746387,117394] 0 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/394: write d2/d9/f67 [679069,4611] 0 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/395: fsync d2/d9/d1d/f30 0 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:4/310: write d6/d9/d11/d14/d3e/f61 [273139,62691] 0 2024-09-12T01:43:02.465 INFO:tasks.workunit.client.1.smithi153.stdout:1/396: chown d2/d9/c57 262864323 1 2024-09-12T01:43:02.466 INFO:tasks.workunit.client.0.smithi066.stdout:0/51: creat d1/dc/de/f13 x:0 0 0 2024-09-12T01:43:02.467 INFO:tasks.workunit.client.0.smithi066.stdout:5/38: sync 2024-09-12T01:43:02.467 INFO:tasks.workunit.client.0.smithi066.stdout:4/25: sync 2024-09-12T01:43:02.467 INFO:tasks.workunit.client.0.smithi066.stdout:4/26: write f3 [2583709,121572] 0 2024-09-12T01:43:02.469 INFO:tasks.workunit.client.0.smithi066.stdout:0/52: creat d1/dc/f14 x:0 0 0 2024-09-12T01:43:02.471 INFO:tasks.workunit.client.0.smithi066.stdout:5/39: symlink d0/la 0 2024-09-12T01:43:02.475 INFO:tasks.workunit.client.1.smithi153.stdout:7/363: dwrite f7 [0,4194304] 0 2024-09-12T01:43:02.475 INFO:tasks.workunit.client.0.smithi066.stdout:4/27: mknod d4/cb 0 2024-09-12T01:43:02.475 INFO:tasks.workunit.client.0.smithi066.stdout:4/28: chown d4/cb 20 1 2024-09-12T01:43:02.475 INFO:tasks.workunit.client.0.smithi066.stdout:4/29: chown d4/l5 1781 1 2024-09-12T01:43:02.477 INFO:tasks.workunit.client.1.smithi153.stdout:0/414: unlink d22/d30/d4c/c80 0 2024-09-12T01:43:02.477 INFO:tasks.workunit.client.1.smithi153.stdout:0/415: chown d22/f65 5026855 1 2024-09-12T01:43:02.478 INFO:tasks.workunit.client.0.smithi066.stdout:0/53: getdents d1 0 2024-09-12T01:43:02.479 INFO:tasks.workunit.client.1.smithi153.stdout:3/397: getdents d1/d59 0 2024-09-12T01:43:02.480 INFO:tasks.workunit.client.0.smithi066.stdout:5/40: mkdir d0/db 0 2024-09-12T01:43:02.482 INFO:tasks.workunit.client.0.smithi066.stdout:9/68: fsync d0/d5/f14 0 2024-09-12T01:43:02.483 INFO:tasks.workunit.client.0.smithi066.stdout:5/41: creat d0/db/fc x:0 0 0 2024-09-12T01:43:02.483 INFO:tasks.workunit.client.0.smithi066.stdout:5/42: dread - d0/db/fc zero size 2024-09-12T01:43:02.486 INFO:tasks.workunit.client.0.smithi066.stdout:9/69: unlink d0/d6/fb 0 2024-09-12T01:43:02.491 INFO:tasks.workunit.client.1.smithi153.stdout:2/357: creat d7/db/d27/d56/f6e x:0 0 0 2024-09-12T01:43:02.493 INFO:tasks.workunit.client.1.smithi153.stdout:5/413: symlink d0/l82 0 2024-09-12T01:43:02.494 INFO:tasks.workunit.client.1.smithi153.stdout:1/397: unlink d2/d9/ca 0 2024-09-12T01:43:02.494 INFO:tasks.workunit.client.1.smithi153.stdout:1/398: write d2/d34/f50 [2557030,10940] 0 2024-09-12T01:43:02.495 INFO:tasks.workunit.client.0.smithi066.stdout:4/30: dread f3 [0,4194304] 0 2024-09-12T01:43:02.495 INFO:tasks.workunit.client.0.smithi066.stdout:4/31: chown d4/d6 1 1 2024-09-12T01:43:02.495 INFO:tasks.workunit.client.1.smithi153.stdout:4/311: link d6/d9/d20/l55 d6/l73 0 2024-09-12T01:43:02.496 INFO:tasks.workunit.client.1.smithi153.stdout:2/358: dread d7/db/d1d/d4a/f66 [0,4194304] 0 2024-09-12T01:43:02.496 INFO:tasks.workunit.client.1.smithi153.stdout:0/416: unlink d22/d79/l7c 0 2024-09-12T01:43:02.496 INFO:tasks.workunit.client.1.smithi153.stdout:0/417: fsync d22/d30/d4c/d6e/f3f 0 2024-09-12T01:43:02.497 INFO:tasks.workunit.client.1.smithi153.stdout:0/418: readlink d22/d30/l64 0 2024-09-12T01:43:02.497 INFO:tasks.workunit.client.1.smithi153.stdout:0/419: chown d22/d30/c38 124862850 1 2024-09-12T01:43:02.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/32: mknod d4/d6/cc 0 2024-09-12T01:43:02.498 INFO:tasks.workunit.client.0.smithi066.stdout:0/54: dread d1/f9 [0,4194304] 0 2024-09-12T01:43:02.499 INFO:tasks.workunit.client.1.smithi153.stdout:3/398: creat d1/d13/d23/d47/d71/f7a x:0 0 0 2024-09-12T01:43:02.500 INFO:tasks.workunit.client.0.smithi066.stdout:4/33: creat d4/fd x:0 0 0 2024-09-12T01:43:02.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/55: rename d1/c2 to d1/dc/df/c15 0 2024-09-12T01:43:02.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/56: write d1/dc/f14 [280587,121767] 0 2024-09-12T01:43:02.503 INFO:tasks.workunit.client.1.smithi153.stdout:2/359: read d7/f1c [3243384,80083] 0 2024-09-12T01:43:02.504 INFO:tasks.workunit.client.1.smithi153.stdout:1/399: symlink d2/d9/d58/l72 0 2024-09-12T01:43:02.504 INFO:tasks.workunit.client.1.smithi153.stdout:1/400: chown d2/l4 6 1 2024-09-12T01:43:02.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/57: rename d1/ld to d1/dc/l16 0 2024-09-12T01:43:02.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/58: write d1/dc/de/f13 [76253,112631] 0 2024-09-12T01:43:02.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/59: write d1/dc/f14 [1172468,70191] 0 2024-09-12T01:43:02.508 INFO:tasks.workunit.client.1.smithi153.stdout:3/399: rename d1/lb to d1/d16/l7b 0 2024-09-12T01:43:02.509 INFO:tasks.workunit.client.1.smithi153.stdout:2/360: creat d7/d19/d6b/f6f x:0 0 0 2024-09-12T01:43:02.510 INFO:tasks.workunit.client.0.smithi066.stdout:0/60: symlink d1/dc/df/l17 0 2024-09-12T01:43:02.511 INFO:tasks.workunit.client.1.smithi153.stdout:1/401: mkdir d2/d9/d28/d73 0 2024-09-12T01:43:02.511 INFO:tasks.workunit.client.1.smithi153.stdout:1/402: fsync d2/d9/d17/d69/f70 0 2024-09-12T01:43:02.511 INFO:tasks.workunit.client.1.smithi153.stdout:1/403: getdents d2/d9/d28/d73 0 2024-09-12T01:43:02.512 INFO:tasks.workunit.client.1.smithi153.stdout:3/400: creat d1/d16/f7c x:0 0 0 2024-09-12T01:43:02.514 INFO:tasks.workunit.client.1.smithi153.stdout:3/401: link d1/d16/d1c/c3c d1/d13/d23/d47/d6c/c7d 0 2024-09-12T01:43:02.514 INFO:tasks.workunit.client.1.smithi153.stdout:8/410: sync 2024-09-12T01:43:02.514 INFO:tasks.workunit.client.1.smithi153.stdout:8/411: dread - d17/d21/d56/f84 zero size 2024-09-12T01:43:02.515 INFO:tasks.workunit.client.1.smithi153.stdout:8/412: dread - d17/d1f/d4f/d34/f5f zero size 2024-09-12T01:43:02.515 INFO:tasks.workunit.client.1.smithi153.stdout:0/420: dread d22/f32 [0,4194304] 0 2024-09-12T01:43:02.515 INFO:tasks.workunit.client.0.smithi066.stdout:5/43: dwrite d0/db/fc [0,4194304] 0 2024-09-12T01:43:02.518 INFO:tasks.workunit.client.0.smithi066.stdout:9/70: readlink d0/d5/d9/de/l15 0 2024-09-12T01:43:02.524 INFO:tasks.workunit.client.0.smithi066.stdout:9/71: mkdir d0/d6/d17/d1b 0 2024-09-12T01:43:02.527 INFO:tasks.workunit.client.0.smithi066.stdout:9/72: creat d0/d6/d17/d1b/f1c x:0 0 0 2024-09-12T01:43:02.529 INFO:tasks.workunit.client.1.smithi153.stdout:5/414: dwrite d0/df/f10 [0,4194304] 0 2024-09-12T01:43:02.529 INFO:tasks.workunit.client.0.smithi066.stdout:4/34: dwrite f3 [0,4194304] 0 2024-09-12T01:43:02.531 INFO:tasks.workunit.client.0.smithi066.stdout:0/61: write d1/f9 [788929,78177] 0 2024-09-12T01:43:02.531 INFO:tasks.workunit.client.1.smithi153.stdout:5/415: truncate d0/d43/d51/d36/d39/f72 2338255 0 2024-09-12T01:43:02.533 INFO:tasks.workunit.client.1.smithi153.stdout:8/413: dread f16 [0,4194304] 0 2024-09-12T01:43:02.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/62: mknod d1/dc/df/c18 0 2024-09-12T01:43:02.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/63: readlink d1/dc/l16 0 2024-09-12T01:43:02.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/64: creat d1/dc/de/f19 x:0 0 0 2024-09-12T01:43:02.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/65: write d1/f9 [2462531,58165] 0 2024-09-12T01:43:02.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/66: write d1/f9 [1062800,79530] 0 2024-09-12T01:43:02.535 INFO:tasks.workunit.client.1.smithi153.stdout:8/414: symlink d17/d75/l90 0 2024-09-12T01:43:02.537 INFO:tasks.workunit.client.0.smithi066.stdout:0/67: creat d1/dc/df/f1a x:0 0 0 2024-09-12T01:43:02.537 INFO:tasks.workunit.client.0.smithi066.stdout:0/68: write d1/dc/df/f1a [415831,27419] 0 2024-09-12T01:43:02.538 INFO:tasks.workunit.client.0.smithi066.stdout:5/44: write d0/db/fc [2252602,27300] 0 2024-09-12T01:43:02.539 INFO:tasks.workunit.client.1.smithi153.stdout:2/361: rename d7/d19/d6b to d7/d4d/d70 0 2024-09-12T01:43:02.540 INFO:tasks.workunit.client.1.smithi153.stdout:2/362: dread d7/db/d27/f31 [0,4194304] 0 2024-09-12T01:43:02.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/69: mkdir d1/dc/df/d1b 0 2024-09-12T01:43:02.541 INFO:tasks.workunit.client.0.smithi066.stdout:5/45: getdents d0 0 2024-09-12T01:43:02.542 INFO:tasks.workunit.client.1.smithi153.stdout:1/404: rename d2/d9/d17/d54 to d2/d9/d58/d74 0 2024-09-12T01:43:02.543 INFO:tasks.workunit.client.1.smithi153.stdout:1/405: write d2/d9/d17/d2f/d56/f5c [230210,121525] 0 2024-09-12T01:43:02.543 INFO:tasks.workunit.client.1.smithi153.stdout:1/406: truncate d2/d34/f53 849089 0 2024-09-12T01:43:02.543 INFO:tasks.workunit.client.1.smithi153.stdout:1/407: chown d2/d9/d17/f2d 19 1 2024-09-12T01:43:02.543 INFO:tasks.workunit.client.0.smithi066.stdout:0/70: link d1/cb d1/dc/de/c1c 0 2024-09-12T01:43:02.544 INFO:tasks.workunit.client.1.smithi153.stdout:2/363: symlink d7/d4d/d70/l71 0 2024-09-12T01:43:02.545 INFO:tasks.workunit.client.1.smithi153.stdout:3/402: rename d1/d13/d25/f34 to d1/d16/d1c/d32/f7e 0 2024-09-12T01:43:02.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/71: getdents d1 0 2024-09-12T01:43:02.547 INFO:tasks.workunit.client.0.smithi066.stdout:4/35: dread f3 [0,4194304] 0 2024-09-12T01:43:02.547 INFO:tasks.workunit.client.1.smithi153.stdout:1/408: link d2/d9/f32 d2/d9/d17/d2f/d56/d71/f75 0 2024-09-12T01:43:02.548 INFO:tasks.workunit.client.1.smithi153.stdout:0/421: dwrite d22/f2b [4194304,4194304] 0 2024-09-12T01:43:02.549 INFO:tasks.workunit.client.0.smithi066.stdout:0/72: link d1/dc/de/f19 d1/dc/de/f1d 0 2024-09-12T01:43:02.550 INFO:tasks.workunit.client.1.smithi153.stdout:2/364: read d7/db/d27/f29 [396821,63296] 0 2024-09-12T01:43:02.550 INFO:tasks.workunit.client.1.smithi153.stdout:2/365: write d7/db/d27/f3a [4260457,33605] 0 2024-09-12T01:43:02.555 INFO:tasks.workunit.client.1.smithi153.stdout:3/403: unlink d1/d16/d1c/l39 0 2024-09-12T01:43:02.555 INFO:tasks.workunit.client.1.smithi153.stdout:3/404: write d1/d16/d1c/f33 [2944169,30331] 0 2024-09-12T01:43:02.555 INFO:tasks.workunit.client.1.smithi153.stdout:3/405: dread - d1/d16/f7c zero size 2024-09-12T01:43:02.555 INFO:tasks.workunit.client.1.smithi153.stdout:3/406: fdatasync d1/d16/d1c/f2d 0 2024-09-12T01:43:02.556 INFO:tasks.workunit.client.1.smithi153.stdout:3/407: fsync d1/d1e/f2f 0 2024-09-12T01:43:02.556 INFO:tasks.workunit.client.0.smithi066.stdout:4/36: rmdir d4/d6/d8 39 2024-09-12T01:43:02.556 INFO:tasks.workunit.client.0.smithi066.stdout:5/46: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:02.561 INFO:tasks.workunit.client.1.smithi153.stdout:1/409: mkdir d2/d9/d28/d73/d76 0 2024-09-12T01:43:02.561 INFO:tasks.workunit.client.1.smithi153.stdout:1/410: chown d2/d9/d1d/d25/f38 510 1 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/37: unlink d4/cb 0 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/38: stat l1 0 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/39: write d4/d6/d8/fa [286,84685] 0 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/40: chown d4 2129074755 1 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/41: rename d4/d6 to d4/d6/d8/de 22 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:4/42: fsync f3 0 2024-09-12T01:43:02.562 INFO:tasks.workunit.client.0.smithi066.stdout:9/73: dwrite d0/d6/d17/d1b/f1c [0,4194304] 0 2024-09-12T01:43:02.565 INFO:tasks.workunit.client.0.smithi066.stdout:5/47: unlink d0/db/fc 0 2024-09-12T01:43:02.567 INFO:tasks.workunit.client.1.smithi153.stdout:0/422: symlink d22/d30/d4c/d8a/l92 0 2024-09-12T01:43:02.572 INFO:tasks.workunit.client.1.smithi153.stdout:2/366: dwrite d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:02.572 INFO:tasks.workunit.client.1.smithi153.stdout:5/416: rename d0/d43/d51 to d0/df/d83 0 2024-09-12T01:43:02.572 INFO:tasks.workunit.client.1.smithi153.stdout:5/417: chown d0/l82 50 1 2024-09-12T01:43:02.573 INFO:tasks.workunit.client.1.smithi153.stdout:5/418: chown d0/d43/f6b 33014 1 2024-09-12T01:43:02.579 INFO:tasks.workunit.client.0.smithi066.stdout:9/74: mknod d0/d5/c1d 0 2024-09-12T01:43:02.580 INFO:tasks.workunit.client.1.smithi153.stdout:2/367: creat d7/db/d62/f72 x:0 0 0 2024-09-12T01:43:02.580 INFO:tasks.workunit.client.0.smithi066.stdout:5/48: truncate d0/f2 1526702 0 2024-09-12T01:43:02.583 INFO:tasks.workunit.client.1.smithi153.stdout:8/415: rename d17/d1f/d4f/f5c to d17/d1d/d27/f91 0 2024-09-12T01:43:02.586 INFO:tasks.workunit.client.0.smithi066.stdout:9/75: link d0/f2 d0/d6/d17/f1e 0 2024-09-12T01:43:02.586 INFO:tasks.workunit.client.0.smithi066.stdout:9/76: fdatasync d0/d5/dc/f11 0 2024-09-12T01:43:02.586 INFO:tasks.workunit.client.0.smithi066.stdout:9/77: truncate d0/d6/d17/f18 183558 0 2024-09-12T01:43:02.586 INFO:tasks.workunit.client.0.smithi066.stdout:9/78: chown d0/d5/c1d 0 1 2024-09-12T01:43:02.586 INFO:tasks.workunit.client.0.smithi066.stdout:9/79: stat d0/f7 0 2024-09-12T01:43:02.587 INFO:tasks.workunit.client.1.smithi153.stdout:5/419: mknod d0/d43/d68/c84 0 2024-09-12T01:43:02.587 INFO:tasks.workunit.client.1.smithi153.stdout:5/420: stat d0/d15 0 2024-09-12T01:43:02.588 INFO:tasks.workunit.client.0.smithi066.stdout:4/43: dwrite d4/fd [0,4194304] 0 2024-09-12T01:43:02.588 INFO:tasks.workunit.client.0.smithi066.stdout:4/44: write d4/d6/d8/fa [189430,22150] 0 2024-09-12T01:43:02.588 INFO:tasks.workunit.client.1.smithi153.stdout:2/368: dread d7/db/d36/f42 [0,4194304] 0 2024-09-12T01:43:02.588 INFO:tasks.workunit.client.1.smithi153.stdout:0/423: getdents d22/d30/d4c/d6f/d88 0 2024-09-12T01:43:02.590 INFO:tasks.workunit.client.0.smithi066.stdout:9/80: unlink d0/d6/d17/f1e 0 2024-09-12T01:43:02.591 INFO:tasks.workunit.client.1.smithi153.stdout:3/408: rename d1/d16/d17/l50 to d1/d16/l7f 0 2024-09-12T01:43:02.591 INFO:tasks.workunit.client.1.smithi153.stdout:3/409: truncate d1/d16/f7c 721816 0 2024-09-12T01:43:02.592 INFO:tasks.workunit.client.1.smithi153.stdout:3/410: read d1/f54 [41654,87846] 0 2024-09-12T01:43:02.597 INFO:tasks.workunit.client.0.smithi066.stdout:4/45: symlink d4/d6/d8/lf 0 2024-09-12T01:43:02.597 INFO:tasks.workunit.client.0.smithi066.stdout:3/64: sync 2024-09-12T01:43:02.597 INFO:tasks.workunit.client.0.smithi066.stdout:8/59: sync 2024-09-12T01:43:02.597 INFO:tasks.workunit.client.0.smithi066.stdout:8/60: chown ff 10227 1 2024-09-12T01:43:02.598 INFO:tasks.workunit.client.0.smithi066.stdout:3/65: write d5/d6/f9 [634169,18689] 0 2024-09-12T01:43:02.598 INFO:tasks.workunit.client.0.smithi066.stdout:8/61: write fb [175544,32666] 0 2024-09-12T01:43:02.598 INFO:tasks.workunit.client.0.smithi066.stdout:8/62: write fb [845663,125970] 0 2024-09-12T01:43:02.598 INFO:tasks.workunit.client.0.smithi066.stdout:8/63: fsync f10 0 2024-09-12T01:43:02.598 INFO:tasks.workunit.client.1.smithi153.stdout:3/411: unlink d1/d64/l65 0 2024-09-12T01:43:02.598 INFO:tasks.workunit.client.0.smithi066.stdout:9/81: creat d0/d5/d12/f1f x:0 0 0 2024-09-12T01:43:02.599 INFO:tasks.workunit.client.1.smithi153.stdout:0/424: dread d22/d30/d4c/f58 [0,4194304] 0 2024-09-12T01:43:02.600 INFO:tasks.workunit.client.1.smithi153.stdout:2/369: rmdir d7/d4d 39 2024-09-12T01:43:02.601 INFO:tasks.workunit.client.0.smithi066.stdout:2/66: sync 2024-09-12T01:43:02.601 INFO:tasks.workunit.client.0.smithi066.stdout:1/58: sync 2024-09-12T01:43:02.601 INFO:tasks.workunit.client.0.smithi066.stdout:1/59: fdatasync f1 0 2024-09-12T01:43:02.601 INFO:tasks.workunit.client.1.smithi153.stdout:3/412: truncate d1/d16/d1c/d32/f7e 3147070 0 2024-09-12T01:43:02.603 INFO:tasks.workunit.client.0.smithi066.stdout:9/82: rmdir d0/d5/dc/d1a 0 2024-09-12T01:43:02.603 INFO:tasks.workunit.client.1.smithi153.stdout:0/425: rmdir d22/d30 39 2024-09-12T01:43:02.603 INFO:tasks.workunit.client.1.smithi153.stdout:0/426: read - d22/d30/d4c/f86 zero size 2024-09-12T01:43:02.604 INFO:tasks.workunit.client.0.smithi066.stdout:3/66: mkdir d5/d6/dd 0 2024-09-12T01:43:02.605 INFO:tasks.workunit.client.1.smithi153.stdout:5/421: rmdir d0/d5f 0 2024-09-12T01:43:02.606 INFO:tasks.workunit.client.0.smithi066.stdout:5/49: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:43:02.606 INFO:tasks.workunit.client.1.smithi153.stdout:8/416: dwrite d17/d1d/d27/f7e [0,4194304] 0 2024-09-12T01:43:02.606 INFO:tasks.workunit.client.1.smithi153.stdout:8/417: write d17/d21/f88 [565525,123426] 0 2024-09-12T01:43:02.606 INFO:tasks.workunit.client.1.smithi153.stdout:8/418: readlink d17/d1f/d4f/d42/l7a 0 2024-09-12T01:43:02.607 INFO:tasks.workunit.client.1.smithi153.stdout:8/419: creat d17/d21/f92 x:0 0 0 2024-09-12T01:43:02.607 INFO:tasks.workunit.client.0.smithi066.stdout:8/64: link cd c11 0 2024-09-12T01:43:02.610 INFO:tasks.workunit.client.1.smithi153.stdout:2/370: creat d7/db/d27/f73 x:0 0 0 2024-09-12T01:43:02.612 INFO:tasks.workunit.client.0.smithi066.stdout:2/67: mkdir de/d16 0 2024-09-12T01:43:02.614 INFO:tasks.workunit.client.1.smithi153.stdout:3/413: truncate d1/d16/f53 6307250 0 2024-09-12T01:43:02.616 INFO:tasks.workunit.client.0.smithi066.stdout:1/60: truncate d5/f9 436146 0 2024-09-12T01:43:02.618 INFO:tasks.workunit.client.1.smithi153.stdout:0/427: creat d22/d30/d4c/d6e/d7f/f93 x:0 0 0 2024-09-12T01:43:02.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/83: rename d0/d5/dc/f11 to d0/d6/f20 0 2024-09-12T01:43:02.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/422: creat d0/df/d83/d63/d75/d58/f85 x:0 0 0 2024-09-12T01:43:02.626 INFO:tasks.workunit.client.1.smithi153.stdout:5/423: dread d0/df/f35 [0,4194304] 0 2024-09-12T01:43:02.626 INFO:tasks.workunit.client.1.smithi153.stdout:5/424: chown d0/df/d83 6 1 2024-09-12T01:43:02.626 INFO:tasks.workunit.client.1.smithi153.stdout:2/371: rmdir d7/db/d1d/d1e 39 2024-09-12T01:43:02.626 INFO:tasks.workunit.client.1.smithi153.stdout:5/425: write d0/f32 [4318291,76821] 0 2024-09-12T01:43:02.626 INFO:tasks.workunit.client.1.smithi153.stdout:5/426: chown d0/df/d83/l33 65 1 2024-09-12T01:43:02.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/427: creat d0/df/d1c/d22/f86 x:0 0 0 2024-09-12T01:43:02.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/428: write d0/fd [1369026,86523] 0 2024-09-12T01:43:02.628 INFO:tasks.workunit.client.1.smithi153.stdout:3/414: unlink d1/d13/d25/d26/l72 0 2024-09-12T01:43:02.629 INFO:tasks.workunit.client.1.smithi153.stdout:3/415: read d1/d13/d25/d26/f44 [1389163,61881] 0 2024-09-12T01:43:02.629 INFO:tasks.workunit.client.1.smithi153.stdout:3/416: readlink d1/d16/d1c/l1d 0 2024-09-12T01:43:02.629 INFO:tasks.workunit.client.1.smithi153.stdout:3/417: creat d1/d1e/f80 x:0 0 0 2024-09-12T01:43:02.630 INFO:tasks.workunit.client.0.smithi066.stdout:1/61: creat d5/dc/dd/f11 x:0 0 0 2024-09-12T01:43:02.632 INFO:tasks.workunit.client.0.smithi066.stdout:2/68: dread f1 [0,4194304] 0 2024-09-12T01:43:02.636 INFO:tasks.workunit.client.1.smithi153.stdout:0/428: dread f1b [0,4194304] 0 2024-09-12T01:43:02.636 INFO:tasks.workunit.client.1.smithi153.stdout:0/429: fdatasync d22/f26 0 2024-09-12T01:43:02.636 INFO:tasks.workunit.client.1.smithi153.stdout:0/430: write f20 [392704,57378] 0 2024-09-12T01:43:02.638 INFO:tasks.workunit.client.0.smithi066.stdout:1/62: creat d5/dc/f12 x:0 0 0 2024-09-12T01:43:02.640 INFO:tasks.workunit.client.1.smithi153.stdout:3/418: mknod d1/d13/d25/d26/c81 0 2024-09-12T01:43:02.640 INFO:tasks.workunit.client.1.smithi153.stdout:3/419: fdatasync d1/f12 0 2024-09-12T01:43:02.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/420: write d1/f12 [95423,6383] 0 2024-09-12T01:43:02.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/421: truncate d1/d16/d1c/d32/f7e 3274506 0 2024-09-12T01:43:02.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/422: dread - d1/d45/f61 zero size 2024-09-12T01:43:02.642 INFO:tasks.workunit.client.0.smithi066.stdout:2/69: rmdir de/d16 0 2024-09-12T01:43:02.644 INFO:tasks.workunit.client.0.smithi066.stdout:9/84: rmdir d0/d6/d17/d1b 39 2024-09-12T01:43:02.644 INFO:tasks.workunit.client.0.smithi066.stdout:9/85: truncate d0/d6/f10 1068125 0 2024-09-12T01:43:02.644 INFO:tasks.workunit.client.0.smithi066.stdout:9/86: truncate d0/d6/f13 723706 0 2024-09-12T01:43:02.645 INFO:tasks.workunit.client.1.smithi153.stdout:3/423: mkdir d1/d16/d17/d82 0 2024-09-12T01:43:02.645 INFO:tasks.workunit.client.1.smithi153.stdout:3/424: creat d1/d13/f83 x:0 0 0 2024-09-12T01:43:02.646 INFO:tasks.workunit.client.0.smithi066.stdout:2/70: symlink de/l17 0 2024-09-12T01:43:02.647 INFO:tasks.workunit.client.0.smithi066.stdout:9/87: truncate d0/d5/f14 324096 0 2024-09-12T01:43:02.647 INFO:tasks.workunit.client.0.smithi066.stdout:9/88: write d0/d6/d17/f18 [4288,3053] 0 2024-09-12T01:43:02.647 INFO:tasks.workunit.client.1.smithi153.stdout:3/425: mknod d1/d13/d25/d26/c84 0 2024-09-12T01:43:02.649 INFO:tasks.workunit.client.1.smithi153.stdout:3/426: symlink d1/d16/d1c/d68/l85 0 2024-09-12T01:43:02.650 INFO:tasks.workunit.client.0.smithi066.stdout:2/71: symlink de/l18 0 2024-09-12T01:43:02.650 INFO:tasks.workunit.client.0.smithi066.stdout:2/72: dread - fd zero size 2024-09-12T01:43:02.650 INFO:tasks.workunit.client.0.smithi066.stdout:9/89: getdents d0/d5/d9 0 2024-09-12T01:43:02.651 INFO:tasks.workunit.client.0.smithi066.stdout:9/90: chown d0/c4 1 1 2024-09-12T01:43:02.652 INFO:tasks.workunit.client.0.smithi066.stdout:9/91: mknod d0/d6/d17/d1b/c21 0 2024-09-12T01:43:02.664 INFO:tasks.workunit.client.1.smithi153.stdout:3/427: write d1/d16/f27 [1935791,42802] 0 2024-09-12T01:43:02.665 INFO:tasks.workunit.client.1.smithi153.stdout:3/428: creat d1/d64/f86 x:0 0 0 2024-09-12T01:43:02.666 INFO:tasks.workunit.client.1.smithi153.stdout:3/429: creat d1/d16/f87 x:0 0 0 2024-09-12T01:43:02.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/430: mknod d1/d13/d25/d26/c88 0 2024-09-12T01:43:02.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/431: rmdir d1/d13/d25 39 2024-09-12T01:43:02.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/432: fdatasync d1/d16/d1c/d32/f5f 0 2024-09-12T01:43:02.668 INFO:tasks.workunit.client.1.smithi153.stdout:3/433: fsync d1/d13/d25/f4c 0 2024-09-12T01:43:02.668 INFO:tasks.workunit.client.1.smithi153.stdout:3/434: symlink d1/d13/d23/l89 0 2024-09-12T01:43:02.670 INFO:tasks.workunit.client.1.smithi153.stdout:3/435: rename d1/d45/c6b to d1/d13/d25/d26/d4b/c8a 0 2024-09-12T01:43:02.670 INFO:tasks.workunit.client.1.smithi153.stdout:3/436: fsync d1/d59/f66 0 2024-09-12T01:43:02.671 INFO:tasks.workunit.client.1.smithi153.stdout:3/437: truncate d1/d16/f27 9563873 0 2024-09-12T01:43:02.671 INFO:tasks.workunit.client.1.smithi153.stdout:3/438: read d1/d16/d1c/f33 [1046074,51797] 0 2024-09-12T01:43:02.685 INFO:tasks.workunit.client.0.smithi066.stdout:5/50: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:43:02.685 INFO:tasks.workunit.client.0.smithi066.stdout:8/65: dwrite fb [0,4194304] 0 2024-09-12T01:43:02.685 INFO:tasks.workunit.client.0.smithi066.stdout:8/66: chown le 5462079 1 2024-09-12T01:43:02.686 INFO:tasks.workunit.client.0.smithi066.stdout:4/46: dwrite d4/d6/d8/fa [0,4194304] 0 2024-09-12T01:43:02.693 INFO:tasks.workunit.client.0.smithi066.stdout:8/67: mkdir d12 0 2024-09-12T01:43:02.694 INFO:tasks.workunit.client.0.smithi066.stdout:8/68: rename cd to d12/c13 0 2024-09-12T01:43:02.695 INFO:tasks.workunit.client.0.smithi066.stdout:8/69: link c2 d12/c14 0 2024-09-12T01:43:02.695 INFO:tasks.workunit.client.0.smithi066.stdout:8/70: fsync f10 0 2024-09-12T01:43:02.701 INFO:tasks.workunit.client.1.smithi153.stdout:8/420: dwrite d17/d1f/d4f/d34/d6f/f70 [0,4194304] 0 2024-09-12T01:43:02.701 INFO:tasks.workunit.client.1.smithi153.stdout:8/421: fdatasync d17/d1f/d4f/d34/d6f/f70 0 2024-09-12T01:43:02.701 INFO:tasks.workunit.client.0.smithi066.stdout:2/73: dwrite fd [0,4194304] 0 2024-09-12T01:43:02.702 INFO:tasks.workunit.client.1.smithi153.stdout:0/431: dwrite d22/d30/d4c/d6f/d88/f90 [0,4194304] 0 2024-09-12T01:43:02.702 INFO:tasks.workunit.client.1.smithi153.stdout:5/429: dwrite d0/d15/f2a [0,4194304] 0 2024-09-12T01:43:02.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/372: dwrite d7/db/d1d/f60 [0,4194304] 0 2024-09-12T01:43:02.703 INFO:tasks.workunit.client.1.smithi153.stdout:3/439: dwrite d1/d16/d1c/f2d [0,4194304] 0 2024-09-12T01:43:02.704 INFO:tasks.workunit.client.0.smithi066.stdout:8/71: dread fb [0,4194304] 0 2024-09-12T01:43:02.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/74: symlink de/l19 0 2024-09-12T01:43:02.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/75: truncate fa 895616 0 2024-09-12T01:43:02.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/76: chown f5 18770982 1 2024-09-12T01:43:02.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/77: write de/ff [1026025,24918] 0 2024-09-12T01:43:02.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/78: chown fa 5 1 2024-09-12T01:43:02.709 INFO:tasks.workunit.client.0.smithi066.stdout:5/51: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:02.710 INFO:tasks.workunit.client.0.smithi066.stdout:5/52: readlink d0/l8 0 2024-09-12T01:43:02.710 INFO:tasks.workunit.client.0.smithi066.stdout:8/72: rename c11 to d12/c15 0 2024-09-12T01:43:02.711 INFO:tasks.workunit.client.1.smithi153.stdout:8/422: dread fd [0,4194304] 0 2024-09-12T01:43:02.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/432: write d22/f68 [1178299,46960] 0 2024-09-12T01:43:02.712 INFO:tasks.workunit.client.0.smithi066.stdout:2/79: symlink de/l1a 0 2024-09-12T01:43:02.714 INFO:tasks.workunit.client.0.smithi066.stdout:4/47: write d4/fd [3027565,10412] 0 2024-09-12T01:43:02.714 INFO:tasks.workunit.client.0.smithi066.stdout:9/92: dwrite d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:02.714 INFO:tasks.workunit.client.0.smithi066.stdout:1/63: rmdir d5 39 2024-09-12T01:43:02.714 INFO:tasks.workunit.client.0.smithi066.stdout:1/64: chown c2 7361 1 2024-09-12T01:43:02.719 INFO:tasks.workunit.client.1.smithi153.stdout:5/430: read d0/df/d83/f4c [5353475,85105] 0 2024-09-12T01:43:02.719 INFO:tasks.workunit.client.1.smithi153.stdout:5/431: chown d0/df/d83/c5e 699075744 1 2024-09-12T01:43:02.719 INFO:tasks.workunit.client.1.smithi153.stdout:5/432: readlink d0/d43/l48 0 2024-09-12T01:43:02.720 INFO:tasks.workunit.client.0.smithi066.stdout:5/53: mkdir d0/dd 0 2024-09-12T01:43:02.721 INFO:tasks.workunit.client.1.smithi153.stdout:8/423: write d17/d1f/d4f/f45 [3493742,16601] 0 2024-09-12T01:43:02.724 INFO:tasks.workunit.client.0.smithi066.stdout:2/80: rename de/l18 to de/l1b 0 2024-09-12T01:43:02.725 INFO:tasks.workunit.client.0.smithi066.stdout:2/81: write de/f15 [856373,713] 0 2024-09-12T01:43:02.725 INFO:tasks.workunit.client.0.smithi066.stdout:5/54: write d0/f4 [5215862,46120] 0 2024-09-12T01:43:02.727 INFO:tasks.workunit.client.1.smithi153.stdout:2/373: unlink d7/f1c 0 2024-09-12T01:43:02.729 INFO:tasks.workunit.client.0.smithi066.stdout:4/48: dread d4/fd [0,4194304] 0 2024-09-12T01:43:02.729 INFO:tasks.workunit.client.0.smithi066.stdout:4/49: creat d4/f10 x:0 0 0 2024-09-12T01:43:02.730 INFO:tasks.workunit.client.1.smithi153.stdout:3/440: dwrite d1/f1a [0,4194304] 0 2024-09-12T01:43:02.735 INFO:tasks.workunit.client.1.smithi153.stdout:8/424: mkdir d17/d1d/d93 0 2024-09-12T01:43:02.735 INFO:tasks.workunit.client.1.smithi153.stdout:8/425: stat d17/l19 0 2024-09-12T01:43:02.735 INFO:tasks.workunit.client.1.smithi153.stdout:8/426: fdatasync d17/d1f/d4f/f57 0 2024-09-12T01:43:02.735 INFO:tasks.workunit.client.1.smithi153.stdout:8/427: write d17/d1f/d4f/d34/f5f [817989,82994] 0 2024-09-12T01:43:02.737 INFO:tasks.workunit.client.1.smithi153.stdout:2/374: link d7/d19/d40/c54 d7/db/c74 0 2024-09-12T01:43:02.739 INFO:tasks.workunit.client.1.smithi153.stdout:3/441: creat d1/d16/d1c/d32/f8b x:0 0 0 2024-09-12T01:43:02.740 INFO:tasks.workunit.client.0.smithi066.stdout:1/65: symlink d5/dc/dd/l13 0 2024-09-12T01:43:02.741 INFO:tasks.workunit.client.1.smithi153.stdout:2/375: stat d7/c3e 0 2024-09-12T01:43:02.743 INFO:tasks.workunit.client.1.smithi153.stdout:3/442: creat d1/d13/d25/d26/d4b/f8c x:0 0 0 2024-09-12T01:43:02.744 INFO:tasks.workunit.client.0.smithi066.stdout:2/82: link f2 de/f1c 0 2024-09-12T01:43:02.744 INFO:tasks.workunit.client.0.smithi066.stdout:2/83: chown f9 1 1 2024-09-12T01:43:02.744 INFO:tasks.workunit.client.0.smithi066.stdout:2/84: creat de/f1d x:0 0 0 2024-09-12T01:43:02.746 INFO:tasks.workunit.client.0.smithi066.stdout:1/66: creat d5/f14 x:0 0 0 2024-09-12T01:43:02.748 INFO:tasks.workunit.client.0.smithi066.stdout:1/67: dread d5/f9 [0,4194304] 0 2024-09-12T01:43:02.748 INFO:tasks.workunit.client.0.smithi066.stdout:2/85: mkdir de/d13/d1e 0 2024-09-12T01:43:02.749 INFO:tasks.workunit.client.0.smithi066.stdout:1/68: mkdir d5/d15 0 2024-09-12T01:43:02.749 INFO:tasks.workunit.client.0.smithi066.stdout:1/69: write d5/dc/f10 [613332,90454] 0 2024-09-12T01:43:02.750 INFO:tasks.workunit.client.0.smithi066.stdout:2/86: creat de/d13/f1f x:0 0 0 2024-09-12T01:43:02.750 INFO:tasks.workunit.client.0.smithi066.stdout:2/87: write f2 [8681368,13997] 0 2024-09-12T01:43:02.750 INFO:tasks.workunit.client.0.smithi066.stdout:2/88: write de/f14 [802107,124476] 0 2024-09-12T01:43:02.750 INFO:tasks.workunit.client.0.smithi066.stdout:9/93: dread d0/f2 [4194304,4194304] 0 2024-09-12T01:43:02.750 INFO:tasks.workunit.client.0.smithi066.stdout:1/70: symlink d5/dc/dd/l16 0 2024-09-12T01:43:02.751 INFO:tasks.workunit.client.0.smithi066.stdout:1/71: truncate d5/dc/f12 361375 0 2024-09-12T01:43:02.752 INFO:tasks.workunit.client.0.smithi066.stdout:9/94: link d0/d5/f14 d0/d5/d9/f22 0 2024-09-12T01:43:02.753 INFO:tasks.workunit.client.0.smithi066.stdout:1/72: symlink d5/dc/dd/l17 0 2024-09-12T01:43:02.792 INFO:tasks.workunit.client.0.smithi066.stdout:7/19: sync 2024-09-12T01:43:02.792 INFO:tasks.workunit.client.0.smithi066.stdout:6/134: sync 2024-09-12T01:43:02.793 INFO:tasks.workunit.client.0.smithi066.stdout:7/20: rename d2/d3 to d2/d4 0 2024-09-12T01:43:02.793 INFO:tasks.workunit.client.0.smithi066.stdout:7/21: write - no filename 2024-09-12T01:43:02.794 INFO:tasks.workunit.client.0.smithi066.stdout:7/22: write - no filename 2024-09-12T01:43:02.794 INFO:tasks.workunit.client.0.smithi066.stdout:7/23: read - no filename 2024-09-12T01:43:02.794 INFO:tasks.workunit.client.0.smithi066.stdout:7/24: getdents d2/d4 0 2024-09-12T01:43:02.794 INFO:tasks.workunit.client.0.smithi066.stdout:7/25: dread - no filename 2024-09-12T01:43:02.794 INFO:tasks.workunit.client.0.smithi066.stdout:6/135: creat d2/d31/f33 x:0 0 0 2024-09-12T01:43:02.796 INFO:tasks.workunit.client.0.smithi066.stdout:6/136: dread d2/db/f27 [0,4194304] 0 2024-09-12T01:43:02.797 INFO:tasks.workunit.client.0.smithi066.stdout:6/137: link d2/db/f2d d2/d21/f34 0 2024-09-12T01:43:02.808 INFO:tasks.workunit.client.0.smithi066.stdout:2/89: dread f5 [0,4194304] 0 2024-09-12T01:43:02.808 INFO:tasks.workunit.client.0.smithi066.stdout:2/90: chown f6 7 1 2024-09-12T01:43:02.808 INFO:tasks.workunit.client.0.smithi066.stdout:2/91: truncate de/f14 959592 0 2024-09-12T01:43:02.808 INFO:tasks.workunit.client.0.smithi066.stdout:2/92: fdatasync fa 0 2024-09-12T01:43:02.809 INFO:tasks.workunit.client.0.smithi066.stdout:2/93: symlink de/d13/d1e/l20 0 2024-09-12T01:43:02.809 INFO:tasks.workunit.client.0.smithi066.stdout:2/94: creat de/f21 x:0 0 0 2024-09-12T01:43:02.810 INFO:tasks.workunit.client.0.smithi066.stdout:2/95: write de/f12 [483198,70355] 0 2024-09-12T01:43:02.812 INFO:tasks.workunit.client.1.smithi153.stdout:9/408: sync 2024-09-12T01:43:02.812 INFO:tasks.workunit.client.1.smithi153.stdout:9/409: write d3/fe [4052753,39718] 0 2024-09-12T01:43:02.812 INFO:tasks.workunit.client.1.smithi153.stdout:6/436: sync 2024-09-12T01:43:02.812 INFO:tasks.workunit.client.1.smithi153.stdout:7/364: sync 2024-09-12T01:43:02.812 INFO:tasks.workunit.client.1.smithi153.stdout:4/312: sync 2024-09-12T01:43:02.813 INFO:tasks.workunit.client.0.smithi066.stdout:2/96: write de/f1c [3938096,93689] 0 2024-09-12T01:43:02.814 INFO:tasks.workunit.client.0.smithi066.stdout:2/97: mkdir de/d13/d1e/d22 0 2024-09-12T01:43:02.814 INFO:tasks.workunit.client.1.smithi153.stdout:7/365: rmdir d12/d21/d29/d35/d37/d58 39 2024-09-12T01:43:02.815 INFO:tasks.workunit.client.0.smithi066.stdout:2/98: creat de/d13/d1e/f23 x:0 0 0 2024-09-12T01:43:02.816 INFO:tasks.workunit.client.1.smithi153.stdout:7/366: unlink d12/d21/d29/f3f 0 2024-09-12T01:43:02.816 INFO:tasks.workunit.client.0.smithi066.stdout:2/99: symlink de/d13/d1e/d22/l24 0 2024-09-12T01:43:02.817 INFO:tasks.workunit.client.1.smithi153.stdout:7/367: unlink d12/c15 0 2024-09-12T01:43:02.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/100: mkdir de/d13/d1e/d25 0 2024-09-12T01:43:02.819 INFO:tasks.workunit.client.1.smithi153.stdout:7/368: rename d12/d21/d29/d35/d37/d4c/d5c/f65 to d12/d21/f6b 0 2024-09-12T01:43:02.820 INFO:tasks.workunit.client.0.smithi066.stdout:2/101: truncate fa 742249 0 2024-09-12T01:43:02.821 INFO:tasks.workunit.client.1.smithi153.stdout:7/369: truncate d12/d21/d29/d35/d37/f57 997492 0 2024-09-12T01:43:02.823 INFO:tasks.workunit.client.0.smithi066.stdout:2/102: write f6 [295147,85003] 0 2024-09-12T01:43:02.825 INFO:tasks.workunit.client.1.smithi153.stdout:9/410: dread d3/d3a/d42/f48 [0,4194304] 0 2024-09-12T01:43:02.826 INFO:tasks.workunit.client.0.smithi066.stdout:2/103: unlink f4 0 2024-09-12T01:43:02.826 INFO:tasks.workunit.client.0.smithi066.stdout:2/104: write f1 [1624809,103042] 0 2024-09-12T01:43:02.826 INFO:tasks.workunit.client.0.smithi066.stdout:2/105: creat de/f26 x:0 0 0 2024-09-12T01:43:02.826 INFO:tasks.workunit.client.1.smithi153.stdout:3/443: dread d1/d16/d1c/f2d [0,4194304] 0 2024-09-12T01:43:02.827 INFO:tasks.workunit.client.1.smithi153.stdout:9/411: creat d3/d3a/d42/d72/f7c x:0 0 0 2024-09-12T01:43:02.830 INFO:tasks.workunit.client.1.smithi153.stdout:9/412: creat d3/d55/d30/d5b/f7d x:0 0 0 2024-09-12T01:43:02.833 INFO:tasks.workunit.client.1.smithi153.stdout:8/428: dread d17/d1d/f36 [0,4194304] 0 2024-09-12T01:43:02.833 INFO:tasks.workunit.client.1.smithi153.stdout:3/444: getdents d1/d1e 0 2024-09-12T01:43:02.835 INFO:tasks.workunit.client.0.smithi066.stdout:4/50: write d4/d6/d8/fa [1712283,113021] 0 2024-09-12T01:43:02.835 INFO:tasks.workunit.client.0.smithi066.stdout:4/51: chown d4/d6/d8/lf 2926537 1 2024-09-12T01:43:02.836 INFO:tasks.workunit.client.1.smithi153.stdout:9/413: rename d3/d55/d30/l3d to d3/d5f/l7e 0 2024-09-12T01:43:02.836 INFO:tasks.workunit.client.1.smithi153.stdout:3/445: read d1/d13/d25/f4c [1934164,128165] 0 2024-09-12T01:43:02.838 INFO:tasks.workunit.client.1.smithi153.stdout:9/414: getdents d3/d3a/d42 0 2024-09-12T01:43:02.840 INFO:tasks.workunit.client.0.smithi066.stdout:4/52: mknod d4/c11 0 2024-09-12T01:43:02.840 INFO:tasks.workunit.client.0.smithi066.stdout:4/53: creat d4/f12 x:0 0 0 2024-09-12T01:43:02.841 INFO:tasks.workunit.client.1.smithi153.stdout:9/415: truncate d3/d55/f2a 2746826 0 2024-09-12T01:43:02.842 INFO:tasks.workunit.client.0.smithi066.stdout:4/54: creat d4/d6/d8/f13 x:0 0 0 2024-09-12T01:43:02.842 INFO:tasks.workunit.client.0.smithi066.stdout:4/55: dread - d4/f10 zero size 2024-09-12T01:43:02.847 INFO:tasks.workunit.client.0.smithi066.stdout:4/56: write f3 [4056353,101910] 0 2024-09-12T01:43:02.851 INFO:tasks.workunit.client.1.smithi153.stdout:0/433: dwrite d22/f83 [0,4194304] 0 2024-09-12T01:43:02.856 INFO:tasks.workunit.client.1.smithi153.stdout:2/376: write d7/d19/d40/f37 [2249896,56665] 0 2024-09-12T01:43:02.856 INFO:tasks.workunit.client.1.smithi153.stdout:2/377: chown d7/db/f64 3918 1 2024-09-12T01:43:02.856 INFO:tasks.workunit.client.1.smithi153.stdout:2/378: truncate d7/db/d1d/f5d 241500 0 2024-09-12T01:43:02.857 INFO:tasks.workunit.client.1.smithi153.stdout:2/379: mknod d7/db/d1d/d4a/c75 0 2024-09-12T01:43:02.857 INFO:tasks.workunit.client.1.smithi153.stdout:2/380: readlink d7/db/d62/l6a 0 2024-09-12T01:43:02.857 INFO:tasks.workunit.client.1.smithi153.stdout:2/381: chown d7/db/d1d 741776910 1 2024-09-12T01:43:02.858 INFO:tasks.workunit.client.1.smithi153.stdout:2/382: chown d7/db/d1d/d1e/l53 84 1 2024-09-12T01:43:02.858 INFO:tasks.workunit.client.1.smithi153.stdout:2/383: mkdir d7/db/d6c/d76 0 2024-09-12T01:43:02.858 INFO:tasks.workunit.client.1.smithi153.stdout:2/384: symlink d7/d4d/d70/l77 0 2024-09-12T01:43:02.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/55: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:43:02.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/56: readlink d0/l3 0 2024-09-12T01:43:02.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/57: chown d0 3 1 2024-09-12T01:43:02.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/58: getdents d0/dd 0 2024-09-12T01:43:02.864 INFO:tasks.workunit.client.0.smithi066.stdout:9/95: dwrite d0/d5/f14 [0,4194304] 0 2024-09-12T01:43:02.865 INFO:tasks.workunit.client.0.smithi066.stdout:2/106: dwrite f8 [0,4194304] 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.1.smithi153.stdout:6/437: dwrite d1/d6/da/d19/d3a/f4d [0,4194304] 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/313: dwrite d6/d9/d11/d14/d3e/f50 [0,4194304] 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/314: chown d6/d15/c32 24 1 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/315: write d6/d9/d11/d13/f18 [1456176,18452] 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/316: fdatasync d6/d9/d11/d14/f57 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.1.smithi153.stdout:4/317: creat d6/d9/d26/f74 x:0 0 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.0.smithi066.stdout:6/138: dwrite d2/d21/f25 [0,4194304] 0 2024-09-12T01:43:02.866 INFO:tasks.workunit.client.0.smithi066.stdout:6/139: fdatasync d2/d31/f33 0 2024-09-12T01:43:02.868 INFO:tasks.workunit.client.1.smithi153.stdout:3/446: dwrite d1/d16/f53 [0,4194304] 0 2024-09-12T01:43:02.871 INFO:tasks.workunit.client.1.smithi153.stdout:9/416: dread d3/d3a/d42/f58 [0,4194304] 0 2024-09-12T01:43:02.872 INFO:tasks.workunit.client.1.smithi153.stdout:6/438: creat d1/d6/d46/d73/f8b x:0 0 0 2024-09-12T01:43:02.872 INFO:tasks.workunit.client.1.smithi153.stdout:2/385: dread d7/f51 [0,4194304] 0 2024-09-12T01:43:02.874 INFO:tasks.workunit.client.0.smithi066.stdout:6/140: mknod d2/db/c35 0 2024-09-12T01:43:02.874 INFO:tasks.workunit.client.0.smithi066.stdout:2/107: dread de/ff [0,4194304] 0 2024-09-12T01:43:02.874 INFO:tasks.workunit.client.0.smithi066.stdout:6/141: chown d2/db/f11 2 1 2024-09-12T01:43:02.875 INFO:tasks.workunit.client.1.smithi153.stdout:0/434: dread d22/f2c [0,4194304] 0 2024-09-12T01:43:02.879 INFO:tasks.workunit.client.1.smithi153.stdout:4/318: symlink d6/d15/d38/l75 0 2024-09-12T01:43:02.882 INFO:tasks.workunit.client.0.smithi066.stdout:9/96: write d0/d5/f14 [2328217,61853] 0 2024-09-12T01:43:02.882 INFO:tasks.workunit.client.0.smithi066.stdout:9/97: stat d0/c4 0 2024-09-12T01:43:02.884 INFO:tasks.workunit.client.0.smithi066.stdout:5/59: write d0/f2 [602729,96166] 0 2024-09-12T01:43:02.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/417: truncate d3/f29 1377167 0 2024-09-12T01:43:02.884 INFO:tasks.workunit.client.1.smithi153.stdout:6/439: dread d1/d6/f4c [4194304,4194304] 0 2024-09-12T01:43:02.884 INFO:tasks.workunit.client.1.smithi153.stdout:6/440: write d1/d6/d39/d76/f79 [236321,43779] 0 2024-09-12T01:43:02.885 INFO:tasks.workunit.client.1.smithi153.stdout:0/435: unlink f1b 0 2024-09-12T01:43:02.886 INFO:tasks.workunit.client.1.smithi153.stdout:0/436: fdatasync d22/d30/d4c/d6f/f70 0 2024-09-12T01:43:02.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/319: mkdir d6/d9/dc/d31/d76 0 2024-09-12T01:43:02.887 INFO:tasks.workunit.client.1.smithi153.stdout:2/386: dread d7/db/d1d/f35 [0,4194304] 0 2024-09-12T01:43:02.888 INFO:tasks.workunit.client.0.smithi066.stdout:0/73: sync 2024-09-12T01:43:02.888 INFO:tasks.workunit.client.0.smithi066.stdout:0/74: write d1/dc/de/f1d [506601,77575] 0 2024-09-12T01:43:02.890 INFO:tasks.workunit.client.0.smithi066.stdout:5/60: creat d0/dd/fe x:0 0 0 2024-09-12T01:43:02.890 INFO:tasks.workunit.client.0.smithi066.stdout:5/61: creat d0/dd/ff x:0 0 0 2024-09-12T01:43:02.890 INFO:tasks.workunit.client.0.smithi066.stdout:5/62: creat d0/db/f10 x:0 0 0 2024-09-12T01:43:02.891 INFO:tasks.workunit.client.1.smithi153.stdout:6/441: rename d1/d6/d39/f3e to d1/d6/d23/f8c 0 2024-09-12T01:43:02.892 INFO:tasks.workunit.client.0.smithi066.stdout:0/75: mknod d1/c1e 0 2024-09-12T01:43:02.893 INFO:tasks.workunit.client.1.smithi153.stdout:0/437: symlink d22/d79/l94 0 2024-09-12T01:43:02.893 INFO:tasks.workunit.client.0.smithi066.stdout:0/76: write d1/dc/f14 [1163746,79678] 0 2024-09-12T01:43:02.893 INFO:tasks.workunit.client.0.smithi066.stdout:2/108: dwrite fd [0,4194304] 0 2024-09-12T01:43:02.894 INFO:tasks.workunit.client.0.smithi066.stdout:2/109: fsync f9 0 2024-09-12T01:43:02.894 INFO:tasks.workunit.client.0.smithi066.stdout:9/98: dread d0/d5/f19 [0,4194304] 0 2024-09-12T01:43:02.894 INFO:tasks.workunit.client.0.smithi066.stdout:9/99: creat d0/d6/d17/f23 x:0 0 0 2024-09-12T01:43:02.895 INFO:tasks.workunit.client.1.smithi153.stdout:4/320: mknod d6/d9/d11/d14/d3e/d66/c77 0 2024-09-12T01:43:02.896 INFO:tasks.workunit.client.1.smithi153.stdout:2/387: mknod d7/db/d36/c78 0 2024-09-12T01:43:02.898 INFO:tasks.workunit.client.0.smithi066.stdout:9/100: dread d0/d5/d9/fa [4194304,4194304] 0 2024-09-12T01:43:02.898 INFO:tasks.workunit.client.0.smithi066.stdout:9/101: write d0/d5/d12/f1f [41772,84598] 0 2024-09-12T01:43:02.898 INFO:tasks.workunit.client.0.smithi066.stdout:5/63: unlink d0/l6 0 2024-09-12T01:43:02.899 INFO:tasks.workunit.client.1.smithi153.stdout:9/418: link d3/c26 d3/d55/c7f 0 2024-09-12T01:43:02.900 INFO:tasks.workunit.client.0.smithi066.stdout:0/77: rename d1/dc/de/f13 to d1/dc/de/f1f 0 2024-09-12T01:43:02.901 INFO:tasks.workunit.client.0.smithi066.stdout:7/26: getdents d2 0 2024-09-12T01:43:02.901 INFO:tasks.workunit.client.0.smithi066.stdout:7/27: write - no filename 2024-09-12T01:43:02.901 INFO:tasks.workunit.client.0.smithi066.stdout:7/28: readlink - no filename 2024-09-12T01:43:02.901 INFO:tasks.workunit.client.0.smithi066.stdout:7/29: stat d2 0 2024-09-12T01:43:02.902 INFO:tasks.workunit.client.1.smithi153.stdout:6/442: mkdir d1/d6/da/d32/d53/d8d 0 2024-09-12T01:43:02.902 INFO:tasks.workunit.client.1.smithi153.stdout:6/443: dread - d1/df/f6f zero size 2024-09-12T01:43:02.902 INFO:tasks.workunit.client.1.smithi153.stdout:6/444: chown d1/d6/da/d32/f36 3528 1 2024-09-12T01:43:02.902 INFO:tasks.workunit.client.1.smithi153.stdout:6/445: dread - d1/d6/da/d19/f6b zero size 2024-09-12T01:43:02.902 INFO:tasks.workunit.client.1.smithi153.stdout:6/446: fdatasync d1/d6/da/d32/f68 0 2024-09-12T01:43:02.903 INFO:tasks.workunit.client.0.smithi066.stdout:6/142: getdents d2/d21 0 2024-09-12T01:43:02.904 INFO:tasks.workunit.client.1.smithi153.stdout:0/438: rename c1c to d22/d79/d8e/c95 0 2024-09-12T01:43:02.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/321: rename d6/d9 to d6/d9/dc/d31/d78 22 2024-09-12T01:43:02.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/322: write d6/d9/dc/d31/f70 [929695,115732] 0 2024-09-12T01:43:02.905 INFO:tasks.workunit.client.0.smithi066.stdout:2/110: rename de/l11 to de/d13/d1e/l27 0 2024-09-12T01:43:02.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/447: creat d1/df/f8e x:0 0 0 2024-09-12T01:43:02.908 INFO:tasks.workunit.client.0.smithi066.stdout:9/102: creat d0/d6/d17/d1b/f24 x:0 0 0 2024-09-12T01:43:02.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/448: readlink d1/d6/da/d32/d4f/l5c 0 2024-09-12T01:43:02.909 INFO:tasks.workunit.client.0.smithi066.stdout:5/64: dread d0/f4 [0,4194304] 0 2024-09-12T01:43:02.910 INFO:tasks.workunit.client.0.smithi066.stdout:0/78: mkdir d1/dc/df/d20 0 2024-09-12T01:43:02.910 INFO:tasks.workunit.client.0.smithi066.stdout:0/79: readlink d1/l4 0 2024-09-12T01:43:02.911 INFO:tasks.workunit.client.1.smithi153.stdout:0/439: creat d22/d30/d4c/d6f/d88/f96 x:0 0 0 2024-09-12T01:43:02.912 INFO:tasks.workunit.client.0.smithi066.stdout:7/30: rename d2/d4 to d2/d5 0 2024-09-12T01:43:02.913 INFO:tasks.workunit.client.0.smithi066.stdout:6/143: write d2/f7 [269110,9938] 0 2024-09-12T01:43:02.915 INFO:tasks.workunit.client.1.smithi153.stdout:4/323: mknod d6/d9/d11/c79 0 2024-09-12T01:43:02.915 INFO:tasks.workunit.client.1.smithi153.stdout:4/324: write d6/d9/d20/f59 [69906,16727] 0 2024-09-12T01:43:02.916 INFO:tasks.workunit.client.1.smithi153.stdout:0/440: rmdir d22 39 2024-09-12T01:43:02.919 INFO:tasks.workunit.client.1.smithi153.stdout:0/441: symlink d22/d79/d8e/l97 0 2024-09-12T01:43:02.919 INFO:tasks.workunit.client.1.smithi153.stdout:0/442: chown d22/l66 114069856 1 2024-09-12T01:43:02.922 INFO:tasks.workunit.client.1.smithi153.stdout:9/419: dwrite d3/d55/f57 [0,4194304] 0 2024-09-12T01:43:02.922 INFO:tasks.workunit.client.1.smithi153.stdout:9/420: chown d3/d55/c7f 488161 1 2024-09-12T01:43:02.922 INFO:tasks.workunit.client.1.smithi153.stdout:3/447: truncate d1/d16/d1c/f2d 2792024 0 2024-09-12T01:43:02.925 INFO:tasks.workunit.client.1.smithi153.stdout:6/449: read d1/d6/da/d19/d3a/f4d [2755676,89560] 0 2024-09-12T01:43:02.925 INFO:tasks.workunit.client.1.smithi153.stdout:0/443: mkdir d22/d30/d4c/d6e/d7f/d98 0 2024-09-12T01:43:02.926 INFO:tasks.workunit.client.0.smithi066.stdout:4/57: truncate d4/d6/d8/fa 3410725 0 2024-09-12T01:43:02.926 INFO:tasks.workunit.client.0.smithi066.stdout:4/58: dread - d4/f12 zero size 2024-09-12T01:43:02.929 INFO:tasks.workunit.client.0.smithi066.stdout:0/80: creat d1/dc/df/d20/f21 x:0 0 0 2024-09-12T01:43:02.929 INFO:tasks.workunit.client.0.smithi066.stdout:0/81: readlink l0 0 2024-09-12T01:43:02.930 INFO:tasks.workunit.client.0.smithi066.stdout:7/31: mkdir d2/d5/d6 0 2024-09-12T01:43:02.932 INFO:tasks.workunit.client.1.smithi153.stdout:9/421: mkdir d3/d66/d80 0 2024-09-12T01:43:02.932 INFO:tasks.workunit.client.1.smithi153.stdout:9/422: truncate d3/d3a/d42/f48 5319451 0 2024-09-12T01:43:02.932 INFO:tasks.workunit.client.1.smithi153.stdout:9/423: stat d3/d35 0 2024-09-12T01:43:02.934 INFO:tasks.workunit.client.1.smithi153.stdout:4/325: dwrite d6/d9/dc/d31/f34 [0,4194304] 0 2024-09-12T01:43:02.935 INFO:tasks.workunit.client.1.smithi153.stdout:6/450: rename d1/d6/da/d19/d34/f28 to d1/d6/d46/d73/d8a/d84/f8f 0 2024-09-12T01:43:02.935 INFO:tasks.workunit.client.1.smithi153.stdout:6/451: dread - d1/d6/d23/f8c zero size 2024-09-12T01:43:02.935 INFO:tasks.workunit.client.1.smithi153.stdout:6/452: write d1/d6/da/d19/f64 [800051,10508] 0 2024-09-12T01:43:02.937 INFO:tasks.workunit.client.1.smithi153.stdout:0/444: creat d22/d30/d4c/d6f/f99 x:0 0 0 2024-09-12T01:43:02.937 INFO:tasks.workunit.client.1.smithi153.stdout:0/445: creat d22/d30/d4c/d6f/d88/f9a x:0 0 0 2024-09-12T01:43:02.937 INFO:tasks.workunit.client.1.smithi153.stdout:3/448: read d1/d13/d25/d26/d4b/f4f [4117416,115495] 0 2024-09-12T01:43:02.939 INFO:tasks.workunit.client.0.smithi066.stdout:4/59: mkdir d4/d6/d14 0 2024-09-12T01:43:02.942 INFO:tasks.workunit.client.1.smithi153.stdout:4/326: mknod d6/d9/d11/d13/c7a 0 2024-09-12T01:43:02.942 INFO:tasks.workunit.client.1.smithi153.stdout:9/424: dread d3/d55/f1e [0,4194304] 0 2024-09-12T01:43:02.943 INFO:tasks.workunit.client.0.smithi066.stdout:5/65: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:43:02.945 INFO:tasks.workunit.client.1.smithi153.stdout:0/446: rmdir d22/d30/d4c/d8a 39 2024-09-12T01:43:02.945 INFO:tasks.workunit.client.1.smithi153.stdout:0/447: getdents d22/d82 0 2024-09-12T01:43:02.945 INFO:tasks.workunit.client.0.smithi066.stdout:0/82: symlink d1/dc/df/l22 0 2024-09-12T01:43:02.945 INFO:tasks.workunit.client.0.smithi066.stdout:0/83: write d1/dc/f14 [1324752,108220] 0 2024-09-12T01:43:02.946 INFO:tasks.workunit.client.1.smithi153.stdout:3/449: symlink d1/d16/d1c/d68/d79/l8d 0 2024-09-12T01:43:02.946 INFO:tasks.workunit.client.1.smithi153.stdout:3/450: readlink d1/d13/d25/l63 0 2024-09-12T01:43:02.946 INFO:tasks.workunit.client.1.smithi153.stdout:3/451: dread - d1/d64/f86 zero size 2024-09-12T01:43:02.946 INFO:tasks.workunit.client.1.smithi153.stdout:3/452: readlink d1/d16/d1c/d68/l73 0 2024-09-12T01:43:02.947 INFO:tasks.workunit.client.0.smithi066.stdout:7/32: mkdir d2/d5/d7 0 2024-09-12T01:43:02.948 INFO:tasks.workunit.client.0.smithi066.stdout:5/66: dread d0/f4 [0,4194304] 0 2024-09-12T01:43:02.949 INFO:tasks.workunit.client.1.smithi153.stdout:6/453: write d1/f38 [6365924,32028] 0 2024-09-12T01:43:02.949 INFO:tasks.workunit.client.1.smithi153.stdout:4/327: mkdir d6/d15/d38/d7b 0 2024-09-12T01:43:02.949 INFO:tasks.workunit.client.1.smithi153.stdout:4/328: chown d6/d9 7 1 2024-09-12T01:43:02.949 INFO:tasks.workunit.client.1.smithi153.stdout:4/329: chown d6/d15/l2d 1076067 1 2024-09-12T01:43:02.950 INFO:tasks.workunit.client.1.smithi153.stdout:9/425: mkdir d3/d5f/d81 0 2024-09-12T01:43:02.950 INFO:tasks.workunit.client.1.smithi153.stdout:9/426: getdents d3/d66/d80 0 2024-09-12T01:43:02.950 INFO:tasks.workunit.client.1.smithi153.stdout:9/427: readlink d3/d3a/d42/l56 0 2024-09-12T01:43:02.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/84: link d1/dc/df/c15 d1/dc/df/d1b/c23 0 2024-09-12T01:43:02.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/85: chown d1/dc/c12 1329352 1 2024-09-12T01:43:02.951 INFO:tasks.workunit.client.0.smithi066.stdout:2/111: truncate f8 1516981 0 2024-09-12T01:43:02.953 INFO:tasks.workunit.client.1.smithi153.stdout:0/448: creat d22/d82/f9b x:0 0 0 2024-09-12T01:43:02.953 INFO:tasks.workunit.client.1.smithi153.stdout:0/449: read d22/d30/f67 [178972,89613] 0 2024-09-12T01:43:02.953 INFO:tasks.workunit.client.1.smithi153.stdout:0/450: write fa [1189066,76865] 0 2024-09-12T01:43:02.954 INFO:tasks.workunit.client.0.smithi066.stdout:5/67: mknod d0/dd/c11 0 2024-09-12T01:43:02.955 INFO:tasks.workunit.client.1.smithi153.stdout:3/453: truncate d1/d16/f69 3925383 0 2024-09-12T01:43:02.955 INFO:tasks.workunit.client.1.smithi153.stdout:3/454: chown d1/d13/d25/d26/f5a 24733915 1 2024-09-12T01:43:02.955 INFO:tasks.workunit.client.1.smithi153.stdout:3/455: write d1/d64/f86 [293434,81673] 0 2024-09-12T01:43:02.957 INFO:tasks.workunit.client.1.smithi153.stdout:6/454: rename d1/d6/da/d19/l52 to d1/d6/da/d32/d53/d69/l90 0 2024-09-12T01:43:02.957 INFO:tasks.workunit.client.1.smithi153.stdout:6/455: write d1/d6/da/d32/d53/d69/f7d [41070,102072] 0 2024-09-12T01:43:02.957 INFO:tasks.workunit.client.1.smithi153.stdout:6/456: chown d1/d6/da/d19/d3a/f4d 514347390 1 2024-09-12T01:43:02.958 INFO:tasks.workunit.client.1.smithi153.stdout:4/330: symlink d6/d9/d11/d13/l7c 0 2024-09-12T01:43:02.958 INFO:tasks.workunit.client.1.smithi153.stdout:4/331: chown d6/d15/d38/l75 21336521 1 2024-09-12T01:43:02.958 INFO:tasks.workunit.client.0.smithi066.stdout:2/112: mkdir de/d13/d28 0 2024-09-12T01:43:02.958 INFO:tasks.workunit.client.0.smithi066.stdout:2/113: readlink de/d13/d1e/d22/l24 0 2024-09-12T01:43:02.960 INFO:tasks.workunit.client.1.smithi153.stdout:9/428: write d3/f11 [4084624,104572] 0 2024-09-12T01:43:02.960 INFO:tasks.workunit.client.1.smithi153.stdout:6/457: rename d1/d6/da/f5a to d1/d6/d46/d73/f91 0 2024-09-12T01:43:02.962 INFO:tasks.workunit.client.0.smithi066.stdout:5/68: symlink d0/l12 0 2024-09-12T01:43:02.962 INFO:tasks.workunit.client.0.smithi066.stdout:5/69: read - d0/dd/fe zero size 2024-09-12T01:43:02.966 INFO:tasks.workunit.client.1.smithi153.stdout:3/456: dread d1/f5 [0,4194304] 0 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/457: chown d1/d1e/f2f 1674164 1 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:3/458: fsync d1/d1e/f5e 0 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:6/458: creat d1/d80/f92 x:0 0 0 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:4/332: mkdir d6/d9/dc/d31/d7d 0 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:6/459: read - d1/d6/da/d19/d3a/f7e zero size 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:4/333: creat d6/d9/d11/d14/f7e x:0 0 0 2024-09-12T01:43:02.967 INFO:tasks.workunit.client.1.smithi153.stdout:4/334: read - d6/f63 zero size 2024-09-12T01:43:02.968 INFO:tasks.workunit.client.1.smithi153.stdout:3/459: mkdir d1/d13/d23/d47/d71/d8e 0 2024-09-12T01:43:02.973 INFO:tasks.workunit.client.1.smithi153.stdout:6/460: rename d1/d6/f2d to d1/d6/da/d32/d53/d8d/f93 0 2024-09-12T01:43:02.973 INFO:tasks.workunit.client.1.smithi153.stdout:6/461: chown d1/d6/da/d32/d53/d69/c75 102845642 1 2024-09-12T01:43:02.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/335: rename d6/l71 to d6/l7f 0 2024-09-12T01:43:02.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/336: truncate d6/d9/d11/d13/f65 60976 0 2024-09-12T01:43:02.976 INFO:tasks.workunit.client.1.smithi153.stdout:3/460: mknod d1/d13/d23/d47/d71/c8f 0 2024-09-12T01:43:02.976 INFO:tasks.workunit.client.1.smithi153.stdout:3/461: truncate d1/d13/d25/d26/f5a 159610 0 2024-09-12T01:43:02.976 INFO:tasks.workunit.client.1.smithi153.stdout:4/337: symlink d6/d15/d38/d7b/l80 0 2024-09-12T01:43:02.978 INFO:tasks.workunit.client.1.smithi153.stdout:3/462: rename d1/d13/d25/d26/d4b/c8a to d1/d13/d25/d26/d4b/c90 0 2024-09-12T01:43:02.980 INFO:tasks.workunit.client.1.smithi153.stdout:4/338: link d6/d9/d26/c4d d6/d9/dc/d42/c81 0 2024-09-12T01:43:02.980 INFO:tasks.workunit.client.1.smithi153.stdout:1/411: sync 2024-09-12T01:43:02.980 INFO:tasks.workunit.client.1.smithi153.stdout:1/412: readlink d2/d9/d1d/l21 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:1/413: creat d2/d68/f77 x:0 0 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/463: getdents d1/d13/d23/d47/d6c 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/464: chown d1/d16/f7c 31 1 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/465: creat d1/d16/d1c/f91 x:0 0 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/466: stat d1/d16/d17/f67 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:3/467: truncate d1/d45/f58 823380 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:6/462: dread d1/d6/d39/d76/f3c [0,4194304] 0 2024-09-12T01:43:02.987 INFO:tasks.workunit.client.1.smithi153.stdout:6/463: fsync d1/d6/d23/f48 0 2024-09-12T01:43:02.988 INFO:tasks.workunit.client.0.smithi066.stdout:9/103: rmdir d0/d6 39 2024-09-12T01:43:02.988 INFO:tasks.workunit.client.0.smithi066.stdout:9/104: creat d0/d5/d12/f25 x:0 0 0 2024-09-12T01:43:02.992 INFO:tasks.workunit.client.1.smithi153.stdout:3/468: mkdir d1/d16/d17/d82/d92 0 2024-09-12T01:43:02.992 INFO:tasks.workunit.client.1.smithi153.stdout:3/469: truncate d1/d1e/f2a 1362958 0 2024-09-12T01:43:02.993 INFO:tasks.workunit.client.0.smithi066.stdout:9/105: link d0/d5/d9/de/l15 d0/d5/l26 0 2024-09-12T01:43:02.993 INFO:tasks.workunit.client.0.smithi066.stdout:9/106: chown d0/d6/d17/f23 106994848 1 2024-09-12T01:43:02.993 INFO:tasks.workunit.client.0.smithi066.stdout:9/107: write d0/d5/f19 [4706925,108346] 0 2024-09-12T01:43:02.994 INFO:tasks.workunit.client.1.smithi153.stdout:6/464: mkdir d1/d6/da/d19/d94 0 2024-09-12T01:43:02.996 INFO:tasks.workunit.client.1.smithi153.stdout:6/465: link d1/d6/da/d19/d34/f61 d1/d6/da/d32/d53/d69/d7c/d7f/f95 0 2024-09-12T01:43:02.998 INFO:tasks.workunit.client.1.smithi153.stdout:6/466: mkdir d1/d6/d46/d73/d8a/d84/d96 0 2024-09-12T01:43:02.998 INFO:tasks.workunit.client.1.smithi153.stdout:0/451: dwrite d22/d30/d4c/d6f/f73 [0,4194304] 0 2024-09-12T01:43:02.999 INFO:tasks.workunit.client.0.smithi066.stdout:3/67: sync 2024-09-12T01:43:02.999 INFO:tasks.workunit.client.0.smithi066.stdout:8/73: sync 2024-09-12T01:43:02.999 INFO:tasks.workunit.client.0.smithi066.stdout:4/60: write d4/d6/d8/fa [2473740,107561] 0 2024-09-12T01:43:02.999 INFO:tasks.workunit.client.0.smithi066.stdout:4/61: write f3 [1974635,47078] 0 2024-09-12T01:43:02.999 INFO:tasks.workunit.client.0.smithi066.stdout:4/62: chown d4 169711907 1 2024-09-12T01:43:02.999 INFO:tasks.workunit.client.0.smithi066.stdout:3/68: creat d5/fe x:0 0 0 2024-09-12T01:43:03.000 INFO:tasks.workunit.client.0.smithi066.stdout:8/74: write f3 [2699354,110510] 0 2024-09-12T01:43:03.002 INFO:tasks.workunit.client.1.smithi153.stdout:0/452: unlink d22/f5e 0 2024-09-12T01:43:03.005 INFO:tasks.workunit.client.0.smithi066.stdout:0/86: dwrite d1/dc/de/f19 [0,4194304] 0 2024-09-12T01:43:03.005 INFO:tasks.workunit.client.0.smithi066.stdout:2/114: dwrite de/f1c [4194304,4194304] 0 2024-09-12T01:43:03.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/414: dread d2/d34/f50 [0,4194304] 0 2024-09-12T01:43:03.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/415: fdatasync d2/d9/d1d/f62 0 2024-09-12T01:43:03.007 INFO:tasks.workunit.client.0.smithi066.stdout:4/63: dread d4/fd [0,4194304] 0 2024-09-12T01:43:03.007 INFO:tasks.workunit.client.0.smithi066.stdout:4/64: write d4/d6/d8/fa [4163249,15146] 0 2024-09-12T01:43:03.007 INFO:tasks.workunit.client.0.smithi066.stdout:8/75: getdents d12 0 2024-09-12T01:43:03.010 INFO:tasks.workunit.client.0.smithi066.stdout:0/87: symlink d1/dc/df/d1b/l24 0 2024-09-12T01:43:03.010 INFO:tasks.workunit.client.0.smithi066.stdout:0/88: write d1/dc/df/d20/f21 [658659,8336] 0 2024-09-12T01:43:03.010 INFO:tasks.workunit.client.0.smithi066.stdout:0/89: write d1/dc/df/d20/f21 [1351219,89872] 0 2024-09-12T01:43:03.010 INFO:tasks.workunit.client.1.smithi153.stdout:3/470: dread d1/f19 [4194304,4194304] 0 2024-09-12T01:43:03.010 INFO:tasks.workunit.client.1.smithi153.stdout:9/429: dwrite d3/d3a/d42/f58 [0,4194304] 0 2024-09-12T01:43:03.012 INFO:tasks.workunit.client.1.smithi153.stdout:1/416: unlink d2/d9/f67 0 2024-09-12T01:43:03.013 INFO:tasks.workunit.client.0.smithi066.stdout:2/115: link f5 de/d13/d1e/d25/f29 0 2024-09-12T01:43:03.013 INFO:tasks.workunit.client.0.smithi066.stdout:2/116: fsync de/d13/d1e/f23 0 2024-09-12T01:43:03.015 INFO:tasks.workunit.client.0.smithi066.stdout:4/65: mkdir d4/d15 0 2024-09-12T01:43:03.015 INFO:tasks.workunit.client.0.smithi066.stdout:4/66: creat d4/f16 x:0 0 0 2024-09-12T01:43:03.017 INFO:tasks.workunit.client.0.smithi066.stdout:8/76: symlink d12/l16 0 2024-09-12T01:43:03.019 INFO:tasks.workunit.client.0.smithi066.stdout:0/90: link d1/l11 d1/l25 0 2024-09-12T01:43:03.019 INFO:tasks.workunit.client.0.smithi066.stdout:0/91: chown d1 836754621 1 2024-09-12T01:43:03.020 INFO:tasks.workunit.client.0.smithi066.stdout:1/73: sync 2024-09-12T01:43:03.021 INFO:tasks.workunit.client.0.smithi066.stdout:1/74: read d5/f7 [560212,75480] 0 2024-09-12T01:43:03.022 INFO:tasks.workunit.client.1.smithi153.stdout:0/453: mknod d22/d30/d4c/d6e/c9c 0 2024-09-12T01:43:03.028 INFO:tasks.workunit.client.0.smithi066.stdout:8/77: creat d12/f17 x:0 0 0 2024-09-12T01:43:03.029 INFO:tasks.workunit.client.1.smithi153.stdout:9/430: unlink d3/d3a/c61 0 2024-09-12T01:43:03.030 INFO:tasks.workunit.client.0.smithi066.stdout:0/92: mkdir d1/dc/df/d1b/d26 0 2024-09-12T01:43:03.031 INFO:tasks.workunit.client.1.smithi153.stdout:6/467: getdents d1/d6/d46/d73 0 2024-09-12T01:43:03.031 INFO:tasks.workunit.client.1.smithi153.stdout:6/468: fsync d1/df/f30 0 2024-09-12T01:43:03.031 INFO:tasks.workunit.client.1.smithi153.stdout:6/469: creat d1/d6/da/d32/d53/f97 x:0 0 0 2024-09-12T01:43:03.032 INFO:tasks.workunit.client.0.smithi066.stdout:1/75: link d5/dc/dd/l16 d5/d15/l18 0 2024-09-12T01:43:03.033 INFO:tasks.workunit.client.0.smithi066.stdout:9/108: dwrite d0/d5/d9/fa [0,4194304] 0 2024-09-12T01:43:03.034 INFO:tasks.workunit.client.0.smithi066.stdout:4/67: link d4/f16 d4/f17 0 2024-09-12T01:43:03.037 INFO:tasks.workunit.client.0.smithi066.stdout:8/78: link l4 d12/l18 0 2024-09-12T01:43:03.037 INFO:tasks.workunit.client.0.smithi066.stdout:8/79: chown d12/c15 2 1 2024-09-12T01:43:03.038 INFO:tasks.workunit.client.0.smithi066.stdout:8/80: creat d12/f19 x:0 0 0 2024-09-12T01:43:03.038 INFO:tasks.workunit.client.1.smithi153.stdout:1/417: dwrite d2/d34/f50 [0,4194304] 0 2024-09-12T01:43:03.038 INFO:tasks.workunit.client.1.smithi153.stdout:1/418: fdatasync d2/d9/d1d/f22 0 2024-09-12T01:43:03.041 INFO:tasks.workunit.client.1.smithi153.stdout:0/454: dread d22/f84 [0,4194304] 0 2024-09-12T01:43:03.042 INFO:tasks.workunit.client.0.smithi066.stdout:3/69: dwrite d5/d6/f9 [0,4194304] 0 2024-09-12T01:43:03.044 INFO:tasks.workunit.client.0.smithi066.stdout:1/76: mknod d5/dc/c19 0 2024-09-12T01:43:03.045 INFO:tasks.workunit.client.0.smithi066.stdout:1/77: chown d5/d15 129467228 1 2024-09-12T01:43:03.045 INFO:tasks.workunit.client.0.smithi066.stdout:1/78: truncate d5/dc/f12 1083011 0 2024-09-12T01:43:03.045 INFO:tasks.workunit.client.1.smithi153.stdout:4/339: rmdir d6/d9/dc 39 2024-09-12T01:43:03.049 INFO:tasks.workunit.client.0.smithi066.stdout:9/109: rename d0/d6/d17/d1b/f24 to d0/d5/d12/f27 0 2024-09-12T01:43:03.051 INFO:tasks.workunit.client.0.smithi066.stdout:0/93: dread d1/dc/df/d20/f21 [0,4194304] 0 2024-09-12T01:43:03.055 INFO:tasks.workunit.client.1.smithi153.stdout:9/431: link d3/d3a/d42/l4e d3/d66/l82 0 2024-09-12T01:43:03.060 INFO:tasks.workunit.client.1.smithi153.stdout:0/455: dread f6 [0,4194304] 0 2024-09-12T01:43:03.061 INFO:tasks.workunit.client.0.smithi066.stdout:4/68: dwrite d4/f17 [0,4194304] 0 2024-09-12T01:43:03.066 INFO:tasks.workunit.client.1.smithi153.stdout:1/419: creat d2/d9/d28/d73/f78 x:0 0 0 2024-09-12T01:43:03.070 INFO:tasks.workunit.client.0.smithi066.stdout:9/110: dread d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:03.070 INFO:tasks.workunit.client.0.smithi066.stdout:9/111: fdatasync d0/d5/d12/f25 0 2024-09-12T01:43:03.071 INFO:tasks.workunit.client.0.smithi066.stdout:9/112: fdatasync d0/f2 0 2024-09-12T01:43:03.071 INFO:tasks.workunit.client.0.smithi066.stdout:9/113: stat d0/d5/dc 0 2024-09-12T01:43:03.071 INFO:tasks.workunit.client.0.smithi066.stdout:9/114: write d0/d5/d12/f25 [279036,21805] 0 2024-09-12T01:43:03.073 INFO:tasks.workunit.client.0.smithi066.stdout:3/70: unlink d5/fe 0 2024-09-12T01:43:03.073 INFO:tasks.workunit.client.0.smithi066.stdout:3/71: chown d5/fa 1660 1 2024-09-12T01:43:03.073 INFO:tasks.workunit.client.0.smithi066.stdout:3/72: fsync f4 0 2024-09-12T01:43:03.077 INFO:tasks.workunit.client.0.smithi066.stdout:0/94: creat d1/f27 x:0 0 0 2024-09-12T01:43:03.077 INFO:tasks.workunit.client.0.smithi066.stdout:4/69: write d4/f17 [1220186,127733] 0 2024-09-12T01:43:03.077 INFO:tasks.workunit.client.0.smithi066.stdout:4/70: dread - d4/f10 zero size 2024-09-12T01:43:03.079 INFO:tasks.workunit.client.0.smithi066.stdout:8/81: dwrite f10 [0,4194304] 0 2024-09-12T01:43:03.080 INFO:tasks.workunit.client.0.smithi066.stdout:1/79: dwrite f1 [4194304,4194304] 0 2024-09-12T01:43:03.080 INFO:tasks.workunit.client.0.smithi066.stdout:1/80: truncate d5/fa 4331017 0 2024-09-12T01:43:03.081 INFO:tasks.workunit.client.1.smithi153.stdout:4/340: dwrite d6/d9/d11/d14/f2a [0,4194304] 0 2024-09-12T01:43:03.081 INFO:tasks.workunit.client.1.smithi153.stdout:4/341: chown d6/d9/d11/d13/c7a 13565165 1 2024-09-12T01:43:03.083 INFO:tasks.workunit.client.0.smithi066.stdout:9/115: mkdir d0/d6/d17/d28 0 2024-09-12T01:43:03.083 INFO:tasks.workunit.client.0.smithi066.stdout:9/116: write d0/d5/d12/f25 [520088,86682] 0 2024-09-12T01:43:03.087 INFO:tasks.workunit.client.1.smithi153.stdout:9/432: dwrite d3/d55/f77 [0,4194304] 0 2024-09-12T01:43:03.090 INFO:tasks.workunit.client.1.smithi153.stdout:4/342: symlink d6/d9/d26/l82 0 2024-09-12T01:43:03.091 INFO:tasks.workunit.client.0.smithi066.stdout:0/95: read d1/dc/de/f1d [337395,38479] 0 2024-09-12T01:43:03.091 INFO:tasks.workunit.client.0.smithi066.stdout:0/96: creat d1/f28 x:0 0 0 2024-09-12T01:43:03.091 INFO:tasks.workunit.client.0.smithi066.stdout:0/97: stat d1/dc/de 0 2024-09-12T01:43:03.093 INFO:tasks.workunit.client.1.smithi153.stdout:9/433: creat d3/d5f/d81/f83 x:0 0 0 2024-09-12T01:43:03.094 INFO:tasks.workunit.client.1.smithi153.stdout:4/343: mknod d6/d15/d38/c83 0 2024-09-12T01:43:03.095 INFO:tasks.workunit.client.1.smithi153.stdout:9/434: truncate d3/f8 790861 0 2024-09-12T01:43:03.095 INFO:tasks.workunit.client.1.smithi153.stdout:9/435: write d3/d55/f6b [850611,129139] 0 2024-09-12T01:43:03.096 INFO:tasks.workunit.client.1.smithi153.stdout:0/456: dwrite d22/f5a [0,4194304] 0 2024-09-12T01:43:03.097 INFO:tasks.workunit.client.1.smithi153.stdout:4/344: mknod d6/d9/d11/d14/d3e/d66/c84 0 2024-09-12T01:43:03.098 INFO:tasks.workunit.client.1.smithi153.stdout:9/436: mkdir d3/d5f/d81/d84 0 2024-09-12T01:43:03.100 INFO:tasks.workunit.client.0.smithi066.stdout:0/98: link d1/dc/de/c1c d1/dc/de/c29 0 2024-09-12T01:43:03.101 INFO:tasks.workunit.client.0.smithi066.stdout:1/81: dwrite d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:03.101 INFO:tasks.workunit.client.0.smithi066.stdout:3/73: dwrite d5/fb [0,4194304] 0 2024-09-12T01:43:03.101 INFO:tasks.workunit.client.0.smithi066.stdout:3/74: creat d5/ff x:0 0 0 2024-09-12T01:43:03.102 INFO:tasks.workunit.client.0.smithi066.stdout:3/75: write d5/fa [918639,11255] 0 2024-09-12T01:43:03.103 INFO:tasks.workunit.client.0.smithi066.stdout:4/71: getdents d4 0 2024-09-12T01:43:03.108 INFO:tasks.workunit.client.0.smithi066.stdout:0/99: truncate d1/f9 1706987 0 2024-09-12T01:43:03.110 INFO:tasks.workunit.client.0.smithi066.stdout:9/117: getdents d0/d5/d12 0 2024-09-12T01:43:03.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/82: getdents d12 0 2024-09-12T01:43:03.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/83: fdatasync d12/f17 0 2024-09-12T01:43:03.114 INFO:tasks.workunit.client.0.smithi066.stdout:9/118: dread d0/d5/d9/f22 [0,4194304] 0 2024-09-12T01:43:03.116 INFO:tasks.workunit.client.1.smithi153.stdout:9/437: creat d3/d55/d30/d7b/f85 x:0 0 0 2024-09-12T01:43:03.116 INFO:tasks.workunit.client.1.smithi153.stdout:9/438: truncate d3/f6a 871205 0 2024-09-12T01:43:03.116 INFO:tasks.workunit.client.1.smithi153.stdout:9/439: write d3/d55/f2e [851835,24486] 0 2024-09-12T01:43:03.116 INFO:tasks.workunit.client.1.smithi153.stdout:6/470: rename d1/d6/da/d32 to d1/d6/d23/d98 0 2024-09-12T01:43:03.119 INFO:tasks.workunit.client.1.smithi153.stdout:1/420: rename d2/d9/d1d/d25/d3f/f6c to d2/d9/d17/d2f/d56/f79 0 2024-09-12T01:43:03.119 INFO:tasks.workunit.client.1.smithi153.stdout:1/421: stat d2/d9/d17/d69/f70 0 2024-09-12T01:43:03.119 INFO:tasks.workunit.client.1.smithi153.stdout:1/422: chown d2/d9/d28/l6f 10312 1 2024-09-12T01:43:03.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/72: mkdir d4/d6/d8/d18 0 2024-09-12T01:43:03.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/73: read d4/f17 [1663457,96189] 0 2024-09-12T01:43:03.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/74: write f3 [1144066,99229] 0 2024-09-12T01:43:03.123 INFO:tasks.workunit.client.0.smithi066.stdout:9/119: unlink d0/d5/d9/f22 0 2024-09-12T01:43:03.124 INFO:tasks.workunit.client.1.smithi153.stdout:6/471: dread d1/d6/d39/f63 [0,4194304] 0 2024-09-12T01:43:03.124 INFO:tasks.workunit.client.1.smithi153.stdout:6/472: creat d1/d6/d39/d76/f99 x:0 0 0 2024-09-12T01:43:03.125 INFO:tasks.workunit.client.1.smithi153.stdout:4/345: dwrite d6/d9/d11/f2f [0,4194304] 0 2024-09-12T01:43:03.128 INFO:tasks.workunit.client.0.smithi066.stdout:3/76: rename d5/d6/l8 to d5/l10 0 2024-09-12T01:43:03.129 INFO:tasks.workunit.client.0.smithi066.stdout:1/82: dwrite d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:03.132 INFO:tasks.workunit.client.0.smithi066.stdout:3/77: symlink d5/d6/dd/l11 0 2024-09-12T01:43:03.132 INFO:tasks.workunit.client.0.smithi066.stdout:3/78: truncate d5/fa 1877400 0 2024-09-12T01:43:03.133 INFO:tasks.workunit.client.1.smithi153.stdout:0/457: read d22/d30/d4c/d6f/d88/f90 [2440137,7790] 0 2024-09-12T01:43:03.134 INFO:tasks.workunit.client.0.smithi066.stdout:8/84: write f10 [171876,100556] 0 2024-09-12T01:43:03.134 INFO:tasks.workunit.client.0.smithi066.stdout:8/85: dread - d12/f17 zero size 2024-09-12T01:43:03.134 INFO:tasks.workunit.client.0.smithi066.stdout:8/86: readlink l4 0 2024-09-12T01:43:03.136 INFO:tasks.workunit.client.1.smithi153.stdout:6/473: dread d1/f4 [0,4194304] 0 2024-09-12T01:43:03.138 INFO:tasks.workunit.client.1.smithi153.stdout:9/440: dread d3/d55/f6b [0,4194304] 0 2024-09-12T01:43:03.140 INFO:tasks.workunit.client.1.smithi153.stdout:0/458: truncate d22/f68 4174906 0 2024-09-12T01:43:03.143 INFO:tasks.workunit.client.1.smithi153.stdout:9/441: creat d3/d55/d30/f86 x:0 0 0 2024-09-12T01:43:03.144 INFO:tasks.workunit.client.0.smithi066.stdout:3/79: symlink d5/d6/l12 0 2024-09-12T01:43:03.145 INFO:tasks.workunit.client.0.smithi066.stdout:1/83: dread f1 [0,4194304] 0 2024-09-12T01:43:03.145 INFO:tasks.workunit.client.0.smithi066.stdout:1/84: creat d5/f1a x:0 0 0 2024-09-12T01:43:03.146 INFO:tasks.workunit.client.1.smithi153.stdout:0/459: rename c19 to d22/d30/d4c/d6f/c9d 0 2024-09-12T01:43:03.148 INFO:tasks.workunit.client.0.smithi066.stdout:8/87: rename f10 to d12/f1a 0 2024-09-12T01:43:03.150 INFO:tasks.workunit.client.1.smithi153.stdout:9/442: symlink d3/d55/d30/l87 0 2024-09-12T01:43:03.150 INFO:tasks.workunit.client.1.smithi153.stdout:9/443: write d3/f8 [1457341,107008] 0 2024-09-12T01:43:03.151 INFO:tasks.workunit.client.0.smithi066.stdout:3/80: symlink d5/d6/dd/l13 0 2024-09-12T01:43:03.151 INFO:tasks.workunit.client.0.smithi066.stdout:3/81: chown f2 29264070 1 2024-09-12T01:43:03.151 INFO:tasks.workunit.client.0.smithi066.stdout:3/82: fsync f2 0 2024-09-12T01:43:03.154 INFO:tasks.workunit.client.1.smithi153.stdout:9/444: dread d3/d55/f59 [0,4194304] 0 2024-09-12T01:43:03.157 INFO:tasks.workunit.client.1.smithi153.stdout:9/445: mkdir d3/d55/d30/d88 0 2024-09-12T01:43:03.157 INFO:tasks.workunit.client.1.smithi153.stdout:4/346: dwrite d6/d9/dc/d31/f70 [0,4194304] 0 2024-09-12T01:43:03.158 INFO:tasks.workunit.client.1.smithi153.stdout:9/446: write d3/d55/d30/f31 [1343923,63792] 0 2024-09-12T01:43:03.159 INFO:tasks.workunit.client.0.smithi066.stdout:4/75: dwrite d4/f12 [0,4194304] 0 2024-09-12T01:43:03.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/423: dwrite d2/d9/d17/d2f/d56/d71/f75 [0,4194304] 0 2024-09-12T01:43:03.162 INFO:tasks.workunit.client.1.smithi153.stdout:6/474: dwrite d1/d6/da/d19/d3a/f7e [0,4194304] 0 2024-09-12T01:43:03.165 INFO:tasks.workunit.client.1.smithi153.stdout:4/347: creat d6/d9/dc/d42/f85 x:0 0 0 2024-09-12T01:43:03.165 INFO:tasks.workunit.client.1.smithi153.stdout:0/460: dread d22/d30/d4c/d6e/f48 [0,4194304] 0 2024-09-12T01:43:03.166 INFO:tasks.workunit.client.1.smithi153.stdout:0/461: fsync d22/d30/d4c/d6e/f35 0 2024-09-12T01:43:03.166 INFO:tasks.workunit.client.1.smithi153.stdout:0/462: fsync d22/f74 0 2024-09-12T01:43:03.168 INFO:tasks.workunit.client.1.smithi153.stdout:9/447: rename d3/d55/f2e to d3/d55/d30/d7b/f89 0 2024-09-12T01:43:03.168 INFO:tasks.workunit.client.1.smithi153.stdout:9/448: read - d3/d55/d30/f86 zero size 2024-09-12T01:43:03.172 INFO:tasks.workunit.client.1.smithi153.stdout:1/424: link d2/d9/d17/f41 d2/d9/d17/d2f/d56/d71/f7a 0 2024-09-12T01:43:03.172 INFO:tasks.workunit.client.1.smithi153.stdout:1/425: creat d2/d9/f7b x:0 0 0 2024-09-12T01:43:03.174 INFO:tasks.workunit.client.0.smithi066.stdout:4/76: rmdir d4/d6/d8 39 2024-09-12T01:43:03.175 INFO:tasks.workunit.client.1.smithi153.stdout:5/433: sync 2024-09-12T01:43:03.176 INFO:tasks.workunit.client.1.smithi153.stdout:8/429: sync 2024-09-12T01:43:03.176 INFO:tasks.workunit.client.1.smithi153.stdout:2/388: sync 2024-09-12T01:43:03.176 INFO:tasks.workunit.client.1.smithi153.stdout:7/370: sync 2024-09-12T01:43:03.176 INFO:tasks.workunit.client.1.smithi153.stdout:8/430: write d17/d1f/d4f/d34/f40 [618797,55348] 0 2024-09-12T01:43:03.176 INFO:tasks.workunit.client.1.smithi153.stdout:8/431: chown d17/d21/d3a/d6c/d89/f8e 27482 1 2024-09-12T01:43:03.176 INFO:tasks.workunit.client.1.smithi153.stdout:8/432: readlink d17/d21/l77 0 2024-09-12T01:43:03.177 INFO:tasks.workunit.client.1.smithi153.stdout:4/348: mknod d6/d9/dc/d31/d7d/c86 0 2024-09-12T01:43:03.177 INFO:tasks.workunit.client.1.smithi153.stdout:6/475: dread d1/d6/da/f1a [0,4194304] 0 2024-09-12T01:43:03.177 INFO:tasks.workunit.client.1.smithi153.stdout:6/476: write d1/d6/d39/d76/f99 [202300,127342] 0 2024-09-12T01:43:03.179 INFO:tasks.workunit.client.1.smithi153.stdout:0/463: getdents d22/d79/d8e 0 2024-09-12T01:43:03.179 INFO:tasks.workunit.client.1.smithi153.stdout:0/464: write d22/f2a [3968881,47920] 0 2024-09-12T01:43:03.180 INFO:tasks.workunit.client.1.smithi153.stdout:0/465: stat fa 0 2024-09-12T01:43:03.180 INFO:tasks.workunit.client.1.smithi153.stdout:0/466: chown d22/d79/d8e 107 1 2024-09-12T01:43:03.181 INFO:tasks.workunit.client.0.smithi066.stdout:1/85: dwrite d5/dc/dd/f11 [0,4194304] 0 2024-09-12T01:43:03.181 INFO:tasks.workunit.client.1.smithi153.stdout:9/449: rename d3/d3a/f54 to d3/d35/f8a 0 2024-09-12T01:43:03.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/100: dwrite d1/f9 [0,4194304] 0 2024-09-12T01:43:03.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/101: write d1/dc/de/f19 [4167886,105335] 0 2024-09-12T01:43:03.185 INFO:tasks.workunit.client.1.smithi153.stdout:1/426: mknod d2/d34/c7c 0 2024-09-12T01:43:03.186 INFO:tasks.workunit.client.1.smithi153.stdout:1/427: truncate d2/d9/d1d/d25/f38 1958958 0 2024-09-12T01:43:03.187 INFO:tasks.workunit.client.1.smithi153.stdout:7/371: rmdir d12/d21/d29/d35/d37 39 2024-09-12T01:43:03.187 INFO:tasks.workunit.client.1.smithi153.stdout:3/471: sync 2024-09-12T01:43:03.187 INFO:tasks.workunit.client.1.smithi153.stdout:3/472: write d1/d13/d25/d26/f5a [576704,96423] 0 2024-09-12T01:43:03.189 INFO:tasks.workunit.client.0.smithi066.stdout:1/86: rename f3 to d5/d15/f1b 0 2024-09-12T01:43:03.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/434: write d0/f32 [2609089,46963] 0 2024-09-12T01:43:03.191 INFO:tasks.workunit.client.0.smithi066.stdout:6/144: sync 2024-09-12T01:43:03.191 INFO:tasks.workunit.client.0.smithi066.stdout:6/145: write d2/d21/f30 [332818,48524] 0 2024-09-12T01:43:03.191 INFO:tasks.workunit.client.0.smithi066.stdout:6/146: truncate d2/f7 4601961 0 2024-09-12T01:43:03.192 INFO:tasks.workunit.client.1.smithi153.stdout:2/389: getdents d7/db 0 2024-09-12T01:43:03.192 INFO:tasks.workunit.client.1.smithi153.stdout:2/390: stat d7/d19/c43 0 2024-09-12T01:43:03.196 INFO:tasks.workunit.client.0.smithi066.stdout:6/147: symlink d2/l36 0 2024-09-12T01:43:03.198 INFO:tasks.workunit.client.1.smithi153.stdout:6/477: chown d1/df/l54 183 1 2024-09-12T01:43:03.198 INFO:tasks.workunit.client.1.smithi153.stdout:6/478: creat d1/d6/d39/d76/f9a x:0 0 0 2024-09-12T01:43:03.199 INFO:tasks.workunit.client.1.smithi153.stdout:0/467: creat d22/f9e x:0 0 0 2024-09-12T01:43:03.201 INFO:tasks.workunit.client.1.smithi153.stdout:1/428: rmdir d2/d9/d58/d74 39 2024-09-12T01:43:03.203 INFO:tasks.workunit.client.1.smithi153.stdout:7/372: creat d12/d21/d29/d35/d37/f6c x:0 0 0 2024-09-12T01:43:03.203 INFO:tasks.workunit.client.1.smithi153.stdout:7/373: stat d12/d21/d29/d35/d37/l61 0 2024-09-12T01:43:03.205 INFO:tasks.workunit.client.0.smithi066.stdout:8/88: dwrite d12/f1a [0,4194304] 0 2024-09-12T01:43:03.205 INFO:tasks.workunit.client.0.smithi066.stdout:8/89: chown c7 10138 1 2024-09-12T01:43:03.205 INFO:tasks.workunit.client.1.smithi153.stdout:5/435: creat d0/df/d1c/d22/d2f/f87 x:0 0 0 2024-09-12T01:43:03.207 INFO:tasks.workunit.client.1.smithi153.stdout:2/391: creat d7/d19/f79 x:0 0 0 2024-09-12T01:43:03.207 INFO:tasks.workunit.client.1.smithi153.stdout:2/392: write d7/db/d1d/d4a/f5f [523141,13553] 0 2024-09-12T01:43:03.207 INFO:tasks.workunit.client.0.smithi066.stdout:3/83: rmdir d5 39 2024-09-12T01:43:03.209 INFO:tasks.workunit.client.1.smithi153.stdout:6/479: link d1/d6/d23/d98/d53/f59 d1/d6/d23/d98/d53/d69/d7c/d7f/f9b 0 2024-09-12T01:43:03.209 INFO:tasks.workunit.client.1.smithi153.stdout:3/473: dread d1/d45/f51 [0,4194304] 0 2024-09-12T01:43:03.210 INFO:tasks.workunit.client.0.smithi066.stdout:3/84: creat d5/d6/dd/f14 x:0 0 0 2024-09-12T01:43:03.212 INFO:tasks.workunit.client.1.smithi153.stdout:1/429: mknod d2/d9/d17/d2f/d56/c7d 0 2024-09-12T01:43:03.212 INFO:tasks.workunit.client.1.smithi153.stdout:1/430: write d2/d34/d3d/f59 [101116,90348] 0 2024-09-12T01:43:03.212 INFO:tasks.workunit.client.1.smithi153.stdout:1/431: creat d2/d9/d17/d69/f7e x:0 0 0 2024-09-12T01:43:03.213 INFO:tasks.workunit.client.1.smithi153.stdout:1/432: chown d2/d9/d28 74131 1 2024-09-12T01:43:03.213 INFO:tasks.workunit.client.0.smithi066.stdout:3/85: getdents d5/d6 0 2024-09-12T01:43:03.214 INFO:tasks.workunit.client.1.smithi153.stdout:5/436: mkdir d0/df/d1c/d22/d88 0 2024-09-12T01:43:03.217 INFO:tasks.workunit.client.1.smithi153.stdout:0/468: rename d22/d30/f60 to d22/d30/d4c/f9f 0 2024-09-12T01:43:03.220 INFO:tasks.workunit.client.1.smithi153.stdout:1/433: mknod d2/d9/d17/d69/c7f 0 2024-09-12T01:43:03.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/374: write d12/f20 [2862100,40759] 0 2024-09-12T01:43:03.223 INFO:tasks.workunit.client.1.smithi153.stdout:5/437: symlink d0/df/d83/l89 0 2024-09-12T01:43:03.223 INFO:tasks.workunit.client.1.smithi153.stdout:2/393: getdents d7/db/d27 0 2024-09-12T01:43:03.225 INFO:tasks.workunit.client.1.smithi153.stdout:1/434: mkdir d2/d34/d3d/d80 0 2024-09-12T01:43:03.225 INFO:tasks.workunit.client.1.smithi153.stdout:1/435: fsync d2/d9/d17/f48 0 2024-09-12T01:43:03.226 INFO:tasks.workunit.client.1.smithi153.stdout:5/438: rename d0/df/d83/d63/d75/l76 to d0/df/l8a 0 2024-09-12T01:43:03.227 INFO:tasks.workunit.client.1.smithi153.stdout:5/439: write d0/df/f35 [465691,9667] 0 2024-09-12T01:43:03.227 INFO:tasks.workunit.client.1.smithi153.stdout:5/440: fdatasync d0/df/d1c/d22/f2b 0 2024-09-12T01:43:03.227 INFO:tasks.workunit.client.0.smithi066.stdout:8/90: dread d12/f1a [0,4194304] 0 2024-09-12T01:43:03.229 INFO:tasks.workunit.client.1.smithi153.stdout:1/436: rename d2/d9/d17/d69/c7f to d2/d9/d58/c81 0 2024-09-12T01:43:03.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/77: dwrite d4/f10 [0,4194304] 0 2024-09-12T01:43:03.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/78: chown d4/d6/d8/fa 7690174 1 2024-09-12T01:43:03.229 INFO:tasks.workunit.client.0.smithi066.stdout:4/79: read d4/f16 [2121716,75775] 0 2024-09-12T01:43:03.230 INFO:tasks.workunit.client.0.smithi066.stdout:8/91: rename d12/f1a to d12/f1b 0 2024-09-12T01:43:03.232 INFO:tasks.workunit.client.1.smithi153.stdout:1/437: mkdir d2/d9/d1d/d82 0 2024-09-12T01:43:03.234 INFO:tasks.workunit.client.1.smithi153.stdout:4/349: dwrite d6/d9/d26/f74 [0,4194304] 0 2024-09-12T01:43:03.235 INFO:tasks.workunit.client.1.smithi153.stdout:1/438: mkdir d2/d9/d17/d2f/d56/d83 0 2024-09-12T01:43:03.235 INFO:tasks.workunit.client.1.smithi153.stdout:1/439: write d2/d9/f32 [4758881,111612] 0 2024-09-12T01:43:03.235 INFO:tasks.workunit.client.1.smithi153.stdout:1/440: truncate d2/d9/d1d/d25/f4a 4594657 0 2024-09-12T01:43:03.235 INFO:tasks.workunit.client.1.smithi153.stdout:0/469: dread d22/d30/d4c/f9f [0,4194304] 0 2024-09-12T01:43:03.236 INFO:tasks.workunit.client.0.smithi066.stdout:0/102: fsync d1/dc/de/f1d 0 2024-09-12T01:43:03.236 INFO:tasks.workunit.client.0.smithi066.stdout:0/103: truncate d1/dc/f14 1483785 0 2024-09-12T01:43:03.236 INFO:tasks.workunit.client.0.smithi066.stdout:0/104: fdatasync d1/f28 0 2024-09-12T01:43:03.236 INFO:tasks.workunit.client.0.smithi066.stdout:0/105: chown d1/dc/l16 1007296430 1 2024-09-12T01:43:03.236 INFO:tasks.workunit.client.0.smithi066.stdout:0/106: creat d1/dc/de/f2a x:0 0 0 2024-09-12T01:43:03.236 INFO:tasks.workunit.client.0.smithi066.stdout:8/92: symlink d12/l1c 0 2024-09-12T01:43:03.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/86: fsync d5/d6/dd/f14 0 2024-09-12T01:43:03.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/87: chown d5 10828903 1 2024-09-12T01:43:03.239 INFO:tasks.workunit.client.1.smithi153.stdout:5/441: dread d0/df/d83/d36/d39/f72 [0,4194304] 0 2024-09-12T01:43:03.241 INFO:tasks.workunit.client.1.smithi153.stdout:9/450: dwrite d3/d55/d30/d5b/f7d [0,4194304] 0 2024-09-12T01:43:03.241 INFO:tasks.workunit.client.0.smithi066.stdout:6/148: dwrite d2/f22 [0,4194304] 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.0.smithi066.stdout:1/87: dwrite d5/dc/f10 [0,4194304] 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.0.smithi066.stdout:1/88: fsync d5/dc/f10 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.0.smithi066.stdout:0/107: mknod d1/dc/df/c2b 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.0.smithi066.stdout:0/108: creat d1/dc/de/f2c x:0 0 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.0.smithi066.stdout:0/109: creat d1/f2d x:0 0 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.1.smithi153.stdout:1/441: creat d2/d9/d17/d2f/d56/d71/f84 x:0 0 0 2024-09-12T01:43:03.242 INFO:tasks.workunit.client.1.smithi153.stdout:1/442: fdatasync d2/d9/d17/d2f/d56/f5c 0 2024-09-12T01:43:03.243 INFO:tasks.workunit.client.0.smithi066.stdout:8/93: mknod d12/c1d 0 2024-09-12T01:43:03.243 INFO:tasks.workunit.client.0.smithi066.stdout:8/94: chown le 3289008 1 2024-09-12T01:43:03.243 INFO:tasks.workunit.client.0.smithi066.stdout:8/95: dread - d12/f17 zero size 2024-09-12T01:43:03.243 INFO:tasks.workunit.client.1.smithi153.stdout:0/470: readlink d22/d30/d4c/d8a/l92 0 2024-09-12T01:43:03.245 INFO:tasks.workunit.client.0.smithi066.stdout:3/88: mknod d5/d6/c15 0 2024-09-12T01:43:03.246 INFO:tasks.workunit.client.1.smithi153.stdout:5/442: mknod d0/df/d1c/c8b 0 2024-09-12T01:43:03.247 INFO:tasks.workunit.client.0.smithi066.stdout:1/89: stat d5/d15/l18 0 2024-09-12T01:43:03.250 INFO:tasks.workunit.client.1.smithi153.stdout:3/474: dwrite d1/d45/f51 [0,4194304] 0 2024-09-12T01:43:03.250 INFO:tasks.workunit.client.0.smithi066.stdout:0/110: creat d1/dc/df/d1b/d26/f2e x:0 0 0 2024-09-12T01:43:03.250 INFO:tasks.workunit.client.0.smithi066.stdout:0/111: write d1/dc/de/f1d [1431544,49042] 0 2024-09-12T01:43:03.251 INFO:tasks.workunit.client.0.smithi066.stdout:3/89: mknod d5/c16 0 2024-09-12T01:43:03.251 INFO:tasks.workunit.client.0.smithi066.stdout:1/90: dread d5/f7 [0,4194304] 0 2024-09-12T01:43:03.252 INFO:tasks.workunit.client.1.smithi153.stdout:4/350: dread d6/d9/d26/f47 [0,4194304] 0 2024-09-12T01:43:03.253 INFO:tasks.workunit.client.0.smithi066.stdout:0/112: rename d1/dc/l16 to d1/dc/df/l2f 0 2024-09-12T01:43:03.255 INFO:tasks.workunit.client.0.smithi066.stdout:3/90: creat d5/f17 x:0 0 0 2024-09-12T01:43:03.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/91: truncate f1 6876187 0 2024-09-12T01:43:03.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/92: chown d5/dc/c19 1 1 2024-09-12T01:43:03.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/93: stat d5/dc/c19 0 2024-09-12T01:43:03.258 INFO:tasks.workunit.client.0.smithi066.stdout:1/94: unlink d5/dc/dd/l16 0 2024-09-12T01:43:03.262 INFO:tasks.workunit.client.1.smithi153.stdout:1/443: write d2/d9/d17/d2c/f4d [1790563,43200] 0 2024-09-12T01:43:03.262 INFO:tasks.workunit.client.1.smithi153.stdout:6/480: dwrite d1/d6/d39/d76/f42 [0,4194304] 0 2024-09-12T01:43:03.269 INFO:tasks.workunit.client.1.smithi153.stdout:1/444: creat d2/d9/d17/d2c/f85 x:0 0 0 2024-09-12T01:43:03.272 INFO:tasks.workunit.client.1.smithi153.stdout:3/475: dread d1/d13/d25/d26/d4b/f4f [0,4194304] 0 2024-09-12T01:43:03.272 INFO:tasks.workunit.client.1.smithi153.stdout:3/476: fsync d1/d16/d1c/d32/f43 0 2024-09-12T01:43:03.272 INFO:tasks.workunit.client.1.smithi153.stdout:3/477: stat d1/d13/d25/d26/c84 0 2024-09-12T01:43:03.272 INFO:tasks.workunit.client.1.smithi153.stdout:3/478: fsync d1/d13/f83 0 2024-09-12T01:43:03.272 INFO:tasks.workunit.client.1.smithi153.stdout:3/479: fdatasync d1/d13/d23/f2b 0 2024-09-12T01:43:03.273 INFO:tasks.workunit.client.0.smithi066.stdout:1/95: write d5/dc/f10 [2728262,54739] 0 2024-09-12T01:43:03.273 INFO:tasks.workunit.client.1.smithi153.stdout:7/375: dwrite d12/d21/d29/f3d [0,4194304] 0 2024-09-12T01:43:03.274 INFO:tasks.workunit.client.0.smithi066.stdout:1/96: mkdir d5/dc/dd/d1c 0 2024-09-12T01:43:03.275 INFO:tasks.workunit.client.0.smithi066.stdout:1/97: mknod d5/dc/c1d 0 2024-09-12T01:43:03.276 INFO:tasks.workunit.client.0.smithi066.stdout:1/98: dread d5/f7 [0,4194304] 0 2024-09-12T01:43:03.277 INFO:tasks.workunit.client.1.smithi153.stdout:3/480: rename d1/d16/d1c/d68 to d1/d13/d23/d47/d71/d8e/d93 0 2024-09-12T01:43:03.277 INFO:tasks.workunit.client.0.smithi066.stdout:1/99: mknod d5/c1e 0 2024-09-12T01:43:03.277 INFO:tasks.workunit.client.0.smithi066.stdout:1/100: readlink d5/d15/l18 0 2024-09-12T01:43:03.278 INFO:tasks.workunit.client.0.smithi066.stdout:1/101: write d5/dc/f10 [405635,109380] 0 2024-09-12T01:43:03.278 INFO:tasks.workunit.client.1.smithi153.stdout:3/481: mknod d1/d13/d23/d47/d71/d8e/d93/d79/c94 0 2024-09-12T01:43:03.279 INFO:tasks.workunit.client.1.smithi153.stdout:3/482: getdents d1/d13/d23/d47 0 2024-09-12T01:43:03.280 INFO:tasks.workunit.client.1.smithi153.stdout:3/483: symlink d1/d13/d23/d47/l95 0 2024-09-12T01:43:03.282 INFO:tasks.workunit.client.1.smithi153.stdout:3/484: rename d1/l10 to d1/d16/d17/d82/l96 0 2024-09-12T01:43:03.283 INFO:tasks.workunit.client.1.smithi153.stdout:3/485: write d1/d16/f53 [5357923,71327] 0 2024-09-12T01:43:03.286 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:02 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:03.289 INFO:tasks.workunit.client.1.smithi153.stdout:6/481: dread d1/d6/d46/d73/f91 [0,4194304] 0 2024-09-12T01:43:03.291 INFO:tasks.workunit.client.1.smithi153.stdout:6/482: creat d1/d6/d23/d98/d53/d69/d7c/d7f/f9c x:0 0 0 2024-09-12T01:43:03.291 INFO:tasks.workunit.client.1.smithi153.stdout:6/483: fsync d1/d6/da/f37 0 2024-09-12T01:43:03.293 INFO:tasks.workunit.client.1.smithi153.stdout:2/394: dwrite d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:03.293 INFO:tasks.workunit.client.1.smithi153.stdout:2/395: read d7/db/d27/f29 [36208,20098] 0 2024-09-12T01:43:03.295 INFO:tasks.workunit.client.1.smithi153.stdout:3/486: write d1/f1a [1806983,21746] 0 2024-09-12T01:43:03.296 INFO:tasks.workunit.client.0.smithi066.stdout:4/80: truncate d4/f10 1707276 0 2024-09-12T01:43:03.298 INFO:tasks.workunit.client.1.smithi153.stdout:1/445: getdents d2/d9/d1d 0 2024-09-12T01:43:03.302 INFO:tasks.workunit.client.1.smithi153.stdout:2/396: link d7/db/d27/l57 d7/db/d27/d56/l7a 0 2024-09-12T01:43:03.303 INFO:tasks.workunit.client.1.smithi153.stdout:1/446: truncate d2/d34/f55 590465 0 2024-09-12T01:43:03.304 INFO:tasks.workunit.client.1.smithi153.stdout:2/397: mkdir d7/d4d/d7b 0 2024-09-12T01:43:03.304 INFO:tasks.workunit.client.1.smithi153.stdout:2/398: dread - d7/db/d27/f73 zero size 2024-09-12T01:43:03.305 INFO:tasks.workunit.client.0.smithi066.stdout:4/81: dread d4/fd [0,4194304] 0 2024-09-12T01:43:03.305 INFO:tasks.workunit.client.1.smithi153.stdout:2/399: mkdir d7/db/d7c 0 2024-09-12T01:43:03.305 INFO:tasks.workunit.client.1.smithi153.stdout:2/400: fsync d7/db/ff 0 2024-09-12T01:43:03.305 INFO:tasks.workunit.client.1.smithi153.stdout:2/401: creat d7/db/d27/f7d x:0 0 0 2024-09-12T01:43:03.307 INFO:tasks.workunit.client.0.smithi066.stdout:4/82: mknod d4/d6/d8/c19 0 2024-09-12T01:43:03.310 INFO:tasks.workunit.client.0.smithi066.stdout:4/83: creat d4/d6/d8/f1a x:0 0 0 2024-09-12T01:43:03.315 INFO:tasks.workunit.client.0.smithi066.stdout:4/84: dread d4/fd [0,4194304] 0 2024-09-12T01:43:03.316 INFO:tasks.workunit.client.1.smithi153.stdout:0/471: dwrite d22/f3c [0,4194304] 0 2024-09-12T01:43:03.317 INFO:tasks.workunit.client.1.smithi153.stdout:9/451: dwrite d3/f1f [4194304,4194304] 0 2024-09-12T01:43:03.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/113: dwrite d1/fa [0,4194304] 0 2024-09-12T01:43:03.321 INFO:tasks.workunit.client.1.smithi153.stdout:7/376: dwrite d12/d21/d4d/f59 [0,4194304] 0 2024-09-12T01:43:03.322 INFO:tasks.workunit.client.1.smithi153.stdout:7/377: write d12/f17 [3483489,72918] 0 2024-09-12T01:43:03.322 INFO:tasks.workunit.client.1.smithi153.stdout:7/378: write d12/d21/d29/d35/d37/d58/f63 [818523,110057] 0 2024-09-12T01:43:03.322 INFO:tasks.workunit.client.0.smithi066.stdout:8/96: dwrite d12/f19 [0,4194304] 0 2024-09-12T01:43:03.322 INFO:tasks.workunit.client.0.smithi066.stdout:8/97: write d12/f1b [4645326,104586] 0 2024-09-12T01:43:03.323 INFO:tasks.workunit.client.0.smithi066.stdout:3/91: dwrite f3 [0,4194304] 0 2024-09-12T01:43:03.327 INFO:tasks.workunit.client.1.smithi153.stdout:5/443: dwrite d0/d15/f54 [0,4194304] 0 2024-09-12T01:43:03.327 INFO:tasks.workunit.client.1.smithi153.stdout:5/444: stat d0/df/d1c/d22 0 2024-09-12T01:43:03.327 INFO:tasks.workunit.client.1.smithi153.stdout:5/445: read d0/df/d1c/d22/f38 [720502,99981] 0 2024-09-12T01:43:03.328 INFO:tasks.workunit.client.0.smithi066.stdout:0/114: dread d1/dc/df/f1a [0,4194304] 0 2024-09-12T01:43:03.328 INFO:tasks.workunit.client.0.smithi066.stdout:0/115: fdatasync d1/dc/df/d20/f21 0 2024-09-12T01:43:03.328 INFO:tasks.workunit.client.0.smithi066.stdout:0/116: creat d1/dc/df/d20/f30 x:0 0 0 2024-09-12T01:43:03.335 INFO:tasks.workunit.client.1.smithi153.stdout:3/487: dwrite d1/d16/d17/f18 [0,4194304] 0 2024-09-12T01:43:03.335 INFO:tasks.workunit.client.1.smithi153.stdout:3/488: write d1/d16/f69 [1680147,75979] 0 2024-09-12T01:43:03.336 INFO:tasks.workunit.client.1.smithi153.stdout:2/402: rename d7/db/d1d/d4a to d7/db/d6c/d7e 0 2024-09-12T01:43:03.336 INFO:tasks.workunit.client.1.smithi153.stdout:2/403: creat d7/db/d62/f7f x:0 0 0 2024-09-12T01:43:03.336 INFO:tasks.workunit.client.1.smithi153.stdout:2/404: readlink d7/db/d62/l6a 0 2024-09-12T01:43:03.336 INFO:tasks.workunit.client.1.smithi153.stdout:2/405: write d7/db/d27/d56/f5b [850480,80108] 0 2024-09-12T01:43:03.340 INFO:tasks.workunit.client.1.smithi153.stdout:6/484: dwrite d1/d6/da/d19/f6b [0,4194304] 0 2024-09-12T01:43:03.341 INFO:tasks.workunit.client.1.smithi153.stdout:0/472: getdents d22/d30/d4c/d6f/d88 0 2024-09-12T01:43:03.347 INFO:tasks.workunit.client.1.smithi153.stdout:5/446: write d0/df/f10 [2176814,128342] 0 2024-09-12T01:43:03.355 INFO:tasks.workunit.client.0.smithi066.stdout:8/98: rename d12/f17 to d12/f1e 0 2024-09-12T01:43:03.355 INFO:tasks.workunit.client.0.smithi066.stdout:8/99: dread - d12/f1e zero size 2024-09-12T01:43:03.359 INFO:tasks.workunit.client.0.smithi066.stdout:6/149: dwrite d2/d21/f30 [0,4194304] 0 2024-09-12T01:43:03.359 INFO:tasks.workunit.client.1.smithi153.stdout:9/452: dwrite d3/f51 [0,4194304] 0 2024-09-12T01:43:03.360 INFO:tasks.workunit.client.1.smithi153.stdout:9/453: write d3/d35/f37 [1094761,64355] 0 2024-09-12T01:43:03.363 INFO:tasks.workunit.client.1.smithi153.stdout:7/379: dwrite d12/d21/f45 [0,4194304] 0 2024-09-12T01:43:03.364 INFO:tasks.workunit.client.1.smithi153.stdout:7/380: dread - d12/d21/d29/d35/d37/f6c zero size 2024-09-12T01:43:03.364 INFO:tasks.workunit.client.0.smithi066.stdout:0/117: dwrite d1/fa [0,4194304] 0 2024-09-12T01:43:03.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/100: creat d12/f1f x:0 0 0 2024-09-12T01:43:03.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/101: fdatasync d12/f1e 0 2024-09-12T01:43:03.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/102: dread - d12/f1e zero size 2024-09-12T01:43:03.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/103: chown ff 413854873 1 2024-09-12T01:43:03.365 INFO:tasks.workunit.client.1.smithi153.stdout:3/489: dwrite d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:03.371 INFO:tasks.workunit.client.1.smithi153.stdout:9/454: dread d3/d55/f32 [0,4194304] 0 2024-09-12T01:43:03.371 INFO:tasks.workunit.client.1.smithi153.stdout:9/455: readlink d3/d3a/l43 0 2024-09-12T01:43:03.371 INFO:tasks.workunit.client.1.smithi153.stdout:9/456: chown d3/d66/l67 1333898273 1 2024-09-12T01:43:03.372 INFO:tasks.workunit.client.1.smithi153.stdout:1/447: write d2/d34/f55 [171671,130360] 0 2024-09-12T01:43:03.372 INFO:tasks.workunit.client.0.smithi066.stdout:4/85: unlink d4/f10 0 2024-09-12T01:43:03.373 INFO:tasks.workunit.client.1.smithi153.stdout:2/406: rmdir d7/db/d6c 39 2024-09-12T01:43:03.376 INFO:tasks.workunit.client.0.smithi066.stdout:0/118: mknod d1/dc/df/d20/c31 0 2024-09-12T01:43:03.376 INFO:tasks.workunit.client.0.smithi066.stdout:0/119: write d1/dc/f14 [2206502,60030] 0 2024-09-12T01:43:03.377 INFO:tasks.workunit.client.0.smithi066.stdout:6/150: symlink d2/db/l37 0 2024-09-12T01:43:03.379 INFO:tasks.workunit.client.0.smithi066.stdout:4/86: dread d4/f16 [0,4194304] 0 2024-09-12T01:43:03.379 INFO:tasks.workunit.client.0.smithi066.stdout:0/120: rename d1/dc/df/l17 to d1/dc/df/d20/l32 0 2024-09-12T01:43:03.379 INFO:tasks.workunit.client.0.smithi066.stdout:0/121: readlink d1/dc/df/l22 0 2024-09-12T01:43:03.380 INFO:tasks.workunit.client.1.smithi153.stdout:0/473: mknod d22/d30/ca0 0 2024-09-12T01:43:03.384 INFO:tasks.workunit.client.1.smithi153.stdout:5/447: rename d0/df/f4f to d0/df/d83/d63/d75/f8c 0 2024-09-12T01:43:03.385 INFO:tasks.workunit.client.1.smithi153.stdout:5/448: write d0/df/d83/f7f [272400,88830] 0 2024-09-12T01:43:03.385 INFO:tasks.workunit.client.1.smithi153.stdout:5/449: chown d0/df/d83/d36/d39 2218448 1 2024-09-12T01:43:03.385 INFO:tasks.workunit.client.0.smithi066.stdout:4/87: symlink d4/l1b 0 2024-09-12T01:43:03.385 INFO:tasks.workunit.client.0.smithi066.stdout:4/88: write d4/fd [3093549,77686] 0 2024-09-12T01:43:03.386 INFO:tasks.workunit.client.0.smithi066.stdout:6/151: dread d2/f7 [0,4194304] 0 2024-09-12T01:43:03.386 INFO:tasks.workunit.client.0.smithi066.stdout:6/152: fdatasync d2/d21/f30 0 2024-09-12T01:43:03.388 INFO:tasks.workunit.client.0.smithi066.stdout:4/89: mknod d4/c1c 0 2024-09-12T01:43:03.388 INFO:tasks.workunit.client.0.smithi066.stdout:4/90: read d4/f16 [1869771,29364] 0 2024-09-12T01:43:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:02 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:03.390 INFO:tasks.workunit.client.0.smithi066.stdout:4/91: mknod d4/d6/d8/c1d 0 2024-09-12T01:43:03.393 INFO:tasks.workunit.client.0.smithi066.stdout:4/92: unlink d4/fd 0 2024-09-12T01:43:03.395 INFO:tasks.workunit.client.0.smithi066.stdout:4/93: mknod d4/d6/d14/c1e 0 2024-09-12T01:43:03.398 INFO:tasks.workunit.client.1.smithi153.stdout:3/490: mkdir d1/d13/d25/d26/d4b/d97 0 2024-09-12T01:43:03.398 INFO:tasks.workunit.client.1.smithi153.stdout:3/491: write d1/d45/f61 [236441,15168] 0 2024-09-12T01:43:03.399 INFO:tasks.workunit.client.1.smithi153.stdout:1/448: mknod d2/d9/d17/d2f/d56/d71/c86 0 2024-09-12T01:43:03.399 INFO:tasks.workunit.client.1.smithi153.stdout:6/485: mkdir d1/df/d9d 0 2024-09-12T01:43:03.401 INFO:tasks.workunit.client.1.smithi153.stdout:0/474: symlink d22/la1 0 2024-09-12T01:43:03.401 INFO:tasks.workunit.client.1.smithi153.stdout:7/381: getdents d12/d21/d29/d35/d3c 0 2024-09-12T01:43:03.403 INFO:tasks.workunit.client.1.smithi153.stdout:1/449: getdents d2/d9/d28 0 2024-09-12T01:43:03.404 INFO:tasks.workunit.client.1.smithi153.stdout:0/475: fsync d22/d30/d4c/f81 0 2024-09-12T01:43:03.404 INFO:tasks.workunit.client.1.smithi153.stdout:0/476: stat d22/d30/d4c/d6f/d88/f89 0 2024-09-12T01:43:03.407 INFO:tasks.workunit.client.0.smithi066.stdout:8/104: dwrite fb [0,4194304] 0 2024-09-12T01:43:03.410 INFO:tasks.workunit.client.1.smithi153.stdout:1/450: truncate d2/d9/d17/d2c/f4d 3053000 0 2024-09-12T01:43:03.411 INFO:tasks.workunit.client.1.smithi153.stdout:0/477: creat d22/d30/d4c/fa2 x:0 0 0 2024-09-12T01:43:03.416 INFO:tasks.workunit.client.1.smithi153.stdout:1/451: rename d2/d9/d17/d2f/d56/d71/c86 to d2/d68/c87 0 2024-09-12T01:43:03.416 INFO:tasks.workunit.client.1.smithi153.stdout:1/452: chown d2/d34/f53 6323741 1 2024-09-12T01:43:03.418 INFO:tasks.workunit.client.0.smithi066.stdout:7/33: sync 2024-09-12T01:43:03.418 INFO:tasks.workunit.client.0.smithi066.stdout:7/34: truncate - no filename 2024-09-12T01:43:03.419 INFO:tasks.workunit.client.0.smithi066.stdout:7/35: mknod d2/d5/d6/c8 0 2024-09-12T01:43:03.419 INFO:tasks.workunit.client.0.smithi066.stdout:7/36: fsync - no filename 2024-09-12T01:43:03.420 INFO:tasks.workunit.client.0.smithi066.stdout:7/37: symlink d2/d5/l9 0 2024-09-12T01:43:03.420 INFO:tasks.workunit.client.0.smithi066.stdout:7/38: mkdir d2/d5/da 0 2024-09-12T01:43:03.420 INFO:tasks.workunit.client.0.smithi066.stdout:7/39: chown d2/d5/da 4495480 1 2024-09-12T01:43:03.421 INFO:tasks.workunit.client.0.smithi066.stdout:7/40: write - no filename 2024-09-12T01:43:03.421 INFO:tasks.workunit.client.0.smithi066.stdout:7/41: mknod d2/d5/d7/cb 0 2024-09-12T01:43:03.421 INFO:tasks.workunit.client.0.smithi066.stdout:7/42: rmdir d2 39 2024-09-12T01:43:03.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/43: dwrite - no filename 2024-09-12T01:43:03.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/44: dwrite - no filename 2024-09-12T01:43:03.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/45: read - no filename 2024-09-12T01:43:03.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/46: write - no filename 2024-09-12T01:43:03.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/47: rename d2/d5/d7/cb to d2/d5/cc 0 2024-09-12T01:43:03.422 INFO:tasks.workunit.client.0.smithi066.stdout:7/48: truncate - no filename 2024-09-12T01:43:03.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/49: link d2/d5/d6/c8 d2/d5/cd 0 2024-09-12T01:43:03.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/50: dread - no filename 2024-09-12T01:43:03.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/51: creat d2/d5/d6/fe x:0 0 0 2024-09-12T01:43:03.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/52: rename d2/d5/d6 to d2/d5/d6/df 22 2024-09-12T01:43:03.472 INFO:tasks.workunit.client.1.smithi153.stdout:9/457: dwrite d3/f5 [0,4194304] 0 2024-09-12T01:43:03.476 INFO:tasks.workunit.client.0.smithi066.stdout:8/105: dread f3 [0,4194304] 0 2024-09-12T01:43:03.476 INFO:tasks.workunit.client.1.smithi153.stdout:9/458: write d3/d35/f37 [1151385,108973] 0 2024-09-12T01:43:03.477 INFO:tasks.workunit.client.0.smithi066.stdout:8/106: rmdir d12 39 2024-09-12T01:43:03.478 INFO:tasks.workunit.client.0.smithi066.stdout:6/153: dwrite d2/d21/f34 [0,4194304] 0 2024-09-12T01:43:03.478 INFO:tasks.workunit.client.0.smithi066.stdout:6/154: write d2/f1f [795378,103573] 0 2024-09-12T01:43:03.478 INFO:tasks.workunit.client.0.smithi066.stdout:6/155: creat d2/f38 x:0 0 0 2024-09-12T01:43:03.478 INFO:tasks.workunit.client.0.smithi066.stdout:6/156: write d2/fe [1231443,120370] 0 2024-09-12T01:43:03.478 INFO:tasks.workunit.client.0.smithi066.stdout:6/157: creat d2/d31/f39 x:0 0 0 2024-09-12T01:43:03.479 INFO:tasks.workunit.client.1.smithi153.stdout:3/492: dwrite d1/d64/f86 [0,4194304] 0 2024-09-12T01:43:03.479 INFO:tasks.workunit.client.1.smithi153.stdout:6/486: dwrite d1/d6/d23/d98/d4f/f66 [0,4194304] 0 2024-09-12T01:43:03.479 INFO:tasks.workunit.client.1.smithi153.stdout:5/450: dwrite d0/df/d83/d36/f3b [0,4194304] 0 2024-09-12T01:43:03.481 INFO:tasks.workunit.client.1.smithi153.stdout:2/407: dwrite d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:03.482 INFO:tasks.workunit.client.0.smithi066.stdout:6/158: creat d2/db/f3a x:0 0 0 2024-09-12T01:43:03.482 INFO:tasks.workunit.client.1.smithi153.stdout:1/453: write d2/d9/d17/d2f/d56/f6a [3542870,27663] 0 2024-09-12T01:43:03.483 INFO:tasks.workunit.client.1.smithi153.stdout:9/459: dread d3/d3a/d42/d72/f74 [0,4194304] 0 2024-09-12T01:43:03.487 INFO:tasks.workunit.client.1.smithi153.stdout:3/493: unlink d1/d64/c6e 0 2024-09-12T01:43:03.488 INFO:tasks.workunit.client.1.smithi153.stdout:6/487: link d1/d6/da/l1c d1/l9e 0 2024-09-12T01:43:03.491 INFO:tasks.workunit.client.1.smithi153.stdout:2/408: mknod d7/d4d/d7b/c80 0 2024-09-12T01:43:03.492 INFO:tasks.workunit.client.1.smithi153.stdout:9/460: mkdir d3/d5f/d81/d84/d8b 0 2024-09-12T01:43:03.492 INFO:tasks.workunit.client.1.smithi153.stdout:9/461: write d3/d55/d30/f31 [1335158,101865] 0 2024-09-12T01:43:03.496 INFO:tasks.workunit.client.0.smithi066.stdout:0/122: dwrite d1/dc/f14 [0,4194304] 0 2024-09-12T01:43:03.496 INFO:tasks.workunit.client.1.smithi153.stdout:6/488: rename d1/d6/d23/d98/d53/f59 to d1/d6/da/d19/d3a/f9f 0 2024-09-12T01:43:03.496 INFO:tasks.workunit.client.1.smithi153.stdout:9/462: dread d3/d55/d30/d7b/f89 [0,4194304] 0 2024-09-12T01:43:03.497 INFO:tasks.workunit.client.1.smithi153.stdout:2/409: mkdir d7/d4d/d70/d81 0 2024-09-12T01:43:03.499 INFO:tasks.workunit.client.0.smithi066.stdout:8/107: write d12/f19 [2994766,31238] 0 2024-09-12T01:43:03.501 INFO:tasks.workunit.client.1.smithi153.stdout:9/463: creat d3/d55/d30/d88/f8c x:0 0 0 2024-09-12T01:43:03.501 INFO:tasks.workunit.client.1.smithi153.stdout:9/464: stat d3/f7 0 2024-09-12T01:43:03.501 INFO:tasks.workunit.client.1.smithi153.stdout:9/465: write d3/d35/f79 [823557,104917] 0 2024-09-12T01:43:03.501 INFO:tasks.workunit.client.1.smithi153.stdout:9/466: chown d3/d5f 0 1 2024-09-12T01:43:03.501 INFO:tasks.workunit.client.0.smithi066.stdout:0/123: creat d1/dc/df/d1b/f33 x:0 0 0 2024-09-12T01:43:03.503 INFO:tasks.workunit.client.1.smithi153.stdout:9/467: symlink d3/d5f/d62/l8d 0 2024-09-12T01:43:03.523 INFO:tasks.workunit.client.0.smithi066.stdout:7/53: dwrite d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:03.525 INFO:tasks.workunit.client.0.smithi066.stdout:7/54: mknod d2/d5/da/c10 0 2024-09-12T01:43:03.525 INFO:tasks.workunit.client.0.smithi066.stdout:7/55: readlink d2/d5/l9 0 2024-09-12T01:43:03.525 INFO:tasks.workunit.client.1.smithi153.stdout:0/478: dwrite d22/d30/d4c/d6f/f73 [0,4194304] 0 2024-09-12T01:43:03.525 INFO:tasks.workunit.client.1.smithi153.stdout:0/479: creat d22/d30/d4c/d6e/d7f/fa3 x:0 0 0 2024-09-12T01:43:03.525 INFO:tasks.workunit.client.1.smithi153.stdout:0/480: dread - d22/d30/f59 zero size 2024-09-12T01:43:03.526 INFO:tasks.workunit.client.1.smithi153.stdout:9/468: dread d3/d35/f75 [0,4194304] 0 2024-09-12T01:43:03.526 INFO:tasks.workunit.client.1.smithi153.stdout:9/469: creat d3/d3a/f8e x:0 0 0 2024-09-12T01:43:03.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/481: link d22/f3e d22/d82/fa4 0 2024-09-12T01:43:03.529 INFO:tasks.workunit.client.1.smithi153.stdout:9/470: mkdir d3/d55/d30/d7b/d8f 0 2024-09-12T01:43:03.530 INFO:tasks.workunit.client.1.smithi153.stdout:9/471: mkdir d3/d55/d30/d90 0 2024-09-12T01:43:03.530 INFO:tasks.workunit.client.1.smithi153.stdout:9/472: stat d3/f51 0 2024-09-12T01:43:03.530 INFO:tasks.workunit.client.1.smithi153.stdout:9/473: chown d3/d3a/d42/l45 194206641 1 2024-09-12T01:43:03.532 INFO:tasks.workunit.client.0.smithi066.stdout:0/124: dwrite d1/dc/df/d1b/f33 [0,4194304] 0 2024-09-12T01:43:03.532 INFO:tasks.workunit.client.0.smithi066.stdout:0/125: fsync d1/dc/df/d20/f21 0 2024-09-12T01:43:03.532 INFO:tasks.workunit.client.0.smithi066.stdout:8/108: dwrite d12/f1e [0,4194304] 0 2024-09-12T01:43:03.533 INFO:tasks.workunit.client.1.smithi153.stdout:6/489: dwrite d1/d6/d23/d98/d53/f97 [0,4194304] 0 2024-09-12T01:43:03.533 INFO:tasks.workunit.client.1.smithi153.stdout:6/490: chown d1/d6/d23/d98/d53/f78 91 1 2024-09-12T01:43:03.533 INFO:tasks.workunit.client.1.smithi153.stdout:1/454: dwrite d2/d34/f55 [0,4194304] 0 2024-09-12T01:43:03.533 INFO:tasks.workunit.client.1.smithi153.stdout:5/451: dwrite d0/d15/f6f [0,4194304] 0 2024-09-12T01:43:03.533 INFO:tasks.workunit.client.1.smithi153.stdout:5/452: chown d0/d20/f37 0 1 2024-09-12T01:43:03.535 INFO:tasks.workunit.client.0.smithi066.stdout:7/56: dread d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:03.542 INFO:tasks.workunit.client.1.smithi153.stdout:1/455: symlink d2/d34/d3d/d80/l88 0 2024-09-12T01:43:03.542 INFO:tasks.workunit.client.1.smithi153.stdout:1/456: fsync d2/d9/f15 0 2024-09-12T01:43:03.545 INFO:tasks.workunit.client.1.smithi153.stdout:5/453: write d0/f1f [660388,113894] 0 2024-09-12T01:43:03.546 INFO:tasks.workunit.client.1.smithi153.stdout:3/494: truncate d1/d64/f86 2641825 0 2024-09-12T01:43:03.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/457: mkdir d2/d9/d1d/d82/d89 0 2024-09-12T01:43:03.548 INFO:tasks.workunit.client.0.smithi066.stdout:8/109: rename l4 to d12/l20 0 2024-09-12T01:43:03.548 INFO:tasks.workunit.client.0.smithi066.stdout:8/110: truncate d12/f1f 242469 0 2024-09-12T01:43:03.548 INFO:tasks.workunit.client.0.smithi066.stdout:8/111: fsync fb 0 2024-09-12T01:43:03.548 INFO:tasks.workunit.client.0.smithi066.stdout:8/112: fsync d12/f19 0 2024-09-12T01:43:03.548 INFO:tasks.workunit.client.1.smithi153.stdout:3/495: creat d1/d59/f98 x:0 0 0 2024-09-12T01:43:03.550 INFO:tasks.workunit.client.0.smithi066.stdout:7/57: unlink d2/d5/l9 0 2024-09-12T01:43:03.550 INFO:tasks.workunit.client.0.smithi066.stdout:6/159: getdents d2/db 0 2024-09-12T01:43:03.550 INFO:tasks.workunit.client.0.smithi066.stdout:6/160: readlink d2/db/d12/l20 0 2024-09-12T01:43:03.550 INFO:tasks.workunit.client.0.smithi066.stdout:6/161: truncate d2/f38 816498 0 2024-09-12T01:43:03.551 INFO:tasks.workunit.client.1.smithi153.stdout:1/458: mkdir d2/d34/d8a 0 2024-09-12T01:43:03.552 INFO:tasks.workunit.client.0.smithi066.stdout:8/113: mkdir d12/d21 0 2024-09-12T01:43:03.552 INFO:tasks.workunit.client.0.smithi066.stdout:8/114: readlink l5 0 2024-09-12T01:43:03.553 INFO:tasks.workunit.client.0.smithi066.stdout:7/58: unlink d2/d5/d6/c8 0 2024-09-12T01:43:03.555 INFO:tasks.workunit.client.1.smithi153.stdout:1/459: unlink d2/d9/d1d/d25/f44 0 2024-09-12T01:43:03.556 INFO:tasks.workunit.client.0.smithi066.stdout:6/162: creat d2/db/f3b x:0 0 0 2024-09-12T01:43:03.557 INFO:tasks.workunit.client.0.smithi066.stdout:8/115: rmdir d12 39 2024-09-12T01:43:03.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/460: rename d2/d9/l65 to d2/d9/d1d/d25/d3f/l8b 0 2024-09-12T01:43:03.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/461: chown d2/d9/c33 940887084 1 2024-09-12T01:43:03.560 INFO:tasks.workunit.client.1.smithi153.stdout:1/462: dread - d2/d9/f7b zero size 2024-09-12T01:43:03.561 INFO:tasks.workunit.client.0.smithi066.stdout:6/163: chown d2/db/c35 1814 1 2024-09-12T01:43:03.561 INFO:tasks.workunit.client.0.smithi066.stdout:6/164: chown d2/d31/f39 995 1 2024-09-12T01:43:03.562 INFO:tasks.workunit.client.0.smithi066.stdout:6/165: readlink d2/db/l17 0 2024-09-12T01:43:03.563 INFO:tasks.workunit.client.0.smithi066.stdout:6/166: creat d2/db/f3c x:0 0 0 2024-09-12T01:43:03.564 INFO:tasks.workunit.client.0.smithi066.stdout:6/167: creat d2/db/f3d x:0 0 0 2024-09-12T01:43:03.564 INFO:tasks.workunit.client.0.smithi066.stdout:6/168: write d2/f38 [19253,126572] 0 2024-09-12T01:43:03.566 INFO:tasks.workunit.client.0.smithi066.stdout:6/169: mknod d2/d31/c3e 0 2024-09-12T01:43:03.567 INFO:tasks.workunit.client.0.smithi066.stdout:0/126: dwrite d1/dc/de/f2c [0,4194304] 0 2024-09-12T01:43:03.568 INFO:tasks.workunit.client.0.smithi066.stdout:5/70: sync 2024-09-12T01:43:03.568 INFO:tasks.workunit.client.1.smithi153.stdout:9/474: dwrite d3/d3a/d42/f4c [0,4194304] 0 2024-09-12T01:43:03.569 INFO:tasks.workunit.client.1.smithi153.stdout:6/491: dwrite d1/d6/da/d19/d34/f20 [0,4194304] 0 2024-09-12T01:43:03.569 INFO:tasks.workunit.client.1.smithi153.stdout:6/492: dread - d1/d6/d23/d98/d4f/f83 zero size 2024-09-12T01:43:03.570 INFO:tasks.workunit.client.1.smithi153.stdout:3/496: dread d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:03.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/454: fdatasync d0/f1f 0 2024-09-12T01:43:03.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/455: chown d0/d79 74315 1 2024-09-12T01:43:03.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/456: write d0/df/d83/d36/d39/f60 [355230,22298] 0 2024-09-12T01:43:03.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/457: write d0/fe [517879,47346] 0 2024-09-12T01:43:03.571 INFO:tasks.workunit.client.1.smithi153.stdout:5/458: dread - d0/df/d83/d63/d75/d58/d70/f5a zero size 2024-09-12T01:43:03.572 INFO:tasks.workunit.client.1.smithi153.stdout:0/482: rmdir d22/d30/d4c 39 2024-09-12T01:43:03.572 INFO:tasks.workunit.client.1.smithi153.stdout:0/483: chown d22/d30/l71 0 1 2024-09-12T01:43:03.576 INFO:tasks.workunit.client.1.smithi153.stdout:5/459: dread d0/d15/f46 [0,4194304] 0 2024-09-12T01:43:03.577 INFO:tasks.workunit.client.0.smithi066.stdout:0/127: rmdir d1/dc/df/d1b 39 2024-09-12T01:43:03.580 INFO:tasks.workunit.client.1.smithi153.stdout:4/351: sync 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/352: fsync d6/f53 0 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/353: chown d6/d9/dc/d42/f85 614619 1 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/354: readlink d6/d9/dc/d31/l3d 0 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/355: write d6/d9/dc/d31/f34 [4668451,70788] 0 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/356: chown d6/d9/dc/f3a 16631531 1 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:3/497: unlink d1/d13/d25/l5d 0 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:0/484: mknod d22/d30/d4c/d6f/ca5 0 2024-09-12T01:43:03.581 INFO:tasks.workunit.client.1.smithi153.stdout:5/460: mkdir d0/d43/d8d 0 2024-09-12T01:43:03.584 INFO:tasks.workunit.client.1.smithi153.stdout:3/498: mknod d1/d13/d25/d26/d4b/d97/c99 0 2024-09-12T01:43:03.585 INFO:tasks.workunit.client.1.smithi153.stdout:5/461: mkdir d0/d43/d8d/d8e 0 2024-09-12T01:43:03.585 INFO:tasks.workunit.client.1.smithi153.stdout:8/433: sync 2024-09-12T01:43:03.585 INFO:tasks.workunit.client.1.smithi153.stdout:8/434: fsync d17/f85 0 2024-09-12T01:43:03.586 INFO:tasks.workunit.client.1.smithi153.stdout:4/357: getdents d6/d9/d11 0 2024-09-12T01:43:03.586 INFO:tasks.workunit.client.1.smithi153.stdout:3/499: write d1/d13/d23/d47/d6c/f6d [257524,96428] 0 2024-09-12T01:43:03.587 INFO:tasks.workunit.client.1.smithi153.stdout:3/500: chown d1/d16/d1c/f2d 0 1 2024-09-12T01:43:03.587 INFO:tasks.workunit.client.1.smithi153.stdout:3/501: fsync d1/d13/d25/d26/d4b/f8c 0 2024-09-12T01:43:03.587 INFO:tasks.workunit.client.0.smithi066.stdout:8/116: truncate d12/f1e 631395 0 2024-09-12T01:43:03.588 INFO:tasks.workunit.client.1.smithi153.stdout:0/485: mknod d22/d30/d4c/ca6 0 2024-09-12T01:43:03.589 INFO:tasks.workunit.client.0.smithi066.stdout:0/128: dread d1/dc/de/f2c [0,4194304] 0 2024-09-12T01:43:03.590 INFO:tasks.workunit.client.1.smithi153.stdout:5/462: symlink d0/df/d83/d63/d75/l8f 0 2024-09-12T01:43:03.591 INFO:tasks.workunit.client.1.smithi153.stdout:8/435: creat d17/d1d/f94 x:0 0 0 2024-09-12T01:43:03.592 INFO:tasks.workunit.client.0.smithi066.stdout:0/129: mknod d1/dc/c34 0 2024-09-12T01:43:03.592 INFO:tasks.workunit.client.0.smithi066.stdout:0/130: creat d1/dc/df/d20/f35 x:0 0 0 2024-09-12T01:43:03.592 INFO:tasks.workunit.client.0.smithi066.stdout:0/131: read - d1/dc/df/d20/f35 zero size 2024-09-12T01:43:03.592 INFO:tasks.workunit.client.0.smithi066.stdout:0/132: write d1/f28 [700262,37894] 0 2024-09-12T01:43:03.593 INFO:tasks.workunit.client.1.smithi153.stdout:6/493: dread d1/d6/d23/d98/d4f/f66 [0,4194304] 0 2024-09-12T01:43:03.593 INFO:tasks.workunit.client.1.smithi153.stdout:4/358: creat d6/d9/d20/f87 x:0 0 0 2024-09-12T01:43:03.595 INFO:tasks.workunit.client.1.smithi153.stdout:0/486: rename d22/l25 to d22/d79/la7 0 2024-09-12T01:43:03.597 INFO:tasks.workunit.client.1.smithi153.stdout:5/463: creat d0/d43/d8d/f90 x:0 0 0 2024-09-12T01:43:03.597 INFO:tasks.workunit.client.0.smithi066.stdout:0/133: symlink d1/dc/df/d1b/l36 0 2024-09-12T01:43:03.600 INFO:tasks.workunit.client.1.smithi153.stdout:8/436: rmdir d17/d21/d3a/d6c/d6e/d7f/d87 0 2024-09-12T01:43:03.602 INFO:tasks.workunit.client.1.smithi153.stdout:4/359: rename d6/d9/d20/f69 to d6/d9/d11/d14/f88 0 2024-09-12T01:43:03.603 INFO:tasks.workunit.client.1.smithi153.stdout:0/487: creat d22/d30/d4c/d6e/fa8 x:0 0 0 2024-09-12T01:43:03.605 INFO:tasks.workunit.client.0.smithi066.stdout:7/59: dwrite d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:03.606 INFO:tasks.workunit.client.1.smithi153.stdout:1/463: dwrite d2/d9/d1d/f4b [0,4194304] 0 2024-09-12T01:43:03.606 INFO:tasks.workunit.client.1.smithi153.stdout:1/464: fdatasync d2/d9/d1d/f4b 0 2024-09-12T01:43:03.606 INFO:tasks.workunit.client.1.smithi153.stdout:4/360: rename d6/d9/d11/d14/d3e/d66/c77 to d6/d9/c89 0 2024-09-12T01:43:03.607 INFO:tasks.workunit.client.1.smithi153.stdout:9/475: dwrite d3/d3a/f8e [0,4194304] 0 2024-09-12T01:43:03.607 INFO:tasks.workunit.client.0.smithi066.stdout:6/170: dwrite d2/f22 [4194304,4194304] 0 2024-09-12T01:43:03.607 INFO:tasks.workunit.client.0.smithi066.stdout:5/71: dwrite d0/dd/ff [0,4194304] 0 2024-09-12T01:43:03.608 INFO:tasks.workunit.client.1.smithi153.stdout:0/488: mknod d22/d30/d4c/d6f/ca9 0 2024-09-12T01:43:03.609 INFO:tasks.workunit.client.1.smithi153.stdout:0/489: chown d22/d30/d4c/d6e/f7b 224 1 2024-09-12T01:43:03.609 INFO:tasks.workunit.client.1.smithi153.stdout:4/361: dread d6/d9/d11/d13/f65 [0,4194304] 0 2024-09-12T01:43:03.609 INFO:tasks.workunit.client.1.smithi153.stdout:5/464: dread d0/df/d1c/d22/d2f/f3a [0,4194304] 0 2024-09-12T01:43:03.609 INFO:tasks.workunit.client.1.smithi153.stdout:5/465: truncate d0/d15/f1a 5024824 0 2024-09-12T01:43:03.615 INFO:tasks.workunit.client.1.smithi153.stdout:6/494: dwrite d1/d6/da/f1a [4194304,4194304] 0 2024-09-12T01:43:03.616 INFO:tasks.workunit.client.1.smithi153.stdout:6/495: write d1/df/f5f [746045,21669] 0 2024-09-12T01:43:03.616 INFO:tasks.workunit.client.1.smithi153.stdout:1/465: mknod d2/d9/d1d/d82/d89/c8c 0 2024-09-12T01:43:03.616 INFO:tasks.workunit.client.1.smithi153.stdout:1/466: write d2/d9/d17/d2f/d56/f6a [1235940,118358] 0 2024-09-12T01:43:03.619 INFO:tasks.workunit.client.1.smithi153.stdout:9/476: mknod d3/d55/d30/d7b/c91 0 2024-09-12T01:43:03.619 INFO:tasks.workunit.client.1.smithi153.stdout:9/477: truncate d3/d66/f6f 485111 0 2024-09-12T01:43:03.620 INFO:tasks.workunit.client.0.smithi066.stdout:5/72: write d0/f2 [2804037,163] 0 2024-09-12T01:43:03.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/73: write d0/f4 [4200965,84209] 0 2024-09-12T01:43:03.622 INFO:tasks.workunit.client.0.smithi066.stdout:7/60: creat d2/d5/da/f11 x:0 0 0 2024-09-12T01:43:03.627 INFO:tasks.workunit.client.1.smithi153.stdout:0/490: creat d22/d30/d4c/d6f/d88/faa x:0 0 0 2024-09-12T01:43:03.628 INFO:tasks.workunit.client.0.smithi066.stdout:5/74: dread d0/dd/ff [0,4194304] 0 2024-09-12T01:43:03.629 INFO:tasks.workunit.client.1.smithi153.stdout:4/362: getdents d6/d15/d38/d7b 0 2024-09-12T01:43:03.631 INFO:tasks.workunit.client.1.smithi153.stdout:5/466: mknod d0/c91 0 2024-09-12T01:43:03.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/491: dread d22/f83 [4194304,4194304] 0 2024-09-12T01:43:03.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/492: readlink d22/d30/d4c/d6e/l4f 0 2024-09-12T01:43:03.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/493: readlink d22/d30/d4c/d6e/l45 0 2024-09-12T01:43:03.637 INFO:tasks.workunit.client.0.smithi066.stdout:7/61: read - d2/d5/da/f11 zero size 2024-09-12T01:43:03.640 INFO:tasks.workunit.client.1.smithi153.stdout:0/494: dread d22/f2b [4194304,4194304] 0 2024-09-12T01:43:03.641 INFO:tasks.workunit.client.0.smithi066.stdout:6/171: mknod d2/db/d12/c3f 0 2024-09-12T01:43:03.641 INFO:tasks.workunit.client.0.smithi066.stdout:6/172: chown d2/f1a 5232284 1 2024-09-12T01:43:03.642 INFO:tasks.workunit.client.1.smithi153.stdout:6/496: mkdir d1/d6/d23/d98/d53/da0 0 2024-09-12T01:43:03.642 INFO:tasks.workunit.client.1.smithi153.stdout:6/497: fdatasync d1/d80/f92 0 2024-09-12T01:43:03.644 INFO:tasks.workunit.client.0.smithi066.stdout:7/62: fsync d2/d5/d6/fe 0 2024-09-12T01:43:03.644 INFO:tasks.workunit.client.0.smithi066.stdout:7/63: dread - d2/d5/da/f11 zero size 2024-09-12T01:43:03.644 INFO:tasks.workunit.client.0.smithi066.stdout:7/64: write d2/d5/da/f11 [42250,71710] 0 2024-09-12T01:43:03.644 INFO:tasks.workunit.client.0.smithi066.stdout:7/65: truncate d2/d5/da/f11 627026 0 2024-09-12T01:43:03.644 INFO:tasks.workunit.client.0.smithi066.stdout:7/66: rename d2/d5 to d2/d5/d6/d12 22 2024-09-12T01:43:03.645 INFO:tasks.workunit.client.1.smithi153.stdout:1/467: symlink d2/d9/d17/d2f/d56/d83/l8d 0 2024-09-12T01:43:03.645 INFO:tasks.workunit.client.0.smithi066.stdout:8/117: dwrite d12/f1e [0,4194304] 0 2024-09-12T01:43:03.645 INFO:tasks.workunit.client.0.smithi066.stdout:8/118: getdents d12/d21 0 2024-09-12T01:43:03.645 INFO:tasks.workunit.client.0.smithi066.stdout:8/119: chown fb 0 1 2024-09-12T01:43:03.646 INFO:tasks.workunit.client.0.smithi066.stdout:6/173: mknod d2/db/d12/c40 0 2024-09-12T01:43:03.646 INFO:tasks.workunit.client.0.smithi066.stdout:6/174: chown d2/d31 100 1 2024-09-12T01:43:03.646 INFO:tasks.workunit.client.0.smithi066.stdout:6/175: readlink d2/db/d12/l2f 0 2024-09-12T01:43:03.648 INFO:tasks.workunit.client.0.smithi066.stdout:5/75: getdents d0 0 2024-09-12T01:43:03.648 INFO:tasks.workunit.client.0.smithi066.stdout:5/76: creat d0/dd/f13 x:0 0 0 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/117: sync 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:9/120: sync 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:1/102: sync 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:3/92: sync 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/118: read - de/f26 zero size 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:3/93: fsync d5/f17 0 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:9/121: fsync d0/d6/d17/f23 0 2024-09-12T01:43:03.649 INFO:tasks.workunit.client.0.smithi066.stdout:3/94: chown d5/d6/dd/f14 7028 1 2024-09-12T01:43:03.650 INFO:tasks.workunit.client.1.smithi153.stdout:4/363: symlink d6/d9/d11/d14/d3e/d66/l8a 0 2024-09-12T01:43:03.651 INFO:tasks.workunit.client.1.smithi153.stdout:5/467: link d0/d20/f37 d0/d43/f92 0 2024-09-12T01:43:03.651 INFO:tasks.workunit.client.1.smithi153.stdout:5/468: dread - d0/d43/f6b zero size 2024-09-12T01:43:03.654 INFO:tasks.workunit.client.1.smithi153.stdout:1/468: symlink d2/d9/d1d/l8e 0 2024-09-12T01:43:03.658 INFO:tasks.workunit.client.0.smithi066.stdout:3/95: write f2 [4574660,23721] 0 2024-09-12T01:43:03.658 INFO:tasks.workunit.client.1.smithi153.stdout:9/478: rename d3/l17 to d3/d5f/d81/d84/l92 0 2024-09-12T01:43:03.660 INFO:tasks.workunit.client.1.smithi153.stdout:4/364: creat d6/f8b x:0 0 0 2024-09-12T01:43:03.661 INFO:tasks.workunit.client.0.smithi066.stdout:4/94: sync 2024-09-12T01:43:03.661 INFO:tasks.workunit.client.0.smithi066.stdout:4/95: read d4/d6/d8/fa [2076899,103098] 0 2024-09-12T01:43:03.663 INFO:tasks.workunit.client.1.smithi153.stdout:6/498: dwrite d1/d6/d23/d98/d53/d69/d7c/d7f/f9b [0,4194304] 0 2024-09-12T01:43:03.663 INFO:tasks.workunit.client.1.smithi153.stdout:5/469: creat d0/d43/d68/f93 x:0 0 0 2024-09-12T01:43:03.663 INFO:tasks.workunit.client.1.smithi153.stdout:5/470: creat d0/df/d83/d63/d75/d58/f94 x:0 0 0 2024-09-12T01:43:03.663 INFO:tasks.workunit.client.1.smithi153.stdout:5/471: getdents d0/df/d1c/d22/d88 0 2024-09-12T01:43:03.663 INFO:tasks.workunit.client.1.smithi153.stdout:5/472: read - d0/df/d83/d36/f7d zero size 2024-09-12T01:43:03.664 INFO:tasks.workunit.client.0.smithi066.stdout:1/103: dread d5/fa [0,4194304] 0 2024-09-12T01:43:03.664 INFO:tasks.workunit.client.0.smithi066.stdout:1/104: write d5/f14 [740301,124164] 0 2024-09-12T01:43:03.664 INFO:tasks.workunit.client.0.smithi066.stdout:1/105: write d5/dc/f10 [3462519,75360] 0 2024-09-12T01:43:03.668 INFO:tasks.workunit.client.0.smithi066.stdout:5/77: symlink d0/db/l14 0 2024-09-12T01:43:03.668 INFO:tasks.workunit.client.0.smithi066.stdout:5/78: fdatasync d0/f4 0 2024-09-12T01:43:03.668 INFO:tasks.workunit.client.0.smithi066.stdout:5/79: truncate d0/f4 5689288 0 2024-09-12T01:43:03.669 INFO:tasks.workunit.client.1.smithi153.stdout:0/495: rename d22/f2f to d22/d30/d4c/d6f/fab 0 2024-09-12T01:43:03.670 INFO:tasks.workunit.client.0.smithi066.stdout:9/122: write d0/d5/f14 [3703260,123238] 0 2024-09-12T01:43:03.672 INFO:tasks.workunit.client.0.smithi066.stdout:5/80: write d0/dd/ff [2491202,61166] 0 2024-09-12T01:43:03.672 INFO:tasks.workunit.client.0.smithi066.stdout:5/81: chown d0/dd/fe 0 1 2024-09-12T01:43:03.673 INFO:tasks.workunit.client.0.smithi066.stdout:2/119: symlink de/d13/l2a 0 2024-09-12T01:43:03.673 INFO:tasks.workunit.client.0.smithi066.stdout:8/120: dwrite d12/f1e [4194304,4194304] 0 2024-09-12T01:43:03.676 INFO:tasks.workunit.client.0.smithi066.stdout:6/176: getdents d2/d31 0 2024-09-12T01:43:03.679 INFO:tasks.workunit.client.0.smithi066.stdout:3/96: unlink l1 0 2024-09-12T01:43:03.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/96: mknod d4/d6/d8/d18/c1f 0 2024-09-12T01:43:03.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/97: write f3 [4864136,23581] 0 2024-09-12T01:43:03.682 INFO:tasks.workunit.client.1.smithi153.stdout:6/499: creat d1/d6/d23/d98/d4f/fa1 x:0 0 0 2024-09-12T01:43:03.683 INFO:tasks.workunit.client.0.smithi066.stdout:1/106: creat d5/dc/f1f x:0 0 0 2024-09-12T01:43:03.685 INFO:tasks.workunit.client.0.smithi066.stdout:9/123: creat d0/d6/f29 x:0 0 0 2024-09-12T01:43:03.685 INFO:tasks.workunit.client.0.smithi066.stdout:9/124: stat d0/d6/f29 0 2024-09-12T01:43:03.685 INFO:tasks.workunit.client.1.smithi153.stdout:5/473: truncate d0/d15/f25 2972449 0 2024-09-12T01:43:03.687 INFO:tasks.workunit.client.0.smithi066.stdout:7/67: link d2/d5/cd d2/d5/da/c13 0 2024-09-12T01:43:03.688 INFO:tasks.workunit.client.1.smithi153.stdout:4/365: rename d6/d9/d20/f59 to d6/d6a/f8c 0 2024-09-12T01:43:03.690 INFO:tasks.workunit.client.1.smithi153.stdout:0/496: creat d22/d79/d8e/fac x:0 0 0 2024-09-12T01:43:03.691 INFO:tasks.workunit.client.1.smithi153.stdout:0/497: fsync d22/d30/d4c/d6e/f87 0 2024-09-12T01:43:03.692 INFO:tasks.workunit.client.0.smithi066.stdout:2/120: link f2 de/d13/d1e/d25/f2b 0 2024-09-12T01:43:03.692 INFO:tasks.workunit.client.0.smithi066.stdout:2/121: truncate de/d13/f1f 798279 0 2024-09-12T01:43:03.693 INFO:tasks.workunit.client.1.smithi153.stdout:1/469: dwrite d2/d34/d3d/f59 [0,4194304] 0 2024-09-12T01:43:03.693 INFO:tasks.workunit.client.1.smithi153.stdout:9/479: mknod d3/c93 0 2024-09-12T01:43:03.694 INFO:tasks.workunit.client.0.smithi066.stdout:8/121: symlink d12/d21/l22 0 2024-09-12T01:43:03.695 INFO:tasks.workunit.client.1.smithi153.stdout:6/500: mknod d1/d6/d46/ca2 0 2024-09-12T01:43:03.696 INFO:tasks.workunit.client.0.smithi066.stdout:5/82: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:43:03.697 INFO:tasks.workunit.client.0.smithi066.stdout:4/98: dread d4/d6/d8/fa [0,4194304] 0 2024-09-12T01:43:03.698 INFO:tasks.workunit.client.0.smithi066.stdout:4/99: truncate d4/f17 5113242 0 2024-09-12T01:43:03.698 INFO:tasks.workunit.client.0.smithi066.stdout:3/97: rename d5/d6/l12 to d5/d6/dd/l18 0 2024-09-12T01:43:03.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/98: truncate d5/d6/dd/f14 915766 0 2024-09-12T01:43:03.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/99: chown d5/ff 141133220 1 2024-09-12T01:43:03.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/100: chown d5/d6/dd/f14 182538 1 2024-09-12T01:43:03.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/101: chown d5/f17 415464 1 2024-09-12T01:43:03.699 INFO:tasks.workunit.client.1.smithi153.stdout:0/498: creat d22/d30/d4c/fad x:0 0 0 2024-09-12T01:43:03.702 INFO:tasks.workunit.client.0.smithi066.stdout:1/107: creat d5/dc/dd/d1c/f20 x:0 0 0 2024-09-12T01:43:03.702 INFO:tasks.workunit.client.1.smithi153.stdout:4/366: read d6/d9/d26/f74 [1056155,30122] 0 2024-09-12T01:43:03.702 INFO:tasks.workunit.client.1.smithi153.stdout:4/367: chown d6/d9/dc/d31/f34 2 1 2024-09-12T01:43:03.706 INFO:tasks.workunit.client.0.smithi066.stdout:1/108: write f1 [249835,57327] 0 2024-09-12T01:43:03.707 INFO:tasks.workunit.client.0.smithi066.stdout:9/125: link d0/d6/d17/d1b/f1c d0/d5/dc/f2a 0 2024-09-12T01:43:03.708 INFO:tasks.workunit.client.1.smithi153.stdout:1/470: mknod d2/d9/d1d/d25/d3f/c8f 0 2024-09-12T01:43:03.708 INFO:tasks.workunit.client.0.smithi066.stdout:6/177: dread d2/db/f2d [0,4194304] 0 2024-09-12T01:43:03.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/122: mkdir de/d13/d1e/d22/d2c 0 2024-09-12T01:43:03.709 INFO:tasks.workunit.client.0.smithi066.stdout:2/123: stat de/l19 0 2024-09-12T01:43:03.709 INFO:tasks.workunit.client.1.smithi153.stdout:6/501: mknod d1/d6/d46/d73/ca3 0 2024-09-12T01:43:03.710 INFO:tasks.workunit.client.1.smithi153.stdout:6/502: truncate d1/d6/d39/d76/f79 1026828 0 2024-09-12T01:43:03.710 INFO:tasks.workunit.client.0.smithi066.stdout:8/122: creat d12/f23 x:0 0 0 2024-09-12T01:43:03.710 INFO:tasks.workunit.client.0.smithi066.stdout:8/123: readlink lc 0 2024-09-12T01:43:03.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/499: mkdir d22/d79/d8e/dae 0 2024-09-12T01:43:03.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/500: fsync d22/d30/d4c/d6e/f48 0 2024-09-12T01:43:03.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/501: fsync d22/f32 0 2024-09-12T01:43:03.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/502: stat d22/d30/d4c/d6f/ca5 0 2024-09-12T01:43:03.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/503: dread - d22/d30/d4c/d6e/fa8 zero size 2024-09-12T01:43:03.712 INFO:tasks.workunit.client.1.smithi153.stdout:0/504: dread - d22/d30/d4c/d6f/d88/f96 zero size 2024-09-12T01:43:03.713 INFO:tasks.workunit.client.1.smithi153.stdout:5/474: dwrite d0/df/d1c/d22/d2f/f3a [0,4194304] 0 2024-09-12T01:43:03.714 INFO:tasks.workunit.client.1.smithi153.stdout:5/475: readlink d0/df/d1c/d22/l59 0 2024-09-12T01:43:03.714 INFO:tasks.workunit.client.1.smithi153.stdout:5/476: fsync d0/d15/f6f 0 2024-09-12T01:43:03.714 INFO:tasks.workunit.client.1.smithi153.stdout:9/480: dwrite d3/f6a [0,4194304] 0 2024-09-12T01:43:03.714 INFO:tasks.workunit.client.0.smithi066.stdout:5/83: mknod d0/dd/c15 0 2024-09-12T01:43:03.715 INFO:tasks.workunit.client.1.smithi153.stdout:9/481: chown d3/d55/l1c 1140 1 2024-09-12T01:43:03.715 INFO:tasks.workunit.client.1.smithi153.stdout:0/505: mknod d22/d30/d4c/d6e/d7f/caf 0 2024-09-12T01:43:03.716 INFO:tasks.workunit.client.0.smithi066.stdout:4/100: symlink d4/d15/l20 0 2024-09-12T01:43:03.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/109: dread d5/dc/f10 [0,4194304] 0 2024-09-12T01:43:03.719 INFO:tasks.workunit.client.1.smithi153.stdout:0/506: dread d22/f84 [0,4194304] 0 2024-09-12T01:43:03.719 INFO:tasks.workunit.client.1.smithi153.stdout:0/507: chown d22/d30/d4c/d6f/l8b 94540030 1 2024-09-12T01:43:03.721 INFO:tasks.workunit.client.1.smithi153.stdout:5/477: creat d0/df/d83/d63/d75/f95 x:0 0 0 2024-09-12T01:43:03.722 INFO:tasks.workunit.client.1.smithi153.stdout:5/478: creat d0/d15/f96 x:0 0 0 2024-09-12T01:43:03.722 INFO:tasks.workunit.client.0.smithi066.stdout:6/178: dread d2/f5 [0,4194304] 0 2024-09-12T01:43:03.727 INFO:tasks.workunit.client.1.smithi153.stdout:4/368: rmdir d6/d9/d11/d14/d3e 39 2024-09-12T01:43:03.728 INFO:tasks.workunit.client.0.smithi066.stdout:8/124: dread d12/f19 [0,4194304] 0 2024-09-12T01:43:03.728 INFO:tasks.workunit.client.0.smithi066.stdout:8/125: creat d12/f24 x:0 0 0 2024-09-12T01:43:03.728 INFO:tasks.workunit.client.0.smithi066.stdout:8/126: dread - ff zero size 2024-09-12T01:43:03.736 INFO:tasks.workunit.client.1.smithi153.stdout:7/382: sync 2024-09-12T01:43:03.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/482: truncate d3/d35/f75 4103294 0 2024-09-12T01:43:03.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/483: stat d3/d5f/c6e 0 2024-09-12T01:43:03.741 INFO:tasks.workunit.client.1.smithi153.stdout:5/479: mknod d0/d43/d8d/c97 0 2024-09-12T01:43:03.742 INFO:tasks.workunit.client.1.smithi153.stdout:4/369: symlink d6/d6a/l8d 0 2024-09-12T01:43:03.743 INFO:tasks.workunit.client.0.smithi066.stdout:7/68: truncate d2/d5/da/f11 273632 0 2024-09-12T01:43:03.747 INFO:tasks.workunit.client.0.smithi066.stdout:9/126: rename d0/d6/f29 to d0/d5/dc/f2b 0 2024-09-12T01:43:03.747 INFO:tasks.workunit.client.1.smithi153.stdout:2/410: sync 2024-09-12T01:43:03.748 INFO:tasks.workunit.client.1.smithi153.stdout:8/437: sync 2024-09-12T01:43:03.748 INFO:tasks.workunit.client.1.smithi153.stdout:3/502: sync 2024-09-12T01:43:03.748 INFO:tasks.workunit.client.1.smithi153.stdout:3/503: stat d1/d13/d25/d26/d4b/d97/c99 0 2024-09-12T01:43:03.748 INFO:tasks.workunit.client.1.smithi153.stdout:3/504: fsync d1/d16/d1c/d32/f5f 0 2024-09-12T01:43:03.749 INFO:tasks.workunit.client.1.smithi153.stdout:5/480: unlink d0/d15/f16 0 2024-09-12T01:43:03.750 INFO:tasks.workunit.client.0.smithi066.stdout:2/124: mknod de/c2d 0 2024-09-12T01:43:03.752 INFO:tasks.workunit.client.1.smithi153.stdout:9/484: getdents d3/d5f/d81 0 2024-09-12T01:43:03.753 INFO:tasks.workunit.client.1.smithi153.stdout:7/383: dread fe [0,4194304] 0 2024-09-12T01:43:03.754 INFO:tasks.workunit.client.1.smithi153.stdout:1/471: dwrite d2/d9/d17/f41 [0,4194304] 0 2024-09-12T01:43:03.754 INFO:tasks.workunit.client.1.smithi153.stdout:1/472: fdatasync d2/d9/d17/d2c/f4d 0 2024-09-12T01:43:03.755 INFO:tasks.workunit.client.0.smithi066.stdout:4/101: symlink d4/d6/d8/l21 0 2024-09-12T01:43:03.756 INFO:tasks.workunit.client.1.smithi153.stdout:5/481: mknod d0/d43/d8d/d8e/c98 0 2024-09-12T01:43:03.756 INFO:tasks.workunit.client.1.smithi153.stdout:5/482: write d0/df/f21 [1527679,51924] 0 2024-09-12T01:43:03.757 INFO:tasks.workunit.client.0.smithi066.stdout:3/102: truncate d5/d6/dd/f14 440807 0 2024-09-12T01:43:03.757 INFO:tasks.workunit.client.0.smithi066.stdout:3/103: read f4 [2243623,120618] 0 2024-09-12T01:43:03.758 INFO:tasks.workunit.client.1.smithi153.stdout:7/384: symlink d12/d4e/l6d 0 2024-09-12T01:43:03.758 INFO:tasks.workunit.client.1.smithi153.stdout:7/385: write d12/d21/d29/d35/d37/d4c/f62 [55324,107012] 0 2024-09-12T01:43:03.759 INFO:tasks.workunit.client.1.smithi153.stdout:7/386: readlink d12/d21/d29/d2d/l42 0 2024-09-12T01:43:03.759 INFO:tasks.workunit.client.1.smithi153.stdout:7/387: chown d12/d21/f45 2509370 1 2024-09-12T01:43:03.761 INFO:tasks.workunit.client.0.smithi066.stdout:6/179: creat d2/d21/f41 x:0 0 0 2024-09-12T01:43:03.761 INFO:tasks.workunit.client.0.smithi066.stdout:1/110: dread d5/d15/f1b [0,4194304] 0 2024-09-12T01:43:03.761 INFO:tasks.workunit.client.1.smithi153.stdout:8/438: getdents d17/d1d 0 2024-09-12T01:43:03.762 INFO:tasks.workunit.client.0.smithi066.stdout:5/84: dwrite d0/dd/ff [0,4194304] 0 2024-09-12T01:43:03.764 INFO:tasks.workunit.client.0.smithi066.stdout:8/127: truncate f3 2475971 0 2024-09-12T01:43:03.764 INFO:tasks.workunit.client.0.smithi066.stdout:8/128: truncate d12/f19 4723744 0 2024-09-12T01:43:03.766 INFO:tasks.workunit.client.1.smithi153.stdout:1/473: mknod d2/d9/d17/d69/c90 0 2024-09-12T01:43:03.766 INFO:tasks.workunit.client.1.smithi153.stdout:1/474: fdatasync d2/d9/d1d/f4b 0 2024-09-12T01:43:03.767 INFO:tasks.workunit.client.0.smithi066.stdout:6/180: symlink d2/db/d12/d1d/l42 0 2024-09-12T01:43:03.768 INFO:tasks.workunit.client.1.smithi153.stdout:5/483: mkdir d0/df/d99 0 2024-09-12T01:43:03.769 INFO:tasks.workunit.client.1.smithi153.stdout:5/484: dread - d0/df/d83/d63/d75/d58/f85 zero size 2024-09-12T01:43:03.769 INFO:tasks.workunit.client.1.smithi153.stdout:5/485: creat d0/df/d1c/d69/f9a x:0 0 0 2024-09-12T01:43:03.769 INFO:tasks.workunit.client.1.smithi153.stdout:5/486: fdatasync d0/d15/f54 0 2024-09-12T01:43:03.769 INFO:tasks.workunit.client.1.smithi153.stdout:5/487: fdatasync d0/df/d83/d63/d75/d58/d71/f7e 0 2024-09-12T01:43:03.769 INFO:tasks.workunit.client.0.smithi066.stdout:5/85: symlink d0/l16 0 2024-09-12T01:43:03.772 INFO:tasks.workunit.client.1.smithi153.stdout:2/411: dread d7/db/ff [0,4194304] 0 2024-09-12T01:43:03.772 INFO:tasks.workunit.client.1.smithi153.stdout:6/503: dwrite d1/d6/d23/d98/d53/d69/d7c/d7f/f95 [0,4194304] 0 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:6/504: getdents d1/d6/d23/d98/d53/da0 0 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:2/412: write d7/db/d62/f7f [641896,6733] 0 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:6/505: write d1/d6/f8 [4679595,21656] 0 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:2/413: dread - d7/d4d/f68 zero size 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:6/506: chown d1/d6/l16 1 1 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:7/388: link d12/d21/d29/d2d/f30 d12/d21/d29/d35/f6e 0 2024-09-12T01:43:03.773 INFO:tasks.workunit.client.1.smithi153.stdout:7/389: write d12/f31 [913285,25822] 0 2024-09-12T01:43:03.774 INFO:tasks.workunit.client.1.smithi153.stdout:9/485: write d3/d55/f57 [1806885,108904] 0 2024-09-12T01:43:03.774 INFO:tasks.workunit.client.1.smithi153.stdout:0/508: dwrite d22/f68 [0,4194304] 0 2024-09-12T01:43:03.774 INFO:tasks.workunit.client.1.smithi153.stdout:9/486: dread - d3/d5f/d81/f83 zero size 2024-09-12T01:43:03.774 INFO:tasks.workunit.client.0.smithi066.stdout:3/104: symlink d5/l19 0 2024-09-12T01:43:03.774 INFO:tasks.workunit.client.0.smithi066.stdout:1/111: dread d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:03.774 INFO:tasks.workunit.client.1.smithi153.stdout:9/487: write d3/d55/f6b [1837574,67358] 0 2024-09-12T01:43:03.775 INFO:tasks.workunit.client.1.smithi153.stdout:4/370: dwrite d6/d9/dc/f64 [0,4194304] 0 2024-09-12T01:43:03.775 INFO:tasks.workunit.client.1.smithi153.stdout:8/439: mkdir d17/d21/d56/d95 0 2024-09-12T01:43:03.776 INFO:tasks.workunit.client.0.smithi066.stdout:5/86: creat d0/f17 x:0 0 0 2024-09-12T01:43:03.777 INFO:tasks.workunit.client.0.smithi066.stdout:7/69: write d2/d5/da/f11 [242187,49161] 0 2024-09-12T01:43:03.777 INFO:tasks.workunit.client.0.smithi066.stdout:7/70: rename d2 to d2/d5/da/d14 22 2024-09-12T01:43:03.778 INFO:tasks.workunit.client.1.smithi153.stdout:1/475: mkdir d2/d9/d17/d2f/d56/d91 0 2024-09-12T01:43:03.779 INFO:tasks.workunit.client.0.smithi066.stdout:3/105: creat d5/d6/dd/f1a x:0 0 0 2024-09-12T01:43:03.779 INFO:tasks.workunit.client.0.smithi066.stdout:3/106: chown f3 118825 1 2024-09-12T01:43:03.779 INFO:tasks.workunit.client.0.smithi066.stdout:8/129: dread d12/f19 [0,4194304] 0 2024-09-12T01:43:03.781 INFO:tasks.workunit.client.0.smithi066.stdout:5/87: mkdir d0/dd/d18 0 2024-09-12T01:43:03.782 INFO:tasks.workunit.client.0.smithi066.stdout:5/88: chown d0/la 136 1 2024-09-12T01:43:03.783 INFO:tasks.workunit.client.1.smithi153.stdout:5/488: mknod d0/df/d1c/d22/d88/c9b 0 2024-09-12T01:43:03.786 INFO:tasks.workunit.client.0.smithi066.stdout:0/134: sync 2024-09-12T01:43:03.786 INFO:tasks.workunit.client.0.smithi066.stdout:0/135: dread - d1/dc/df/d20/f35 zero size 2024-09-12T01:43:03.790 INFO:tasks.workunit.client.1.smithi153.stdout:6/507: mkdir d1/d6/d23/d98/d53/da4 0 2024-09-12T01:43:03.790 INFO:tasks.workunit.client.0.smithi066.stdout:8/130: getdents d12/d21 0 2024-09-12T01:43:03.793 INFO:tasks.workunit.client.1.smithi153.stdout:7/390: mknod d12/d21/d29/c6f 0 2024-09-12T01:43:03.793 INFO:tasks.workunit.client.1.smithi153.stdout:7/391: write d12/d21/f6b [250309,111494] 0 2024-09-12T01:43:03.793 INFO:tasks.workunit.client.1.smithi153.stdout:7/392: fdatasync d12/d21/d29/d2d/f30 0 2024-09-12T01:43:03.793 INFO:tasks.workunit.client.1.smithi153.stdout:7/393: creat d12/d21/d29/d35/d37/d4c/d5c/f70 x:0 0 0 2024-09-12T01:43:03.794 INFO:tasks.workunit.client.0.smithi066.stdout:5/89: creat d0/dd/d18/f19 x:0 0 0 2024-09-12T01:43:03.794 INFO:tasks.workunit.client.0.smithi066.stdout:7/71: symlink d2/d5/d7/l15 0 2024-09-12T01:43:03.796 INFO:tasks.workunit.client.0.smithi066.stdout:0/136: symlink d1/dc/df/d1b/d26/l37 0 2024-09-12T01:43:03.796 INFO:tasks.workunit.client.0.smithi066.stdout:0/137: write d1/dc/de/f1d [3000446,83059] 0 2024-09-12T01:43:03.796 INFO:tasks.workunit.client.0.smithi066.stdout:0/138: write d1/dc/df/f1a [818883,53203] 0 2024-09-12T01:43:03.797 INFO:tasks.workunit.client.1.smithi153.stdout:0/509: getdents d22/d30/d4c/d8a 0 2024-09-12T01:43:03.798 INFO:tasks.workunit.client.0.smithi066.stdout:5/90: unlink d0/l12 0 2024-09-12T01:43:03.800 INFO:tasks.workunit.client.0.smithi066.stdout:0/139: link d1/dc/df/d20/f21 d1/dc/f38 0 2024-09-12T01:43:03.801 INFO:tasks.workunit.client.0.smithi066.stdout:3/107: dread d5/fa [0,4194304] 0 2024-09-12T01:43:03.802 INFO:tasks.workunit.client.1.smithi153.stdout:4/371: truncate d6/d9/dc/d31/f34 2571504 0 2024-09-12T01:43:03.803 INFO:tasks.workunit.client.0.smithi066.stdout:3/108: mkdir d5/d6/d1b 0 2024-09-12T01:43:03.805 INFO:tasks.workunit.client.0.smithi066.stdout:3/109: link f4 d5/d6/dd/f1c 0 2024-09-12T01:43:03.812 INFO:tasks.workunit.client.1.smithi153.stdout:0/510: unlink d22/d82/f9b 0 2024-09-12T01:43:03.812 INFO:tasks.workunit.client.1.smithi153.stdout:0/511: fdatasync d22/d30/d4c/d6f/f73 0 2024-09-12T01:43:03.815 INFO:tasks.workunit.client.1.smithi153.stdout:8/440: rename d17/d21/d3a to d17/d21/d56/d96 0 2024-09-12T01:43:03.817 INFO:tasks.workunit.client.1.smithi153.stdout:1/476: rename d2/l27 to d2/d34/d3d/l92 0 2024-09-12T01:43:03.819 INFO:tasks.workunit.client.1.smithi153.stdout:1/477: getdents d2/d9/d17 0 2024-09-12T01:43:03.820 INFO:tasks.workunit.client.1.smithi153.stdout:7/394: write d12/d21/f44 [636186,107075] 0 2024-09-12T01:43:03.820 INFO:tasks.workunit.client.1.smithi153.stdout:7/395: chown d12/l18 1843 1 2024-09-12T01:43:03.820 INFO:tasks.workunit.client.1.smithi153.stdout:7/396: creat d12/d21/d29/d35/d37/d4c/f71 x:0 0 0 2024-09-12T01:43:03.821 INFO:tasks.workunit.client.1.smithi153.stdout:5/489: rename d0/df/d83/d63 to d0/df/d1c/d22/d2f/d55/d9c 0 2024-09-12T01:43:03.824 INFO:tasks.workunit.client.1.smithi153.stdout:5/490: mknod d0/df/c9d 0 2024-09-12T01:43:03.825 INFO:tasks.workunit.client.1.smithi153.stdout:5/491: fdatasync d0/df/d83/d36/d39/f72 0 2024-09-12T01:43:03.825 INFO:tasks.workunit.client.1.smithi153.stdout:3/505: dwrite d1/d13/d25/d26/f5a [0,4194304] 0 2024-09-12T01:43:03.826 INFO:tasks.workunit.client.1.smithi153.stdout:8/441: rename d17/d21/d56/d96/f58 to d17/d1f/d4f/d42/f97 0 2024-09-12T01:43:03.826 INFO:tasks.workunit.client.1.smithi153.stdout:8/442: readlink d17/d1f/l7c 0 2024-09-12T01:43:03.828 INFO:tasks.workunit.client.1.smithi153.stdout:3/506: mkdir d1/d1e/d9a 0 2024-09-12T01:43:03.829 INFO:tasks.workunit.client.1.smithi153.stdout:3/507: chown d1/d16/f69 18662 1 2024-09-12T01:43:03.831 INFO:tasks.workunit.client.1.smithi153.stdout:8/443: creat d17/d1f/d4f/d42/d79/f98 x:0 0 0 2024-09-12T01:43:03.832 INFO:tasks.workunit.client.0.smithi066.stdout:5/91: dread d0/f4 [0,4194304] 0 2024-09-12T01:43:03.833 INFO:tasks.workunit.client.1.smithi153.stdout:4/372: read d6/d15/f22 [3522159,36218] 0 2024-09-12T01:43:03.833 INFO:tasks.workunit.client.1.smithi153.stdout:4/373: write d6/d9/d11/d14/d3e/f5e [803079,18558] 0 2024-09-12T01:43:03.833 INFO:tasks.workunit.client.1.smithi153.stdout:8/444: mkdir d17/d21/d56/d99 0 2024-09-12T01:43:03.834 INFO:tasks.workunit.client.0.smithi066.stdout:6/181: dwrite d2/f38 [0,4194304] 0 2024-09-12T01:43:03.834 INFO:tasks.workunit.client.0.smithi066.stdout:5/92: link d0/dd/c11 d0/dd/d18/c1a 0 2024-09-12T01:43:03.836 INFO:tasks.workunit.client.1.smithi153.stdout:3/508: getdents d1/d64 0 2024-09-12T01:43:03.839 INFO:tasks.workunit.client.1.smithi153.stdout:0/512: dread d22/f2c [0,4194304] 0 2024-09-12T01:43:03.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/445: truncate d17/f1a 328687 0 2024-09-12T01:43:03.839 INFO:tasks.workunit.client.1.smithi153.stdout:8/446: dread - d17/d21/d56/f63 zero size 2024-09-12T01:43:03.840 INFO:tasks.workunit.client.0.smithi066.stdout:4/102: dwrite d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:03.840 INFO:tasks.workunit.client.0.smithi066.stdout:4/103: write d4/f16 [3991080,75585] 0 2024-09-12T01:43:03.840 INFO:tasks.workunit.client.0.smithi066.stdout:4/104: chown d4 0 1 2024-09-12T01:43:03.840 INFO:tasks.workunit.client.0.smithi066.stdout:3/110: dwrite f4 [0,4194304] 0 2024-09-12T01:43:03.841 INFO:tasks.workunit.client.0.smithi066.stdout:5/93: dread d0/f4 [0,4194304] 0 2024-09-12T01:43:03.843 INFO:tasks.workunit.client.1.smithi153.stdout:0/513: creat d22/d30/d4c/d6f/fb0 x:0 0 0 2024-09-12T01:43:03.843 INFO:tasks.workunit.client.1.smithi153.stdout:0/514: chown d22/d30/d4c/fa2 481 1 2024-09-12T01:43:03.843 INFO:tasks.workunit.client.1.smithi153.stdout:0/515: fdatasync d22/f5f 0 2024-09-12T01:43:03.843 INFO:tasks.workunit.client.1.smithi153.stdout:8/447: mknod d17/d21/d56/d96/d6c/d89/c9a 0 2024-09-12T01:43:03.843 INFO:tasks.workunit.client.1.smithi153.stdout:8/448: chown d17/d1d/d27/f6b 10 1 2024-09-12T01:43:03.843 INFO:tasks.workunit.client.1.smithi153.stdout:8/449: write d17/d1d/d27/f6b [4690937,83610] 0 2024-09-12T01:43:03.844 INFO:tasks.workunit.client.1.smithi153.stdout:8/450: write d17/d1f/d4f/d42/f86 [600994,65918] 0 2024-09-12T01:43:03.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/488: dwrite d3/f13 [0,4194304] 0 2024-09-12T01:43:03.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/489: creat d3/d3a/d42/d72/f94 x:0 0 0 2024-09-12T01:43:03.844 INFO:tasks.workunit.client.0.smithi066.stdout:8/131: dwrite f3 [0,4194304] 0 2024-09-12T01:43:03.848 INFO:tasks.workunit.client.0.smithi066.stdout:4/105: symlink d4/d6/d14/l22 0 2024-09-12T01:43:03.854 INFO:tasks.workunit.client.1.smithi153.stdout:0/516: link d22/d30/d4c/l5c d22/d79/lb1 0 2024-09-12T01:43:03.855 INFO:tasks.workunit.client.1.smithi153.stdout:3/509: dread d1/d13/d25/d26/f44 [0,4194304] 0 2024-09-12T01:43:03.856 INFO:tasks.workunit.client.0.smithi066.stdout:8/132: link c2 d12/d21/c25 0 2024-09-12T01:43:03.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/508: dwrite d1/d6/d23/d98/d53/d8d/f93 [4194304,4194304] 0 2024-09-12T01:43:03.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/509: write d1/d6/d23/d98/d53/d69/f7d [790607,127014] 0 2024-09-12T01:43:03.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/510: getdents d1/d6/d23/d98/d53/da0 0 2024-09-12T01:43:03.859 INFO:tasks.workunit.client.0.smithi066.stdout:4/106: creat d4/d6/f23 x:0 0 0 2024-09-12T01:43:03.861 INFO:tasks.workunit.client.1.smithi153.stdout:3/510: mknod d1/d13/d25/d26/d4b/c9b 0 2024-09-12T01:43:03.862 INFO:tasks.workunit.client.0.smithi066.stdout:4/107: write f3 [4408780,35308] 0 2024-09-12T01:43:03.867 INFO:tasks.workunit.client.0.smithi066.stdout:8/133: mkdir d12/d26 0 2024-09-12T01:43:03.869 INFO:tasks.workunit.client.0.smithi066.stdout:6/182: write d2/f22 [8014991,90829] 0 2024-09-12T01:43:03.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/125: dwrite f9 [0,4194304] 0 2024-09-12T01:43:03.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/126: chown de/d13/f1f 9816 1 2024-09-12T01:43:03.873 INFO:tasks.workunit.client.0.smithi066.stdout:8/134: creat d12/d26/f27 x:0 0 0 2024-09-12T01:43:03.875 INFO:tasks.workunit.client.1.smithi153.stdout:0/517: dread d22/d30/d4c/f58 [0,4194304] 0 2024-09-12T01:43:03.875 INFO:tasks.workunit.client.1.smithi153.stdout:0/518: fsync d22/d30/d4c/fa2 0 2024-09-12T01:43:03.880 INFO:tasks.workunit.client.1.smithi153.stdout:6/511: unlink d1/df/f5f 0 2024-09-12T01:43:03.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/492: dwrite d0/df/d83/d36/f7d [0,4194304] 0 2024-09-12T01:43:03.886 INFO:tasks.workunit.client.1.smithi153.stdout:5/493: readlink d0/df/l5b 0 2024-09-12T01:43:03.886 INFO:tasks.workunit.client.1.smithi153.stdout:1/478: dwrite d2/d9/d17/d2c/f4d [0,4194304] 0 2024-09-12T01:43:03.889 INFO:tasks.workunit.client.1.smithi153.stdout:3/511: write d1/d45/f51 [4140379,42887] 0 2024-09-12T01:43:03.894 INFO:tasks.workunit.client.0.smithi066.stdout:6/183: rename d2/db/d12/c3f to d2/c43 0 2024-09-12T01:43:03.896 INFO:tasks.workunit.client.0.smithi066.stdout:2/127: rmdir de/d13/d1e/d22/d2c 0 2024-09-12T01:43:03.897 INFO:tasks.workunit.client.1.smithi153.stdout:4/374: dwrite d6/d9/d11/d14/d3e/f50 [0,4194304] 0 2024-09-12T01:43:03.897 INFO:tasks.workunit.client.1.smithi153.stdout:4/375: stat d6/d9/l21 0 2024-09-12T01:43:03.898 INFO:tasks.workunit.client.1.smithi153.stdout:5/494: link d0/df/l5b d0/d43/d8d/l9e 0 2024-09-12T01:43:03.899 INFO:tasks.workunit.client.0.smithi066.stdout:8/135: symlink d12/d21/l28 0 2024-09-12T01:43:03.901 INFO:tasks.workunit.client.1.smithi153.stdout:1/479: rename d2/d9/f15 to d2/d9/d17/d2c/f93 0 2024-09-12T01:43:03.903 INFO:tasks.workunit.client.0.smithi066.stdout:6/184: mknod d2/d21/c44 0 2024-09-12T01:43:03.903 INFO:tasks.workunit.client.0.smithi066.stdout:6/185: fdatasync d2/d31/f33 0 2024-09-12T01:43:03.907 INFO:tasks.workunit.client.0.smithi066.stdout:8/136: rmdir d12/d21 39 2024-09-12T01:43:03.907 INFO:tasks.workunit.client.0.smithi066.stdout:7/72: dwrite d2/d5/da/f11 [0,4194304] 0 2024-09-12T01:43:03.907 INFO:tasks.workunit.client.0.smithi066.stdout:7/73: truncate d2/d5/da/f11 5075382 0 2024-09-12T01:43:03.907 INFO:tasks.workunit.client.1.smithi153.stdout:3/512: mkdir d1/d13/d23/d47/d6c/d9c 0 2024-09-12T01:43:03.908 INFO:tasks.workunit.client.0.smithi066.stdout:6/186: rmdir d2/db/d12/d1d 39 2024-09-12T01:43:03.911 INFO:tasks.workunit.client.1.smithi153.stdout:4/376: symlink d6/d9/l8e 0 2024-09-12T01:43:03.916 INFO:tasks.workunit.client.1.smithi153.stdout:9/490: dwrite d3/d55/d30/d7b/f85 [0,4194304] 0 2024-09-12T01:43:03.916 INFO:tasks.workunit.client.0.smithi066.stdout:3/111: dwrite d5/f17 [0,4194304] 0 2024-09-12T01:43:03.918 INFO:tasks.workunit.client.1.smithi153.stdout:4/377: rmdir d6/d9/d20 39 2024-09-12T01:43:03.921 INFO:tasks.workunit.client.1.smithi153.stdout:5/495: dread d0/df/f5d [0,4194304] 0 2024-09-12T01:43:03.921 INFO:tasks.workunit.client.1.smithi153.stdout:5/496: chown d0/df/d83/d36 227 1 2024-09-12T01:43:03.922 INFO:tasks.workunit.client.0.smithi066.stdout:4/108: dwrite d4/d6/d8/f13 [0,4194304] 0 2024-09-12T01:43:03.923 INFO:tasks.workunit.client.0.smithi066.stdout:7/74: write d2/d5/d6/fe [867366,71240] 0 2024-09-12T01:43:03.924 INFO:tasks.workunit.client.1.smithi153.stdout:3/513: dread d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:03.924 INFO:tasks.workunit.client.1.smithi153.stdout:8/451: dwrite d17/d75/f8d [0,4194304] 0 2024-09-12T01:43:03.924 INFO:tasks.workunit.client.1.smithi153.stdout:8/452: fsync d17/d1f/d4f/f65 0 2024-09-12T01:43:03.924 INFO:tasks.workunit.client.1.smithi153.stdout:7/397: dwrite d12/f31 [0,4194304] 0 2024-09-12T01:43:03.924 INFO:tasks.workunit.client.1.smithi153.stdout:7/398: readlink d12/d21/d29/d2d/l4a 0 2024-09-12T01:43:03.924 INFO:tasks.workunit.client.1.smithi153.stdout:7/399: fdatasync d12/d21/d29/d2d/f30 0 2024-09-12T01:43:03.925 INFO:tasks.workunit.client.1.smithi153.stdout:1/480: dread d2/d9/d1d/d25/f35 [0,4194304] 0 2024-09-12T01:43:03.925 INFO:tasks.workunit.client.1.smithi153.stdout:1/481: readlink d2/d34/d3d/l66 0 2024-09-12T01:43:03.925 INFO:tasks.workunit.client.1.smithi153.stdout:1/482: chown d2/d9/d1d/f4b 8 1 2024-09-12T01:43:03.926 INFO:tasks.workunit.client.1.smithi153.stdout:4/378: creat d6/d9/d20/f8f x:0 0 0 2024-09-12T01:43:03.928 INFO:tasks.workunit.client.1.smithi153.stdout:5/497: rename d0/df/d1c/d22/d2f/d55/f56 to d0/df/d83/f9f 0 2024-09-12T01:43:03.931 INFO:tasks.workunit.client.0.smithi066.stdout:7/75: rename d2/d5/cd to d2/d5/d7/c16 0 2024-09-12T01:43:03.932 INFO:tasks.workunit.client.0.smithi066.stdout:2/128: dwrite de/d13/d1e/d25/f2b [0,4194304] 0 2024-09-12T01:43:03.932 INFO:tasks.workunit.client.1.smithi153.stdout:3/514: getdents d1/d13/d25/d26/d4b/d97 0 2024-09-12T01:43:03.933 INFO:tasks.workunit.client.0.smithi066.stdout:3/112: symlink d5/l1d 0 2024-09-12T01:43:03.935 INFO:tasks.workunit.client.0.smithi066.stdout:0/140: dwrite d1/dc/df/f1a [0,4194304] 0 2024-09-12T01:43:03.935 INFO:tasks.workunit.client.1.smithi153.stdout:8/453: symlink d17/d1f/d4f/l9b 0 2024-09-12T01:43:03.936 INFO:tasks.workunit.client.1.smithi153.stdout:8/454: chown d17/d1f/d4f/d42/l7a 99003 1 2024-09-12T01:43:03.936 INFO:tasks.workunit.client.1.smithi153.stdout:0/519: dwrite d22/d30/f47 [0,4194304] 0 2024-09-12T01:43:03.936 INFO:tasks.workunit.client.1.smithi153.stdout:6/512: dwrite d1/df/f6f [0,4194304] 0 2024-09-12T01:43:03.938 INFO:tasks.workunit.client.0.smithi066.stdout:6/187: dwrite d2/db/f1c [0,4194304] 0 2024-09-12T01:43:03.938 INFO:tasks.workunit.client.0.smithi066.stdout:6/188: truncate d2/f1a 1184763 0 2024-09-12T01:43:03.938 INFO:tasks.workunit.client.0.smithi066.stdout:6/189: readlink d2/db/d12/l20 0 2024-09-12T01:43:03.938 INFO:tasks.workunit.client.0.smithi066.stdout:6/190: creat d2/f45 x:0 0 0 2024-09-12T01:43:03.939 INFO:tasks.workunit.client.0.smithi066.stdout:2/129: dread de/f15 [0,4194304] 0 2024-09-12T01:43:03.939 INFO:tasks.workunit.client.0.smithi066.stdout:3/113: truncate d5/ff 626143 0 2024-09-12T01:43:03.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/400: unlink d12/d21/f34 0 2024-09-12T01:43:03.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/401: chown d12/d21/d29/d35/d37/l61 6089224 1 2024-09-12T01:43:03.943 INFO:tasks.workunit.client.0.smithi066.stdout:2/130: symlink de/l2e 0 2024-09-12T01:43:03.944 INFO:tasks.workunit.client.0.smithi066.stdout:7/76: dread d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:03.946 INFO:tasks.workunit.client.1.smithi153.stdout:5/498: dread d0/f12 [0,4194304] 0 2024-09-12T01:43:03.946 INFO:tasks.workunit.client.1.smithi153.stdout:1/483: creat d2/d34/d8a/f94 x:0 0 0 2024-09-12T01:43:03.947 INFO:tasks.workunit.client.0.smithi066.stdout:3/114: rename d5/d6/dd/l13 to d5/d6/l1e 0 2024-09-12T01:43:03.948 INFO:tasks.workunit.client.1.smithi153.stdout:9/491: rmdir d3/d55/d30/d88 39 2024-09-12T01:43:03.948 INFO:tasks.workunit.client.1.smithi153.stdout:9/492: dread - d3/d3a/d42/d72/f94 zero size 2024-09-12T01:43:03.950 INFO:tasks.workunit.client.0.smithi066.stdout:2/131: creat de/d13/d28/f2f x:0 0 0 2024-09-12T01:43:03.952 INFO:tasks.workunit.client.0.smithi066.stdout:7/77: mknod d2/d5/da/c17 0 2024-09-12T01:43:03.952 INFO:tasks.workunit.client.0.smithi066.stdout:7/78: fsync d2/d5/da/f11 0 2024-09-12T01:43:03.953 INFO:tasks.workunit.client.0.smithi066.stdout:7/79: stat d2/d5/da/c17 0 2024-09-12T01:43:03.954 INFO:tasks.workunit.client.1.smithi153.stdout:3/515: creat d1/f9d x:0 0 0 2024-09-12T01:43:03.954 INFO:tasks.workunit.client.1.smithi153.stdout:3/516: write d1/d16/f27 [4378125,105639] 0 2024-09-12T01:43:03.955 INFO:tasks.workunit.client.0.smithi066.stdout:2/132: link de/ff de/d13/d28/f30 0 2024-09-12T01:43:03.957 INFO:tasks.workunit.client.1.smithi153.stdout:8/455: mkdir d17/d21/d56/d96/d6c/d89/d9c 0 2024-09-12T01:43:03.960 INFO:tasks.workunit.client.0.smithi066.stdout:2/133: symlink de/d13/l31 0 2024-09-12T01:43:03.960 INFO:tasks.workunit.client.0.smithi066.stdout:2/134: chown de/d13/l31 3539948 1 2024-09-12T01:43:03.960 INFO:tasks.workunit.client.0.smithi066.stdout:2/135: truncate de/f15 1379133 0 2024-09-12T01:43:03.960 INFO:tasks.workunit.client.0.smithi066.stdout:2/136: readlink de/l1b 0 2024-09-12T01:43:03.960 INFO:tasks.workunit.client.0.smithi066.stdout:2/137: readlink de/l2e 0 2024-09-12T01:43:03.961 INFO:tasks.workunit.client.0.smithi066.stdout:2/138: truncate de/d13/d1e/d25/f29 1288178 0 2024-09-12T01:43:03.961 INFO:tasks.workunit.client.0.smithi066.stdout:0/141: dwrite d1/dc/de/f1d [0,4194304] 0 2024-09-12T01:43:03.961 INFO:tasks.workunit.client.0.smithi066.stdout:0/142: chown d1/c1e 4011 1 2024-09-12T01:43:03.961 INFO:tasks.workunit.client.0.smithi066.stdout:0/143: dread - d1/dc/de/f2a zero size 2024-09-12T01:43:03.962 INFO:tasks.workunit.client.1.smithi153.stdout:0/520: rename d22/d30/d4c/d6e/l4f to d22/d30/d4c/d6f/d88/lb2 0 2024-09-12T01:43:03.962 INFO:tasks.workunit.client.1.smithi153.stdout:0/521: write d22/d30/d4c/d6f/fb0 [666857,114006] 0 2024-09-12T01:43:03.962 INFO:tasks.workunit.client.1.smithi153.stdout:0/522: fsync d22/f32 0 2024-09-12T01:43:03.962 INFO:tasks.workunit.client.1.smithi153.stdout:0/523: chown fa 4 1 2024-09-12T01:43:03.962 INFO:tasks.workunit.client.1.smithi153.stdout:0/524: stat d22/d30/d4c/d6e/d7f/fa3 0 2024-09-12T01:43:03.962 INFO:tasks.workunit.client.1.smithi153.stdout:0/525: truncate d22/d30/d4c/d6f/f99 1017511 0 2024-09-12T01:43:03.963 INFO:tasks.workunit.client.1.smithi153.stdout:0/526: write d22/d30/d4c/d6f/f70 [115389,15099] 0 2024-09-12T01:43:03.963 INFO:tasks.workunit.client.1.smithi153.stdout:0/527: dread d22/d30/f67 [0,4194304] 0 2024-09-12T01:43:03.964 INFO:tasks.workunit.client.0.smithi066.stdout:2/139: creat de/d13/d1e/d25/f32 x:0 0 0 2024-09-12T01:43:03.964 INFO:tasks.workunit.client.0.smithi066.stdout:2/140: readlink de/l2e 0 2024-09-12T01:43:03.965 INFO:tasks.workunit.client.0.smithi066.stdout:8/137: rmdir d12 39 2024-09-12T01:43:03.969 INFO:tasks.workunit.client.0.smithi066.stdout:0/144: truncate d1/f9 2253900 0 2024-09-12T01:43:03.969 INFO:tasks.workunit.client.0.smithi066.stdout:2/141: unlink f6 0 2024-09-12T01:43:03.969 INFO:tasks.workunit.client.0.smithi066.stdout:2/142: write de/d13/f1f [53465,102459] 0 2024-09-12T01:43:03.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/138: unlink d12/l16 0 2024-09-12T01:43:03.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/139: readlink le 0 2024-09-12T01:43:03.970 INFO:tasks.workunit.client.0.smithi066.stdout:6/191: dwrite d2/fa [0,4194304] 0 2024-09-12T01:43:03.970 INFO:tasks.workunit.client.0.smithi066.stdout:6/192: truncate d2/f45 75032 0 2024-09-12T01:43:03.971 INFO:tasks.workunit.client.0.smithi066.stdout:0/145: symlink d1/dc/l39 0 2024-09-12T01:43:03.972 INFO:tasks.workunit.client.0.smithi066.stdout:3/115: dwrite d5/d6/f9 [4194304,4194304] 0 2024-09-12T01:43:03.977 INFO:tasks.workunit.client.0.smithi066.stdout:2/143: write de/d13/d1e/d25/f2b [5458784,127369] 0 2024-09-12T01:43:03.977 INFO:tasks.workunit.client.0.smithi066.stdout:2/144: creat de/d13/d1e/d25/f33 x:0 0 0 2024-09-12T01:43:03.977 INFO:tasks.workunit.client.0.smithi066.stdout:2/145: readlink l3 0 2024-09-12T01:43:03.977 INFO:tasks.workunit.client.0.smithi066.stdout:4/109: write d4/d6/d8/f13 [4921686,100349] 0 2024-09-12T01:43:03.979 INFO:tasks.workunit.client.1.smithi153.stdout:5/499: creat d0/df/d1c/d22/d2f/d55/d9c/fa0 x:0 0 0 2024-09-12T01:43:03.979 INFO:tasks.workunit.client.1.smithi153.stdout:1/484: rmdir d2/d9/d1d/d82 39 2024-09-12T01:43:03.980 INFO:tasks.workunit.client.1.smithi153.stdout:5/500: creat d0/d20/fa1 x:0 0 0 2024-09-12T01:43:03.980 INFO:tasks.workunit.client.1.smithi153.stdout:5/501: chown d0/df/f10 4 1 2024-09-12T01:43:03.982 INFO:tasks.workunit.client.1.smithi153.stdout:4/379: getdents d6/d9/d11/d13 0 2024-09-12T01:43:03.983 INFO:tasks.workunit.client.0.smithi066.stdout:8/140: dwrite ff [0,4194304] 0 2024-09-12T01:43:03.988 INFO:tasks.workunit.client.0.smithi066.stdout:7/80: rename d2/d5/d7/c16 to d2/c18 0 2024-09-12T01:43:03.988 INFO:tasks.workunit.client.0.smithi066.stdout:7/81: chown d2/d5/d7/l15 44215 1 2024-09-12T01:43:03.988 INFO:tasks.workunit.client.0.smithi066.stdout:7/82: creat d2/d5/da/f19 x:0 0 0 2024-09-12T01:43:03.990 INFO:tasks.workunit.client.1.smithi153.stdout:8/456: mknod d17/d21/d56/c9d 0 2024-09-12T01:43:03.992 INFO:tasks.workunit.client.1.smithi153.stdout:9/493: rename d3/d5f/d81 to d3/d55/d30/d95 0 2024-09-12T01:43:03.994 INFO:tasks.workunit.client.1.smithi153.stdout:0/528: mknod d22/d30/d4c/d8a/cb3 0 2024-09-12T01:43:03.995 INFO:tasks.workunit.client.1.smithi153.stdout:9/494: dread d3/d55/d30/d7b/f89 [0,4194304] 0 2024-09-12T01:43:03.998 INFO:tasks.workunit.client.1.smithi153.stdout:6/513: rmdir d1/df 39 2024-09-12T01:43:04.001 INFO:tasks.workunit.client.1.smithi153.stdout:6/514: write d1/d6/f35 [1330146,121367] 0 2024-09-12T01:43:04.001 INFO:tasks.workunit.client.1.smithi153.stdout:5/502: dwrite d0/df/d1c/d22/d2f/d55/d9c/d75/d58/f66 [0,4194304] 0 2024-09-12T01:43:04.003 INFO:tasks.workunit.client.1.smithi153.stdout:7/402: rmdir d12/d21/d29/d35 39 2024-09-12T01:43:04.006 INFO:tasks.workunit.client.0.smithi066.stdout:3/116: symlink d5/d6/dd/l1f 0 2024-09-12T01:43:04.009 INFO:tasks.workunit.client.1.smithi153.stdout:4/380: mkdir d6/d9/d11/d90 0 2024-09-12T01:43:04.009 INFO:tasks.workunit.client.1.smithi153.stdout:4/381: readlink d6/d9/d11/d13/l7c 0 2024-09-12T01:43:04.009 INFO:tasks.workunit.client.0.smithi066.stdout:2/146: mknod de/d13/d1e/d25/c34 0 2024-09-12T01:43:04.010 INFO:tasks.workunit.client.0.smithi066.stdout:2/147: write de/ff [1278139,2493] 0 2024-09-12T01:43:04.010 INFO:tasks.workunit.client.0.smithi066.stdout:2/148: chown de/l1b 9964466 1 2024-09-12T01:43:04.010 INFO:tasks.workunit.client.0.smithi066.stdout:2/149: readlink de/d13/l31 0 2024-09-12T01:43:04.010 INFO:tasks.workunit.client.0.smithi066.stdout:2/150: creat de/d13/d28/f35 x:0 0 0 2024-09-12T01:43:04.010 INFO:tasks.workunit.client.0.smithi066.stdout:2/151: stat de/d13/d28 0 2024-09-12T01:43:04.011 INFO:tasks.workunit.client.1.smithi153.stdout:3/517: unlink d1/d13/d23/d47/d71/c8f 0 2024-09-12T01:43:04.011 INFO:tasks.workunit.client.1.smithi153.stdout:3/518: creat d1/d16/d1c/d32/f9e x:0 0 0 2024-09-12T01:43:04.012 INFO:tasks.workunit.client.0.smithi066.stdout:4/110: unlink d4/d6/d8/d18/c1f 0 2024-09-12T01:43:04.012 INFO:tasks.workunit.client.1.smithi153.stdout:2/414: sync 2024-09-12T01:43:04.013 INFO:tasks.workunit.client.1.smithi153.stdout:2/415: write d7/f11 [1782946,51619] 0 2024-09-12T01:43:04.014 INFO:tasks.workunit.client.1.smithi153.stdout:9/495: stat d3/f1d 0 2024-09-12T01:43:04.014 INFO:tasks.workunit.client.1.smithi153.stdout:6/515: dread d1/d6/d23/d98/d53/f97 [0,4194304] 0 2024-09-12T01:43:04.014 INFO:tasks.workunit.client.1.smithi153.stdout:6/516: dread - d1/d6/d46/d73/f8b zero size 2024-09-12T01:43:04.014 INFO:tasks.workunit.client.1.smithi153.stdout:8/457: dwrite d17/d1d/d27/f7e [0,4194304] 0 2024-09-12T01:43:04.014 INFO:tasks.workunit.client.1.smithi153.stdout:4/382: dread d6/d6a/f8c [0,4194304] 0 2024-09-12T01:43:04.015 INFO:tasks.workunit.client.1.smithi153.stdout:2/416: dread d7/db/d1d/f5d [0,4194304] 0 2024-09-12T01:43:04.015 INFO:tasks.workunit.client.1.smithi153.stdout:2/417: chown d7/d19/f4b 280 1 2024-09-12T01:43:04.015 INFO:tasks.workunit.client.1.smithi153.stdout:5/503: symlink d0/d20/la2 0 2024-09-12T01:43:04.018 INFO:tasks.workunit.client.0.smithi066.stdout:8/141: rename lc to d12/d21/l29 0 2024-09-12T01:43:04.020 INFO:tasks.workunit.client.1.smithi153.stdout:7/403: creat d12/d21/d29/d35/d3c/f72 x:0 0 0 2024-09-12T01:43:04.021 INFO:tasks.workunit.client.0.smithi066.stdout:3/117: write f3 [3286601,75566] 0 2024-09-12T01:43:04.021 INFO:tasks.workunit.client.0.smithi066.stdout:3/118: fdatasync d5/d6/f7 0 2024-09-12T01:43:04.021 INFO:tasks.workunit.client.0.smithi066.stdout:3/119: fsync d5/f17 0 2024-09-12T01:43:04.023 INFO:tasks.workunit.client.0.smithi066.stdout:7/83: creat d2/d5/f1a x:0 0 0 2024-09-12T01:43:04.023 INFO:tasks.workunit.client.0.smithi066.stdout:7/84: dread - d2/d5/da/f19 zero size 2024-09-12T01:43:04.024 INFO:tasks.workunit.client.0.smithi066.stdout:7/85: dread d2/d5/da/f11 [4194304,4194304] 0 2024-09-12T01:43:04.024 INFO:tasks.workunit.client.1.smithi153.stdout:8/458: dread d17/d1d/d27/f35 [0,4194304] 0 2024-09-12T01:43:04.024 INFO:tasks.workunit.client.1.smithi153.stdout:1/485: rmdir d2/d9/d1d/d25/d3f 39 2024-09-12T01:43:04.025 INFO:tasks.workunit.client.1.smithi153.stdout:4/383: read d6/d9/f10 [2014095,91668] 0 2024-09-12T01:43:04.026 INFO:tasks.workunit.client.0.smithi066.stdout:6/193: getdents d2/db 0 2024-09-12T01:43:04.026 INFO:tasks.workunit.client.1.smithi153.stdout:2/418: dread d7/db/f30 [0,4194304] 0 2024-09-12T01:43:04.027 INFO:tasks.workunit.client.0.smithi066.stdout:6/194: dread d2/db/f11 [0,4194304] 0 2024-09-12T01:43:04.029 INFO:tasks.workunit.client.0.smithi066.stdout:0/146: getdents d1/dc/df/d20 0 2024-09-12T01:43:04.033 INFO:tasks.workunit.client.1.smithi153.stdout:9/496: getdents d3/d5f/d62 0 2024-09-12T01:43:04.034 INFO:tasks.workunit.client.0.smithi066.stdout:8/142: write d12/f1e [5832919,13521] 0 2024-09-12T01:43:04.034 INFO:tasks.workunit.client.0.smithi066.stdout:8/143: write d12/f23 [759974,65551] 0 2024-09-12T01:43:04.034 INFO:tasks.workunit.client.1.smithi153.stdout:9/497: write d3/d55/f6b [652575,22420] 0 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.1.smithi153.stdout:9/498: creat d3/d3a/d42/d72/f96 x:0 0 0 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.0.smithi066.stdout:9/127: sync 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.0.smithi066.stdout:1/112: sync 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.0.smithi066.stdout:5/94: sync 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.0.smithi066.stdout:5/95: read - d0/dd/d18/f19 zero size 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.0.smithi066.stdout:6/195: dread d2/d21/f25 [0,4194304] 0 2024-09-12T01:43:04.035 INFO:tasks.workunit.client.0.smithi066.stdout:6/196: fsync d2/db/f3a 0 2024-09-12T01:43:04.037 INFO:tasks.workunit.client.0.smithi066.stdout:4/111: rename d4/c1c to d4/d15/c24 0 2024-09-12T01:43:04.038 INFO:tasks.workunit.client.0.smithi066.stdout:0/147: write d1/fa [2247498,104882] 0 2024-09-12T01:43:04.038 INFO:tasks.workunit.client.0.smithi066.stdout:0/148: creat d1/dc/de/f3a x:0 0 0 2024-09-12T01:43:04.038 INFO:tasks.workunit.client.0.smithi066.stdout:0/149: stat d1/dc/df/d1b/d26/l37 0 2024-09-12T01:43:04.039 INFO:tasks.workunit.client.0.smithi066.stdout:3/120: symlink d5/d6/dd/l20 0 2024-09-12T01:43:04.044 INFO:tasks.workunit.client.0.smithi066.stdout:8/144: mknod d12/d21/c2a 0 2024-09-12T01:43:04.047 INFO:tasks.workunit.client.1.smithi153.stdout:6/517: link d1/d6/d23/d98/d53/f97 d1/d6/d39/fa5 0 2024-09-12T01:43:04.049 INFO:tasks.workunit.client.1.smithi153.stdout:5/504: creat d0/d79/fa3 x:0 0 0 2024-09-12T01:43:04.051 INFO:tasks.workunit.client.1.smithi153.stdout:8/459: creat d17/d21/d56/d99/f9e x:0 0 0 2024-09-12T01:43:04.051 INFO:tasks.workunit.client.1.smithi153.stdout:8/460: write d17/f24 [4779903,7427] 0 2024-09-12T01:43:04.051 INFO:tasks.workunit.client.1.smithi153.stdout:8/461: truncate d17/d21/f88 1631577 0 2024-09-12T01:43:04.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/486: mkdir d2/d9/d17/d69/d95 0 2024-09-12T01:43:04.053 INFO:tasks.workunit.client.1.smithi153.stdout:1/487: fsync d2/f6 0 2024-09-12T01:43:04.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/384: mknod d6/d9/dc/d42/c91 0 2024-09-12T01:43:04.056 INFO:tasks.workunit.client.1.smithi153.stdout:2/419: creat d7/d19/d40/f82 x:0 0 0 2024-09-12T01:43:04.057 INFO:tasks.workunit.client.0.smithi066.stdout:9/128: symlink d0/d6/d17/l2c 0 2024-09-12T01:43:04.059 INFO:tasks.workunit.client.0.smithi066.stdout:1/113: creat d5/d15/f21 x:0 0 0 2024-09-12T01:43:04.059 INFO:tasks.workunit.client.0.smithi066.stdout:3/121: dwrite d5/d6/dd/f1a [0,4194304] 0 2024-09-12T01:43:04.060 INFO:tasks.workunit.client.1.smithi153.stdout:9/499: getdents d3/d55/d30/d95/d84 0 2024-09-12T01:43:04.060 INFO:tasks.workunit.client.1.smithi153.stdout:9/500: chown d3/d55/d30/f73 34 1 2024-09-12T01:43:04.061 INFO:tasks.workunit.client.1.smithi153.stdout:9/501: dread d3/d3a/d42/d72/f74 [0,4194304] 0 2024-09-12T01:43:04.061 INFO:tasks.workunit.client.1.smithi153.stdout:9/502: truncate d3/d55/d30/f86 151163 0 2024-09-12T01:43:04.062 INFO:tasks.workunit.client.0.smithi066.stdout:5/96: unlink d0/dd/ff 0 2024-09-12T01:43:04.062 INFO:tasks.workunit.client.0.smithi066.stdout:2/152: rmdir de 39 2024-09-12T01:43:04.062 INFO:tasks.workunit.client.0.smithi066.stdout:2/153: dread - de/d13/d1e/f23 zero size 2024-09-12T01:43:04.063 INFO:tasks.workunit.client.1.smithi153.stdout:6/518: creat d1/d6/d46/d73/fa6 x:0 0 0 2024-09-12T01:43:04.064 INFO:tasks.workunit.client.0.smithi066.stdout:6/197: link d2/l36 d2/db/l46 0 2024-09-12T01:43:04.065 INFO:tasks.workunit.client.1.smithi153.stdout:5/505: mkdir d0/df/d83/d36/d39/da4 0 2024-09-12T01:43:04.065 INFO:tasks.workunit.client.0.smithi066.stdout:7/86: rename d2/d5 to d2/d5/d1b 22 2024-09-12T01:43:04.065 INFO:tasks.workunit.client.1.smithi153.stdout:2/420: dread d7/d17/f3c [0,4194304] 0 2024-09-12T01:43:04.066 INFO:tasks.workunit.client.1.smithi153.stdout:9/503: write d3/d35/f75 [167781,24898] 0 2024-09-12T01:43:04.067 INFO:tasks.workunit.client.0.smithi066.stdout:4/112: mknod d4/d6/d8/d18/c25 0 2024-09-12T01:43:04.068 INFO:tasks.workunit.client.1.smithi153.stdout:1/488: mknod d2/d9/d28/c96 0 2024-09-12T01:43:04.070 INFO:tasks.workunit.client.1.smithi153.stdout:4/385: symlink d6/l92 0 2024-09-12T01:43:04.070 INFO:tasks.workunit.client.1.smithi153.stdout:4/386: truncate d6/d9/dc/d31/f24 4920107 0 2024-09-12T01:43:04.070 INFO:tasks.workunit.client.1.smithi153.stdout:4/387: truncate d6/d9/d11/d13/f65 884991 0 2024-09-12T01:43:04.071 INFO:tasks.workunit.client.1.smithi153.stdout:5/506: mkdir d0/df/d83/d36/da5 0 2024-09-12T01:43:04.072 INFO:tasks.workunit.client.1.smithi153.stdout:5/507: dread - d0/df/d1c/d69/f80 zero size 2024-09-12T01:43:04.072 INFO:tasks.workunit.client.0.smithi066.stdout:8/145: unlink d12/f1e 0 2024-09-12T01:43:04.074 INFO:tasks.workunit.client.0.smithi066.stdout:9/129: rmdir d0/d5/d9/de 39 2024-09-12T01:43:04.074 INFO:tasks.workunit.client.0.smithi066.stdout:9/130: creat d0/d6/f2d x:0 0 0 2024-09-12T01:43:04.074 INFO:tasks.workunit.client.1.smithi153.stdout:8/462: rmdir d17/d1f/d4f/d42/d79 39 2024-09-12T01:43:04.075 INFO:tasks.workunit.client.0.smithi066.stdout:1/114: mknod d5/c22 0 2024-09-12T01:43:04.076 INFO:tasks.workunit.client.0.smithi066.stdout:6/198: dread d2/d21/f34 [0,4194304] 0 2024-09-12T01:43:04.077 INFO:tasks.workunit.client.1.smithi153.stdout:9/504: rmdir d3/d55/d30/d95 39 2024-09-12T01:43:04.077 INFO:tasks.workunit.client.1.smithi153.stdout:9/505: write d3/d3a/f7a [2961952,66154] 0 2024-09-12T01:43:04.078 INFO:tasks.workunit.client.1.smithi153.stdout:1/489: truncate d2/d9/d1d/f4b 838066 0 2024-09-12T01:43:04.078 INFO:tasks.workunit.client.1.smithi153.stdout:1/490: chown d2/d34/d3d/f59 986553 1 2024-09-12T01:43:04.079 INFO:tasks.workunit.client.1.smithi153.stdout:4/388: mknod d6/d6a/c93 0 2024-09-12T01:43:04.079 INFO:tasks.workunit.client.1.smithi153.stdout:2/421: getdents d7/db/d1d 0 2024-09-12T01:43:04.080 INFO:tasks.workunit.client.0.smithi066.stdout:2/154: creat de/d13/d1e/f36 x:0 0 0 2024-09-12T01:43:04.080 INFO:tasks.workunit.client.0.smithi066.stdout:2/155: fsync f5 0 2024-09-12T01:43:04.081 INFO:tasks.workunit.client.1.smithi153.stdout:8/463: rename d17/d21/d56/c62 to d17/d21/d56/d96/d6c/c9f 0 2024-09-12T01:43:04.081 INFO:tasks.workunit.client.1.smithi153.stdout:6/519: dwrite d1/d6/d46/d73/f91 [0,4194304] 0 2024-09-12T01:43:04.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/506: symlink d3/d55/d30/d5b/l97 0 2024-09-12T01:43:04.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/507: dread - d3/d55/d30/f5e zero size 2024-09-12T01:43:04.083 INFO:tasks.workunit.client.1.smithi153.stdout:4/389: mkdir d6/d9/dc/d31/d7d/d94 0 2024-09-12T01:43:04.083 INFO:tasks.workunit.client.1.smithi153.stdout:2/422: mkdir d7/d19/d83 0 2024-09-12T01:43:04.086 INFO:tasks.workunit.client.0.smithi066.stdout:8/146: unlink d12/d21/c2a 0 2024-09-12T01:43:04.086 INFO:tasks.workunit.client.1.smithi153.stdout:8/464: mknod d17/d1d/ca0 0 2024-09-12T01:43:04.088 INFO:tasks.workunit.client.1.smithi153.stdout:9/508: mkdir d3/d3a/d42/d72/d98 0 2024-09-12T01:43:04.094 INFO:tasks.workunit.client.1.smithi153.stdout:2/423: creat d7/db/d36/f84 x:0 0 0 2024-09-12T01:43:04.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/115: creat d5/dc/dd/f23 x:0 0 0 2024-09-12T01:43:04.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/116: chown d5/cb 1065 1 2024-09-12T01:43:04.098 INFO:tasks.workunit.client.1.smithi153.stdout:9/509: readlink d3/l25 0 2024-09-12T01:43:04.098 INFO:tasks.workunit.client.1.smithi153.stdout:9/510: write d3/d55/f22 [5088390,87038] 0 2024-09-12T01:43:04.099 INFO:tasks.workunit.client.0.smithi066.stdout:6/199: creat d2/d31/f47 x:0 0 0 2024-09-12T01:43:04.100 INFO:tasks.workunit.client.0.smithi066.stdout:8/147: write d12/f1b [2056475,111357] 0 2024-09-12T01:43:04.100 INFO:tasks.workunit.client.0.smithi066.stdout:8/148: fsync d12/f24 0 2024-09-12T01:43:04.102 INFO:tasks.workunit.client.0.smithi066.stdout:3/122: mknod d5/c21 0 2024-09-12T01:43:04.103 INFO:tasks.workunit.client.1.smithi153.stdout:4/390: getdents d6/d9/d20 0 2024-09-12T01:43:04.105 INFO:tasks.workunit.client.0.smithi066.stdout:4/113: dwrite f3 [0,4194304] 0 2024-09-12T01:43:04.105 INFO:tasks.workunit.client.0.smithi066.stdout:4/114: readlink l0 0 2024-09-12T01:43:04.108 INFO:tasks.workunit.client.0.smithi066.stdout:5/97: rmdir d0/dd 39 2024-09-12T01:43:04.110 INFO:tasks.workunit.client.0.smithi066.stdout:0/150: rmdir d1 39 2024-09-12T01:43:04.110 INFO:tasks.workunit.client.0.smithi066.stdout:0/151: chown d1/dc/df/d20/l32 671 1 2024-09-12T01:43:04.111 INFO:tasks.workunit.client.0.smithi066.stdout:2/156: mkdir de/d13/d1e/d25/d37 0 2024-09-12T01:43:04.112 INFO:tasks.workunit.client.0.smithi066.stdout:2/157: write de/d13/d1e/d25/f29 [102926,126677] 0 2024-09-12T01:43:04.113 INFO:tasks.workunit.client.0.smithi066.stdout:2/158: stat de/f12 0 2024-09-12T01:43:04.114 INFO:tasks.workunit.client.0.smithi066.stdout:7/87: mknod d2/d5/c1c 0 2024-09-12T01:43:04.114 INFO:tasks.workunit.client.1.smithi153.stdout:6/520: dwrite d1/d6/f35 [0,4194304] 0 2024-09-12T01:43:04.116 INFO:tasks.workunit.client.1.smithi153.stdout:4/391: rmdir d6/d15 39 2024-09-12T01:43:04.116 INFO:tasks.workunit.client.1.smithi153.stdout:4/392: stat d6/f63 0 2024-09-12T01:43:04.116 INFO:tasks.workunit.client.0.smithi066.stdout:1/117: mknod d5/c24 0 2024-09-12T01:43:04.119 INFO:tasks.workunit.client.0.smithi066.stdout:6/200: unlink d2/d31/f47 0 2024-09-12T01:43:04.119 INFO:tasks.workunit.client.0.smithi066.stdout:6/201: dread - d2/d31/f39 zero size 2024-09-12T01:43:04.120 INFO:tasks.workunit.client.1.smithi153.stdout:6/521: dread d1/d6/d23/d98/d53/d69/f7d [0,4194304] 0 2024-09-12T01:43:04.124 INFO:tasks.workunit.client.0.smithi066.stdout:8/149: creat d12/d21/f2b x:0 0 0 2024-09-12T01:43:04.124 INFO:tasks.workunit.client.0.smithi066.stdout:8/150: chown d12/l18 50 1 2024-09-12T01:43:04.126 INFO:tasks.workunit.client.0.smithi066.stdout:3/123: mknod d5/d6/d1b/c22 0 2024-09-12T01:43:04.127 INFO:tasks.workunit.client.0.smithi066.stdout:4/115: symlink d4/d6/d8/d18/l26 0 2024-09-12T01:43:04.129 INFO:tasks.workunit.client.0.smithi066.stdout:5/98: symlink d0/dd/l1b 0 2024-09-12T01:43:04.129 INFO:tasks.workunit.client.0.smithi066.stdout:5/99: write d0/db/f10 [379898,45594] 0 2024-09-12T01:43:04.130 INFO:tasks.workunit.client.0.smithi066.stdout:9/131: getdents d0/d6 0 2024-09-12T01:43:04.131 INFO:tasks.workunit.client.0.smithi066.stdout:0/152: mkdir d1/dc/df/d1b/d3b 0 2024-09-12T01:43:04.131 INFO:tasks.workunit.client.0.smithi066.stdout:0/153: fdatasync d1/dc/de/f1f 0 2024-09-12T01:43:04.132 INFO:tasks.workunit.client.1.smithi153.stdout:1/491: dwrite d2/d9/d17/f23 [0,4194304] 0 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:8/465: dwrite d17/d21/d56/d96/d6c/d89/f8e [0,4194304] 0 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/424: dwrite d7/db/f25 [0,4194304] 0 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/425: write d7/db/d27/f73 [677846,49518] 0 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/426: chown d7/db/d36 60 1 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/427: chown d7/db/d62 16 1 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/428: chown d7/db/d6c/d7e 1027705608 1 2024-09-12T01:43:04.133 INFO:tasks.workunit.client.1.smithi153.stdout:2/429: dread - d7/db/d6c/d7e/f63 zero size 2024-09-12T01:43:04.134 INFO:tasks.workunit.client.0.smithi066.stdout:1/118: dwrite d5/f1a [0,4194304] 0 2024-09-12T01:43:04.136 INFO:tasks.workunit.client.0.smithi066.stdout:6/202: symlink d2/db/l48 0 2024-09-12T01:43:04.136 INFO:tasks.workunit.client.1.smithi153.stdout:4/393: creat d6/d9/d11/d90/f95 x:0 0 0 2024-09-12T01:43:04.139 INFO:tasks.workunit.client.0.smithi066.stdout:3/124: symlink d5/d6/d1b/l23 0 2024-09-12T01:43:04.139 INFO:tasks.workunit.client.0.smithi066.stdout:3/125: readlink d5/d6/d1b/l23 0 2024-09-12T01:43:04.141 INFO:tasks.workunit.client.0.smithi066.stdout:5/100: symlink d0/dd/l1c 0 2024-09-12T01:43:04.143 INFO:tasks.workunit.client.1.smithi153.stdout:1/492: mkdir d2/d9/d17/d2f/d56/d97 0 2024-09-12T01:43:04.143 INFO:tasks.workunit.client.1.smithi153.stdout:6/522: creat d1/df/fa7 x:0 0 0 2024-09-12T01:43:04.143 INFO:tasks.workunit.client.1.smithi153.stdout:6/523: chown d1/d6/d23/d98/d53/d69/d7c/d7f/f9b 2271 1 2024-09-12T01:43:04.143 INFO:tasks.workunit.client.1.smithi153.stdout:6/524: readlink d1/l9e 0 2024-09-12T01:43:04.143 INFO:tasks.workunit.client.1.smithi153.stdout:6/525: chown d1/d6/d46 0 1 2024-09-12T01:43:04.144 INFO:tasks.workunit.client.0.smithi066.stdout:9/132: mknod d0/d6/c2e 0 2024-09-12T01:43:04.145 INFO:tasks.workunit.client.0.smithi066.stdout:4/116: dread d4/d6/d8/fa [0,4194304] 0 2024-09-12T01:43:04.146 INFO:tasks.workunit.client.0.smithi066.stdout:0/154: creat d1/dc/de/f3c x:0 0 0 2024-09-12T01:43:04.150 INFO:tasks.workunit.client.1.smithi153.stdout:8/466: truncate f15 2080896 0 2024-09-12T01:43:04.151 INFO:tasks.workunit.client.0.smithi066.stdout:7/88: rmdir d2/d5/d6 39 2024-09-12T01:43:04.151 INFO:tasks.workunit.client.0.smithi066.stdout:7/89: fdatasync d2/d5/f1a 0 2024-09-12T01:43:04.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:03 smithi153 ceph-mon[34713]: pgmap v242: 65 pgs: 65 active+clean; 972 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 119 MiB/s wr, 729 op/s 2024-09-12T01:43:04.156 INFO:tasks.workunit.client.0.smithi066.stdout:6/203: dread d2/f22 [4194304,4194304] 0 2024-09-12T01:43:04.157 INFO:tasks.workunit.client.0.smithi066.stdout:9/133: dread d0/d5/f19 [0,4194304] 0 2024-09-12T01:43:04.158 INFO:tasks.workunit.client.0.smithi066.stdout:1/119: truncate d5/dc/f10 3095508 0 2024-09-12T01:43:04.160 INFO:tasks.workunit.client.0.smithi066.stdout:3/126: mknod d5/d6/dd/c24 0 2024-09-12T01:43:04.160 INFO:tasks.workunit.client.0.smithi066.stdout:3/127: chown d5/d6/dd/l1f 597 1 2024-09-12T01:43:04.160 INFO:tasks.workunit.client.0.smithi066.stdout:3/128: readlink d5/l1d 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:4/394: symlink d6/d9/d11/d14/d3e/l96 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/493: mknod d2/d9/d58/d74/c98 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:4/395: write d6/f63 [476472,7626] 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:6/526: creat d1/d6/da/d19/d34/fa8 x:0 0 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:4/396: truncate d6/d9/d11/d14/d3e/f50 5136496 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:6/527: fdatasync d1/d6/da/d19/d3a/f4d 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/494: write d2/d9/d1d/d25/f35 [652204,88456] 0 2024-09-12T01:43:04.162 INFO:tasks.workunit.client.1.smithi153.stdout:1/495: chown d2/d9/d17/d2f/d56/c7d 1 1 2024-09-12T01:43:04.163 INFO:tasks.workunit.client.1.smithi153.stdout:1/496: stat d2/d9/d17/d2f/d56 0 2024-09-12T01:43:04.163 INFO:tasks.workunit.client.0.smithi066.stdout:5/101: mknod d0/dd/d18/c1d 0 2024-09-12T01:43:04.163 INFO:tasks.workunit.client.0.smithi066.stdout:5/102: read - d0/dd/fe zero size 2024-09-12T01:43:04.163 INFO:tasks.workunit.client.0.smithi066.stdout:5/103: chown d0/c7 1350 1 2024-09-12T01:43:04.163 INFO:tasks.workunit.client.0.smithi066.stdout:0/155: read d1/dc/de/f1d [756252,57404] 0 2024-09-12T01:43:04.167 INFO:tasks.workunit.client.1.smithi153.stdout:8/467: unlink d17/l3f 0 2024-09-12T01:43:04.168 INFO:tasks.workunit.client.1.smithi153.stdout:8/468: write d17/d21/f88 [1004561,45327] 0 2024-09-12T01:43:04.169 INFO:tasks.workunit.client.0.smithi066.stdout:7/90: dread d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:04.169 INFO:tasks.workunit.client.0.smithi066.stdout:7/91: truncate d2/d5/f1a 935038 0 2024-09-12T01:43:04.169 INFO:tasks.workunit.client.0.smithi066.stdout:6/204: mkdir d2/db/d12/d49 0 2024-09-12T01:43:04.171 INFO:tasks.workunit.client.0.smithi066.stdout:9/134: symlink d0/d5/dc/l2f 0 2024-09-12T01:43:04.174 INFO:tasks.workunit.client.0.smithi066.stdout:8/151: dwrite d12/f1b [0,4194304] 0 2024-09-12T01:43:04.178 INFO:tasks.workunit.client.1.smithi153.stdout:4/397: creat d6/d9/dc/d31/d7d/d94/f97 x:0 0 0 2024-09-12T01:43:04.180 INFO:tasks.workunit.client.1.smithi153.stdout:1/497: symlink d2/d9/d17/d69/l99 0 2024-09-12T01:43:04.180 INFO:tasks.workunit.client.1.smithi153.stdout:1/498: readlink d2/d34/d3d/l92 0 2024-09-12T01:43:04.180 INFO:tasks.workunit.client.1.smithi153.stdout:1/499: fdatasync d2/d9/d1d/d25/f5f 0 2024-09-12T01:43:04.181 INFO:tasks.workunit.client.0.smithi066.stdout:2/159: dwrite f2 [0,4194304] 0 2024-09-12T01:43:04.181 INFO:tasks.workunit.client.0.smithi066.stdout:2/160: chown de/l1b 472 1 2024-09-12T01:43:04.181 INFO:tasks.workunit.client.1.smithi153.stdout:2/430: dwrite d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:04.182 INFO:tasks.workunit.client.0.smithi066.stdout:5/104: unlink d0/dd/c11 0 2024-09-12T01:43:04.182 INFO:tasks.workunit.client.0.smithi066.stdout:3/129: dwrite d5/d6/dd/f14 [0,4194304] 0 2024-09-12T01:43:04.182 INFO:tasks.workunit.client.0.smithi066.stdout:4/117: dwrite f3 [4194304,4194304] 0 2024-09-12T01:43:04.183 INFO:tasks.workunit.client.1.smithi153.stdout:8/469: symlink d17/d1f/la1 0 2024-09-12T01:43:04.185 INFO:tasks.workunit.client.0.smithi066.stdout:0/156: mkdir d1/dc/df/d20/d3d 0 2024-09-12T01:43:04.185 INFO:tasks.workunit.client.0.smithi066.stdout:0/157: fsync d1/dc/f14 0 2024-09-12T01:43:04.185 INFO:tasks.workunit.client.0.smithi066.stdout:0/158: fdatasync d1/f27 0 2024-09-12T01:43:04.185 INFO:tasks.workunit.client.0.smithi066.stdout:0/159: truncate d1/dc/df/d1b/d26/f2e 150098 0 2024-09-12T01:43:04.186 INFO:tasks.workunit.client.0.smithi066.stdout:7/92: dread d2/d5/da/f11 [0,4194304] 0 2024-09-12T01:43:04.186 INFO:tasks.workunit.client.0.smithi066.stdout:9/135: truncate d0/d5/dc/f2a 3152808 0 2024-09-12T01:43:04.187 INFO:tasks.workunit.client.0.smithi066.stdout:7/93: dread d2/d5/f1a [0,4194304] 0 2024-09-12T01:43:04.187 INFO:tasks.workunit.client.1.smithi153.stdout:1/500: mkdir d2/d9/d17/d2f/d56/d71/d9a 0 2024-09-12T01:43:04.187 INFO:tasks.workunit.client.1.smithi153.stdout:1/501: chown d2/d34/f39 98885847 1 2024-09-12T01:43:04.188 INFO:tasks.workunit.client.0.smithi066.stdout:1/120: symlink d5/d15/l25 0 2024-09-12T01:43:04.189 INFO:tasks.workunit.client.1.smithi153.stdout:2/431: symlink d7/db/d6c/l85 0 2024-09-12T01:43:04.191 INFO:tasks.workunit.client.0.smithi066.stdout:2/161: rmdir de/d13/d1e/d25/d37 0 2024-09-12T01:43:04.192 INFO:tasks.workunit.client.0.smithi066.stdout:7/94: dread d2/d5/da/f11 [0,4194304] 0 2024-09-12T01:43:04.192 INFO:tasks.workunit.client.0.smithi066.stdout:7/95: chown d2/d5/d7 26566710 1 2024-09-12T01:43:04.192 INFO:tasks.workunit.client.0.smithi066.stdout:7/96: write d2/d5/da/f19 [822277,13347] 0 2024-09-12T01:43:04.193 INFO:tasks.workunit.client.0.smithi066.stdout:5/105: rename d0/dd/d18/f19 to d0/db/f1e 0 2024-09-12T01:43:04.194 INFO:tasks.workunit.client.0.smithi066.stdout:5/106: creat d0/db/f1f x:0 0 0 2024-09-12T01:43:04.198 INFO:tasks.workunit.client.0.smithi066.stdout:4/118: unlink d4/d6/cc 0 2024-09-12T01:43:04.199 INFO:tasks.workunit.client.0.smithi066.stdout:0/160: mkdir d1/dc/df/d3e 0 2024-09-12T01:43:04.200 INFO:tasks.workunit.client.0.smithi066.stdout:9/136: unlink d0/d6/c2e 0 2024-09-12T01:43:04.201 INFO:tasks.workunit.client.1.smithi153.stdout:6/528: dwrite d1/d6/d23/d98/d53/f85 [0,4194304] 0 2024-09-12T01:43:04.203 INFO:tasks.workunit.client.1.smithi153.stdout:8/470: link d17/d21/d56/f63 d17/d1d/fa2 0 2024-09-12T01:43:04.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/121: symlink d5/dc/dd/d1c/l26 0 2024-09-12T01:43:04.203 INFO:tasks.workunit.client.0.smithi066.stdout:1/122: dread - d5/dc/dd/f23 zero size 2024-09-12T01:43:04.204 INFO:tasks.workunit.client.0.smithi066.stdout:3/130: dread d5/f17 [0,4194304] 0 2024-09-12T01:43:04.204 INFO:tasks.workunit.client.0.smithi066.stdout:3/131: chown d5/fa 119 1 2024-09-12T01:43:04.204 INFO:tasks.workunit.client.0.smithi066.stdout:2/162: creat de/d13/d28/f38 x:0 0 0 2024-09-12T01:43:04.205 INFO:tasks.workunit.client.1.smithi153.stdout:2/432: mknod d7/d17/c86 0 2024-09-12T01:43:04.205 INFO:tasks.workunit.client.1.smithi153.stdout:2/433: readlink d7/d4d/d70/l77 0 2024-09-12T01:43:04.206 INFO:tasks.workunit.client.0.smithi066.stdout:7/97: unlink d2/d5/c1c 0 2024-09-12T01:43:04.206 INFO:tasks.workunit.client.0.smithi066.stdout:7/98: stat d2/d5/da 0 2024-09-12T01:43:04.207 INFO:tasks.workunit.client.0.smithi066.stdout:8/152: dwrite d12/f24 [0,4194304] 0 2024-09-12T01:43:04.207 INFO:tasks.workunit.client.0.smithi066.stdout:8/153: chown l5 6 1 2024-09-12T01:43:04.208 INFO:tasks.workunit.client.1.smithi153.stdout:1/502: write d2/d9/d17/f23 [2895062,79890] 0 2024-09-12T01:43:04.208 INFO:tasks.workunit.client.1.smithi153.stdout:1/503: dread - d2/d9/d17/d2c/f85 zero size 2024-09-12T01:43:04.208 INFO:tasks.workunit.client.0.smithi066.stdout:8/154: dread d12/f1f [0,4194304] 0 2024-09-12T01:43:04.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/161: rename d1/dc/df/d1b/l24 to d1/dc/df/d3e/l3f 0 2024-09-12T01:43:04.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/162: readlink d1/l25 0 2024-09-12T01:43:04.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/163: chown d1/dc/df/c18 819 1 2024-09-12T01:43:04.213 INFO:tasks.workunit.client.0.smithi066.stdout:9/137: symlink d0/d5/l30 0 2024-09-12T01:43:04.213 INFO:tasks.workunit.client.0.smithi066.stdout:6/205: dwrite d2/fe [0,4194304] 0 2024-09-12T01:43:04.216 INFO:tasks.workunit.client.0.smithi066.stdout:3/132: creat d5/d6/d1b/f25 x:0 0 0 2024-09-12T01:43:04.216 INFO:tasks.workunit.client.0.smithi066.stdout:5/107: dwrite d0/db/f1e [0,4194304] 0 2024-09-12T01:43:04.216 INFO:tasks.workunit.client.0.smithi066.stdout:5/108: creat d0/f20 x:0 0 0 2024-09-12T01:43:04.216 INFO:tasks.workunit.client.0.smithi066.stdout:5/109: stat d0/f4 0 2024-09-12T01:43:04.218 INFO:tasks.workunit.client.0.smithi066.stdout:1/123: dread d5/dc/dd/f11 [0,4194304] 0 2024-09-12T01:43:04.218 INFO:tasks.workunit.client.1.smithi153.stdout:8/471: creat d17/d21/d56/d96/d6c/d6e/d7f/fa3 x:0 0 0 2024-09-12T01:43:04.219 INFO:tasks.workunit.client.0.smithi066.stdout:2/163: symlink de/d13/l39 0 2024-09-12T01:43:04.219 INFO:tasks.workunit.client.0.smithi066.stdout:2/164: chown de/d13/d1e/d25/f33 3 1 2024-09-12T01:43:04.221 INFO:tasks.workunit.client.1.smithi153.stdout:8/472: dread d17/f28 [0,4194304] 0 2024-09-12T01:43:04.224 INFO:tasks.workunit.client.0.smithi066.stdout:1/124: dread d5/f14 [0,4194304] 0 2024-09-12T01:43:04.224 INFO:tasks.workunit.client.1.smithi153.stdout:2/434: mkdir d7/db/d62/d87 0 2024-09-12T01:43:04.228 INFO:tasks.workunit.client.0.smithi066.stdout:7/99: mkdir d2/d5/d7/d1d 0 2024-09-12T01:43:04.233 INFO:tasks.workunit.client.1.smithi153.stdout:1/504: symlink d2/d9/d58/d74/l9b 0 2024-09-12T01:43:04.233 INFO:tasks.workunit.client.1.smithi153.stdout:1/505: fsync d2/d9/f5a 0 2024-09-12T01:43:04.233 INFO:tasks.workunit.client.1.smithi153.stdout:1/506: creat d2/d9/d17/d2f/d56/d71/f9c x:0 0 0 2024-09-12T01:43:04.236 INFO:tasks.workunit.client.1.smithi153.stdout:4/398: rename d6/d9/d11/d14 to d6/d9/dc/d98 0 2024-09-12T01:43:04.237 INFO:tasks.workunit.client.0.smithi066.stdout:8/155: symlink d12/l2c 0 2024-09-12T01:43:04.241 INFO:tasks.workunit.client.1.smithi153.stdout:2/435: creat d7/d4d/d70/f88 x:0 0 0 2024-09-12T01:43:04.247 INFO:tasks.workunit.client.1.smithi153.stdout:1/507: creat d2/d9/d28/f9d x:0 0 0 2024-09-12T01:43:04.250 INFO:tasks.workunit.client.0.smithi066.stdout:2/165: mkdir de/d13/d28/d3a 0 2024-09-12T01:43:04.252 INFO:tasks.workunit.client.0.smithi066.stdout:0/164: dwrite d1/dc/f38 [0,4194304] 0 2024-09-12T01:43:04.252 INFO:tasks.workunit.client.0.smithi066.stdout:0/165: write d1/dc/df/d1b/d26/f2e [1078467,36325] 0 2024-09-12T01:43:04.252 INFO:tasks.workunit.client.0.smithi066.stdout:0/166: write d1/dc/de/f3a [149252,109304] 0 2024-09-12T01:43:04.253 INFO:tasks.workunit.client.0.smithi066.stdout:7/100: mkdir d2/d5/d7/d1e 0 2024-09-12T01:43:04.255 INFO:tasks.workunit.client.0.smithi066.stdout:6/206: dwrite d2/db/d12/d1d/f2b [0,4194304] 0 2024-09-12T01:43:04.255 INFO:tasks.workunit.client.0.smithi066.stdout:5/110: dwrite d0/f17 [0,4194304] 0 2024-09-12T01:43:04.256 INFO:tasks.workunit.client.1.smithi153.stdout:4/399: rename d6/d9/dc/d42 to d6/d9/dc/d31/d76/d99 0 2024-09-12T01:43:04.256 INFO:tasks.workunit.client.1.smithi153.stdout:2/436: dread d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:04.256 INFO:tasks.workunit.client.1.smithi153.stdout:4/400: readlink d6/d9/l21 0 2024-09-12T01:43:04.257 INFO:tasks.workunit.client.1.smithi153.stdout:8/473: dwrite d17/d1f/d4f/d42/f48 [0,4194304] 0 2024-09-12T01:43:04.257 INFO:tasks.workunit.client.1.smithi153.stdout:8/474: fsync d17/d1f/d4f/f65 0 2024-09-12T01:43:04.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/156: mknod d12/d21/c2d 0 2024-09-12T01:43:04.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/157: dread - d12/d21/f2b zero size 2024-09-12T01:43:04.259 INFO:tasks.workunit.client.0.smithi066.stdout:3/133: dwrite f3 [0,4194304] 0 2024-09-12T01:43:04.259 INFO:tasks.workunit.client.0.smithi066.stdout:7/101: write d2/d5/da/f11 [1422494,91789] 0 2024-09-12T01:43:04.260 INFO:tasks.workunit.client.1.smithi153.stdout:1/508: dread d2/d9/d17/f23 [0,4194304] 0 2024-09-12T01:43:04.260 INFO:tasks.workunit.client.0.smithi066.stdout:7/102: stat d2/d5 0 2024-09-12T01:43:04.260 INFO:tasks.workunit.client.0.smithi066.stdout:7/103: truncate d2/d5/f1a 1311082 0 2024-09-12T01:43:04.261 INFO:tasks.workunit.client.1.smithi153.stdout:4/401: creat d6/d9/dc/d31/f9a x:0 0 0 2024-09-12T01:43:04.263 INFO:tasks.workunit.client.0.smithi066.stdout:2/166: creat de/d13/d1e/d22/f3b x:0 0 0 2024-09-12T01:43:04.263 INFO:tasks.workunit.client.1.smithi153.stdout:2/437: mknod d7/db/d62/d87/c89 0 2024-09-12T01:43:04.264 INFO:tasks.workunit.client.1.smithi153.stdout:2/438: fsync d7/db/d27/f73 0 2024-09-12T01:43:04.265 INFO:tasks.workunit.client.1.smithi153.stdout:4/402: dread d6/d6a/f8c [0,4194304] 0 2024-09-12T01:43:04.265 INFO:tasks.workunit.client.0.smithi066.stdout:9/138: write d0/d5/dc/f2a [1501275,47185] 0 2024-09-12T01:43:04.266 INFO:tasks.workunit.client.0.smithi066.stdout:7/104: fsync d2/d5/da/f11 0 2024-09-12T01:43:04.267 INFO:tasks.workunit.client.1.smithi153.stdout:8/475: creat d17/d21/d56/d96/fa4 x:0 0 0 2024-09-12T01:43:04.267 INFO:tasks.workunit.client.1.smithi153.stdout:8/476: fsync d17/d1d/fa2 0 2024-09-12T01:43:04.269 INFO:tasks.workunit.client.1.smithi153.stdout:1/509: mkdir d2/d68/d6b/d9e 0 2024-09-12T01:43:04.269 INFO:tasks.workunit.client.0.smithi066.stdout:0/167: mknod d1/dc/df/d1b/d3b/c40 0 2024-09-12T01:43:04.269 INFO:tasks.workunit.client.0.smithi066.stdout:0/168: fsync d1/f2d 0 2024-09-12T01:43:04.271 INFO:tasks.workunit.client.0.smithi066.stdout:7/105: dread d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:04.271 INFO:tasks.workunit.client.0.smithi066.stdout:7/106: write d2/d5/f1a [2030023,85322] 0 2024-09-12T01:43:04.272 INFO:tasks.workunit.client.0.smithi066.stdout:1/125: rmdir d5/d15 39 2024-09-12T01:43:04.272 INFO:tasks.workunit.client.1.smithi153.stdout:2/439: creat d7/d4d/d70/d81/f8a x:0 0 0 2024-09-12T01:43:04.272 INFO:tasks.workunit.client.1.smithi153.stdout:2/440: chown d7/db/d27/f4c 41703349 1 2024-09-12T01:43:04.275 INFO:tasks.workunit.client.1.smithi153.stdout:8/477: link d17/d21/f88 d17/d1d/d93/fa5 0 2024-09-12T01:43:04.280 INFO:tasks.workunit.client.1.smithi153.stdout:1/510: creat d2/d9/d17/d2f/d56/d91/f9f x:0 0 0 2024-09-12T01:43:04.282 INFO:tasks.workunit.client.0.smithi066.stdout:5/111: mkdir d0/d21 0 2024-09-12T01:43:04.284 INFO:tasks.workunit.client.0.smithi066.stdout:8/158: rename d12/d21/f2b to d12/d26/f2e 0 2024-09-12T01:43:04.286 INFO:tasks.workunit.client.0.smithi066.stdout:3/134: mkdir d5/d6/dd/d26 0 2024-09-12T01:43:04.286 INFO:tasks.workunit.client.0.smithi066.stdout:3/135: readlink d5/l1d 0 2024-09-12T01:43:04.287 INFO:tasks.workunit.client.0.smithi066.stdout:9/139: dread - d0/d6/f2d zero size 2024-09-12T01:43:04.287 INFO:tasks.workunit.client.0.smithi066.stdout:9/140: fsync d0/f7 0 2024-09-12T01:43:04.290 INFO:tasks.workunit.client.0.smithi066.stdout:2/167: fsync de/ff 0 2024-09-12T01:43:04.290 INFO:tasks.workunit.client.0.smithi066.stdout:2/168: write de/d13/d28/f2f [637779,63312] 0 2024-09-12T01:43:04.291 INFO:tasks.workunit.client.0.smithi066.stdout:7/107: creat d2/f1f x:0 0 0 2024-09-12T01:43:04.292 INFO:tasks.workunit.client.1.smithi153.stdout:2/441: dread d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:04.293 INFO:tasks.workunit.client.0.smithi066.stdout:1/126: unlink d5/dc/dd/d1c/f20 0 2024-09-12T01:43:04.293 INFO:tasks.workunit.client.0.smithi066.stdout:1/127: chown d5/dc/dd/d1c 2719 1 2024-09-12T01:43:04.293 INFO:tasks.workunit.client.0.smithi066.stdout:1/128: dread - d5/d15/f21 zero size 2024-09-12T01:43:04.293 INFO:tasks.workunit.client.1.smithi153.stdout:8/478: write d17/d21/d56/d96/d6c/f80 [3969442,38076] 0 2024-09-12T01:43:04.293 INFO:tasks.workunit.client.1.smithi153.stdout:8/479: creat d17/d75/fa6 x:0 0 0 2024-09-12T01:43:04.294 INFO:tasks.workunit.client.1.smithi153.stdout:8/480: chown d17/d1f/d4f/l9b 26347787 1 2024-09-12T01:43:04.294 INFO:tasks.workunit.client.1.smithi153.stdout:8/481: chown f16 10 1 2024-09-12T01:43:04.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/207: dwrite d2/f1a [0,4194304] 0 2024-09-12T01:43:04.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/208: creat d2/d21/f4a x:0 0 0 2024-09-12T01:43:04.295 INFO:tasks.workunit.client.0.smithi066.stdout:6/209: truncate d2/db/f27 4555963 0 2024-09-12T01:43:04.295 INFO:tasks.workunit.client.0.smithi066.stdout:5/112: rename d0/c7 to d0/dd/c22 0 2024-09-12T01:43:04.296 INFO:tasks.workunit.client.1.smithi153.stdout:1/511: write d2/d34/f39 [2387364,2352] 0 2024-09-12T01:43:04.297 INFO:tasks.workunit.client.0.smithi066.stdout:3/136: truncate d5/d6/dd/f14 548563 0 2024-09-12T01:43:04.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/169: dwrite d1/dc/df/d20/f30 [0,4194304] 0 2024-09-12T01:43:04.298 INFO:tasks.workunit.client.1.smithi153.stdout:4/403: dwrite d6/d9/dc/d98/f3f [0,4194304] 0 2024-09-12T01:43:04.298 INFO:tasks.workunit.client.1.smithi153.stdout:4/404: write d6/d9/d11/d90/f95 [148068,63871] 0 2024-09-12T01:43:04.299 INFO:tasks.workunit.client.0.smithi066.stdout:1/129: dread d5/dc/dd/f11 [0,4194304] 0 2024-09-12T01:43:04.299 INFO:tasks.workunit.client.0.smithi066.stdout:1/130: readlink d5/dc/dd/l13 0 2024-09-12T01:43:04.299 INFO:tasks.workunit.client.0.smithi066.stdout:2/169: mkdir de/d3c 0 2024-09-12T01:43:04.299 INFO:tasks.workunit.client.0.smithi066.stdout:2/170: truncate f1 2425164 0 2024-09-12T01:43:04.305 INFO:tasks.workunit.client.1.smithi153.stdout:8/482: write d17/f46 [725346,6037] 0 2024-09-12T01:43:04.308 INFO:tasks.workunit.client.0.smithi066.stdout:5/113: creat d0/dd/d18/f23 x:0 0 0 2024-09-12T01:43:04.310 INFO:tasks.workunit.client.1.smithi153.stdout:4/405: dread d6/d9/d26/f74 [0,4194304] 0 2024-09-12T01:43:04.310 INFO:tasks.workunit.client.1.smithi153.stdout:4/406: write d6/f63 [1466196,94666] 0 2024-09-12T01:43:04.310 INFO:tasks.workunit.client.1.smithi153.stdout:4/407: write d6/d9/d11/d90/f95 [1013220,93648] 0 2024-09-12T01:43:04.310 INFO:tasks.workunit.client.1.smithi153.stdout:4/408: chown d6/d6a/f8c 0 1 2024-09-12T01:43:04.311 INFO:tasks.workunit.client.1.smithi153.stdout:8/483: truncate f14 2016008 0 2024-09-12T01:43:04.311 INFO:tasks.workunit.client.1.smithi153.stdout:1/512: fdatasync d2/d34/f39 0 2024-09-12T01:43:04.312 INFO:tasks.workunit.client.1.smithi153.stdout:1/513: fsync d2/d9/d17/d2c/f85 0 2024-09-12T01:43:04.312 INFO:tasks.workunit.client.0.smithi066.stdout:1/131: dread d5/f1a [0,4194304] 0 2024-09-12T01:43:04.313 INFO:tasks.workunit.client.0.smithi066.stdout:3/137: dread f4 [0,4194304] 0 2024-09-12T01:43:04.317 INFO:tasks.workunit.client.1.smithi153.stdout:4/409: truncate d6/d9/d26/f47 839760 0 2024-09-12T01:43:04.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/484: creat d17/d1f/d4f/d42/d67/fa7 x:0 0 0 2024-09-12T01:43:04.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/485: chown d17/d21/d56/d96 821687837 1 2024-09-12T01:43:04.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/486: truncate d17/d1f/d4f/d42/d79/f98 127552 0 2024-09-12T01:43:04.321 INFO:tasks.workunit.client.1.smithi153.stdout:1/514: rename d2/d9/d1d/d25/d3f to d2/d9/d17/d2f/d56/da0 0 2024-09-12T01:43:04.322 INFO:tasks.workunit.client.1.smithi153.stdout:7/404: sync 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.1.smithi153.stdout:3/519: sync 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.1.smithi153.stdout:0/529: sync 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.1.smithi153.stdout:9/511: sync 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.1.smithi153.stdout:9/512: dread - d3/d3a/f60 zero size 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.1.smithi153.stdout:9/513: fsync d3/d3a/f8e 0 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/508: sync 2024-09-12T01:43:04.323 INFO:tasks.workunit.client.0.smithi066.stdout:0/170: symlink d1/dc/df/d1b/d3b/l41 0 2024-09-12T01:43:04.324 INFO:tasks.workunit.client.0.smithi066.stdout:3/138: dread d5/d6/f7 [0,4194304] 0 2024-09-12T01:43:04.324 INFO:tasks.workunit.client.0.smithi066.stdout:2/171: mkdir de/d13/d28/d3d 0 2024-09-12T01:43:04.326 INFO:tasks.workunit.client.1.smithi153.stdout:7/405: rename d12/f1c to d12/d21/d29/d35/d37/d4c/f73 0 2024-09-12T01:43:04.326 INFO:tasks.workunit.client.0.smithi066.stdout:4/119: truncate d4/d6/d8/f13 4280873 0 2024-09-12T01:43:04.329 INFO:tasks.workunit.client.1.smithi153.stdout:3/520: unlink d1/d16/d1c/c52 0 2024-09-12T01:43:04.332 INFO:tasks.workunit.client.1.smithi153.stdout:0/530: unlink d22/c6b 0 2024-09-12T01:43:04.334 INFO:tasks.workunit.client.0.smithi066.stdout:1/132: link c2 d5/dc/dd/d1c/c27 0 2024-09-12T01:43:04.334 INFO:tasks.workunit.client.0.smithi066.stdout:1/133: fdatasync f1 0 2024-09-12T01:43:04.335 INFO:tasks.workunit.client.1.smithi153.stdout:7/406: creat d12/d4e/f74 x:0 0 0 2024-09-12T01:43:04.335 INFO:tasks.workunit.client.1.smithi153.stdout:7/407: truncate d12/d21/d29/d35/f6a 633627 0 2024-09-12T01:43:04.336 INFO:tasks.workunit.client.0.smithi066.stdout:0/171: mkdir d1/dc/df/d1b/d26/d42 0 2024-09-12T01:43:04.338 INFO:tasks.workunit.client.1.smithi153.stdout:3/521: creat d1/d13/d25/d26/f9f x:0 0 0 2024-09-12T01:43:04.341 INFO:tasks.workunit.client.0.smithi066.stdout:3/139: rename d5/d6/d1b/f25 to d5/d6/d1b/f27 0 2024-09-12T01:43:04.342 INFO:tasks.workunit.client.1.smithi153.stdout:0/531: link d22/d30/d4c/d6f/ca5 d22/d30/d4c/d8a/cb4 0 2024-09-12T01:43:04.342 INFO:tasks.workunit.client.1.smithi153.stdout:1/515: dread d2/d9/d17/d2f/d56/f79 [0,4194304] 0 2024-09-12T01:43:04.344 INFO:tasks.workunit.client.1.smithi153.stdout:7/408: link d12/f26 d12/d21/d29/d35/d37/d4c/f75 0 2024-09-12T01:43:04.345 INFO:tasks.workunit.client.0.smithi066.stdout:8/159: dwrite f3 [0,4194304] 0 2024-09-12T01:43:04.345 INFO:tasks.workunit.client.1.smithi153.stdout:2/442: dwrite d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:04.346 INFO:tasks.workunit.client.1.smithi153.stdout:3/522: getdents d1/d13/d23/d47/d71/d8e 0 2024-09-12T01:43:04.347 INFO:tasks.workunit.client.0.smithi066.stdout:1/134: rename d5/l6 to d5/l28 0 2024-09-12T01:43:04.348 INFO:tasks.workunit.client.0.smithi066.stdout:1/135: write d5/f7 [1289897,105871] 0 2024-09-12T01:43:04.348 INFO:tasks.workunit.client.0.smithi066.stdout:1/136: chown d5/cb 2093 1 2024-09-12T01:43:04.348 INFO:tasks.workunit.client.0.smithi066.stdout:1/137: readlink d5/dc/dd/d1c/l26 0 2024-09-12T01:43:04.348 INFO:tasks.workunit.client.0.smithi066.stdout:1/138: write f4 [751045,123435] 0 2024-09-12T01:43:04.349 INFO:tasks.workunit.client.1.smithi153.stdout:0/532: unlink d22/d30/d4c/d6e/l50 0 2024-09-12T01:43:04.349 INFO:tasks.workunit.client.1.smithi153.stdout:0/533: chown d22/d30/d4c/d6f/d88/f96 2174 1 2024-09-12T01:43:04.349 INFO:tasks.workunit.client.1.smithi153.stdout:0/534: rename d22/d30/d4c/d6f/d88 to d22/d30/d4c/d6f/d88/db5 22 2024-09-12T01:43:04.349 INFO:tasks.workunit.client.0.smithi066.stdout:0/172: truncate d1/f9 8618 0 2024-09-12T01:43:04.351 INFO:tasks.workunit.client.1.smithi153.stdout:1/516: creat d2/d9/d17/d69/d95/fa1 x:0 0 0 2024-09-12T01:43:04.352 INFO:tasks.workunit.client.0.smithi066.stdout:3/140: mkdir d5/d6/d1b/d28 0 2024-09-12T01:43:04.353 INFO:tasks.workunit.client.1.smithi153.stdout:7/409: creat d12/d21/d29/d35/d37/f76 x:0 0 0 2024-09-12T01:43:04.353 INFO:tasks.workunit.client.1.smithi153.stdout:7/410: stat d12/l2e 0 2024-09-12T01:43:04.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/535: rename d22/c28 to d22/d79/d8e/dae/cb6 0 2024-09-12T01:43:04.357 INFO:tasks.workunit.client.0.smithi066.stdout:8/160: dread fb [0,4194304] 0 2024-09-12T01:43:04.357 INFO:tasks.workunit.client.0.smithi066.stdout:8/161: write d12/f1f [254044,37003] 0 2024-09-12T01:43:04.357 INFO:tasks.workunit.client.0.smithi066.stdout:8/162: write d12/f24 [4437541,17531] 0 2024-09-12T01:43:04.357 INFO:tasks.workunit.client.0.smithi066.stdout:8/163: dread - d12/d26/f2e zero size 2024-09-12T01:43:04.357 INFO:tasks.workunit.client.0.smithi066.stdout:4/120: dwrite d4/f17 [0,4194304] 0 2024-09-12T01:43:04.358 INFO:tasks.workunit.client.0.smithi066.stdout:1/139: truncate d5/dc/f10 1858723 0 2024-09-12T01:43:04.361 INFO:tasks.workunit.client.0.smithi066.stdout:0/173: symlink d1/dc/df/d20/d3d/l43 0 2024-09-12T01:43:04.362 INFO:tasks.workunit.client.0.smithi066.stdout:0/174: stat d1/dc/df/c2b 0 2024-09-12T01:43:04.362 INFO:tasks.workunit.client.0.smithi066.stdout:0/175: dread - d1/dc/de/f3c zero size 2024-09-12T01:43:04.362 INFO:tasks.workunit.client.0.smithi066.stdout:3/141: creat d5/d6/f29 x:0 0 0 2024-09-12T01:43:04.362 INFO:tasks.workunit.client.0.smithi066.stdout:3/142: readlink d5/d6/dd/l1f 0 2024-09-12T01:43:04.362 INFO:tasks.workunit.client.0.smithi066.stdout:3/143: fdatasync d5/d6/f29 0 2024-09-12T01:43:04.364 INFO:tasks.workunit.client.0.smithi066.stdout:7/108: rename d2/d5/d7 to d2/d20 0 2024-09-12T01:43:04.365 INFO:tasks.workunit.client.1.smithi153.stdout:8/487: dwrite d17/d21/d56/f8f [4194304,4194304] 0 2024-09-12T01:43:04.365 INFO:tasks.workunit.client.0.smithi066.stdout:5/114: dwrite d0/f20 [0,4194304] 0 2024-09-12T01:43:04.365 INFO:tasks.workunit.client.0.smithi066.stdout:4/121: mkdir d4/d6/d27 0 2024-09-12T01:43:04.368 INFO:tasks.workunit.client.0.smithi066.stdout:7/109: mknod d2/d5/da/c21 0 2024-09-12T01:43:04.377 INFO:tasks.workunit.client.0.smithi066.stdout:6/210: rename d2/db/c28 to d2/db/d12/d49/c4b 0 2024-09-12T01:43:04.378 INFO:tasks.workunit.client.1.smithi153.stdout:4/410: dread d6/f63 [0,4194304] 0 2024-09-12T01:43:04.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/411: truncate d6/d15/d38/f68 856888 0 2024-09-12T01:43:04.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/412: write d6/d9/d20/f8f [804998,46547] 0 2024-09-12T01:43:04.379 INFO:tasks.workunit.client.1.smithi153.stdout:4/413: dread - d6/d9/dc/d31/d76/d99/f6b zero size 2024-09-12T01:43:04.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/488: stat d17/d1f/d4f/d34/d6f 0 2024-09-12T01:43:04.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/489: chown d17/d21/d56/d96/d6c/d6e/d7f 13091747 1 2024-09-12T01:43:04.383 INFO:tasks.workunit.client.1.smithi153.stdout:8/490: chown d17/d1f/d4f/f78 282 1 2024-09-12T01:43:04.383 INFO:tasks.workunit.client.1.smithi153.stdout:8/491: creat d17/d1f/d4f/d42/d67/fa8 x:0 0 0 2024-09-12T01:43:04.383 INFO:tasks.workunit.client.1.smithi153.stdout:8/492: write d17/d75/fa6 [101889,26608] 0 2024-09-12T01:43:04.384 INFO:tasks.workunit.client.0.smithi066.stdout:5/115: unlink d0/dd/c15 0 2024-09-12T01:43:04.384 INFO:tasks.workunit.client.0.smithi066.stdout:8/164: dread d12/f1b [0,4194304] 0 2024-09-12T01:43:04.385 INFO:tasks.workunit.client.0.smithi066.stdout:2/172: dwrite de/d13/f1f [0,4194304] 0 2024-09-12T01:43:04.386 INFO:tasks.workunit.client.0.smithi066.stdout:4/122: creat d4/d15/f28 x:0 0 0 2024-09-12T01:43:04.386 INFO:tasks.workunit.client.0.smithi066.stdout:4/123: dread - d4/d15/f28 zero size 2024-09-12T01:43:04.387 INFO:tasks.workunit.client.1.smithi153.stdout:3/523: dwrite d1/d16/f69 [0,4194304] 0 2024-09-12T01:43:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:03 smithi066 ceph-mon[27875]: pgmap v242: 65 pgs: 65 active+clean; 972 MiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 88 MiB/s rd, 119 MiB/s wr, 729 op/s 2024-09-12T01:43:04.389 INFO:tasks.workunit.client.0.smithi066.stdout:6/211: mknod d2/d21/c4c 0 2024-09-12T01:43:04.392 INFO:tasks.workunit.client.1.smithi153.stdout:1/517: dwrite d2/d9/d17/d2c/f93 [4194304,4194304] 0 2024-09-12T01:43:04.393 INFO:tasks.workunit.client.0.smithi066.stdout:5/116: link d0/db/f10 d0/d21/f24 0 2024-09-12T01:43:04.393 INFO:tasks.workunit.client.1.smithi153.stdout:9/514: dwrite d3/d35/f79 [0,4194304] 0 2024-09-12T01:43:04.397 INFO:tasks.workunit.client.1.smithi153.stdout:4/414: truncate d6/d9/d26/f74 981314 0 2024-09-12T01:43:04.397 INFO:tasks.workunit.client.0.smithi066.stdout:2/173: dread de/d13/d28/f30 [0,4194304] 0 2024-09-12T01:43:04.397 INFO:tasks.workunit.client.0.smithi066.stdout:8/165: mkdir d12/d21/d2f 0 2024-09-12T01:43:04.400 INFO:tasks.workunit.client.1.smithi153.stdout:1/518: symlink d2/d9/d17/d69/d95/la2 0 2024-09-12T01:43:04.400 INFO:tasks.workunit.client.1.smithi153.stdout:1/519: chown d2/d9/d17/d2c/f4d 21 1 2024-09-12T01:43:04.403 INFO:tasks.workunit.client.1.smithi153.stdout:7/411: dwrite d12/d21/d29/d35/d37/d58/f63 [0,4194304] 0 2024-09-12T01:43:04.404 INFO:tasks.workunit.client.1.smithi153.stdout:7/412: readlink d12/l40 0 2024-09-12T01:43:04.404 INFO:tasks.workunit.client.0.smithi066.stdout:3/144: write d5/d6/dd/f14 [559705,130642] 0 2024-09-12T01:43:04.406 INFO:tasks.workunit.client.0.smithi066.stdout:6/212: rename d2/db/f11 to d2/db/d12/f4d 0 2024-09-12T01:43:04.409 INFO:tasks.workunit.client.1.smithi153.stdout:3/524: write d1/d16/f69 [1445504,35910] 0 2024-09-12T01:43:04.409 INFO:tasks.workunit.client.1.smithi153.stdout:3/525: chown d1/d45 2 1 2024-09-12T01:43:04.410 INFO:tasks.workunit.client.0.smithi066.stdout:2/174: mknod de/d3c/c3e 0 2024-09-12T01:43:04.410 INFO:tasks.workunit.client.0.smithi066.stdout:2/175: readlink l3 0 2024-09-12T01:43:04.412 INFO:tasks.workunit.client.0.smithi066.stdout:8/166: mknod d12/d21/d2f/c30 0 2024-09-12T01:43:04.413 INFO:tasks.workunit.client.0.smithi066.stdout:7/110: dwrite d2/f1f [0,4194304] 0 2024-09-12T01:43:04.413 INFO:tasks.workunit.client.0.smithi066.stdout:1/140: dwrite d5/f14 [0,4194304] 0 2024-09-12T01:43:04.413 INFO:tasks.workunit.client.0.smithi066.stdout:1/141: creat d5/dc/f29 x:0 0 0 2024-09-12T01:43:04.413 INFO:tasks.workunit.client.0.smithi066.stdout:1/142: stat d5/dc/dd/d1c/l26 0 2024-09-12T01:43:04.413 INFO:tasks.workunit.client.0.smithi066.stdout:1/143: truncate d5/dc/f1f 424468 0 2024-09-12T01:43:04.413 INFO:tasks.workunit.client.0.smithi066.stdout:1/144: write d5/dc/f1f [1329785,19589] 0 2024-09-12T01:43:04.414 INFO:tasks.workunit.client.1.smithi153.stdout:0/536: dwrite d22/d30/d4c/d6e/f48 [0,4194304] 0 2024-09-12T01:43:04.414 INFO:tasks.workunit.client.0.smithi066.stdout:0/176: dwrite d1/dc/de/f1d [0,4194304] 0 2024-09-12T01:43:04.415 INFO:tasks.workunit.client.1.smithi153.stdout:1/520: write d2/d9/d1d/f4b [167333,8414] 0 2024-09-12T01:43:04.415 INFO:tasks.workunit.client.1.smithi153.stdout:1/521: chown d2/d9/d1d/d25/l5b 5646 1 2024-09-12T01:43:04.415 INFO:tasks.workunit.client.1.smithi153.stdout:8/493: dwrite d17/d21/d56/d99/f9e [0,4194304] 0 2024-09-12T01:43:04.415 INFO:tasks.workunit.client.1.smithi153.stdout:8/494: chown f15 374 1 2024-09-12T01:43:04.416 INFO:tasks.workunit.client.0.smithi066.stdout:3/145: symlink d5/d6/dd/l2a 0 2024-09-12T01:43:04.416 INFO:tasks.workunit.client.1.smithi153.stdout:9/515: symlink d3/d5f/l99 0 2024-09-12T01:43:04.416 INFO:tasks.workunit.client.1.smithi153.stdout:9/516: getdents d3/d55/d30/d7b/d8f 0 2024-09-12T01:43:04.418 INFO:tasks.workunit.client.1.smithi153.stdout:4/415: creat d6/d9/dc/d98/d3e/f9b x:0 0 0 2024-09-12T01:43:04.421 INFO:tasks.workunit.client.0.smithi066.stdout:6/213: unlink d2/f1f 0 2024-09-12T01:43:04.421 INFO:tasks.workunit.client.0.smithi066.stdout:6/214: chown d2/db/f1c 896 1 2024-09-12T01:43:04.422 INFO:tasks.workunit.client.1.smithi153.stdout:7/413: rmdir d12/d21/d29/d35/d37/d4c 39 2024-09-12T01:43:04.422 INFO:tasks.workunit.client.1.smithi153.stdout:7/414: stat d12/d21/d29/d35/d37/d4c 0 2024-09-12T01:43:04.422 INFO:tasks.workunit.client.1.smithi153.stdout:7/415: chown d12/c3e 1614 1 2024-09-12T01:43:04.422 INFO:tasks.workunit.client.1.smithi153.stdout:7/416: write d12/f31 [4797304,126541] 0 2024-09-12T01:43:04.422 INFO:tasks.workunit.client.1.smithi153.stdout:7/417: write d12/d21/d29/d2d/f55 [449968,80456] 0 2024-09-12T01:43:04.425 INFO:tasks.workunit.client.0.smithi066.stdout:5/117: symlink d0/dd/d18/l25 0 2024-09-12T01:43:04.429 INFO:tasks.workunit.client.0.smithi066.stdout:3/146: dread d5/d6/f7 [0,4194304] 0 2024-09-12T01:43:04.430 INFO:tasks.workunit.client.0.smithi066.stdout:2/176: creat de/d13/d28/d3d/f3f x:0 0 0 2024-09-12T01:43:04.430 INFO:tasks.workunit.client.0.smithi066.stdout:2/177: dread - de/d13/d28/d3d/f3f zero size 2024-09-12T01:43:04.433 INFO:tasks.workunit.client.1.smithi153.stdout:1/522: link d2/d9/d1d/d25/f38 d2/d9/d17/d2f/d56/d71/d9a/fa3 0 2024-09-12T01:43:04.442 INFO:tasks.workunit.client.1.smithi153.stdout:8/495: unlink d17/d75/l90 0 2024-09-12T01:43:04.442 INFO:tasks.workunit.client.1.smithi153.stdout:3/526: dwrite d1/f1a [0,4194304] 0 2024-09-12T01:43:04.442 INFO:tasks.workunit.client.1.smithi153.stdout:3/527: chown d1/d1e/c60 602190 1 2024-09-12T01:43:04.443 INFO:tasks.workunit.client.0.smithi066.stdout:7/111: rename d2/d20/d1e to d2/d5/d6/d22 0 2024-09-12T01:43:04.444 INFO:tasks.workunit.client.1.smithi153.stdout:9/517: mkdir d3/d3a/d42/d72/d98/d9a 0 2024-09-12T01:43:04.444 INFO:tasks.workunit.client.1.smithi153.stdout:9/518: stat d3/d55/d30/d95/d84 0 2024-09-12T01:43:04.447 INFO:tasks.workunit.client.1.smithi153.stdout:4/416: mkdir d6/d6a/d9c 0 2024-09-12T01:43:04.448 INFO:tasks.workunit.client.0.smithi066.stdout:5/118: mkdir d0/d26 0 2024-09-12T01:43:04.450 INFO:tasks.workunit.client.1.smithi153.stdout:0/537: dwrite d22/f2a [0,4194304] 0 2024-09-12T01:43:04.450 INFO:tasks.workunit.client.1.smithi153.stdout:0/538: dread - d22/d30/d4c/d6e/f7b zero size 2024-09-12T01:43:04.450 INFO:tasks.workunit.client.1.smithi153.stdout:0/539: fdatasync d22/f3c 0 2024-09-12T01:43:04.450 INFO:tasks.workunit.client.1.smithi153.stdout:0/540: fdatasync d22/d30/d4c/f9f 0 2024-09-12T01:43:04.450 INFO:tasks.workunit.client.1.smithi153.stdout:7/418: creat d12/d21/d29/d2d/f77 x:0 0 0 2024-09-12T01:43:04.450 INFO:tasks.workunit.client.1.smithi153.stdout:7/419: fdatasync d12/f1b 0 2024-09-12T01:43:04.453 INFO:tasks.workunit.client.0.smithi066.stdout:2/178: mknod de/d13/d28/c40 0 2024-09-12T01:43:04.453 INFO:tasks.workunit.client.0.smithi066.stdout:2/179: dread - de/f21 zero size 2024-09-12T01:43:04.455 INFO:tasks.workunit.client.1.smithi153.stdout:1/523: rename d2/d9/d1d/c3a to d2/d9/d17/d2f/d56/d71/ca4 0 2024-09-12T01:43:04.455 INFO:tasks.workunit.client.1.smithi153.stdout:1/524: write d2/d9/d28/d73/f78 [686542,77071] 0 2024-09-12T01:43:04.455 INFO:tasks.workunit.client.1.smithi153.stdout:1/525: write d2/d9/d1d/d25/f35 [2667984,115841] 0 2024-09-12T01:43:04.457 INFO:tasks.workunit.client.1.smithi153.stdout:8/496: truncate d17/d1f/d4f/d34/d6f/f70 510747 0 2024-09-12T01:43:04.458 INFO:tasks.workunit.client.0.smithi066.stdout:1/145: rename d5/d15/f21 to d5/f2a 0 2024-09-12T01:43:04.458 INFO:tasks.workunit.client.0.smithi066.stdout:8/167: dwrite d12/f19 [4194304,4194304] 0 2024-09-12T01:43:04.462 INFO:tasks.workunit.client.0.smithi066.stdout:3/147: rmdir d5/d6/d1b 39 2024-09-12T01:43:04.463 INFO:tasks.workunit.client.1.smithi153.stdout:9/519: dread d3/d35/f5c [0,4194304] 0 2024-09-12T01:43:04.463 INFO:tasks.workunit.client.1.smithi153.stdout:8/497: dread d17/d1d/f73 [0,4194304] 0 2024-09-12T01:43:04.464 INFO:tasks.workunit.client.0.smithi066.stdout:2/180: mkdir de/d13/d1e/d41 0 2024-09-12T01:43:04.464 INFO:tasks.workunit.client.0.smithi066.stdout:2/181: write de/f15 [2013207,32024] 0 2024-09-12T01:43:04.468 INFO:tasks.workunit.client.0.smithi066.stdout:0/177: dwrite d1/dc/f38 [0,4194304] 0 2024-09-12T01:43:04.468 INFO:tasks.workunit.client.0.smithi066.stdout:8/168: creat d12/f31 x:0 0 0 2024-09-12T01:43:04.469 INFO:tasks.workunit.client.1.smithi153.stdout:4/417: dread d6/d9/d26/f62 [0,4194304] 0 2024-09-12T01:43:04.470 INFO:tasks.workunit.client.1.smithi153.stdout:3/528: dwrite d1/d1e/f5e [0,4194304] 0 2024-09-12T01:43:04.471 INFO:tasks.workunit.client.0.smithi066.stdout:7/112: link d2/f1f d2/d5/f23 0 2024-09-12T01:43:04.472 INFO:tasks.workunit.client.0.smithi066.stdout:6/215: dwrite d2/db/f27 [0,4194304] 0 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/216: truncate d2/db/f27 5386280 0 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/217: read - d2/db/f3c zero size 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:3/148: dread d5/d6/dd/f1a [0,4194304] 0 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/218: creat d2/f4e x:0 0 0 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/219: fdatasync d2/d31/f39 0 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/220: chown d2/db/l48 189 1 2024-09-12T01:43:04.473 INFO:tasks.workunit.client.0.smithi066.stdout:4/124: truncate d4/f17 2659396 0 2024-09-12T01:43:04.477 INFO:tasks.workunit.client.1.smithi153.stdout:0/541: mkdir d22/d79/d8e/dae/db7 0 2024-09-12T01:43:04.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/420: mknod d12/d21/d29/d35/d3c/c78 0 2024-09-12T01:43:04.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/421: chown d12/d21/d29/d35/d37/d4c 584339407 1 2024-09-12T01:43:04.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/422: readlink d12/d21/d29/d35/d37/d58/l67 0 2024-09-12T01:43:04.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/423: write d12/f22 [1300358,66027] 0 2024-09-12T01:43:04.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/424: chown d12/d21/d29/d35/d3c/c5b 432184 1 2024-09-12T01:43:04.489 INFO:tasks.workunit.client.0.smithi066.stdout:0/178: symlink d1/dc/df/d3e/l44 0 2024-09-12T01:43:04.490 INFO:tasks.workunit.client.0.smithi066.stdout:1/146: write d5/f14 [2153472,19641] 0 2024-09-12T01:43:04.492 INFO:tasks.workunit.client.1.smithi153.stdout:1/526: mkdir d2/d9/d1d/da5 0 2024-09-12T01:43:04.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/418: truncate d6/d9/dc/d31/f34 29985 0 2024-09-12T01:43:04.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/419: fdatasync d6/d9/dc/d98/f88 0 2024-09-12T01:43:04.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/420: chown d6/d9/dc/d31/d76/d99/l67 15497 1 2024-09-12T01:43:04.495 INFO:tasks.workunit.client.0.smithi066.stdout:3/149: creat d5/d6/d1b/d28/f2b x:0 0 0 2024-09-12T01:43:04.495 INFO:tasks.workunit.client.0.smithi066.stdout:8/169: write f3 [2873143,29234] 0 2024-09-12T01:43:04.495 INFO:tasks.workunit.client.0.smithi066.stdout:8/170: creat d12/d21/f32 x:0 0 0 2024-09-12T01:43:04.505 INFO:tasks.workunit.client.1.smithi153.stdout:3/529: truncate d1/d45/f51 3467002 0 2024-09-12T01:43:04.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/179: dread d1/dc/de/f1d [0,4194304] 0 2024-09-12T01:43:04.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/180: dread - d1/dc/de/f3c zero size 2024-09-12T01:43:04.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/181: dread - d1/dc/de/f2a zero size 2024-09-12T01:43:04.507 INFO:tasks.workunit.client.1.smithi153.stdout:3/530: dread d1/f54 [0,4194304] 0 2024-09-12T01:43:04.507 INFO:tasks.workunit.client.1.smithi153.stdout:3/531: dread - d1/d16/d17/f67 zero size 2024-09-12T01:43:04.507 INFO:tasks.workunit.client.1.smithi153.stdout:3/532: write d1/d13/d25/f42 [779338,97772] 0 2024-09-12T01:43:04.507 INFO:tasks.workunit.client.1.smithi153.stdout:3/533: fdatasync d1/d45/f51 0 2024-09-12T01:43:04.508 INFO:tasks.workunit.client.1.smithi153.stdout:3/534: read d1/d1e/f2a [643267,25974] 0 2024-09-12T01:43:04.510 INFO:tasks.workunit.client.1.smithi153.stdout:1/527: truncate d2/d9/f5a 4079697 0 2024-09-12T01:43:04.513 INFO:tasks.workunit.client.0.smithi066.stdout:3/150: truncate d5/d6/dd/f1c 1894731 0 2024-09-12T01:43:04.513 INFO:tasks.workunit.client.0.smithi066.stdout:3/151: readlink d5/d6/dd/l18 0 2024-09-12T01:43:04.513 INFO:tasks.workunit.client.0.smithi066.stdout:3/152: chown d5/d6/d1b/c22 4 1 2024-09-12T01:43:04.515 INFO:tasks.workunit.client.1.smithi153.stdout:4/421: rename d6/d9/d11/d13/c2e to d6/d9/dc/d98/d3e/c9d 0 2024-09-12T01:43:04.515 INFO:tasks.workunit.client.1.smithi153.stdout:4/422: write d6/d9/d11/f3c [5050016,82943] 0 2024-09-12T01:43:04.516 INFO:tasks.workunit.client.0.smithi066.stdout:8/171: dread d12/f19 [4194304,4194304] 0 2024-09-12T01:43:04.516 INFO:tasks.workunit.client.0.smithi066.stdout:8/172: read - d12/d26/f2e zero size 2024-09-12T01:43:04.516 INFO:tasks.workunit.client.0.smithi066.stdout:3/153: dread d5/fa [0,4194304] 0 2024-09-12T01:43:04.516 INFO:tasks.workunit.client.1.smithi153.stdout:3/535: symlink d1/d13/d23/d47/d71/la0 0 2024-09-12T01:43:04.519 INFO:tasks.workunit.client.0.smithi066.stdout:8/173: dread fb [0,4194304] 0 2024-09-12T01:43:04.519 INFO:tasks.workunit.client.0.smithi066.stdout:8/174: creat d12/d21/f33 x:0 0 0 2024-09-12T01:43:04.519 INFO:tasks.workunit.client.1.smithi153.stdout:6/529: sync 2024-09-12T01:43:04.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/423: unlink d6/d9/dc/d98/d3e/f5e 0 2024-09-12T01:43:04.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/424: write d6/f53 [963732,1504] 0 2024-09-12T01:43:04.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/425: creat d6/d9/dc/d31/d7d/d94/f9e x:0 0 0 2024-09-12T01:43:04.521 INFO:tasks.workunit.client.0.smithi066.stdout:5/119: rename d0/db to d0/d21/d27 0 2024-09-12T01:43:04.523 INFO:tasks.workunit.client.0.smithi066.stdout:8/175: write fb [1674274,113720] 0 2024-09-12T01:43:04.523 INFO:tasks.workunit.client.1.smithi153.stdout:3/536: symlink d1/d1e/d9a/la1 0 2024-09-12T01:43:04.523 INFO:tasks.workunit.client.1.smithi153.stdout:3/537: dread - d1/d16/d1c/d32/f8b zero size 2024-09-12T01:43:04.525 INFO:tasks.workunit.client.0.smithi066.stdout:0/182: link d1/l25 d1/dc/df/d3e/l45 0 2024-09-12T01:43:04.526 INFO:tasks.workunit.client.0.smithi066.stdout:3/154: truncate d5/d6/dd/f1a 1694622 0 2024-09-12T01:43:04.527 INFO:tasks.workunit.client.0.smithi066.stdout:3/155: chown d5/d6/l1e 6813 1 2024-09-12T01:43:04.527 INFO:tasks.workunit.client.0.smithi066.stdout:3/156: fdatasync d5/fa 0 2024-09-12T01:43:04.528 INFO:tasks.workunit.client.0.smithi066.stdout:6/221: dwrite d2/db/f3b [0,4194304] 0 2024-09-12T01:43:04.528 INFO:tasks.workunit.client.0.smithi066.stdout:7/113: dwrite d2/d5/f23 [0,4194304] 0 2024-09-12T01:43:04.528 INFO:tasks.workunit.client.0.smithi066.stdout:6/222: write d2/d21/f4a [909719,83695] 0 2024-09-12T01:43:04.529 INFO:tasks.workunit.client.1.smithi153.stdout:0/542: dwrite d22/f5f [0,4194304] 0 2024-09-12T01:43:04.529 INFO:tasks.workunit.client.0.smithi066.stdout:2/182: dwrite de/f1d [0,4194304] 0 2024-09-12T01:43:04.531 INFO:tasks.workunit.client.1.smithi153.stdout:3/538: dread d1/d16/f27 [4194304,4194304] 0 2024-09-12T01:43:04.531 INFO:tasks.workunit.client.1.smithi153.stdout:7/425: dwrite d12/f53 [4194304,4194304] 0 2024-09-12T01:43:04.534 INFO:tasks.workunit.client.0.smithi066.stdout:1/147: dwrite f4 [0,4194304] 0 2024-09-12T01:43:04.545 INFO:tasks.workunit.client.0.smithi066.stdout:0/183: dread d1/fa [0,4194304] 0 2024-09-12T01:43:04.545 INFO:tasks.workunit.client.0.smithi066.stdout:0/184: write d1/dc/de/f3c [1045768,130675] 0 2024-09-12T01:43:04.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/223: dread d2/fa [0,4194304] 0 2024-09-12T01:43:04.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/224: fdatasync d2/d21/f4a 0 2024-09-12T01:43:04.549 INFO:tasks.workunit.client.0.smithi066.stdout:6/225: rename d2/db to d2/db/d12/d1d/d4f 22 2024-09-12T01:43:04.551 INFO:tasks.workunit.client.0.smithi066.stdout:1/148: dread f4 [0,4194304] 0 2024-09-12T01:43:04.551 INFO:tasks.workunit.client.0.smithi066.stdout:1/149: readlink d5/dc/dd/l17 0 2024-09-12T01:43:04.561 INFO:tasks.workunit.client.0.smithi066.stdout:0/185: dread d1/fa [0,4194304] 0 2024-09-12T01:43:04.563 INFO:tasks.workunit.client.1.smithi153.stdout:3/539: dwrite d1/f9d [0,4194304] 0 2024-09-12T01:43:04.564 INFO:tasks.workunit.client.1.smithi153.stdout:3/540: dread d1/d16/f7c [0,4194304] 0 2024-09-12T01:43:04.564 INFO:tasks.workunit.client.1.smithi153.stdout:3/541: truncate d1/d16/d17/f18 4915501 0 2024-09-12T01:43:04.564 INFO:tasks.workunit.client.1.smithi153.stdout:3/542: readlink d1/d16/l7b 0 2024-09-12T01:43:04.570 INFO:tasks.workunit.client.1.smithi153.stdout:7/426: rename fc to d12/d21/d29/d35/d37/f79 0 2024-09-12T01:43:04.570 INFO:tasks.workunit.client.1.smithi153.stdout:7/427: dread - d12/f56 zero size 2024-09-12T01:43:04.570 INFO:tasks.workunit.client.1.smithi153.stdout:7/428: write d12/d21/d29/d2d/f30 [473678,84881] 0 2024-09-12T01:43:04.574 INFO:tasks.workunit.client.1.smithi153.stdout:4/426: dwrite d6/d9/d11/f3c [0,4194304] 0 2024-09-12T01:43:04.576 INFO:tasks.workunit.client.1.smithi153.stdout:0/543: write d22/d30/d4c/f9f [2826504,47923] 0 2024-09-12T01:43:04.577 INFO:tasks.workunit.client.1.smithi153.stdout:3/543: mknod d1/d13/d23/d47/d71/d8e/ca2 0 2024-09-12T01:43:04.577 INFO:tasks.workunit.client.1.smithi153.stdout:7/429: rename d12/f2f to d12/d21/d29/d35/d37/d4c/d5c/f7a 0 2024-09-12T01:43:04.577 INFO:tasks.workunit.client.1.smithi153.stdout:7/430: fdatasync d12/d21/d29/f5a 0 2024-09-12T01:43:04.580 INFO:tasks.workunit.client.0.smithi066.stdout:6/226: dwrite d2/db/f1c [0,4194304] 0 2024-09-12T01:43:04.581 INFO:tasks.workunit.client.1.smithi153.stdout:4/427: dread d6/d9/dc/d98/f57 [0,4194304] 0 2024-09-12T01:43:04.582 INFO:tasks.workunit.client.0.smithi066.stdout:0/186: dwrite d1/dc/de/f3a [0,4194304] 0 2024-09-12T01:43:04.582 INFO:tasks.workunit.client.0.smithi066.stdout:0/187: chown d1/dc/df/d1b/d3b 14 1 2024-09-12T01:43:04.591 INFO:tasks.workunit.client.0.smithi066.stdout:6/227: dread d2/f22 [4194304,4194304] 0 2024-09-12T01:43:04.592 INFO:tasks.workunit.client.0.smithi066.stdout:6/228: fdatasync d2/db/f3c 0 2024-09-12T01:43:04.592 INFO:tasks.workunit.client.1.smithi153.stdout:0/544: creat d22/d79/fb8 x:0 0 0 2024-09-12T01:43:04.594 INFO:tasks.workunit.client.1.smithi153.stdout:4/428: symlink d6/d9/dc/d98/d3e/d66/l9f 0 2024-09-12T01:43:04.595 INFO:tasks.workunit.client.1.smithi153.stdout:4/429: chown d6/d9/d11 52583709 1 2024-09-12T01:43:04.595 INFO:tasks.workunit.client.1.smithi153.stdout:4/430: readlink d6/d9/dc/d31/l37 0 2024-09-12T01:43:04.596 INFO:tasks.workunit.client.1.smithi153.stdout:0/545: readlink d22/d30/d4c/l51 0 2024-09-12T01:43:04.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/431: dwrite fe [4194304,4194304] 0 2024-09-12T01:43:04.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/432: fdatasync d12/d21/d29/d35/d37/d58/f63 0 2024-09-12T01:43:04.598 INFO:tasks.workunit.client.0.smithi066.stdout:4/125: write d4/f16 [1067936,56149] 0 2024-09-12T01:43:04.601 INFO:tasks.workunit.client.0.smithi066.stdout:8/176: link d12/d21/f33 d12/d21/d2f/f34 0 2024-09-12T01:43:04.605 INFO:tasks.workunit.client.0.smithi066.stdout:0/188: write d1/dc/df/f1a [1749562,11289] 0 2024-09-12T01:43:04.605 INFO:tasks.workunit.client.0.smithi066.stdout:0/189: chown d1/dc/de/c1c 50 1 2024-09-12T01:43:04.606 INFO:tasks.workunit.client.1.smithi153.stdout:7/433: link d12/l2e d12/d21/d29/l7b 0 2024-09-12T01:43:04.606 INFO:tasks.workunit.client.0.smithi066.stdout:2/183: getdents de/d13/d1e 0 2024-09-12T01:43:04.607 INFO:tasks.workunit.client.1.smithi153.stdout:4/431: dread d6/d9/d11/f1c [0,4194304] 0 2024-09-12T01:43:04.607 INFO:tasks.workunit.client.1.smithi153.stdout:4/432: write d6/d9/dc/d98/d3e/f9b [814185,58909] 0 2024-09-12T01:43:04.609 INFO:tasks.workunit.client.0.smithi066.stdout:0/190: dread d1/dc/de/f19 [0,4194304] 0 2024-09-12T01:43:04.609 INFO:tasks.workunit.client.0.smithi066.stdout:0/191: fsync d1/dc/de/f19 0 2024-09-12T01:43:04.609 INFO:tasks.workunit.client.1.smithi153.stdout:7/434: creat d12/d21/d29/d35/f7c x:0 0 0 2024-09-12T01:43:04.609 INFO:tasks.workunit.client.1.smithi153.stdout:7/435: stat d12/d21/d29/d35/d37/d4c/f75 0 2024-09-12T01:43:04.609 INFO:tasks.workunit.client.1.smithi153.stdout:7/436: write d12/d21/d29/d35/d37/d4c/d5c/f70 [472659,98626] 0 2024-09-12T01:43:04.610 INFO:tasks.workunit.client.0.smithi066.stdout:1/150: getdents d5/dc/dd 0 2024-09-12T01:43:04.610 INFO:tasks.workunit.client.1.smithi153.stdout:4/433: creat d6/d9/dc/d98/fa0 x:0 0 0 2024-09-12T01:43:04.611 INFO:tasks.workunit.client.0.smithi066.stdout:4/126: unlink l0 0 2024-09-12T01:43:04.611 INFO:tasks.workunit.client.0.smithi066.stdout:4/127: fdatasync d4/d6/f23 0 2024-09-12T01:43:04.612 INFO:tasks.workunit.client.1.smithi153.stdout:2/443: sync 2024-09-12T01:43:04.612 INFO:tasks.workunit.client.1.smithi153.stdout:5/509: sync 2024-09-12T01:43:04.613 INFO:tasks.workunit.client.1.smithi153.stdout:7/437: creat d12/d21/d4d/f7d x:0 0 0 2024-09-12T01:43:04.614 INFO:tasks.workunit.client.0.smithi066.stdout:8/177: mknod d12/c35 0 2024-09-12T01:43:04.616 INFO:tasks.workunit.client.1.smithi153.stdout:4/434: link d6/d9/dc/d98/d3e/d66/c84 d6/d9/dc/d98/d3e/ca1 0 2024-09-12T01:43:04.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/128: dread d4/f17 [0,4194304] 0 2024-09-12T01:43:04.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/129: write d4/d6/d8/fa [800430,31373] 0 2024-09-12T01:43:04.619 INFO:tasks.workunit.client.0.smithi066.stdout:2/184: creat de/f42 x:0 0 0 2024-09-12T01:43:04.619 INFO:tasks.workunit.client.0.smithi066.stdout:2/185: dread - de/d13/d28/d3d/f3f zero size 2024-09-12T01:43:04.619 INFO:tasks.workunit.client.1.smithi153.stdout:0/546: read f18 [5617062,112577] 0 2024-09-12T01:43:04.620 INFO:tasks.workunit.client.1.smithi153.stdout:0/547: chown d22/d30/d4c/d8a/l92 126399870 1 2024-09-12T01:43:04.620 INFO:tasks.workunit.client.1.smithi153.stdout:0/548: getdents d22/d79/d8e/dae/db7 0 2024-09-12T01:43:04.620 INFO:tasks.workunit.client.0.smithi066.stdout:3/157: read d5/d6/dd/f1c [1339309,68181] 0 2024-09-12T01:43:04.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/510: rename d0/d15/f54 to d0/df/d83/d36/da5/fa6 0 2024-09-12T01:43:04.621 INFO:tasks.workunit.client.0.smithi066.stdout:0/192: mkdir d1/dc/de/d46 0 2024-09-12T01:43:04.623 INFO:tasks.workunit.client.1.smithi153.stdout:2/444: mknod d7/db/d36/c8b 0 2024-09-12T01:43:04.623 INFO:tasks.workunit.client.1.smithi153.stdout:2/445: stat d7/db/d1d/d1e/l33 0 2024-09-12T01:43:04.623 INFO:tasks.workunit.client.0.smithi066.stdout:8/178: rename d12/f1f to d12/d26/f36 0 2024-09-12T01:43:04.628 INFO:tasks.workunit.client.0.smithi066.stdout:6/229: dwrite d2/f4e [0,4194304] 0 2024-09-12T01:43:04.628 INFO:tasks.workunit.client.0.smithi066.stdout:1/151: dread f4 [0,4194304] 0 2024-09-12T01:43:04.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/186: mknod de/d13/d1e/d22/c43 0 2024-09-12T01:43:04.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/187: creat de/d13/d1e/d22/f44 x:0 0 0 2024-09-12T01:43:04.630 INFO:tasks.workunit.client.0.smithi066.stdout:0/193: mkdir d1/dc/de/d47 0 2024-09-12T01:43:04.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/549: symlink d22/d30/d4c/d6f/d88/lb9 0 2024-09-12T01:43:04.631 INFO:tasks.workunit.client.1.smithi153.stdout:0/550: truncate d22/d30/d4c/f9f 4765897 0 2024-09-12T01:43:04.632 INFO:tasks.workunit.client.0.smithi066.stdout:8/179: mknod d12/c37 0 2024-09-12T01:43:04.634 INFO:tasks.workunit.client.0.smithi066.stdout:4/130: getdents d4 0 2024-09-12T01:43:04.634 INFO:tasks.workunit.client.0.smithi066.stdout:4/131: chown l1 1 1 2024-09-12T01:43:04.634 INFO:tasks.workunit.client.0.smithi066.stdout:4/132: chown f3 119706 1 2024-09-12T01:43:04.634 INFO:tasks.workunit.client.0.smithi066.stdout:4/133: read - d4/d6/f23 zero size 2024-09-12T01:43:04.639 INFO:tasks.workunit.client.1.smithi153.stdout:5/511: symlink d0/df/d1c/d22/d2f/d55/d9c/d7b/la7 0 2024-09-12T01:43:04.639 INFO:tasks.workunit.client.0.smithi066.stdout:6/230: read d2/fe [4118108,13415] 0 2024-09-12T01:43:04.641 INFO:tasks.workunit.client.1.smithi153.stdout:2/446: creat d7/d17/f8c x:0 0 0 2024-09-12T01:43:04.642 INFO:tasks.workunit.client.0.smithi066.stdout:1/152: creat d5/dc/dd/f2b x:0 0 0 2024-09-12T01:43:04.642 INFO:tasks.workunit.client.1.smithi153.stdout:2/447: write d7/db/d27/f31 [769012,63862] 0 2024-09-12T01:43:04.642 INFO:tasks.workunit.client.1.smithi153.stdout:2/448: dread - d7/d4d/d70/f88 zero size 2024-09-12T01:43:04.645 INFO:tasks.workunit.client.0.smithi066.stdout:2/188: mknod de/c45 0 2024-09-12T01:43:04.646 INFO:tasks.workunit.client.0.smithi066.stdout:0/194: mknod d1/c48 0 2024-09-12T01:43:04.648 INFO:tasks.workunit.client.0.smithi066.stdout:8/180: symlink d12/l38 0 2024-09-12T01:43:04.648 INFO:tasks.workunit.client.1.smithi153.stdout:7/438: rename d12/d21/d29/d35/d3c to d12/d7e 0 2024-09-12T01:43:04.649 INFO:tasks.workunit.client.0.smithi066.stdout:4/134: rmdir d4/d6/d14 39 2024-09-12T01:43:04.649 INFO:tasks.workunit.client.0.smithi066.stdout:1/153: mknod d5/c2c 0 2024-09-12T01:43:04.650 INFO:tasks.workunit.client.0.smithi066.stdout:8/181: dread d12/f23 [0,4194304] 0 2024-09-12T01:43:04.652 INFO:tasks.workunit.client.0.smithi066.stdout:2/189: mknod de/d13/d1e/d22/c46 0 2024-09-12T01:43:04.652 INFO:tasks.workunit.client.0.smithi066.stdout:2/190: chown fa 10867777 1 2024-09-12T01:43:04.654 INFO:tasks.workunit.client.0.smithi066.stdout:8/182: link d12/l1c d12/d26/l39 0 2024-09-12T01:43:04.655 INFO:tasks.workunit.client.0.smithi066.stdout:2/191: symlink de/d3c/l47 0 2024-09-12T01:43:04.658 INFO:tasks.workunit.client.1.smithi153.stdout:7/439: dread d12/d21/d29/d35/d37/f57 [0,4194304] 0 2024-09-12T01:43:04.658 INFO:tasks.workunit.client.0.smithi066.stdout:3/158: dwrite d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:04.659 INFO:tasks.workunit.client.0.smithi066.stdout:2/192: rmdir de/d13/d28/d3d 39 2024-09-12T01:43:04.659 INFO:tasks.workunit.client.0.smithi066.stdout:2/193: dread - de/d13/d1e/f36 zero size 2024-09-12T01:43:04.659 INFO:tasks.workunit.client.0.smithi066.stdout:2/194: creat de/d13/d1e/d22/f48 x:0 0 0 2024-09-12T01:43:04.659 INFO:tasks.workunit.client.0.smithi066.stdout:2/195: fsync de/d13/d28/f35 0 2024-09-12T01:43:04.660 INFO:tasks.workunit.client.1.smithi153.stdout:7/440: getdents d12/d21/d29/d35/d37/d4c 0 2024-09-12T01:43:04.664 INFO:tasks.workunit.client.1.smithi153.stdout:7/441: creat d12/d21/d29/d35/d37/d4c/d5c/f7f x:0 0 0 2024-09-12T01:43:04.664 INFO:tasks.workunit.client.1.smithi153.stdout:7/442: truncate d12/d21/d29/d2d/f77 925797 0 2024-09-12T01:43:04.665 INFO:tasks.workunit.client.1.smithi153.stdout:7/443: read d12/d21/d29/d2d/f55 [156795,110323] 0 2024-09-12T01:43:04.665 INFO:tasks.workunit.client.1.smithi153.stdout:7/444: truncate d12/d21/d29/d35/f7c 363622 0 2024-09-12T01:43:04.665 INFO:tasks.workunit.client.1.smithi153.stdout:7/445: write d12/d21/f49 [1409600,438] 0 2024-09-12T01:43:04.665 INFO:tasks.workunit.client.1.smithi153.stdout:7/446: fsync d12/f22 0 2024-09-12T01:43:04.665 INFO:tasks.workunit.client.1.smithi153.stdout:4/435: dwrite d6/d9/dc/d98/fa0 [0,4194304] 0 2024-09-12T01:43:04.666 INFO:tasks.workunit.client.0.smithi066.stdout:8/183: write ff [4045540,80205] 0 2024-09-12T01:43:04.666 INFO:tasks.workunit.client.0.smithi066.stdout:8/184: readlink d12/l18 0 2024-09-12T01:43:04.682 INFO:tasks.workunit.client.1.smithi153.stdout:8/498: sync 2024-09-12T01:43:04.682 INFO:tasks.workunit.client.1.smithi153.stdout:9/520: sync 2024-09-12T01:43:04.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/231: dwrite d2/d21/f25 [0,4194304] 0 2024-09-12T01:43:04.686 INFO:tasks.workunit.client.0.smithi066.stdout:6/232: mkdir d2/d31/d50 0 2024-09-12T01:43:04.686 INFO:tasks.workunit.client.1.smithi153.stdout:9/521: symlink d3/d66/d80/l9b 0 2024-09-12T01:43:04.687 INFO:tasks.workunit.client.0.smithi066.stdout:6/233: unlink d2/db/f3b 0 2024-09-12T01:43:04.689 INFO:tasks.workunit.client.0.smithi066.stdout:6/234: write d2/d21/f4a [293960,118641] 0 2024-09-12T01:43:04.690 INFO:tasks.workunit.client.0.smithi066.stdout:6/235: truncate d2/db/f27 6311371 0 2024-09-12T01:43:04.690 INFO:tasks.workunit.client.0.smithi066.stdout:6/236: creat d2/d21/f51 x:0 0 0 2024-09-12T01:43:04.690 INFO:tasks.workunit.client.0.smithi066.stdout:6/237: creat d2/d21/f52 x:0 0 0 2024-09-12T01:43:04.691 INFO:tasks.workunit.client.1.smithi153.stdout:8/499: dread d17/d1d/f41 [0,4194304] 0 2024-09-12T01:43:04.691 INFO:tasks.workunit.client.1.smithi153.stdout:5/512: dwrite d0/d15/f53 [0,4194304] 0 2024-09-12T01:43:04.691 INFO:tasks.workunit.client.1.smithi153.stdout:5/513: truncate d0/d43/f92 1865116 0 2024-09-12T01:43:04.692 INFO:tasks.workunit.client.0.smithi066.stdout:8/185: dwrite d12/f31 [0,4194304] 0 2024-09-12T01:43:04.692 INFO:tasks.workunit.client.1.smithi153.stdout:2/449: dwrite d7/d19/d40/f37 [0,4194304] 0 2024-09-12T01:43:04.693 INFO:tasks.workunit.client.0.smithi066.stdout:1/154: dwrite f1 [0,4194304] 0 2024-09-12T01:43:04.693 INFO:tasks.workunit.client.0.smithi066.stdout:6/238: dread d2/d21/f2c [0,4194304] 0 2024-09-12T01:43:04.693 INFO:tasks.workunit.client.0.smithi066.stdout:6/239: chown d2/d21/f52 22 1 2024-09-12T01:43:04.693 INFO:tasks.workunit.client.0.smithi066.stdout:6/240: write d2/d21/f51 [275226,70556] 0 2024-09-12T01:43:04.694 INFO:tasks.workunit.client.1.smithi153.stdout:8/500: creat d17/d21/d56/d96/d6c/d89/d9c/fa9 x:0 0 0 2024-09-12T01:43:04.698 INFO:tasks.workunit.client.0.smithi066.stdout:8/186: rename d12/l2c to d12/d21/l3a 0 2024-09-12T01:43:04.698 INFO:tasks.workunit.client.0.smithi066.stdout:8/187: chown d12/l1c 185415 1 2024-09-12T01:43:04.702 INFO:tasks.workunit.client.0.smithi066.stdout:2/196: dread f9 [0,4194304] 0 2024-09-12T01:43:04.702 INFO:tasks.workunit.client.0.smithi066.stdout:3/159: dread d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:04.703 INFO:tasks.workunit.client.0.smithi066.stdout:3/160: creat d5/d6/d1b/d28/f2c x:0 0 0 2024-09-12T01:43:04.704 INFO:tasks.workunit.client.0.smithi066.stdout:1/155: symlink d5/l2d 0 2024-09-12T01:43:04.706 INFO:tasks.workunit.client.0.smithi066.stdout:6/241: creat d2/db/d12/f53 x:0 0 0 2024-09-12T01:43:04.708 INFO:tasks.workunit.client.1.smithi153.stdout:2/450: unlink d7/d4d/d70/f6f 0 2024-09-12T01:43:04.708 INFO:tasks.workunit.client.1.smithi153.stdout:2/451: stat d7/d17/f8c 0 2024-09-12T01:43:04.709 INFO:tasks.workunit.client.0.smithi066.stdout:8/188: creat d12/d26/f3b x:0 0 0 2024-09-12T01:43:04.710 INFO:tasks.workunit.client.0.smithi066.stdout:8/189: chown d12/d21/l28 252801 1 2024-09-12T01:43:04.711 INFO:tasks.workunit.client.1.smithi153.stdout:8/501: rename d17/d21/d56/c8c to d17/d21/d56/d96/d6c/caa 0 2024-09-12T01:43:04.711 INFO:tasks.workunit.client.1.smithi153.stdout:8/502: dread - d17/d1f/d4f/d42/d67/fa8 zero size 2024-09-12T01:43:04.713 INFO:tasks.workunit.client.0.smithi066.stdout:4/135: truncate d4/d6/d8/fa 2905674 0 2024-09-12T01:43:04.713 INFO:tasks.workunit.client.0.smithi066.stdout:4/136: stat d4/l5 0 2024-09-12T01:43:04.714 INFO:tasks.workunit.client.1.smithi153.stdout:2/452: rename d7/d4d/f68 to d7/d17/f8d 0 2024-09-12T01:43:04.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/156: symlink d5/l2e 0 2024-09-12T01:43:04.719 INFO:tasks.workunit.client.1.smithi153.stdout:7/447: dwrite d12/f36 [4194304,4194304] 0 2024-09-12T01:43:04.719 INFO:tasks.workunit.client.1.smithi153.stdout:4/436: dwrite d6/d9/dc/d98/fa0 [0,4194304] 0 2024-09-12T01:43:04.720 INFO:tasks.workunit.client.0.smithi066.stdout:8/190: unlink f3 0 2024-09-12T01:43:04.720 INFO:tasks.workunit.client.1.smithi153.stdout:4/437: write d6/d9/d11/d13/f65 [494214,117874] 0 2024-09-12T01:43:04.720 INFO:tasks.workunit.client.1.smithi153.stdout:4/438: write d6/d9/dc/f3a [303082,62349] 0 2024-09-12T01:43:04.721 INFO:tasks.workunit.client.1.smithi153.stdout:4/439: read d6/d9/d11/d90/f95 [455099,123245] 0 2024-09-12T01:43:04.721 INFO:tasks.workunit.client.1.smithi153.stdout:4/440: fsync d6/d9/dc/d98/d3e/f9b 0 2024-09-12T01:43:04.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/161: link d5/d6/dd/l1f d5/l2d 0 2024-09-12T01:43:04.724 INFO:tasks.workunit.client.0.smithi066.stdout:8/191: mkdir d12/d26/d3c 0 2024-09-12T01:43:04.724 INFO:tasks.workunit.client.0.smithi066.stdout:8/192: dread - d12/d26/f3b zero size 2024-09-12T01:43:04.724 INFO:tasks.workunit.client.0.smithi066.stdout:8/193: chown d12/c14 1852904 1 2024-09-12T01:43:04.725 INFO:tasks.workunit.client.0.smithi066.stdout:3/162: creat d5/d6/d1b/f2e x:0 0 0 2024-09-12T01:43:04.725 INFO:tasks.workunit.client.0.smithi066.stdout:8/194: read d12/f23 [541793,39472] 0 2024-09-12T01:43:04.725 INFO:tasks.workunit.client.1.smithi153.stdout:4/441: mknod d6/d9/ca2 0 2024-09-12T01:43:04.726 INFO:tasks.workunit.client.1.smithi153.stdout:4/442: readlink d6/l7f 0 2024-09-12T01:43:04.726 INFO:tasks.workunit.client.1.smithi153.stdout:7/448: getdents d12/d21/d29/d35/d37/d4c/d5c 0 2024-09-12T01:43:04.726 INFO:tasks.workunit.client.1.smithi153.stdout:7/449: chown d12/d4e 7 1 2024-09-12T01:43:04.727 INFO:tasks.workunit.client.1.smithi153.stdout:7/450: truncate fe 8503281 0 2024-09-12T01:43:04.728 INFO:tasks.workunit.client.0.smithi066.stdout:3/163: symlink d5/d6/dd/d26/l2f 0 2024-09-12T01:43:04.729 INFO:tasks.workunit.client.1.smithi153.stdout:4/443: unlink d6/d9/dc/d98/f2a 0 2024-09-12T01:43:04.731 INFO:tasks.workunit.client.1.smithi153.stdout:7/451: link d12/d21/d29/d2d/f55 d12/d21/d29/d2d/f80 0 2024-09-12T01:43:04.732 INFO:tasks.workunit.client.0.smithi066.stdout:3/164: mknod d5/d6/c30 0 2024-09-12T01:43:04.734 INFO:tasks.workunit.client.1.smithi153.stdout:7/452: creat d12/d21/d29/d35/d37/d58/f81 x:0 0 0 2024-09-12T01:43:04.738 INFO:tasks.workunit.client.1.smithi153.stdout:5/514: dwrite d0/df/d1c/d22/d2f/d55/d9c/d75/f8c [0,4194304] 0 2024-09-12T01:43:04.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/522: dwrite d3/f2d [0,4194304] 0 2024-09-12T01:43:04.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/523: write d3/fe [456435,101987] 0 2024-09-12T01:43:04.739 INFO:tasks.workunit.client.1.smithi153.stdout:9/524: chown d3/f13 194631 1 2024-09-12T01:43:04.739 INFO:tasks.workunit.client.0.smithi066.stdout:4/137: dread d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:04.742 INFO:tasks.workunit.client.1.smithi153.stdout:5/515: rename d0/d79/fa3 to d0/df/d83/d36/fa8 0 2024-09-12T01:43:04.742 INFO:tasks.workunit.client.1.smithi153.stdout:5/516: write d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d70/f5a [1003011,29976] 0 2024-09-12T01:43:04.745 INFO:tasks.workunit.client.0.smithi066.stdout:6/242: dwrite d2/db/f3c [0,4194304] 0 2024-09-12T01:43:04.747 INFO:tasks.workunit.client.0.smithi066.stdout:1/157: dwrite d5/d15/f1b [0,4194304] 0 2024-09-12T01:43:04.748 INFO:tasks.workunit.client.0.smithi066.stdout:1/158: chown d5/d15/l25 7271011 1 2024-09-12T01:43:04.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/195: dwrite d12/d21/f32 [0,4194304] 0 2024-09-12T01:43:04.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/196: write d12/d26/f36 [1157325,71549] 0 2024-09-12T01:43:04.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/197: creat d12/f3d x:0 0 0 2024-09-12T01:43:04.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/198: chown d12/d21/c25 1661517 1 2024-09-12T01:43:04.752 INFO:tasks.workunit.client.0.smithi066.stdout:6/243: truncate d2/db/d12/d1d/f26 289198 0 2024-09-12T01:43:04.756 INFO:tasks.workunit.client.0.smithi066.stdout:1/159: truncate f4 2666045 0 2024-09-12T01:43:04.757 INFO:tasks.workunit.client.0.smithi066.stdout:3/165: dwrite d5/d6/f7 [0,4194304] 0 2024-09-12T01:43:04.757 INFO:tasks.workunit.client.0.smithi066.stdout:3/166: chown f4 104304366 1 2024-09-12T01:43:04.759 INFO:tasks.workunit.client.1.smithi153.stdout:9/525: rename d3/d55/d30/f4a to d3/d55/d30/d7b/d8f/f9c 0 2024-09-12T01:43:04.763 INFO:tasks.workunit.client.0.smithi066.stdout:8/199: symlink d12/l3e 0 2024-09-12T01:43:04.766 INFO:tasks.workunit.client.1.smithi153.stdout:9/526: unlink d3/d55/d30/f39 0 2024-09-12T01:43:04.767 INFO:tasks.workunit.client.0.smithi066.stdout:8/200: mknod d12/c3f 0 2024-09-12T01:43:04.767 INFO:tasks.workunit.client.0.smithi066.stdout:8/201: fdatasync d12/f24 0 2024-09-12T01:43:04.767 INFO:tasks.workunit.client.0.smithi066.stdout:8/202: dread - d12/d26/f3b zero size 2024-09-12T01:43:04.768 INFO:tasks.workunit.client.0.smithi066.stdout:8/203: link d12/f31 d12/d26/d3c/f40 0 2024-09-12T01:43:04.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/160: write d5/d15/f1b [1112461,81464] 0 2024-09-12T01:43:04.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/161: chown d5/dc 1 1 2024-09-12T01:43:04.772 INFO:tasks.workunit.client.1.smithi153.stdout:7/453: dwrite d12/d7e/f72 [0,4194304] 0 2024-09-12T01:43:04.775 INFO:tasks.workunit.client.0.smithi066.stdout:3/167: rename d5/d6/dd/d26 to d5/d6/d1b/d31 0 2024-09-12T01:43:04.782 INFO:tasks.workunit.client.0.smithi066.stdout:8/204: write d12/f24 [3267170,11166] 0 2024-09-12T01:43:04.782 INFO:tasks.workunit.client.0.smithi066.stdout:8/205: write d12/f23 [1709925,54897] 0 2024-09-12T01:43:04.782 INFO:tasks.workunit.client.0.smithi066.stdout:6/244: dwrite d2/f5 [4194304,4194304] 0 2024-09-12T01:43:04.782 INFO:tasks.workunit.client.0.smithi066.stdout:8/206: write d12/f19 [674915,104384] 0 2024-09-12T01:43:04.782 INFO:tasks.workunit.client.0.smithi066.stdout:8/207: readlink d12/d26/l39 0 2024-09-12T01:43:04.783 INFO:tasks.workunit.client.0.smithi066.stdout:8/208: write d12/d26/f27 [75329,3435] 0 2024-09-12T01:43:04.783 INFO:tasks.workunit.client.0.smithi066.stdout:6/245: unlink d2/db/d12/f4d 0 2024-09-12T01:43:04.784 INFO:tasks.workunit.client.0.smithi066.stdout:1/162: dread d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:04.784 INFO:tasks.workunit.client.0.smithi066.stdout:6/246: mknod d2/db/d12/d49/c54 0 2024-09-12T01:43:04.784 INFO:tasks.workunit.client.0.smithi066.stdout:6/247: chown d2/l14 3757 1 2024-09-12T01:43:04.784 INFO:tasks.workunit.client.0.smithi066.stdout:6/248: chown d2/db/d12/d49/c4b 196913 1 2024-09-12T01:43:04.784 INFO:tasks.workunit.client.0.smithi066.stdout:6/249: truncate d2/db/f3d 479340 0 2024-09-12T01:43:04.785 INFO:tasks.workunit.client.0.smithi066.stdout:6/250: creat d2/db/d12/d49/f55 x:0 0 0 2024-09-12T01:43:04.785 INFO:tasks.workunit.client.0.smithi066.stdout:6/251: mknod d2/c56 0 2024-09-12T01:43:04.793 INFO:tasks.workunit.client.0.smithi066.stdout:6/252: read d2/d21/f25 [3733251,13221] 0 2024-09-12T01:43:04.793 INFO:tasks.workunit.client.0.smithi066.stdout:8/209: write d12/d26/d3c/f40 [1298566,41093] 0 2024-09-12T01:43:04.793 INFO:tasks.workunit.client.0.smithi066.stdout:8/210: write fb [1147398,116796] 0 2024-09-12T01:43:04.794 INFO:tasks.workunit.client.0.smithi066.stdout:6/253: mkdir d2/d31/d57 0 2024-09-12T01:43:04.795 INFO:tasks.workunit.client.0.smithi066.stdout:8/211: mknod d12/c41 0 2024-09-12T01:43:04.796 INFO:tasks.workunit.client.0.smithi066.stdout:6/254: getdents d2/db 0 2024-09-12T01:43:04.796 INFO:tasks.workunit.client.0.smithi066.stdout:6/255: write d2/d21/f51 [1283367,119346] 0 2024-09-12T01:43:04.803 INFO:tasks.workunit.client.0.smithi066.stdout:8/212: dread fb [0,4194304] 0 2024-09-12T01:43:04.803 INFO:tasks.workunit.client.0.smithi066.stdout:8/213: chown d12/d21/f33 173 1 2024-09-12T01:43:04.803 INFO:tasks.workunit.client.0.smithi066.stdout:8/214: fsync d12/d26/f3b 0 2024-09-12T01:43:04.804 INFO:tasks.workunit.client.0.smithi066.stdout:6/256: write d2/f38 [131011,107300] 0 2024-09-12T01:43:04.804 INFO:tasks.workunit.client.0.smithi066.stdout:6/257: truncate d2/f45 87761 0 2024-09-12T01:43:04.804 INFO:tasks.workunit.client.0.smithi066.stdout:6/258: readlink d2/l14 0 2024-09-12T01:43:04.805 INFO:tasks.workunit.client.0.smithi066.stdout:6/259: unlink d2/db/f3c 0 2024-09-12T01:43:04.812 INFO:tasks.workunit.client.1.smithi153.stdout:1/528: sync 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:3/544: sync 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:6/530: sync 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:6/531: write d1/d6/d23/d98/d4f/f83 [18185,67683] 0 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:6/532: write d1/f38 [7149976,91010] 0 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:6/533: fsync d1/d6/d23/d98/d4f/fa1 0 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:4/444: dwrite d6/d9/dc/d31/f70 [4194304,4194304] 0 2024-09-12T01:43:04.813 INFO:tasks.workunit.client.1.smithi153.stdout:1/529: link d2/d9/c26 d2/d9/d17/d2f/d56/d83/ca6 0 2024-09-12T01:43:04.814 INFO:tasks.workunit.client.1.smithi153.stdout:3/545: creat d1/d16/d17/d82/fa3 x:0 0 0 2024-09-12T01:43:04.815 INFO:tasks.workunit.client.1.smithi153.stdout:6/534: creat d1/d6/d23/d98/d53/d8d/fa9 x:0 0 0 2024-09-12T01:43:04.819 INFO:tasks.workunit.client.1.smithi153.stdout:1/530: mkdir d2/d34/d8a/da7 0 2024-09-12T01:43:04.819 INFO:tasks.workunit.client.1.smithi153.stdout:3/546: rmdir d1/d13/d23 39 2024-09-12T01:43:04.819 INFO:tasks.workunit.client.1.smithi153.stdout:3/547: truncate d1/d13/d25/d26/f44 4771247 0 2024-09-12T01:43:04.820 INFO:tasks.workunit.client.1.smithi153.stdout:1/531: mkdir d2/d9/d1d/d82/d89/da8 0 2024-09-12T01:43:04.821 INFO:tasks.workunit.client.1.smithi153.stdout:1/532: mkdir d2/d9/d28/d73/d76/da9 0 2024-09-12T01:43:04.822 INFO:tasks.workunit.client.1.smithi153.stdout:1/533: mknod d2/d9/d1d/da5/caa 0 2024-09-12T01:43:04.823 INFO:tasks.workunit.client.1.smithi153.stdout:1/534: read d2/d9/d17/d2f/d56/f6a [2027166,45092] 0 2024-09-12T01:43:04.823 INFO:tasks.workunit.client.1.smithi153.stdout:1/535: chown d2/d9/d17/d2f/d56/f6a 12 1 2024-09-12T01:43:04.823 INFO:tasks.workunit.client.1.smithi153.stdout:1/536: write d2/d9/d1d/f30 [2465579,104484] 0 2024-09-12T01:43:04.828 INFO:tasks.workunit.client.0.smithi066.stdout:6/260: dwrite d2/db/f3d [0,4194304] 0 2024-09-12T01:43:04.830 INFO:tasks.workunit.client.0.smithi066.stdout:6/261: rename d2/db/f3a to d2/db/f58 0 2024-09-12T01:43:04.831 INFO:tasks.workunit.client.1.smithi153.stdout:6/535: dread d1/df/f6f [0,4194304] 0 2024-09-12T01:43:04.832 INFO:tasks.workunit.client.0.smithi066.stdout:6/262: mknod d2/d31/c59 0 2024-09-12T01:43:04.833 INFO:tasks.workunit.client.1.smithi153.stdout:6/536: symlink d1/d6/da/d19/d94/laa 0 2024-09-12T01:43:04.834 INFO:tasks.workunit.client.0.smithi066.stdout:6/263: mknod d2/db/d12/c5a 0 2024-09-12T01:43:04.835 INFO:tasks.workunit.client.1.smithi153.stdout:6/537: creat d1/d6/da/d19/fab x:0 0 0 2024-09-12T01:43:04.835 INFO:tasks.workunit.client.1.smithi153.stdout:6/538: write d1/d6/d46/d73/fa6 [731342,127310] 0 2024-09-12T01:43:04.835 INFO:tasks.workunit.client.0.smithi066.stdout:6/264: stat d2/f1a 0 2024-09-12T01:43:04.837 INFO:tasks.workunit.client.1.smithi153.stdout:6/539: mknod d1/d6/d39/cac 0 2024-09-12T01:43:04.837 INFO:tasks.workunit.client.1.smithi153.stdout:6/540: readlink d1/d6/da/d19/l22 0 2024-09-12T01:43:04.838 INFO:tasks.workunit.client.1.smithi153.stdout:6/541: creat d1/d6/d23/d98/d53/da0/fad x:0 0 0 2024-09-12T01:43:04.838 INFO:tasks.workunit.client.1.smithi153.stdout:6/542: stat d1/d6/d23/d98/d53/f78 0 2024-09-12T01:43:04.838 INFO:tasks.workunit.client.1.smithi153.stdout:6/543: write d1/d6/da/d19/fab [3345,82611] 0 2024-09-12T01:43:04.840 INFO:tasks.workunit.client.1.smithi153.stdout:4/445: dwrite d6/d9/f10 [0,4194304] 0 2024-09-12T01:43:04.840 INFO:tasks.workunit.client.1.smithi153.stdout:4/446: write d6/d9/dc/d31/d7d/d94/f97 [390986,61118] 0 2024-09-12T01:43:04.842 INFO:tasks.workunit.client.1.smithi153.stdout:4/447: link d6/d9/d11/c4f d6/d6a/d9c/ca3 0 2024-09-12T01:43:04.857 INFO:tasks.workunit.client.1.smithi153.stdout:1/537: dwrite d2/d9/d17/f48 [4194304,4194304] 0 2024-09-12T01:43:04.859 INFO:tasks.workunit.client.1.smithi153.stdout:1/538: rename d2/d9/d1d/d82/d89/da8 to d2/d9/d17/dab 0 2024-09-12T01:43:04.859 INFO:tasks.workunit.client.1.smithi153.stdout:1/539: write d2/f6 [511974,90506] 0 2024-09-12T01:43:04.859 INFO:tasks.workunit.client.1.smithi153.stdout:1/540: readlink d2/d34/d3d/l92 0 2024-09-12T01:43:04.868 INFO:tasks.workunit.client.1.smithi153.stdout:1/541: dread d2/d34/d3d/f59 [0,4194304] 0 2024-09-12T01:43:04.889 INFO:tasks.workunit.client.0.smithi066.stdout:3/168: rmdir d5/d6/d1b 39 2024-09-12T01:43:04.891 INFO:tasks.workunit.client.0.smithi066.stdout:4/138: dread d4/d6/d8/fa [0,4194304] 0 2024-09-12T01:43:04.891 INFO:tasks.workunit.client.0.smithi066.stdout:4/139: chown d4/d6/d14/c1e 2 1 2024-09-12T01:43:04.892 INFO:tasks.workunit.client.0.smithi066.stdout:4/140: creat d4/f29 x:0 0 0 2024-09-12T01:43:04.911 INFO:tasks.workunit.client.1.smithi153.stdout:0/551: sync 2024-09-12T01:43:04.912 INFO:tasks.workunit.client.1.smithi153.stdout:0/552: write d22/f24 [33861,17855] 0 2024-09-12T01:43:04.912 INFO:tasks.workunit.client.1.smithi153.stdout:0/553: rename d22 to d22/d30/d4c/dba 22 2024-09-12T01:43:04.913 INFO:tasks.workunit.client.0.smithi066.stdout:3/169: dread d5/fa [0,4194304] 0 2024-09-12T01:43:04.913 INFO:tasks.workunit.client.0.smithi066.stdout:8/215: dwrite fb [4194304,4194304] 0 2024-09-12T01:43:04.913 INFO:tasks.workunit.client.1.smithi153.stdout:0/554: truncate d22/f5a 974861 0 2024-09-12T01:43:04.913 INFO:tasks.workunit.client.0.smithi066.stdout:6/265: dwrite d2/d21/f52 [0,4194304] 0 2024-09-12T01:43:04.915 INFO:tasks.workunit.client.1.smithi153.stdout:3/548: dwrite d1/f9d [0,4194304] 0 2024-09-12T01:43:04.915 INFO:tasks.workunit.client.1.smithi153.stdout:3/549: write d1/d13/d25/d26/d4b/f4f [403595,15769] 0 2024-09-12T01:43:04.915 INFO:tasks.workunit.client.0.smithi066.stdout:3/170: link d5/d6/c15 d5/d6/dd/c32 0 2024-09-12T01:43:04.917 INFO:tasks.workunit.client.1.smithi153.stdout:0/555: symlink d22/lbb 0 2024-09-12T01:43:04.917 INFO:tasks.workunit.client.1.smithi153.stdout:0/556: creat d22/d30/d4c/d6f/d88/fbc x:0 0 0 2024-09-12T01:43:04.920 INFO:tasks.workunit.client.0.smithi066.stdout:4/141: dwrite d4/f17 [0,4194304] 0 2024-09-12T01:43:04.923 INFO:tasks.workunit.client.1.smithi153.stdout:1/542: dwrite d2/d9/d17/f48 [4194304,4194304] 0 2024-09-12T01:43:04.923 INFO:tasks.workunit.client.1.smithi153.stdout:1/543: truncate d2/d9/d28/f9d 188365 0 2024-09-12T01:43:04.923 INFO:tasks.workunit.client.0.smithi066.stdout:6/266: dread d2/d21/f51 [0,4194304] 0 2024-09-12T01:43:04.923 INFO:tasks.workunit.client.0.smithi066.stdout:1/163: dwrite f4 [0,4194304] 0 2024-09-12T01:43:04.923 INFO:tasks.workunit.client.0.smithi066.stdout:1/164: fdatasync d5/f9 0 2024-09-12T01:43:04.928 INFO:tasks.workunit.client.1.smithi153.stdout:3/550: symlink d1/d16/d1c/la4 0 2024-09-12T01:43:04.931 INFO:tasks.workunit.client.0.smithi066.stdout:8/216: truncate d12/f31 2533007 0 2024-09-12T01:43:04.932 INFO:tasks.workunit.client.1.smithi153.stdout:0/557: mkdir d22/d30/d4c/d6e/d7f/dbd 0 2024-09-12T01:43:04.932 INFO:tasks.workunit.client.1.smithi153.stdout:6/544: dwrite d1/d6/d23/d98/d4f/f83 [0,4194304] 0 2024-09-12T01:43:04.934 INFO:tasks.workunit.client.1.smithi153.stdout:0/558: read d22/d30/d4c/d6f/fb0 [18812,130567] 0 2024-09-12T01:43:04.935 INFO:tasks.workunit.client.1.smithi153.stdout:1/544: link d2/d9/d1d/d82/d89/c8c d2/d9/d28/d73/d76/cac 0 2024-09-12T01:43:04.939 INFO:tasks.workunit.client.1.smithi153.stdout:0/559: read - d22/d30/f59 zero size 2024-09-12T01:43:04.939 INFO:tasks.workunit.client.1.smithi153.stdout:0/560: creat d22/d30/d4c/d6f/d88/fbe x:0 0 0 2024-09-12T01:43:04.942 INFO:tasks.workunit.client.0.smithi066.stdout:3/171: symlink d5/d6/d1b/d31/l33 0 2024-09-12T01:43:04.945 INFO:tasks.workunit.client.1.smithi153.stdout:1/545: truncate d2/d9/f32 595438 0 2024-09-12T01:43:04.945 INFO:tasks.workunit.client.1.smithi153.stdout:1/546: dread - d2/d9/d17/d69/f7e zero size 2024-09-12T01:43:04.945 INFO:tasks.workunit.client.1.smithi153.stdout:6/545: dread d1/d6/da/d19/d3a/f7e [0,4194304] 0 2024-09-12T01:43:04.945 INFO:tasks.workunit.client.1.smithi153.stdout:6/546: fsync d1/d6/d23/d98/d53/f85 0 2024-09-12T01:43:04.946 INFO:tasks.workunit.client.0.smithi066.stdout:6/267: mknod d2/db/d12/d49/c5b 0 2024-09-12T01:43:04.946 INFO:tasks.workunit.client.0.smithi066.stdout:1/165: truncate d5/dc/dd/f11 2173622 0 2024-09-12T01:43:04.947 INFO:tasks.workunit.client.0.smithi066.stdout:3/172: rename d5/d6/dd/l2a to d5/d6/d1b/l34 0 2024-09-12T01:43:04.949 INFO:tasks.workunit.client.1.smithi153.stdout:1/547: truncate d2/d9/d17/d2c/f4d 1046338 0 2024-09-12T01:43:04.950 INFO:tasks.workunit.client.0.smithi066.stdout:3/173: mkdir d5/d35 0 2024-09-12T01:43:04.951 INFO:tasks.workunit.client.0.smithi066.stdout:3/174: getdents d5/d6/d1b/d28 0 2024-09-12T01:43:04.951 INFO:tasks.workunit.client.0.smithi066.stdout:3/175: write d5/d6/d1b/f2e [207147,43147] 0 2024-09-12T01:43:04.952 INFO:tasks.workunit.client.0.smithi066.stdout:3/176: mknod d5/d6/d1b/d28/c36 0 2024-09-12T01:43:04.953 INFO:tasks.workunit.client.1.smithi153.stdout:3/551: dwrite d1/d16/d1c/d32/f9e [0,4194304] 0 2024-09-12T01:43:04.953 INFO:tasks.workunit.client.1.smithi153.stdout:3/552: write d1/d1e/f80 [668941,95380] 0 2024-09-12T01:43:04.953 INFO:tasks.workunit.client.0.smithi066.stdout:3/177: mknod d5/d6/dd/c37 0 2024-09-12T01:43:04.954 INFO:tasks.workunit.client.0.smithi066.stdout:9/141: sync 2024-09-12T01:43:04.955 INFO:tasks.workunit.client.0.smithi066.stdout:9/142: mknod d0/d5/d9/c31 0 2024-09-12T01:43:04.955 INFO:tasks.workunit.client.0.smithi066.stdout:3/178: write d5/d6/dd/f1a [134418,58086] 0 2024-09-12T01:43:04.955 INFO:tasks.workunit.client.0.smithi066.stdout:3/179: chown d5/d6/f29 3 1 2024-09-12T01:43:04.956 INFO:tasks.workunit.client.0.smithi066.stdout:3/180: chown d5/d6/dd/f1a 1865348284 1 2024-09-12T01:43:04.958 INFO:tasks.workunit.client.1.smithi153.stdout:6/547: dread d1/f5e [0,4194304] 0 2024-09-12T01:43:04.958 INFO:tasks.workunit.client.0.smithi066.stdout:9/143: mknod d0/d5/d9/c32 0 2024-09-12T01:43:04.960 INFO:tasks.workunit.client.1.smithi153.stdout:3/553: rename d1/d13/d23/d47/d71/d8e/ca2 to d1/d13/d23/d47/d71/d8e/d93/d79/ca5 0 2024-09-12T01:43:04.960 INFO:tasks.workunit.client.1.smithi153.stdout:3/554: truncate d1/f11 1800208 0 2024-09-12T01:43:04.960 INFO:tasks.workunit.client.1.smithi153.stdout:3/555: chown d1/d16/d1c/d32/f43 65525 1 2024-09-12T01:43:04.961 INFO:tasks.workunit.client.0.smithi066.stdout:7/114: sync 2024-09-12T01:43:04.961 INFO:tasks.workunit.client.0.smithi066.stdout:5/120: sync 2024-09-12T01:43:04.962 INFO:tasks.workunit.client.0.smithi066.stdout:9/144: chown d0/d6/d17/d1b 1653319 1 2024-09-12T01:43:04.962 INFO:tasks.workunit.client.0.smithi066.stdout:0/195: sync 2024-09-12T01:43:04.964 INFO:tasks.workunit.client.0.smithi066.stdout:0/196: mknod d1/dc/df/c49 0 2024-09-12T01:43:04.964 INFO:tasks.workunit.client.0.smithi066.stdout:6/268: dread d2/d21/f52 [0,4194304] 0 2024-09-12T01:43:04.966 INFO:tasks.workunit.client.0.smithi066.stdout:7/115: getdents d2/d5/da 0 2024-09-12T01:43:04.966 INFO:tasks.workunit.client.0.smithi066.stdout:7/116: rename d2/d20/d1d to d2/d20/d1d/d24 22 2024-09-12T01:43:04.968 INFO:tasks.workunit.client.0.smithi066.stdout:7/117: read d2/d5/da/f19 [203616,69450] 0 2024-09-12T01:43:04.968 INFO:tasks.workunit.client.0.smithi066.stdout:0/197: mkdir d1/dc/de/d47/d4a 0 2024-09-12T01:43:04.969 INFO:tasks.workunit.client.0.smithi066.stdout:0/198: creat d1/dc/de/f4b x:0 0 0 2024-09-12T01:43:04.969 INFO:tasks.workunit.client.0.smithi066.stdout:0/199: fdatasync d1/f28 0 2024-09-12T01:43:04.969 INFO:tasks.workunit.client.1.smithi153.stdout:6/548: dread d1/d6/d39/fa5 [0,4194304] 0 2024-09-12T01:43:04.970 INFO:tasks.workunit.client.0.smithi066.stdout:6/269: link d2/db/d12/d49/f55 d2/db/d12/f5c 0 2024-09-12T01:43:04.973 INFO:tasks.workunit.client.1.smithi153.stdout:3/556: dread d1/d16/d17/f1f [0,4194304] 0 2024-09-12T01:43:04.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/200: mknod d1/dc/df/d1b/d26/c4c 0 2024-09-12T01:43:04.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/201: fdatasync d1/f27 0 2024-09-12T01:43:04.973 INFO:tasks.workunit.client.0.smithi066.stdout:0/202: fdatasync d1/dc/de/f1f 0 2024-09-12T01:43:04.974 INFO:tasks.workunit.client.1.smithi153.stdout:1/548: dwrite d2/d9/d17/f48 [0,4194304] 0 2024-09-12T01:43:04.975 INFO:tasks.workunit.client.0.smithi066.stdout:6/270: link d2/c56 d2/d21/c5d 0 2024-09-12T01:43:04.975 INFO:tasks.workunit.client.0.smithi066.stdout:6/271: fsync d2/d21/f34 0 2024-09-12T01:43:04.975 INFO:tasks.workunit.client.0.smithi066.stdout:6/272: chown d2/f4e 163312 1 2024-09-12T01:43:04.975 INFO:tasks.workunit.client.0.smithi066.stdout:6/273: readlink d2/db/l17 0 2024-09-12T01:43:04.976 INFO:tasks.workunit.client.0.smithi066.stdout:7/118: dread d2/d5/da/f19 [0,4194304] 0 2024-09-12T01:43:04.976 INFO:tasks.workunit.client.0.smithi066.stdout:0/203: creat d1/f4d x:0 0 0 2024-09-12T01:43:04.979 INFO:tasks.workunit.client.0.smithi066.stdout:6/274: mkdir d2/d31/d5e 0 2024-09-12T01:43:04.980 INFO:tasks.workunit.client.0.smithi066.stdout:9/145: dread d0/d5/dc/f2a [0,4194304] 0 2024-09-12T01:43:04.986 INFO:tasks.workunit.client.0.smithi066.stdout:9/146: truncate d0/d5/d9/fa 140339 0 2024-09-12T01:43:04.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/147: write d0/d5/dc/f2b [455956,45290] 0 2024-09-12T01:43:04.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/148: read d0/d6/d17/d1b/f1c [55703,47532] 0 2024-09-12T01:43:04.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/149: write d0/d5/d12/f1f [799850,38986] 0 2024-09-12T01:43:04.987 INFO:tasks.workunit.client.0.smithi066.stdout:9/150: chown d0/d6/f13 0 1 2024-09-12T01:43:04.989 INFO:tasks.workunit.client.0.smithi066.stdout:9/151: write d0/d6/f13 [1100567,127026] 0 2024-09-12T01:43:04.989 INFO:tasks.workunit.client.1.smithi153.stdout:8/503: sync 2024-09-12T01:43:04.989 INFO:tasks.workunit.client.1.smithi153.stdout:2/453: sync 2024-09-12T01:43:04.989 INFO:tasks.workunit.client.1.smithi153.stdout:8/504: creat d17/d75/fab x:0 0 0 2024-09-12T01:43:04.990 INFO:tasks.workunit.client.1.smithi153.stdout:2/454: creat d7/d4d/d70/d81/f8e x:0 0 0 2024-09-12T01:43:04.990 INFO:tasks.workunit.client.0.smithi066.stdout:9/152: link d0/d5/l30 d0/d5/l33 0 2024-09-12T01:43:04.991 INFO:tasks.workunit.client.1.smithi153.stdout:1/549: dread d2/d34/f55 [0,4194304] 0 2024-09-12T01:43:04.995 INFO:tasks.workunit.client.1.smithi153.stdout:6/549: dread d1/df/f30 [0,4194304] 0 2024-09-12T01:43:04.996 INFO:tasks.workunit.client.1.smithi153.stdout:2/455: mknod d7/d4d/c8f 0 2024-09-12T01:43:04.998 INFO:tasks.workunit.client.1.smithi153.stdout:1/550: mknod d2/d9/d17/cad 0 2024-09-12T01:43:04.999 INFO:tasks.workunit.client.0.smithi066.stdout:5/121: dwrite d0/f2 [0,4194304] 0 2024-09-12T01:43:05.000 INFO:tasks.workunit.client.1.smithi153.stdout:6/550: link d1/df/f6f d1/d80/fae 0 2024-09-12T01:43:05.001 INFO:tasks.workunit.client.1.smithi153.stdout:2/456: creat d7/d4d/d7b/f90 x:0 0 0 2024-09-12T01:43:05.002 INFO:tasks.workunit.client.1.smithi153.stdout:1/551: link d2/d9/d17/d2c/f4d d2/d68/fae 0 2024-09-12T01:43:05.004 INFO:tasks.workunit.client.1.smithi153.stdout:6/551: rename d1/d6/d46/d73/ca3 to d1/d6/d39/d76/caf 0 2024-09-12T01:43:05.005 INFO:tasks.workunit.client.1.smithi153.stdout:2/457: link d7/db/c49 d7/c91 0 2024-09-12T01:43:05.005 INFO:tasks.workunit.client.1.smithi153.stdout:2/458: stat d7/db/d36/c78 0 2024-09-12T01:43:05.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/552: symlink d2/d9/laf 0 2024-09-12T01:43:05.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/553: write d2/d9/d17/d2f/d56/d91/f9f [797929,127249] 0 2024-09-12T01:43:05.006 INFO:tasks.workunit.client.1.smithi153.stdout:6/552: mkdir d1/d6/da/d19/d3a/db0 0 2024-09-12T01:43:05.007 INFO:tasks.workunit.client.1.smithi153.stdout:1/554: creat d2/d9/d28/d73/d76/fb0 x:0 0 0 2024-09-12T01:43:05.008 INFO:tasks.workunit.client.1.smithi153.stdout:1/555: chown d2/d9/f32 89586 1 2024-09-12T01:43:05.013 INFO:tasks.workunit.client.0.smithi066.stdout:3/181: dwrite d5/d6/d1b/d28/f2c [0,4194304] 0 2024-09-12T01:43:05.017 INFO:tasks.workunit.client.1.smithi153.stdout:2/459: write d7/db/d1d/f28 [3479181,38751] 0 2024-09-12T01:43:05.017 INFO:tasks.workunit.client.1.smithi153.stdout:2/460: creat d7/d4d/d70/f92 x:0 0 0 2024-09-12T01:43:05.023 INFO:tasks.workunit.client.1.smithi153.stdout:1/556: read d2/d9/d1d/d25/f4a [424277,3672] 0 2024-09-12T01:43:05.026 INFO:tasks.workunit.client.1.smithi153.stdout:3/557: dwrite d1/d16/d1c/d32/f5f [0,4194304] 0 2024-09-12T01:43:05.026 INFO:tasks.workunit.client.0.smithi066.stdout:0/204: dwrite d1/dc/de/f4b [0,4194304] 0 2024-09-12T01:43:05.027 INFO:tasks.workunit.client.0.smithi066.stdout:7/119: dwrite d2/d5/f1a [0,4194304] 0 2024-09-12T01:43:05.028 INFO:tasks.workunit.client.1.smithi153.stdout:1/557: creat d2/d9/d17/d2f/d56/d97/fb1 x:0 0 0 2024-09-12T01:43:05.030 INFO:tasks.workunit.client.1.smithi153.stdout:8/505: dwrite d17/d21/f92 [0,4194304] 0 2024-09-12T01:43:05.032 INFO:tasks.workunit.client.0.smithi066.stdout:0/205: creat d1/dc/de/d47/f4e x:0 0 0 2024-09-12T01:43:05.036 INFO:tasks.workunit.client.0.smithi066.stdout:3/182: getdents d5/d6/dd 0 2024-09-12T01:43:05.036 INFO:tasks.workunit.client.0.smithi066.stdout:3/183: chown d5/d6/d1b/l23 0 1 2024-09-12T01:43:05.036 INFO:tasks.workunit.client.0.smithi066.stdout:3/184: dread - d5/d6/f29 zero size 2024-09-12T01:43:05.037 INFO:tasks.workunit.client.1.smithi153.stdout:2/461: rmdir d7/db/d27/d56 39 2024-09-12T01:43:05.037 INFO:tasks.workunit.client.1.smithi153.stdout:2/462: chown d7/d4d/d70/f92 595 1 2024-09-12T01:43:05.037 INFO:tasks.workunit.client.1.smithi153.stdout:2/463: read - d7/db/d6c/d7e/f63 zero size 2024-09-12T01:43:05.039 INFO:tasks.workunit.client.0.smithi066.stdout:7/120: unlink d2/f1f 0 2024-09-12T01:43:05.039 INFO:tasks.workunit.client.0.smithi066.stdout:6/275: dwrite d2/d31/f39 [0,4194304] 0 2024-09-12T01:43:05.039 INFO:tasks.workunit.client.0.smithi066.stdout:5/122: write d0/d21/d27/f1e [1442075,62970] 0 2024-09-12T01:43:05.039 INFO:tasks.workunit.client.0.smithi066.stdout:5/123: chown d0/f2 465219026 1 2024-09-12T01:43:05.039 INFO:tasks.workunit.client.0.smithi066.stdout:6/276: creat d2/f5f x:0 0 0 2024-09-12T01:43:05.041 INFO:tasks.workunit.client.1.smithi153.stdout:1/558: rmdir d2/d9/d28/d73/d76/da9 0 2024-09-12T01:43:05.045 INFO:tasks.workunit.client.0.smithi066.stdout:3/185: mknod d5/d6/c38 0 2024-09-12T01:43:05.049 INFO:tasks.workunit.client.0.smithi066.stdout:0/206: dread d1/dc/de/f3a [0,4194304] 0 2024-09-12T01:43:05.049 INFO:tasks.workunit.client.0.smithi066.stdout:0/207: write d1/dc/de/f2a [551253,30806] 0 2024-09-12T01:43:05.052 INFO:tasks.workunit.client.1.smithi153.stdout:8/506: truncate d17/f1b 3932038 0 2024-09-12T01:43:05.056 INFO:tasks.workunit.client.1.smithi153.stdout:2/464: mknod d7/d4d/d7b/c93 0 2024-09-12T01:43:05.057 INFO:tasks.workunit.client.1.smithi153.stdout:6/553: dwrite d1/d6/da/d19/d3a/f4d [0,4194304] 0 2024-09-12T01:43:05.057 INFO:tasks.workunit.client.0.smithi066.stdout:5/124: creat d0/d21/d27/f28 x:0 0 0 2024-09-12T01:43:05.057 INFO:tasks.workunit.client.0.smithi066.stdout:5/125: truncate d0/dd/f13 459195 0 2024-09-12T01:43:05.061 INFO:tasks.workunit.client.1.smithi153.stdout:8/507: mkdir d17/d1f/d4f/d42/d79/dac 0 2024-09-12T01:43:05.061 INFO:tasks.workunit.client.1.smithi153.stdout:8/508: readlink d17/d1d/d27/l61 0 2024-09-12T01:43:05.063 INFO:tasks.workunit.client.1.smithi153.stdout:3/558: rename d1/d16/d1c/d32 to d1/d13/d25/da6 0 2024-09-12T01:43:05.065 INFO:tasks.workunit.client.0.smithi066.stdout:0/208: creat d1/dc/f4f x:0 0 0 2024-09-12T01:43:05.065 INFO:tasks.workunit.client.0.smithi066.stdout:0/209: rename d1 to d1/dc/de/d46/d50 22 2024-09-12T01:43:05.065 INFO:tasks.workunit.client.0.smithi066.stdout:2/197: sync 2024-09-12T01:43:05.065 INFO:tasks.workunit.client.0.smithi066.stdout:2/198: chown de/f26 9212 1 2024-09-12T01:43:05.065 INFO:tasks.workunit.client.0.smithi066.stdout:2/199: stat de/d13/l39 0 2024-09-12T01:43:05.065 INFO:tasks.workunit.client.0.smithi066.stdout:2/200: chown f1 1533851 1 2024-09-12T01:43:05.066 INFO:tasks.workunit.client.1.smithi153.stdout:2/465: mknod d7/d19/d40/c94 0 2024-09-12T01:43:05.066 INFO:tasks.workunit.client.0.smithi066.stdout:9/153: dwrite d0/d5/d9/fa [0,4194304] 0 2024-09-12T01:43:05.067 INFO:tasks.workunit.client.0.smithi066.stdout:5/126: symlink d0/d21/d27/l29 0 2024-09-12T01:43:05.069 INFO:tasks.workunit.client.0.smithi066.stdout:0/210: getdents d1/dc/df/d1b/d26 0 2024-09-12T01:43:05.071 INFO:tasks.workunit.client.0.smithi066.stdout:6/277: dwrite d2/db/f27 [0,4194304] 0 2024-09-12T01:43:05.071 INFO:tasks.workunit.client.0.smithi066.stdout:6/278: write d2/d21/f25 [9389788,108732] 0 2024-09-12T01:43:05.072 INFO:tasks.workunit.client.0.smithi066.stdout:7/121: dwrite d2/d5/da/f11 [4194304,4194304] 0 2024-09-12T01:43:05.072 INFO:tasks.workunit.client.0.smithi066.stdout:3/186: read d5/fb [1718871,71214] 0 2024-09-12T01:43:05.072 INFO:tasks.workunit.client.0.smithi066.stdout:9/154: unlink d0/d5/f14 0 2024-09-12T01:43:05.075 INFO:tasks.workunit.client.1.smithi153.stdout:8/509: write d17/d21/f30 [3950767,33584] 0 2024-09-12T01:43:05.077 INFO:tasks.workunit.client.0.smithi066.stdout:7/122: mkdir d2/d20/d25 0 2024-09-12T01:43:05.078 INFO:tasks.workunit.client.1.smithi153.stdout:1/559: rmdir d2/d34/d3d 39 2024-09-12T01:43:05.078 INFO:tasks.workunit.client.1.smithi153.stdout:1/560: creat d2/d9/fb2 x:0 0 0 2024-09-12T01:43:05.079 INFO:tasks.workunit.client.1.smithi153.stdout:1/561: chown d2/d34/d8a/f94 471074 1 2024-09-12T01:43:05.081 INFO:tasks.workunit.client.1.smithi153.stdout:6/554: dwrite d1/d6/d23/d98/d53/d69/d7c/d7f/f95 [0,4194304] 0 2024-09-12T01:43:05.081 INFO:tasks.workunit.client.1.smithi153.stdout:6/555: write d1/d6/d23/d98/d53/d69/d7c/d7f/f95 [4215393,112365] 0 2024-09-12T01:43:05.082 INFO:tasks.workunit.client.1.smithi153.stdout:3/559: mknod d1/d13/d23/d47/d6c/d9c/ca7 0 2024-09-12T01:43:05.085 INFO:tasks.workunit.client.1.smithi153.stdout:2/466: rename d7/d19/d40/c2b to d7/db/d36/c95 0 2024-09-12T01:43:05.085 INFO:tasks.workunit.client.1.smithi153.stdout:2/467: write d7/db/d1d/f5d [1252031,117365] 0 2024-09-12T01:43:05.087 INFO:tasks.workunit.client.0.smithi066.stdout:7/123: unlink d2/d5/da/c17 0 2024-09-12T01:43:05.087 INFO:tasks.workunit.client.0.smithi066.stdout:7/124: read d2/d5/da/f19 [494981,127908] 0 2024-09-12T01:43:05.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/510: creat d17/fad x:0 0 0 2024-09-12T01:43:05.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/511: stat d17/d75/fab 0 2024-09-12T01:43:05.089 INFO:tasks.workunit.client.0.smithi066.stdout:9/155: mknod d0/d6/c34 0 2024-09-12T01:43:05.089 INFO:tasks.workunit.client.1.smithi153.stdout:8/512: read - d17/d21/d56/d96/d6c/d89/d9c/fa9 zero size 2024-09-12T01:43:05.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/513: write d17/d21/f30 [4703554,103838] 0 2024-09-12T01:43:05.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/514: chown d17/d21/d56/f82 1215231 1 2024-09-12T01:43:05.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/515: write d17/d75/f8d [4492517,50613] 0 2024-09-12T01:43:05.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/516: stat d17/d21/d56/d95 0 2024-09-12T01:43:05.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/187: dread d5/f17 [0,4194304] 0 2024-09-12T01:43:05.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/188: chown d5/d6/d1b/d28/c36 435 1 2024-09-12T01:43:05.092 INFO:tasks.workunit.client.1.smithi153.stdout:1/562: creat d2/d68/d6b/d9e/fb3 x:0 0 0 2024-09-12T01:43:05.092 INFO:tasks.workunit.client.1.smithi153.stdout:1/563: truncate d2/d9/d17/d69/f70 156779 0 2024-09-12T01:43:05.093 INFO:tasks.workunit.client.1.smithi153.stdout:1/564: dread d2/d9/d17/f46 [0,4194304] 0 2024-09-12T01:43:05.093 INFO:tasks.workunit.client.1.smithi153.stdout:1/565: chown d2/d9/d58/d74/c6e 51176385 1 2024-09-12T01:43:05.098 INFO:tasks.workunit.client.0.smithi066.stdout:3/189: link d5/d6/dd/l11 d5/d35/l39 0 2024-09-12T01:43:05.103 INFO:tasks.workunit.client.1.smithi153.stdout:3/560: unlink d1/d16/f7c 0 2024-09-12T01:43:05.106 INFO:tasks.workunit.client.0.smithi066.stdout:0/211: dwrite d1/dc/f4f [0,4194304] 0 2024-09-12T01:43:05.106 INFO:tasks.workunit.client.1.smithi153.stdout:2/468: rename d7/f11 to d7/db/d6c/d76/f96 0 2024-09-12T01:43:05.106 INFO:tasks.workunit.client.0.smithi066.stdout:5/127: dwrite d0/f20 [0,4194304] 0 2024-09-12T01:43:05.107 INFO:tasks.workunit.client.1.smithi153.stdout:6/556: dwrite d1/df/fa7 [0,4194304] 0 2024-09-12T01:43:05.108 INFO:tasks.workunit.client.1.smithi153.stdout:8/517: mknod d17/d21/cae 0 2024-09-12T01:43:05.109 INFO:tasks.workunit.client.1.smithi153.stdout:3/561: dread d1/f11 [0,4194304] 0 2024-09-12T01:43:05.112 INFO:tasks.workunit.client.0.smithi066.stdout:9/156: write d0/d5/d9/fa [3690716,21998] 0 2024-09-12T01:43:05.114 INFO:tasks.workunit.client.1.smithi153.stdout:1/566: dread d2/d9/d17/f48 [0,4194304] 0 2024-09-12T01:43:05.114 INFO:tasks.workunit.client.1.smithi153.stdout:1/567: read - d2/d34/d8a/f94 zero size 2024-09-12T01:43:05.116 INFO:tasks.workunit.client.0.smithi066.stdout:0/212: dread d1/dc/de/f4b [0,4194304] 0 2024-09-12T01:43:05.117 INFO:tasks.workunit.client.1.smithi153.stdout:5/517: sync 2024-09-12T01:43:05.117 INFO:tasks.workunit.client.1.smithi153.stdout:5/518: write d0/f32 [5094964,10083] 0 2024-09-12T01:43:05.117 INFO:tasks.workunit.client.1.smithi153.stdout:5/519: creat d0/df/d1c/d22/d2f/fa9 x:0 0 0 2024-09-12T01:43:05.117 INFO:tasks.workunit.client.1.smithi153.stdout:9/527: sync 2024-09-12T01:43:05.117 INFO:tasks.workunit.client.1.smithi153.stdout:9/528: chown d3/d5f/d62/f64 4 1 2024-09-12T01:43:05.117 INFO:tasks.workunit.client.1.smithi153.stdout:9/529: chown d3/f5 636203 1 2024-09-12T01:43:05.118 INFO:tasks.workunit.client.1.smithi153.stdout:9/530: stat d3/d55/d30/l6c 0 2024-09-12T01:43:05.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/125: chown d2/d5/f23 13716700 1 2024-09-12T01:43:05.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/126: chown d2/d20/d25 47882344 1 2024-09-12T01:43:05.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/127: read d2/d5/da/f19 [145285,18962] 0 2024-09-12T01:43:05.119 INFO:tasks.workunit.client.1.smithi153.stdout:7/454: sync 2024-09-12T01:43:05.119 INFO:tasks.workunit.client.1.smithi153.stdout:6/557: dread d1/d6/d39/d76/f42 [0,4194304] 0 2024-09-12T01:43:05.119 INFO:tasks.workunit.client.1.smithi153.stdout:4/448: sync 2024-09-12T01:43:05.119 INFO:tasks.workunit.client.1.smithi153.stdout:0/561: sync 2024-09-12T01:43:05.119 INFO:tasks.workunit.client.1.smithi153.stdout:4/449: stat d6/d9/dc/c1a 0 2024-09-12T01:43:05.119 INFO:tasks.workunit.client.1.smithi153.stdout:0/562: dread - d22/d30/d4c/f81 zero size 2024-09-12T01:43:05.121 INFO:tasks.workunit.client.1.smithi153.stdout:2/469: dread d7/db/d1d/f60 [0,4194304] 0 2024-09-12T01:43:05.126 INFO:tasks.workunit.client.1.smithi153.stdout:1/568: dread d2/d9/f1b [0,4194304] 0 2024-09-12T01:43:05.128 INFO:tasks.workunit.client.0.smithi066.stdout:3/190: symlink d5/d6/d1b/d28/l3a 0 2024-09-12T01:43:05.128 INFO:tasks.workunit.client.0.smithi066.stdout:7/128: dread d2/d5/f23 [0,4194304] 0 2024-09-12T01:43:05.130 INFO:tasks.workunit.client.1.smithi153.stdout:0/563: dread d22/f3e [4194304,4194304] 0 2024-09-12T01:43:05.130 INFO:tasks.workunit.client.0.smithi066.stdout:9/157: truncate d0/d6/f20 782946 0 2024-09-12T01:43:05.132 INFO:tasks.workunit.client.1.smithi153.stdout:9/531: mknod d3/d55/d30/d88/c9d 0 2024-09-12T01:43:05.135 INFO:tasks.workunit.client.0.smithi066.stdout:0/213: dwrite d1/dc/df/d1b/d26/f2e [0,4194304] 0 2024-09-12T01:43:05.136 INFO:tasks.workunit.client.1.smithi153.stdout:7/455: creat d12/d7e/f82 x:0 0 0 2024-09-12T01:43:05.137 INFO:tasks.workunit.client.1.smithi153.stdout:7/456: fdatasync f4 0 2024-09-12T01:43:05.137 INFO:tasks.workunit.client.1.smithi153.stdout:7/457: rename d12/d21/d29/d35/d37/d58 to d12/d21/d29/d35/d37/d58/d83 22 2024-09-12T01:43:05.138 INFO:tasks.workunit.client.0.smithi066.stdout:5/128: truncate d0/f20 1961923 0 2024-09-12T01:43:05.139 INFO:tasks.workunit.client.0.smithi066.stdout:5/129: chown d0/d21/d27/f1f 7006 1 2024-09-12T01:43:05.139 INFO:tasks.workunit.client.1.smithi153.stdout:0/564: dread d22/d30/d4c/d6f/f73 [0,4194304] 0 2024-09-12T01:43:05.140 INFO:tasks.workunit.client.0.smithi066.stdout:5/130: dread d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:05.140 INFO:tasks.workunit.client.1.smithi153.stdout:5/520: dwrite d0/df/d1c/d22/d2f/d55/d9c/d75/d58/f94 [0,4194304] 0 2024-09-12T01:43:05.140 INFO:tasks.workunit.client.1.smithi153.stdout:5/521: dread - d0/df/d1c/d22/d2f/f87 zero size 2024-09-12T01:43:05.141 INFO:tasks.workunit.client.0.smithi066.stdout:3/191: rename d5/fb to d5/d6/d1b/d31/f3b 0 2024-09-12T01:43:05.141 INFO:tasks.workunit.client.0.smithi066.stdout:3/192: stat d5/d6/d1b/d31 0 2024-09-12T01:43:05.143 INFO:tasks.workunit.client.1.smithi153.stdout:4/450: mkdir d6/da4 0 2024-09-12T01:43:05.143 INFO:tasks.workunit.client.1.smithi153.stdout:4/451: write d6/d9/dc/d31/d76/d99/f85 [256602,26382] 0 2024-09-12T01:43:05.143 INFO:tasks.workunit.client.1.smithi153.stdout:4/452: chown d6/d9/dc/d31/l3d 81865 1 2024-09-12T01:43:05.145 INFO:tasks.workunit.client.1.smithi153.stdout:8/518: unlink d17/fad 0 2024-09-12T01:43:05.145 INFO:tasks.workunit.client.1.smithi153.stdout:8/519: fsync d17/d1f/d4f/f45 0 2024-09-12T01:43:05.145 INFO:tasks.workunit.client.0.smithi066.stdout:7/129: write d2/d5/f23 [2717328,64355] 0 2024-09-12T01:43:05.146 INFO:tasks.workunit.client.1.smithi153.stdout:2/470: symlink d7/d4d/d70/d81/l97 0 2024-09-12T01:43:05.149 INFO:tasks.workunit.client.1.smithi153.stdout:2/471: dread d7/db/d27/d56/f5b [0,4194304] 0 2024-09-12T01:43:05.149 INFO:tasks.workunit.client.1.smithi153.stdout:2/472: chown d7/db/d1d/f28 3 1 2024-09-12T01:43:05.149 INFO:tasks.workunit.client.0.smithi066.stdout:0/214: rename d1/dc/df/c15 to d1/dc/de/c51 0 2024-09-12T01:43:05.149 INFO:tasks.workunit.client.0.smithi066.stdout:0/215: fdatasync d1/dc/de/f19 0 2024-09-12T01:43:05.150 INFO:tasks.workunit.client.1.smithi153.stdout:1/569: mknod d2/cb4 0 2024-09-12T01:43:05.151 INFO:tasks.workunit.client.0.smithi066.stdout:3/193: getdents d5/d35 0 2024-09-12T01:43:05.152 INFO:tasks.workunit.client.1.smithi153.stdout:9/532: stat d3/lb 0 2024-09-12T01:43:05.152 INFO:tasks.workunit.client.1.smithi153.stdout:9/533: chown d3/d66/l67 0 1 2024-09-12T01:43:05.152 INFO:tasks.workunit.client.1.smithi153.stdout:8/520: dread d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:05.152 INFO:tasks.workunit.client.0.smithi066.stdout:9/158: symlink d0/d5/d12/l35 0 2024-09-12T01:43:05.153 INFO:tasks.workunit.client.1.smithi153.stdout:7/458: truncate d12/f1b 2120279 0 2024-09-12T01:43:05.154 INFO:tasks.workunit.client.1.smithi153.stdout:0/565: mknod d22/d82/cbf 0 2024-09-12T01:43:05.154 INFO:tasks.workunit.client.1.smithi153.stdout:0/566: fdatasync d22/f5f 0 2024-09-12T01:43:05.156 INFO:tasks.workunit.client.0.smithi066.stdout:0/216: link d1/dc/de/f1d d1/dc/df/f52 0 2024-09-12T01:43:05.156 INFO:tasks.workunit.client.0.smithi066.stdout:0/217: chown d1/dc/df/d1b/d26/f2e 26518 1 2024-09-12T01:43:05.158 INFO:tasks.workunit.client.1.smithi153.stdout:2/473: read d7/db/d62/f72 [1820512,90277] 0 2024-09-12T01:43:05.158 INFO:tasks.workunit.client.1.smithi153.stdout:2/474: chown d7/db/d1d/f35 892964 1 2024-09-12T01:43:05.158 INFO:tasks.workunit.client.1.smithi153.stdout:2/475: chown d7/db/d27/f73 1313 1 2024-09-12T01:43:05.159 INFO:tasks.workunit.client.0.smithi066.stdout:3/194: mkdir d5/d6/d1b/d31/d3c 0 2024-09-12T01:43:05.160 INFO:tasks.workunit.client.1.smithi153.stdout:5/522: getdents d0/df/d1c 0 2024-09-12T01:43:05.161 INFO:tasks.workunit.client.1.smithi153.stdout:4/453: getdents d6/d6a/d9c 0 2024-09-12T01:43:05.162 INFO:tasks.workunit.client.0.smithi066.stdout:7/130: creat d2/d5/d6/f26 x:0 0 0 2024-09-12T01:43:05.163 INFO:tasks.workunit.client.1.smithi153.stdout:1/570: dread d2/d9/d17/d2c/f93 [0,4194304] 0 2024-09-12T01:43:05.164 INFO:tasks.workunit.client.1.smithi153.stdout:9/534: symlink d3/d35/l9e 0 2024-09-12T01:43:05.164 INFO:tasks.workunit.client.1.smithi153.stdout:9/535: readlink d3/d55/d30/d95/d84/l92 0 2024-09-12T01:43:05.164 INFO:tasks.workunit.client.1.smithi153.stdout:9/536: creat d3/d55/d30/f9f x:0 0 0 2024-09-12T01:43:05.165 INFO:tasks.workunit.client.0.smithi066.stdout:5/131: rename d0/l16 to d0/dd/d18/l2a 0 2024-09-12T01:43:05.166 INFO:tasks.workunit.client.0.smithi066.stdout:5/132: readlink d0/l1 0 2024-09-12T01:43:05.167 INFO:tasks.workunit.client.0.smithi066.stdout:0/218: mknod d1/c53 0 2024-09-12T01:43:05.169 INFO:tasks.workunit.client.0.smithi066.stdout:3/195: link d5/d6/c15 d5/d35/c3d 0 2024-09-12T01:43:05.170 INFO:tasks.workunit.client.1.smithi153.stdout:7/459: mkdir d12/d21/d29/d84 0 2024-09-12T01:43:05.174 INFO:tasks.workunit.client.1.smithi153.stdout:0/567: unlink d22/d30/d4c/d6e/f35 0 2024-09-12T01:43:05.175 INFO:tasks.workunit.client.1.smithi153.stdout:8/521: read f15 [34818,37379] 0 2024-09-12T01:43:05.176 INFO:tasks.workunit.client.1.smithi153.stdout:2/476: symlink d7/db/d6c/l98 0 2024-09-12T01:43:05.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/571: dread d2/d9/d17/f48 [4194304,4194304] 0 2024-09-12T01:43:05.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/572: creat d2/d9/fb5 x:0 0 0 2024-09-12T01:43:05.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/573: chown d2/d9/c26 2311 1 2024-09-12T01:43:05.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/574: truncate d2/d9/d17/d69/d95/fa1 730352 0 2024-09-12T01:43:05.176 INFO:tasks.workunit.client.1.smithi153.stdout:1/575: fdatasync d2/d9/f1a 0 2024-09-12T01:43:05.177 INFO:tasks.workunit.client.1.smithi153.stdout:4/454: rmdir d6/d9/d11/d13 39 2024-09-12T01:43:05.178 INFO:tasks.workunit.client.1.smithi153.stdout:5/523: dwrite d0/df/d1c/d22/f77 [0,4194304] 0 2024-09-12T01:43:05.182 INFO:tasks.workunit.client.0.smithi066.stdout:7/131: symlink d2/d5/d6/d22/l27 0 2024-09-12T01:43:05.183 INFO:tasks.workunit.client.1.smithi153.stdout:9/537: mkdir d3/d3a/d42/d72/d98/d9a/da0 0 2024-09-12T01:43:05.184 INFO:tasks.workunit.client.0.smithi066.stdout:5/133: symlink d0/d26/l2b 0 2024-09-12T01:43:05.184 INFO:tasks.workunit.client.0.smithi066.stdout:5/134: dread - d0/dd/fe zero size 2024-09-12T01:43:05.186 INFO:tasks.workunit.client.1.smithi153.stdout:0/568: creat d22/d79/d8e/dae/fc0 x:0 0 0 2024-09-12T01:43:05.188 INFO:tasks.workunit.client.0.smithi066.stdout:0/219: truncate d1/dc/df/f52 316330 0 2024-09-12T01:43:05.189 INFO:tasks.workunit.client.1.smithi153.stdout:5/524: dread d0/df/f27 [0,4194304] 0 2024-09-12T01:43:05.189 INFO:tasks.workunit.client.1.smithi153.stdout:2/477: creat d7/f99 x:0 0 0 2024-09-12T01:43:05.192 INFO:tasks.workunit.client.0.smithi066.stdout:9/159: link d0/d6/f10 d0/d5/f36 0 2024-09-12T01:43:05.192 INFO:tasks.workunit.client.0.smithi066.stdout:9/160: write d0/d5/d12/f27 [825669,98969] 0 2024-09-12T01:43:05.194 INFO:tasks.workunit.client.1.smithi153.stdout:1/576: link d2/d9/d17/f48 d2/d9/d17/d2f/fb6 0 2024-09-12T01:43:05.195 INFO:tasks.workunit.client.0.smithi066.stdout:0/220: rename d1/c5 to d1/dc/df/c54 0 2024-09-12T01:43:05.196 INFO:tasks.workunit.client.0.smithi066.stdout:3/196: mknod d5/c3e 0 2024-09-12T01:43:05.197 INFO:tasks.workunit.client.1.smithi153.stdout:9/538: mknod d3/d55/d30/d88/ca1 0 2024-09-12T01:43:05.198 INFO:tasks.workunit.client.1.smithi153.stdout:9/539: stat d3/d55/d30/d7b/f89 0 2024-09-12T01:43:05.198 INFO:tasks.workunit.client.1.smithi153.stdout:7/460: dwrite d12/d21/f6b [0,4194304] 0 2024-09-12T01:43:05.198 INFO:tasks.workunit.client.1.smithi153.stdout:0/569: readlink d22/d30/d4c/d6e/l43 0 2024-09-12T01:43:05.199 INFO:tasks.workunit.client.0.smithi066.stdout:3/197: creat d5/d6/d1b/f3f x:0 0 0 2024-09-12T01:43:05.200 INFO:tasks.workunit.client.1.smithi153.stdout:2/478: creat d7/db/d27/d56/f9a x:0 0 0 2024-09-12T01:43:05.201 INFO:tasks.workunit.client.1.smithi153.stdout:2/479: write d7/db/d36/f42 [5209932,119402] 0 2024-09-12T01:43:05.201 INFO:tasks.workunit.client.0.smithi066.stdout:7/132: write d2/d5/da/f11 [6810451,20047] 0 2024-09-12T01:43:05.201 INFO:tasks.workunit.client.0.smithi066.stdout:9/161: mkdir d0/d6/d37 0 2024-09-12T01:43:05.202 INFO:tasks.workunit.client.1.smithi153.stdout:1/577: link d2/d9/d17/d69/d95/fa1 d2/d9/d28/d73/fb7 0 2024-09-12T01:43:05.203 INFO:tasks.workunit.client.0.smithi066.stdout:5/135: link d0/dd/d18/c1d d0/dd/d18/c2c 0 2024-09-12T01:43:05.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/480: dread d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:05.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/481: creat d7/f9b x:0 0 0 2024-09-12T01:43:05.204 INFO:tasks.workunit.client.1.smithi153.stdout:9/540: creat d3/d3a/d42/fa2 x:0 0 0 2024-09-12T01:43:05.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/198: mkdir d5/d6/d40 0 2024-09-12T01:43:05.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/199: dread - d5/d6/f29 zero size 2024-09-12T01:43:05.209 INFO:tasks.workunit.client.0.smithi066.stdout:0/221: read d1/dc/df/d20/f21 [1535255,16944] 0 2024-09-12T01:43:05.210 INFO:tasks.workunit.client.0.smithi066.stdout:5/136: mkdir d0/d26/d2d 0 2024-09-12T01:43:05.211 INFO:tasks.workunit.client.1.smithi153.stdout:0/570: stat d22/d30/c6d 0 2024-09-12T01:43:05.211 INFO:tasks.workunit.client.1.smithi153.stdout:4/455: dwrite d6/d9/f10 [4194304,4194304] 0 2024-09-12T01:43:05.211 INFO:tasks.workunit.client.1.smithi153.stdout:8/522: dwrite d17/d21/d56/d96/d6c/d6e/d7f/fa3 [0,4194304] 0 2024-09-12T01:43:05.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/523: creat d17/d21/faf x:0 0 0 2024-09-12T01:43:05.212 INFO:tasks.workunit.client.0.smithi066.stdout:3/200: mknod d5/d6/c41 0 2024-09-12T01:43:05.212 INFO:tasks.workunit.client.1.smithi153.stdout:0/571: write d22/d30/d4c/d6e/f3f [594102,32456] 0 2024-09-12T01:43:05.216 INFO:tasks.workunit.client.0.smithi066.stdout:3/201: rmdir d5/d6/d1b/d31/d3c 0 2024-09-12T01:43:05.218 INFO:tasks.workunit.client.1.smithi153.stdout:9/541: symlink d3/d3a/d42/d72/d98/la3 0 2024-09-12T01:43:05.219 INFO:tasks.workunit.client.0.smithi066.stdout:3/202: symlink d5/d6/d1b/d31/l42 0 2024-09-12T01:43:05.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/461: rmdir d12/d7e 39 2024-09-12T01:43:05.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/462: write f7 [9395232,21001] 0 2024-09-12T01:43:05.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/463: fsync d12/d7e/f72 0 2024-09-12T01:43:05.221 INFO:tasks.workunit.client.1.smithi153.stdout:7/464: dread - d12/d21/d29/d35/d37/d4c/d5c/f7f zero size 2024-09-12T01:43:05.224 INFO:tasks.workunit.client.0.smithi066.stdout:5/137: write d0/f17 [1586673,45684] 0 2024-09-12T01:43:05.227 INFO:tasks.workunit.client.0.smithi066.stdout:3/203: write d5/d6/dd/f14 [232560,47747] 0 2024-09-12T01:43:05.227 INFO:tasks.workunit.client.0.smithi066.stdout:3/204: write d5/d6/d1b/f3f [172790,45058] 0 2024-09-12T01:43:05.227 INFO:tasks.workunit.client.0.smithi066.stdout:3/205: write d5/d6/d1b/f27 [339692,19313] 0 2024-09-12T01:43:05.227 INFO:tasks.workunit.client.0.smithi066.stdout:3/206: getdents d5/d6/dd 0 2024-09-12T01:43:05.231 INFO:tasks.workunit.client.0.smithi066.stdout:5/138: rename d0/d21/f24 to d0/d26/f2e 0 2024-09-12T01:43:05.233 INFO:tasks.workunit.client.0.smithi066.stdout:3/207: symlink d5/d35/l43 0 2024-09-12T01:43:05.235 INFO:tasks.workunit.client.0.smithi066.stdout:9/162: rmdir d0/d6 39 2024-09-12T01:43:05.236 INFO:tasks.workunit.client.0.smithi066.stdout:5/139: unlink d0/dd/d18/c2c 0 2024-09-12T01:43:05.238 INFO:tasks.workunit.client.1.smithi153.stdout:8/524: fsync d17/d1f/d4f/d34/f5f 0 2024-09-12T01:43:05.240 INFO:tasks.workunit.client.0.smithi066.stdout:9/163: dread d0/d6/d17/d1b/f1c [0,4194304] 0 2024-09-12T01:43:05.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/572: creat d22/d30/d4c/d6e/d7f/d98/fc1 x:0 0 0 2024-09-12T01:43:05.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/573: write d22/f7a [624137,52386] 0 2024-09-12T01:43:05.242 INFO:tasks.workunit.client.1.smithi153.stdout:0/574: truncate d22/f24 4527574 0 2024-09-12T01:43:05.243 INFO:tasks.workunit.client.0.smithi066.stdout:9/164: symlink d0/d5/d12/l38 0 2024-09-12T01:43:05.245 INFO:tasks.workunit.client.1.smithi153.stdout:2/482: rmdir d7/d4d/d70 39 2024-09-12T01:43:05.246 INFO:tasks.workunit.client.1.smithi153.stdout:7/465: mknod d12/d21/d29/d35/d37/d4c/c85 0 2024-09-12T01:43:05.246 INFO:tasks.workunit.client.1.smithi153.stdout:7/466: creat d12/d4e/f86 x:0 0 0 2024-09-12T01:43:05.246 INFO:tasks.workunit.client.1.smithi153.stdout:7/467: truncate d12/d21/d29/d2d/f55 1474759 0 2024-09-12T01:43:05.247 INFO:tasks.workunit.client.1.smithi153.stdout:8/525: symlink d17/d21/d56/d96/d6c/d6e/lb0 0 2024-09-12T01:43:05.250 INFO:tasks.workunit.client.0.smithi066.stdout:9/165: rename d0/d5/f19 to d0/d5/d9/de/f39 0 2024-09-12T01:43:05.251 INFO:tasks.workunit.client.1.smithi153.stdout:2/483: link d7/db/c2c d7/d19/d83/c9c 0 2024-09-12T01:43:05.251 INFO:tasks.workunit.client.0.smithi066.stdout:7/133: dwrite d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:05.253 INFO:tasks.workunit.client.1.smithi153.stdout:7/468: symlink d12/d21/l87 0 2024-09-12T01:43:05.254 INFO:tasks.workunit.client.1.smithi153.stdout:7/469: truncate d12/d21/d29/d35/d37/f6c 659920 0 2024-09-12T01:43:05.255 INFO:tasks.workunit.client.0.smithi066.stdout:3/208: dwrite f2 [4194304,4194304] 0 2024-09-12T01:43:05.255 INFO:tasks.workunit.client.0.smithi066.stdout:0/222: dwrite d1/dc/df/d1b/f33 [0,4194304] 0 2024-09-12T01:43:05.256 INFO:tasks.workunit.client.1.smithi153.stdout:9/542: dwrite d3/d55/d30/f9f [0,4194304] 0 2024-09-12T01:43:05.256 INFO:tasks.workunit.client.1.smithi153.stdout:9/543: write d3/d55/f57 [4079674,90808] 0 2024-09-12T01:43:05.256 INFO:tasks.workunit.client.1.smithi153.stdout:4/456: dwrite d6/d9/dc/d98/f7e [0,4194304] 0 2024-09-12T01:43:05.257 INFO:tasks.workunit.client.1.smithi153.stdout:8/526: truncate d17/d21/d56/d96/d6c/f80 241993 0 2024-09-12T01:43:05.258 INFO:tasks.workunit.client.0.smithi066.stdout:3/209: dread d5/d6/dd/f1c [0,4194304] 0 2024-09-12T01:43:05.260 INFO:tasks.workunit.client.1.smithi153.stdout:1/578: getdents d2/d9 0 2024-09-12T01:43:05.262 INFO:tasks.workunit.client.1.smithi153.stdout:0/575: rename d22/d30/d4c/d6f/l78 to d22/d30/lc2 0 2024-09-12T01:43:05.262 INFO:tasks.workunit.client.1.smithi153.stdout:0/576: write f20 [3601852,62997] 0 2024-09-12T01:43:05.262 INFO:tasks.workunit.client.1.smithi153.stdout:0/577: creat d22/d30/d4c/d6f/d88/fc3 x:0 0 0 2024-09-12T01:43:05.262 INFO:tasks.workunit.client.1.smithi153.stdout:0/578: readlink d22/d30/d4c/d6e/l49 0 2024-09-12T01:43:05.263 INFO:tasks.workunit.client.1.smithi153.stdout:0/579: creat d22/d79/d8e/fc4 x:0 0 0 2024-09-12T01:43:05.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/140: dread d0/d21/d27/f1e [0,4194304] 0 2024-09-12T01:43:05.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/141: fsync d0/dd/fe 0 2024-09-12T01:43:05.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/142: write d0/d21/d27/f10 [958472,74327] 0 2024-09-12T01:43:05.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/143: chown d0/dd/l1b 3457 1 2024-09-12T01:43:05.265 INFO:tasks.workunit.client.0.smithi066.stdout:5/144: fdatasync d0/dd/fe 0 2024-09-12T01:43:05.266 INFO:tasks.workunit.client.0.smithi066.stdout:0/223: write d1/dc/de/f2a [170270,49094] 0 2024-09-12T01:43:05.271 INFO:tasks.workunit.client.1.smithi153.stdout:0/580: dread fa [0,4194304] 0 2024-09-12T01:43:05.271 INFO:tasks.workunit.client.1.smithi153.stdout:0/581: chown d22/d30/d4c/d6f/d88/c8d 2065431 1 2024-09-12T01:43:05.279 INFO:tasks.workunit.client.0.smithi066.stdout:7/134: stat d2/c18 0 2024-09-12T01:43:05.281 INFO:tasks.workunit.client.1.smithi153.stdout:4/457: creat d6/da4/fa5 x:0 0 0 2024-09-12T01:43:05.282 INFO:tasks.workunit.client.0.smithi066.stdout:9/166: symlink d0/d6/l3a 0 2024-09-12T01:43:05.283 INFO:tasks.workunit.client.1.smithi153.stdout:8/527: symlink d17/d21/d56/d96/d6c/d6e/d7f/lb1 0 2024-09-12T01:43:05.283 INFO:tasks.workunit.client.1.smithi153.stdout:8/528: dread - d17/f85 zero size 2024-09-12T01:43:05.283 INFO:tasks.workunit.client.1.smithi153.stdout:8/529: readlink d17/d1d/d27/l33 0 2024-09-12T01:43:05.286 INFO:tasks.workunit.client.0.smithi066.stdout:7/135: dread d2/d5/f23 [0,4194304] 0 2024-09-12T01:43:05.287 INFO:tasks.workunit.client.1.smithi153.stdout:0/582: stat d22/d30/l71 0 2024-09-12T01:43:05.288 INFO:tasks.workunit.client.0.smithi066.stdout:3/210: creat d5/f44 x:0 0 0 2024-09-12T01:43:05.289 INFO:tasks.workunit.client.0.smithi066.stdout:3/211: write f4 [1830273,35208] 0 2024-09-12T01:43:05.289 INFO:tasks.workunit.client.0.smithi066.stdout:3/212: readlink d5/d35/l39 0 2024-09-12T01:43:05.289 INFO:tasks.workunit.client.0.smithi066.stdout:2/201: sync 2024-09-12T01:43:05.289 INFO:tasks.workunit.client.0.smithi066.stdout:8/217: sync 2024-09-12T01:43:05.289 INFO:tasks.workunit.client.0.smithi066.stdout:8/218: write d12/f3d [747879,53595] 0 2024-09-12T01:43:05.289 INFO:tasks.workunit.client.0.smithi066.stdout:4/142: sync 2024-09-12T01:43:05.290 INFO:tasks.workunit.client.0.smithi066.stdout:5/145: mkdir d0/d26/d2f 0 2024-09-12T01:43:05.291 INFO:tasks.workunit.client.1.smithi153.stdout:9/544: dwrite d3/d35/f79 [0,4194304] 0 2024-09-12T01:43:05.292 INFO:tasks.workunit.client.0.smithi066.stdout:9/167: symlink d0/d6/d17/d1b/l3b 0 2024-09-12T01:43:05.294 INFO:tasks.workunit.client.0.smithi066.stdout:3/213: mkdir d5/d6/d1b/d45 0 2024-09-12T01:43:05.295 INFO:tasks.workunit.client.1.smithi153.stdout:0/583: symlink d22/d30/d4c/d6e/lc5 0 2024-09-12T01:43:05.295 INFO:tasks.workunit.client.1.smithi153.stdout:0/584: dread - d22/f9e zero size 2024-09-12T01:43:05.296 INFO:tasks.workunit.client.0.smithi066.stdout:2/202: mkdir de/d49 0 2024-09-12T01:43:05.296 INFO:tasks.workunit.client.0.smithi066.stdout:2/203: write de/d13/d1e/d25/f32 [749403,127992] 0 2024-09-12T01:43:05.296 INFO:tasks.workunit.client.0.smithi066.stdout:2/204: write de/d13/d28/d3d/f3f [72906,46659] 0 2024-09-12T01:43:05.297 INFO:tasks.workunit.client.1.smithi153.stdout:2/484: dwrite d7/db/d27/f29 [0,4194304] 0 2024-09-12T01:43:05.297 INFO:tasks.workunit.client.0.smithi066.stdout:8/219: mknod d12/d21/c42 0 2024-09-12T01:43:05.298 INFO:tasks.workunit.client.1.smithi153.stdout:9/545: creat d3/d5f/d62/fa4 x:0 0 0 2024-09-12T01:43:05.299 INFO:tasks.workunit.client.1.smithi153.stdout:0/585: mkdir d22/d79/d8e/dc6 0 2024-09-12T01:43:05.300 INFO:tasks.workunit.client.0.smithi066.stdout:3/214: truncate d5/fa 253650 0 2024-09-12T01:43:05.301 INFO:tasks.workunit.client.0.smithi066.stdout:2/205: creat de/d3c/f4a x:0 0 0 2024-09-12T01:43:05.302 INFO:tasks.workunit.client.0.smithi066.stdout:3/215: creat d5/d6/d1b/d28/f46 x:0 0 0 2024-09-12T01:43:05.305 INFO:tasks.workunit.client.0.smithi066.stdout:9/168: dread d0/d5/dc/f2b [0,4194304] 0 2024-09-12T01:43:05.305 INFO:tasks.workunit.client.0.smithi066.stdout:2/206: symlink de/d13/d1e/d22/l4b 0 2024-09-12T01:43:05.323 INFO:tasks.workunit.client.1.smithi153.stdout:0/586: write d22/f68 [1623548,16362] 0 2024-09-12T01:43:05.323 INFO:tasks.workunit.client.1.smithi153.stdout:0/587: chown d22/d82/cbf 118 1 2024-09-12T01:43:05.323 INFO:tasks.workunit.client.1.smithi153.stdout:0/588: write d22/d30/d4c/d6e/d7f/d98/fc1 [380179,33509] 0 2024-09-12T01:43:05.324 INFO:tasks.workunit.client.1.smithi153.stdout:4/458: dwrite d6/d9/dc/d98/f7e [0,4194304] 0 2024-09-12T01:43:05.324 INFO:tasks.workunit.client.1.smithi153.stdout:0/589: creat d22/d79/d8e/dae/db7/fc7 x:0 0 0 2024-09-12T01:43:05.325 INFO:tasks.workunit.client.1.smithi153.stdout:4/459: mknod d6/d9/d11/d13/ca6 0 2024-09-12T01:43:05.326 INFO:tasks.workunit.client.1.smithi153.stdout:4/460: truncate d6/d9/dc/d31/f9a 875113 0 2024-09-12T01:43:05.326 INFO:tasks.workunit.client.1.smithi153.stdout:0/590: creat d22/d30/d4c/d6e/d7f/dbd/fc8 x:0 0 0 2024-09-12T01:43:05.326 INFO:tasks.workunit.client.1.smithi153.stdout:0/591: creat d22/d79/d8e/dae/db7/fc9 x:0 0 0 2024-09-12T01:43:05.327 INFO:tasks.workunit.client.1.smithi153.stdout:4/461: symlink d6/d9/d20/la7 0 2024-09-12T01:43:05.327 INFO:tasks.workunit.client.1.smithi153.stdout:4/462: read - d6/f8b zero size 2024-09-12T01:43:05.327 INFO:tasks.workunit.client.1.smithi153.stdout:0/592: mkdir d22/d79/dca 0 2024-09-12T01:43:05.328 INFO:tasks.workunit.client.1.smithi153.stdout:4/463: symlink d6/d9/dc/d98/d3e/la8 0 2024-09-12T01:43:05.328 INFO:tasks.workunit.client.1.smithi153.stdout:4/464: creat d6/d9/dc/d31/fa9 x:0 0 0 2024-09-12T01:43:05.329 INFO:tasks.workunit.client.1.smithi153.stdout:4/465: symlink d6/d9/dc/d31/d76/laa 0 2024-09-12T01:43:05.343 INFO:tasks.workunit.client.1.smithi153.stdout:1/579: dwrite d2/d9/f1a [0,4194304] 0 2024-09-12T01:43:05.344 INFO:tasks.workunit.client.1.smithi153.stdout:1/580: getdents d2/d9/d17/d69 0 2024-09-12T01:43:05.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/224: dwrite d1/dc/df/d1b/d26/f2e [4194304,4194304] 0 2024-09-12T01:43:05.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/225: readlink d1/l11 0 2024-09-12T01:43:05.345 INFO:tasks.workunit.client.1.smithi153.stdout:7/470: dwrite d12/d21/d29/d35/d37/f6c [0,4194304] 0 2024-09-12T01:43:05.346 INFO:tasks.workunit.client.1.smithi153.stdout:1/581: mkdir d2/d9/d17/d2f/d56/d71/db8 0 2024-09-12T01:43:05.349 INFO:tasks.workunit.client.0.smithi066.stdout:8/220: dread d12/f3d [0,4194304] 0 2024-09-12T01:43:05.351 INFO:tasks.workunit.client.1.smithi153.stdout:0/593: write d22/f3c [3709013,69005] 0 2024-09-12T01:43:05.351 INFO:tasks.workunit.client.1.smithi153.stdout:0/594: write d22/d30/d4c/d6e/f7b [509468,60058] 0 2024-09-12T01:43:05.353 INFO:tasks.workunit.client.0.smithi066.stdout:8/221: mkdir d12/d26/d43 0 2024-09-12T01:43:05.353 INFO:tasks.workunit.client.0.smithi066.stdout:8/222: creat d12/f44 x:0 0 0 2024-09-12T01:43:05.354 INFO:tasks.workunit.client.0.smithi066.stdout:1/166: sync 2024-09-12T01:43:05.355 INFO:tasks.workunit.client.0.smithi066.stdout:1/167: truncate d5/dc/dd/f23 525731 0 2024-09-12T01:43:05.357 INFO:tasks.workunit.client.1.smithi153.stdout:2/485: dwrite d7/d4d/d70/d81/f8e [0,4194304] 0 2024-09-12T01:43:05.357 INFO:tasks.workunit.client.1.smithi153.stdout:2/486: fdatasync d7/d19/f4b 0 2024-09-12T01:43:05.359 INFO:tasks.workunit.client.0.smithi066.stdout:8/223: creat d12/d21/d2f/f45 x:0 0 0 2024-09-12T01:43:05.362 INFO:tasks.workunit.client.0.smithi066.stdout:7/136: dwrite d2/d5/d6/f26 [0,4194304] 0 2024-09-12T01:43:05.362 INFO:tasks.workunit.client.0.smithi066.stdout:8/224: creat d12/d26/d43/f46 x:0 0 0 2024-09-12T01:43:05.362 INFO:tasks.workunit.client.0.smithi066.stdout:8/225: dread - d12/d26/f3b zero size 2024-09-12T01:43:05.362 INFO:tasks.workunit.client.0.smithi066.stdout:8/226: fsync d12/d26/f3b 0 2024-09-12T01:43:05.362 INFO:tasks.workunit.client.0.smithi066.stdout:8/227: creat d12/f47 x:0 0 0 2024-09-12T01:43:05.362 INFO:tasks.workunit.client.0.smithi066.stdout:4/143: dwrite f3 [4194304,4194304] 0 2024-09-12T01:43:05.363 INFO:tasks.workunit.client.0.smithi066.stdout:6/279: sync 2024-09-12T01:43:05.363 INFO:tasks.workunit.client.0.smithi066.stdout:6/280: read d2/f22 [6063758,115926] 0 2024-09-12T01:43:05.364 INFO:tasks.workunit.client.0.smithi066.stdout:2/207: dwrite de/d13/d28/f38 [0,4194304] 0 2024-09-12T01:43:05.364 INFO:tasks.workunit.client.1.smithi153.stdout:9/546: dwrite d3/d55/d30/d88/f8c [0,4194304] 0 2024-09-12T01:43:05.366 INFO:tasks.workunit.client.1.smithi153.stdout:1/582: symlink d2/d34/d3d/lb9 0 2024-09-12T01:43:05.366 INFO:tasks.workunit.client.1.smithi153.stdout:1/583: write d2/d9/d1d/d25/f4a [5336850,56300] 0 2024-09-12T01:43:05.366 INFO:tasks.workunit.client.0.smithi066.stdout:1/168: dread d5/f14 [0,4194304] 0 2024-09-12T01:43:05.367 INFO:tasks.workunit.client.0.smithi066.stdout:1/169: truncate d5/f14 4489907 0 2024-09-12T01:43:05.367 INFO:tasks.workunit.client.0.smithi066.stdout:7/137: mknod d2/d20/d25/c28 0 2024-09-12T01:43:05.371 INFO:tasks.workunit.client.0.smithi066.stdout:4/144: mknod d4/d15/c2a 0 2024-09-12T01:43:05.371 INFO:tasks.workunit.client.0.smithi066.stdout:4/145: creat d4/f2b x:0 0 0 2024-09-12T01:43:05.371 INFO:tasks.workunit.client.0.smithi066.stdout:4/146: rename d4 to d4/d2c 22 2024-09-12T01:43:05.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/487: rename d7/d4d/d7b/c80 to d7/d4d/d70/d81/c9d 0 2024-09-12T01:43:05.374 INFO:tasks.workunit.client.1.smithi153.stdout:2/488: readlink d7/d19/d40/l38 0 2024-09-12T01:43:05.374 INFO:tasks.workunit.client.0.smithi066.stdout:3/216: dwrite d5/d6/f7 [0,4194304] 0 2024-09-12T01:43:05.375 INFO:tasks.workunit.client.0.smithi066.stdout:6/281: rename d2/db/f27 to d2/db/f60 0 2024-09-12T01:43:05.378 INFO:tasks.workunit.client.0.smithi066.stdout:8/228: dread fb [0,4194304] 0 2024-09-12T01:43:05.378 INFO:tasks.workunit.client.0.smithi066.stdout:8/229: readlink d12/d26/l39 0 2024-09-12T01:43:05.378 INFO:tasks.workunit.client.0.smithi066.stdout:8/230: chown c1 8 1 2024-09-12T01:43:05.378 INFO:tasks.workunit.client.0.smithi066.stdout:8/231: creat d12/d21/d2f/f48 x:0 0 0 2024-09-12T01:43:05.385 INFO:tasks.workunit.client.1.smithi153.stdout:2/489: unlink d7/db/d1d/f60 0 2024-09-12T01:43:05.385 INFO:tasks.workunit.client.1.smithi153.stdout:2/490: creat d7/db/d27/d56/f9e x:0 0 0 2024-09-12T01:43:05.387 INFO:tasks.workunit.client.0.smithi066.stdout:2/208: unlink de/d13/d1e/d22/c46 0 2024-09-12T01:43:05.387 INFO:tasks.workunit.client.0.smithi066.stdout:2/209: read - de/d13/d28/f35 zero size 2024-09-12T01:43:05.387 INFO:tasks.workunit.client.0.smithi066.stdout:7/138: symlink d2/d5/d6/d22/l29 0 2024-09-12T01:43:05.392 INFO:tasks.workunit.client.0.smithi066.stdout:3/217: creat d5/d6/d1b/d31/f47 x:0 0 0 2024-09-12T01:43:05.392 INFO:tasks.workunit.client.0.smithi066.stdout:3/218: chown d5/d35 843 1 2024-09-12T01:43:05.393 INFO:tasks.workunit.client.0.smithi066.stdout:5/146: dwrite d0/d21/d27/f10 [0,4194304] 0 2024-09-12T01:43:05.396 INFO:tasks.workunit.client.0.smithi066.stdout:8/232: mkdir d12/d26/d3c/d49 0 2024-09-12T01:43:05.399 INFO:tasks.workunit.client.1.smithi153.stdout:2/491: mkdir d7/db/d6c/d9f 0 2024-09-12T01:43:05.400 INFO:tasks.workunit.client.0.smithi066.stdout:5/147: mkdir d0/d26/d2f/d30 0 2024-09-12T01:43:05.401 INFO:tasks.workunit.client.0.smithi066.stdout:8/233: truncate d12/d26/d3c/f40 1852010 0 2024-09-12T01:43:05.403 INFO:tasks.workunit.client.1.smithi153.stdout:2/492: rename d7/d17/l2a to d7/db/d1d/d1e/d6d/la0 0 2024-09-12T01:43:05.403 INFO:tasks.workunit.client.0.smithi066.stdout:5/148: mkdir d0/d26/d2d/d31 0 2024-09-12T01:43:05.405 INFO:tasks.workunit.client.0.smithi066.stdout:8/234: symlink d12/d26/l4a 0 2024-09-12T01:43:05.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/493: creat d7/db/d6c/d76/fa1 x:0 0 0 2024-09-12T01:43:05.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/494: fdatasync d7/db/f25 0 2024-09-12T01:43:05.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/495: chown d7/d4d/d70/d81/l97 208 1 2024-09-12T01:43:05.407 INFO:tasks.workunit.client.0.smithi066.stdout:9/169: dwrite d0/d5/dc/f2b [0,4194304] 0 2024-09-12T01:43:05.407 INFO:tasks.workunit.client.0.smithi066.stdout:6/282: write d2/d31/f39 [3010854,70721] 0 2024-09-12T01:43:05.407 INFO:tasks.workunit.client.0.smithi066.stdout:5/149: rmdir d0/d26/d2f 39 2024-09-12T01:43:05.409 INFO:tasks.workunit.client.1.smithi153.stdout:7/471: dwrite d12/f17 [0,4194304] 0 2024-09-12T01:43:05.409 INFO:tasks.workunit.client.1.smithi153.stdout:2/496: truncate d7/d19/d40/f23 2389679 0 2024-09-12T01:43:05.409 INFO:tasks.workunit.client.1.smithi153.stdout:2/497: stat d7/f99 0 2024-09-12T01:43:05.410 INFO:tasks.workunit.client.0.smithi066.stdout:0/226: dwrite d1/f4d [0,4194304] 0 2024-09-12T01:43:05.417 INFO:tasks.workunit.client.0.smithi066.stdout:2/210: dread de/f1d [0,4194304] 0 2024-09-12T01:43:05.417 INFO:tasks.workunit.client.0.smithi066.stdout:2/211: fsync de/d3c/f4a 0 2024-09-12T01:43:05.417 INFO:tasks.workunit.client.1.smithi153.stdout:7/472: rmdir d12/d21/d29/d84 0 2024-09-12T01:43:05.418 INFO:tasks.workunit.client.0.smithi066.stdout:9/170: creat d0/f3c x:0 0 0 2024-09-12T01:43:05.419 INFO:tasks.workunit.client.0.smithi066.stdout:1/170: dwrite d5/dc/f1f [0,4194304] 0 2024-09-12T01:43:05.419 INFO:tasks.workunit.client.1.smithi153.stdout:0/595: dwrite d22/f4b [0,4194304] 0 2024-09-12T01:43:05.421 INFO:tasks.workunit.client.0.smithi066.stdout:5/150: creat d0/d21/f32 x:0 0 0 2024-09-12T01:43:05.421 INFO:tasks.workunit.client.0.smithi066.stdout:5/151: fdatasync d0/d21/f32 0 2024-09-12T01:43:05.422 INFO:tasks.workunit.client.1.smithi153.stdout:7/473: symlink d12/d21/d29/d35/l88 0 2024-09-12T01:43:05.422 INFO:tasks.workunit.client.0.smithi066.stdout:5/152: write d0/dd/f13 [1234731,13351] 0 2024-09-12T01:43:05.430 INFO:tasks.workunit.client.1.smithi153.stdout:0/596: creat d22/d30/fcb x:0 0 0 2024-09-12T01:43:05.431 INFO:tasks.workunit.client.1.smithi153.stdout:1/584: dwrite d2/d9/d17/d2f/d56/f79 [0,4194304] 0 2024-09-12T01:43:05.431 INFO:tasks.workunit.client.0.smithi066.stdout:8/235: dwrite d12/d21/d2f/f48 [0,4194304] 0 2024-09-12T01:43:05.432 INFO:tasks.workunit.client.0.smithi066.stdout:4/147: dwrite d4/d6/f23 [0,4194304] 0 2024-09-12T01:43:05.432 INFO:tasks.workunit.client.0.smithi066.stdout:9/171: mknod d0/d5/dc/c3d 0 2024-09-12T01:43:05.432 INFO:tasks.workunit.client.0.smithi066.stdout:4/148: write d4/d15/f28 [905196,68652] 0 2024-09-12T01:43:05.433 INFO:tasks.workunit.client.1.smithi153.stdout:2/498: dread d7/db/f25 [0,4194304] 0 2024-09-12T01:43:05.433 INFO:tasks.workunit.client.1.smithi153.stdout:9/547: dwrite d3/f24 [0,4194304] 0 2024-09-12T01:43:05.433 INFO:tasks.workunit.client.1.smithi153.stdout:2/499: readlink d7/d4d/d70/d81/l97 0 2024-09-12T01:43:05.433 INFO:tasks.workunit.client.1.smithi153.stdout:2/500: chown d7/d4d/d7b 613 1 2024-09-12T01:43:05.434 INFO:tasks.workunit.client.1.smithi153.stdout:7/474: symlink d12/d21/l89 0 2024-09-12T01:43:05.440 INFO:tasks.workunit.client.0.smithi066.stdout:2/212: write fd [1969717,87961] 0 2024-09-12T01:43:05.440 INFO:tasks.workunit.client.0.smithi066.stdout:2/213: rename de/d13 to de/d13/d28/d3d/d4c 22 2024-09-12T01:43:05.440 INFO:tasks.workunit.client.0.smithi066.stdout:7/139: dwrite d2/d5/da/f19 [0,4194304] 0 2024-09-12T01:43:05.440 INFO:tasks.workunit.client.0.smithi066.stdout:7/140: chown d2/c18 13243 1 2024-09-12T01:43:05.440 INFO:tasks.workunit.client.0.smithi066.stdout:7/141: chown d2/d20/l15 124681 1 2024-09-12T01:43:05.443 INFO:tasks.workunit.client.0.smithi066.stdout:8/236: symlink d12/d26/d43/l4b 0 2024-09-12T01:43:05.443 INFO:tasks.workunit.client.0.smithi066.stdout:8/237: stat d12/d26/d3c 0 2024-09-12T01:43:05.450 INFO:tasks.workunit.client.0.smithi066.stdout:9/172: unlink d0/d5/d9/de/f39 0 2024-09-12T01:43:05.454 INFO:tasks.workunit.client.0.smithi066.stdout:6/283: dwrite d2/db/f60 [0,4194304] 0 2024-09-12T01:43:05.455 INFO:tasks.workunit.client.1.smithi153.stdout:9/548: link d3/f7 d3/d55/d30/d90/fa5 0 2024-09-12T01:43:05.455 INFO:tasks.workunit.client.0.smithi066.stdout:7/142: write d2/d5/d6/f26 [2812086,75598] 0 2024-09-12T01:43:05.455 INFO:tasks.workunit.client.0.smithi066.stdout:7/143: creat d2/d5/d6/f2a x:0 0 0 2024-09-12T01:43:05.455 INFO:tasks.workunit.client.0.smithi066.stdout:9/173: dread d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:05.456 INFO:tasks.workunit.client.1.smithi153.stdout:7/475: mknod d12/d21/d29/d35/d37/d4c/d5c/c8a 0 2024-09-12T01:43:05.456 INFO:tasks.workunit.client.0.smithi066.stdout:9/174: write d0/d6/f13 [450194,48723] 0 2024-09-12T01:43:05.458 INFO:tasks.workunit.client.0.smithi066.stdout:2/214: link fa de/d13/d28/d3a/f4d 0 2024-09-12T01:43:05.459 INFO:tasks.workunit.client.1.smithi153.stdout:7/476: mkdir d12/d21/d29/d2d/d8b 0 2024-09-12T01:43:05.463 INFO:tasks.workunit.client.0.smithi066.stdout:0/227: dwrite d1/fa [4194304,4194304] 0 2024-09-12T01:43:05.463 INFO:tasks.workunit.client.0.smithi066.stdout:0/228: chown d1/dc/df/d1b/d3b/l41 804240 1 2024-09-12T01:43:05.463 INFO:tasks.workunit.client.0.smithi066.stdout:0/229: stat d1/dc/df/d1b/d26/d42 0 2024-09-12T01:43:05.463 INFO:tasks.workunit.client.0.smithi066.stdout:0/230: chown d1/dc/df 16108437 1 2024-09-12T01:43:05.463 INFO:tasks.workunit.client.0.smithi066.stdout:0/231: write d1/dc/de/d47/f4e [635898,12367] 0 2024-09-12T01:43:05.464 INFO:tasks.workunit.client.0.smithi066.stdout:8/238: link d12/d21/c25 d12/d21/d2f/c4c 0 2024-09-12T01:43:05.467 INFO:tasks.workunit.client.0.smithi066.stdout:6/284: truncate d2/db/f2d 1018801 0 2024-09-12T01:43:05.474 INFO:tasks.workunit.client.0.smithi066.stdout:7/144: creat d2/f2b x:0 0 0 2024-09-12T01:43:05.477 INFO:tasks.workunit.client.0.smithi066.stdout:6/285: symlink d2/d31/d5e/l61 0 2024-09-12T01:43:05.479 INFO:tasks.workunit.client.0.smithi066.stdout:6/286: truncate d2/f38 2356651 0 2024-09-12T01:43:05.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/145: rename d2/d20/d25/c28 to d2/c2c 0 2024-09-12T01:43:05.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/146: fdatasync d2/d5/da/f19 0 2024-09-12T01:43:05.483 INFO:tasks.workunit.client.0.smithi066.stdout:7/147: mknod d2/d20/c2d 0 2024-09-12T01:43:05.483 INFO:tasks.workunit.client.0.smithi066.stdout:7/148: chown d2/d20 7198 1 2024-09-12T01:43:05.484 INFO:tasks.workunit.client.0.smithi066.stdout:7/149: symlink d2/d20/d1d/l2e 0 2024-09-12T01:43:05.486 INFO:tasks.workunit.client.0.smithi066.stdout:7/150: mkdir d2/d20/d2f 0 2024-09-12T01:43:05.486 INFO:tasks.workunit.client.0.smithi066.stdout:7/151: chown d2/d5/da/c21 25474477 1 2024-09-12T01:43:05.486 INFO:tasks.workunit.client.0.smithi066.stdout:7/152: fdatasync d2/f2b 0 2024-09-12T01:43:05.487 INFO:tasks.workunit.client.0.smithi066.stdout:7/153: creat d2/d5/d6/d22/f30 x:0 0 0 2024-09-12T01:43:05.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/149: truncate d4/d15/f28 138508 0 2024-09-12T01:43:05.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/150: truncate d4/f17 4782207 0 2024-09-12T01:43:05.498 INFO:tasks.workunit.client.0.smithi066.stdout:4/151: link d4/d15/c24 d4/c2d 0 2024-09-12T01:43:05.499 INFO:tasks.workunit.client.0.smithi066.stdout:4/152: mknod d4/c2e 0 2024-09-12T01:43:05.500 INFO:tasks.workunit.client.0.smithi066.stdout:4/153: mkdir d4/d6/d27/d2f 0 2024-09-12T01:43:05.507 INFO:tasks.workunit.client.0.smithi066.stdout:9/175: dread d0/d5/dc/f2b [0,4194304] 0 2024-09-12T01:43:05.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/176: mknod d0/d5/d9/c3e 0 2024-09-12T01:43:05.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/177: write d0/d5/d9/fa [2141936,86233] 0 2024-09-12T01:43:05.509 INFO:tasks.workunit.client.1.smithi153.stdout:8/530: sync 2024-09-12T01:43:05.509 INFO:tasks.workunit.client.1.smithi153.stdout:3/562: sync 2024-09-12T01:43:05.509 INFO:tasks.workunit.client.1.smithi153.stdout:5/525: sync 2024-09-12T01:43:05.509 INFO:tasks.workunit.client.1.smithi153.stdout:6/558: sync 2024-09-12T01:43:05.509 INFO:tasks.workunit.client.1.smithi153.stdout:3/563: chown d1/d1e/c31 14398 1 2024-09-12T01:43:05.510 INFO:tasks.workunit.client.1.smithi153.stdout:4/466: sync 2024-09-12T01:43:05.511 INFO:tasks.workunit.client.1.smithi153.stdout:8/531: unlink d17/d1f/f5a 0 2024-09-12T01:43:05.511 INFO:tasks.workunit.client.1.smithi153.stdout:6/559: truncate d1/d6/d23/d98/d53/f97 1108771 0 2024-09-12T01:43:05.512 INFO:tasks.workunit.client.1.smithi153.stdout:3/564: getdents d1/d13/d23/d47/d6c/d9c 0 2024-09-12T01:43:05.513 INFO:tasks.workunit.client.1.smithi153.stdout:4/467: rename d6/d9/dc/d31/d76/d99/c91 to d6/d9/dc/d98/cab 0 2024-09-12T01:43:05.514 INFO:tasks.workunit.client.1.smithi153.stdout:8/532: symlink d17/d1d/d93/lb2 0 2024-09-12T01:43:05.514 INFO:tasks.workunit.client.1.smithi153.stdout:6/560: symlink d1/d6/da/d19/d3a/lb1 0 2024-09-12T01:43:05.516 INFO:tasks.workunit.client.1.smithi153.stdout:3/565: creat d1/d13/d23/d47/d6c/fa8 x:0 0 0 2024-09-12T01:43:05.516 INFO:tasks.workunit.client.1.smithi153.stdout:4/468: mkdir d6/d9/dc/d31/d76/dac 0 2024-09-12T01:43:05.519 INFO:tasks.workunit.client.1.smithi153.stdout:6/561: creat d1/d6/d23/d98/d53/fb2 x:0 0 0 2024-09-12T01:43:05.521 INFO:tasks.workunit.client.1.smithi153.stdout:3/566: rename d1/d16/d17/f1f to d1/d16/fa9 0 2024-09-12T01:43:05.523 INFO:tasks.workunit.client.1.smithi153.stdout:8/533: link d17/d1f/d4f/d42/l7a d17/d1f/d4f/d34/lb3 0 2024-09-12T01:43:05.525 INFO:tasks.workunit.client.1.smithi153.stdout:8/534: unlink ce 0 2024-09-12T01:43:05.525 INFO:tasks.workunit.client.1.smithi153.stdout:8/535: chown d17/d1f/d4f/f57 1505 1 2024-09-12T01:43:05.527 INFO:tasks.workunit.client.0.smithi066.stdout:3/219: dwrite d5/d6/d1b/f3f [0,4194304] 0 2024-09-12T01:43:05.534 INFO:tasks.workunit.client.1.smithi153.stdout:7/477: dread d12/d21/f45 [0,4194304] 0 2024-09-12T01:43:05.535 INFO:tasks.workunit.client.1.smithi153.stdout:7/478: link d12/d21/d29/d35/d37/d4c/d5c/f70 d12/d21/d5f/f8c 0 2024-09-12T01:43:05.536 INFO:tasks.workunit.client.1.smithi153.stdout:7/479: creat d12/d21/d29/f8d x:0 0 0 2024-09-12T01:43:05.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/480: mkdir d12/d21/d29/d35/d37/d4c/d8e 0 2024-09-12T01:43:05.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/481: getdents d12/d21/d29/d35/d37/d4c/d8e 0 2024-09-12T01:43:05.537 INFO:tasks.workunit.client.1.smithi153.stdout:7/482: creat d12/d7e/f8f x:0 0 0 2024-09-12T01:43:05.538 INFO:tasks.workunit.client.1.smithi153.stdout:7/483: mknod d12/d21/d4d/c90 0 2024-09-12T01:43:05.540 INFO:tasks.workunit.client.1.smithi153.stdout:7/484: rename d12/f22 to d12/d21/d29/d35/d37/f91 0 2024-09-12T01:43:05.551 INFO:tasks.workunit.client.0.smithi066.stdout:8/239: dwrite d12/d26/d43/f46 [0,4194304] 0 2024-09-12T01:43:05.551 INFO:tasks.workunit.client.0.smithi066.stdout:2/215: dwrite f5 [0,4194304] 0 2024-09-12T01:43:05.551 INFO:tasks.workunit.client.0.smithi066.stdout:6/287: dwrite d2/f2a [0,4194304] 0 2024-09-12T01:43:05.551 INFO:tasks.workunit.client.0.smithi066.stdout:6/288: truncate d2/d21/f4a 1677941 0 2024-09-12T01:43:05.554 INFO:tasks.workunit.client.0.smithi066.stdout:8/240: symlink d12/d26/d3c/l4d 0 2024-09-12T01:43:05.554 INFO:tasks.workunit.client.0.smithi066.stdout:8/241: dread - d12/d21/d2f/f45 zero size 2024-09-12T01:43:05.554 INFO:tasks.workunit.client.0.smithi066.stdout:1/171: dwrite d5/dc/dd/f23 [0,4194304] 0 2024-09-12T01:43:05.555 INFO:tasks.workunit.client.0.smithi066.stdout:0/232: dwrite d1/dc/df/f1a [0,4194304] 0 2024-09-12T01:43:05.555 INFO:tasks.workunit.client.1.smithi153.stdout:3/567: dread d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:05.555 INFO:tasks.workunit.client.1.smithi153.stdout:0/597: dwrite d22/d30/d4c/fa2 [0,4194304] 0 2024-09-12T01:43:05.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/585: dwrite d2/d9/d17/f48 [0,4194304] 0 2024-09-12T01:43:05.556 INFO:tasks.workunit.client.1.smithi153.stdout:1/586: chown d2/d9/laf 120237 1 2024-09-12T01:43:05.556 INFO:tasks.workunit.client.0.smithi066.stdout:9/178: dwrite d0/d6/d17/f18 [0,4194304] 0 2024-09-12T01:43:05.556 INFO:tasks.workunit.client.1.smithi153.stdout:2/501: dwrite d7/d19/d40/f37 [0,4194304] 0 2024-09-12T01:43:05.557 INFO:tasks.workunit.client.0.smithi066.stdout:7/154: dwrite d2/d5/d6/f2a [0,4194304] 0 2024-09-12T01:43:05.557 INFO:tasks.workunit.client.0.smithi066.stdout:7/155: dread - d2/d5/d6/d22/f30 zero size 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.0.smithi066.stdout:7/156: dread - d2/d5/d6/d22/f30 zero size 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.1.smithi153.stdout:7/485: dread d12/d21/d29/d35/d37/f57 [0,4194304] 0 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.1.smithi153.stdout:9/549: dwrite d3/d3a/d42/f48 [4194304,4194304] 0 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.1.smithi153.stdout:9/550: write d3/f7 [2436094,32895] 0 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.1.smithi153.stdout:4/469: dwrite d6/d9/d11/f3c [0,4194304] 0 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.1.smithi153.stdout:6/562: dwrite d1/df/fa7 [0,4194304] 0 2024-09-12T01:43:05.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/179: dread d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:05.559 INFO:tasks.workunit.client.0.smithi066.stdout:4/154: dwrite d4/f12 [0,4194304] 0 2024-09-12T01:43:05.559 INFO:tasks.workunit.client.0.smithi066.stdout:4/155: creat d4/d6/f30 x:0 0 0 2024-09-12T01:43:05.562 INFO:tasks.workunit.client.0.smithi066.stdout:2/216: dread de/d13/d1e/d25/f2b [0,4194304] 0 2024-09-12T01:43:05.563 INFO:tasks.workunit.client.0.smithi066.stdout:2/217: fsync de/f42 0 2024-09-12T01:43:05.563 INFO:tasks.workunit.client.0.smithi066.stdout:6/289: symlink d2/db/d12/d1d/l62 0 2024-09-12T01:43:05.563 INFO:tasks.workunit.client.0.smithi066.stdout:2/218: chown de/ff 94464 1 2024-09-12T01:43:05.564 INFO:tasks.workunit.client.1.smithi153.stdout:4/470: dread d6/f63 [0,4194304] 0 2024-09-12T01:43:05.566 INFO:tasks.workunit.client.1.smithi153.stdout:1/587: truncate d2/d9/d17/d2f/d56/d71/f7a 3092974 0 2024-09-12T01:43:05.572 INFO:tasks.workunit.client.1.smithi153.stdout:2/502: link d7/db/c32 d7/ca2 0 2024-09-12T01:43:05.573 INFO:tasks.workunit.client.0.smithi066.stdout:7/157: dread d2/d5/da/f11 [0,4194304] 0 2024-09-12T01:43:05.573 INFO:tasks.workunit.client.0.smithi066.stdout:7/158: dread - d2/f2b zero size 2024-09-12T01:43:05.573 INFO:tasks.workunit.client.0.smithi066.stdout:7/159: stat d2/d5/d6/d22/l29 0 2024-09-12T01:43:05.573 INFO:tasks.workunit.client.0.smithi066.stdout:7/160: readlink d2/d5/d6/d22/l27 0 2024-09-12T01:43:05.573 INFO:tasks.workunit.client.0.smithi066.stdout:7/161: chown d2/d5/da/c10 429 1 2024-09-12T01:43:05.574 INFO:tasks.workunit.client.1.smithi153.stdout:3/568: dwrite d1/f54 [0,4194304] 0 2024-09-12T01:43:05.574 INFO:tasks.workunit.client.0.smithi066.stdout:4/156: dread f3 [4194304,4194304] 0 2024-09-12T01:43:05.574 INFO:tasks.workunit.client.0.smithi066.stdout:0/233: symlink d1/dc/de/l55 0 2024-09-12T01:43:05.576 INFO:tasks.workunit.client.1.smithi153.stdout:7/486: symlink d12/d21/d29/d35/l92 0 2024-09-12T01:43:05.576 INFO:tasks.workunit.client.1.smithi153.stdout:7/487: chown d12/d21/d29/d35/d37/d58/l67 2772 1 2024-09-12T01:43:05.576 INFO:tasks.workunit.client.1.smithi153.stdout:7/488: dread - d12/d21/d29/d35/d37/d4c/f71 zero size 2024-09-12T01:43:05.578 INFO:tasks.workunit.client.1.smithi153.stdout:7/489: dread d12/d21/d29/d35/d37/f57 [0,4194304] 0 2024-09-12T01:43:05.579 INFO:tasks.workunit.client.1.smithi153.stdout:9/551: mkdir d3/d3a/da6 0 2024-09-12T01:43:05.584 INFO:tasks.workunit.client.0.smithi066.stdout:1/172: dwrite d5/dc/dd/f11 [0,4194304] 0 2024-09-12T01:43:05.585 INFO:tasks.workunit.client.1.smithi153.stdout:6/563: unlink d1/d6/l16 0 2024-09-12T01:43:05.585 INFO:tasks.workunit.client.1.smithi153.stdout:6/564: truncate d1/df/f6f 4765310 0 2024-09-12T01:43:05.585 INFO:tasks.workunit.client.1.smithi153.stdout:6/565: chown d1/d6/d46 1433535 1 2024-09-12T01:43:05.586 INFO:tasks.workunit.client.1.smithi153.stdout:4/471: mknod d6/da4/cad 0 2024-09-12T01:43:05.587 INFO:tasks.workunit.client.1.smithi153.stdout:4/472: chown d6/d9/dc/d98/c30 399371176 1 2024-09-12T01:43:05.588 INFO:tasks.workunit.client.1.smithi153.stdout:0/598: rmdir d22/d30/d4c/d6e/d7f/d98 39 2024-09-12T01:43:05.589 INFO:tasks.workunit.client.0.smithi066.stdout:9/180: mknod d0/d5/dc/c3f 0 2024-09-12T01:43:05.589 INFO:tasks.workunit.client.0.smithi066.stdout:9/181: truncate d0/f3c 855618 0 2024-09-12T01:43:05.591 INFO:tasks.workunit.client.1.smithi153.stdout:1/588: mknod d2/d9/d17/d69/cba 0 2024-09-12T01:43:05.593 INFO:tasks.workunit.client.1.smithi153.stdout:2/503: truncate d7/db/d6c/d7e/f52 520251 0 2024-09-12T01:43:05.593 INFO:tasks.workunit.client.1.smithi153.stdout:2/504: write d7/d17/f55 [1038560,14396] 0 2024-09-12T01:43:05.594 INFO:tasks.workunit.client.1.smithi153.stdout:0/599: dread d22/f26 [0,4194304] 0 2024-09-12T01:43:05.594 INFO:tasks.workunit.client.1.smithi153.stdout:0/600: chown d22/d30/d4c/f9f 127 1 2024-09-12T01:43:05.594 INFO:tasks.workunit.client.0.smithi066.stdout:6/290: link d2/db/d12/d1d/f26 d2/db/f63 0 2024-09-12T01:43:05.596 INFO:tasks.workunit.client.1.smithi153.stdout:3/569: dwrite d1/d13/d25/d26/f9f [0,4194304] 0 2024-09-12T01:43:05.596 INFO:tasks.workunit.client.1.smithi153.stdout:3/570: stat d1/d1e/c60 0 2024-09-12T01:43:05.596 INFO:tasks.workunit.client.1.smithi153.stdout:3/571: chown d1/d13/d25/d26/c84 9 1 2024-09-12T01:43:05.596 INFO:tasks.workunit.client.1.smithi153.stdout:3/572: truncate d1/d13/f77 708729 0 2024-09-12T01:43:05.596 INFO:tasks.workunit.client.0.smithi066.stdout:2/219: getdents de/d13/d1e/d25 0 2024-09-12T01:43:05.597 INFO:tasks.workunit.client.0.smithi066.stdout:8/242: rmdir d12/d21/d2f 39 2024-09-12T01:43:05.597 INFO:tasks.workunit.client.0.smithi066.stdout:8/243: read d12/d26/f36 [319977,94118] 0 2024-09-12T01:43:05.601 INFO:tasks.workunit.client.1.smithi153.stdout:6/566: mknod d1/df/d9d/cb3 0 2024-09-12T01:43:05.603 INFO:tasks.workunit.client.1.smithi153.stdout:7/490: dwrite d12/d21/d4d/f7d [0,4194304] 0 2024-09-12T01:43:05.603 INFO:tasks.workunit.client.1.smithi153.stdout:4/473: truncate d6/d9/dc/d98/d3e/f50 4052922 0 2024-09-12T01:43:05.603 INFO:tasks.workunit.client.1.smithi153.stdout:4/474: write d6/d9/d11/f6c [432196,127035] 0 2024-09-12T01:43:05.605 INFO:tasks.workunit.client.1.smithi153.stdout:1/589: rename d2/d9/d17/d69/l99 to d2/d9/d17/lbb 0 2024-09-12T01:43:05.606 INFO:tasks.workunit.client.1.smithi153.stdout:1/590: creat d2/d9/d28/fbc x:0 0 0 2024-09-12T01:43:05.607 INFO:tasks.workunit.client.1.smithi153.stdout:9/552: dwrite d3/d35/f37 [0,4194304] 0 2024-09-12T01:43:05.607 INFO:tasks.workunit.client.1.smithi153.stdout:9/553: write d3/d3a/d42/d72/f7c [117115,125744] 0 2024-09-12T01:43:05.607 INFO:tasks.workunit.client.1.smithi153.stdout:9/554: chown d3/d35/f37 16709624 1 2024-09-12T01:43:05.612 INFO:tasks.workunit.client.1.smithi153.stdout:6/567: mknod d1/d6/da/d19/d34/cb4 0 2024-09-12T01:43:05.621 INFO:tasks.workunit.client.1.smithi153.stdout:2/505: dwrite d7/d19/f79 [0,4194304] 0 2024-09-12T01:43:05.622 INFO:tasks.workunit.client.1.smithi153.stdout:4/475: rename d6/d15/l19 to d6/d9/lae 0 2024-09-12T01:43:05.622 INFO:tasks.workunit.client.0.smithi066.stdout:7/162: creat d2/d5/f31 x:0 0 0 2024-09-12T01:43:05.623 INFO:tasks.workunit.client.1.smithi153.stdout:3/573: dwrite d1/d59/f98 [0,4194304] 0 2024-09-12T01:43:05.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/157: symlink d4/d6/d27/l31 0 2024-09-12T01:43:05.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/158: creat d4/d6/d8/f32 x:0 0 0 2024-09-12T01:43:05.626 INFO:tasks.workunit.client.1.smithi153.stdout:1/591: rmdir d2/d9/d17/d2f/d56/d83 39 2024-09-12T01:43:05.629 INFO:tasks.workunit.client.0.smithi066.stdout:0/234: link d1/dc/de/c51 d1/dc/de/d47/d4a/c56 0 2024-09-12T01:43:05.629 INFO:tasks.workunit.client.0.smithi066.stdout:0/235: truncate d1/dc/df/d20/f35 649481 0 2024-09-12T01:43:05.629 INFO:tasks.workunit.client.0.smithi066.stdout:0/236: fdatasync d1/dc/f38 0 2024-09-12T01:43:05.629 INFO:tasks.workunit.client.0.smithi066.stdout:0/237: chown d1/dc/df/d20/f21 229 1 2024-09-12T01:43:05.629 INFO:tasks.workunit.client.0.smithi066.stdout:0/238: write d1/dc/de/d47/f4e [956515,32683] 0 2024-09-12T01:43:05.630 INFO:tasks.workunit.client.1.smithi153.stdout:0/601: symlink d22/d30/d4c/lcc 0 2024-09-12T01:43:05.631 INFO:tasks.workunit.client.0.smithi066.stdout:2/220: dwrite de/f1d [0,4194304] 0 2024-09-12T01:43:05.631 INFO:tasks.workunit.client.0.smithi066.stdout:2/221: chown de/d3c/c3e 3717 1 2024-09-12T01:43:05.636 INFO:tasks.workunit.client.0.smithi066.stdout:6/291: symlink d2/d31/d5e/l64 0 2024-09-12T01:43:05.636 INFO:tasks.workunit.client.0.smithi066.stdout:6/292: readlink d2/l9 0 2024-09-12T01:43:05.636 INFO:tasks.workunit.client.0.smithi066.stdout:6/293: dread - d2/f5f zero size 2024-09-12T01:43:05.636 INFO:tasks.workunit.client.1.smithi153.stdout:6/568: getdents d1/d6/d23/d98/d53/d69 0 2024-09-12T01:43:05.637 INFO:tasks.workunit.client.0.smithi066.stdout:8/244: mknod d12/d26/d3c/c4e 0 2024-09-12T01:43:05.638 INFO:tasks.workunit.client.1.smithi153.stdout:7/491: getdents d12/d21 0 2024-09-12T01:43:05.641 INFO:tasks.workunit.client.0.smithi066.stdout:4/159: mkdir d4/d15/d33 0 2024-09-12T01:43:05.644 INFO:tasks.workunit.client.1.smithi153.stdout:2/506: mkdir d7/db/d27/d56/da3 0 2024-09-12T01:43:05.646 INFO:tasks.workunit.client.0.smithi066.stdout:2/222: symlink de/d13/d28/d3d/l4e 0 2024-09-12T01:43:05.647 INFO:tasks.workunit.client.1.smithi153.stdout:1/592: write d2/d9/d17/d2f/f31 [1182449,65843] 0 2024-09-12T01:43:05.649 INFO:tasks.workunit.client.0.smithi066.stdout:1/173: rename d5/c24 to d5/d15/c2f 0 2024-09-12T01:43:05.651 INFO:tasks.workunit.client.0.smithi066.stdout:9/182: rmdir d0/d5/dc 39 2024-09-12T01:43:05.651 INFO:tasks.workunit.client.0.smithi066.stdout:0/239: dread d1/dc/f38 [0,4194304] 0 2024-09-12T01:43:05.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/602: symlink d22/d30/d4c/d6f/d88/lcd 0 2024-09-12T01:43:05.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/603: chown f15 1635 1 2024-09-12T01:43:05.652 INFO:tasks.workunit.client.1.smithi153.stdout:0/604: write d22/d30/d4c/d6e/d7f/fa3 [37237,103040] 0 2024-09-12T01:43:05.653 INFO:tasks.workunit.client.0.smithi066.stdout:6/294: symlink d2/d31/d57/l65 0 2024-09-12T01:43:05.653 INFO:tasks.workunit.client.1.smithi153.stdout:6/569: link d1/d6/f4c d1/d6/d23/fb5 0 2024-09-12T01:43:05.654 INFO:tasks.workunit.client.0.smithi066.stdout:9/183: mknod d0/d5/d9/c40 0 2024-09-12T01:43:05.656 INFO:tasks.workunit.client.1.smithi153.stdout:7/492: symlink d12/d21/d29/d35/l93 0 2024-09-12T01:43:05.656 INFO:tasks.workunit.client.1.smithi153.stdout:7/493: chown d12/d21/d29/d35/d37/d58 0 1 2024-09-12T01:43:05.656 INFO:tasks.workunit.client.0.smithi066.stdout:1/174: dread d5/d15/f1b [0,4194304] 0 2024-09-12T01:43:05.658 INFO:tasks.workunit.client.1.smithi153.stdout:2/507: mkdir d7/d17/da4 0 2024-09-12T01:43:05.659 INFO:tasks.workunit.client.0.smithi066.stdout:9/184: creat d0/d6/d17/d28/f41 x:0 0 0 2024-09-12T01:43:05.660 INFO:tasks.workunit.client.0.smithi066.stdout:4/160: dread d4/d6/d8/fa [0,4194304] 0 2024-09-12T01:43:05.660 INFO:tasks.workunit.client.0.smithi066.stdout:4/161: creat d4/d6/f34 x:0 0 0 2024-09-12T01:43:05.660 INFO:tasks.workunit.client.0.smithi066.stdout:4/162: chown d4/d15/c24 386752726 1 2024-09-12T01:43:05.660 INFO:tasks.workunit.client.1.smithi153.stdout:4/476: rmdir d6/da4 39 2024-09-12T01:43:05.662 INFO:tasks.workunit.client.1.smithi153.stdout:1/593: symlink d2/d9/d58/lbd 0 2024-09-12T01:43:05.663 INFO:tasks.workunit.client.0.smithi066.stdout:0/240: rmdir d1/dc/de 39 2024-09-12T01:43:05.664 INFO:tasks.workunit.client.1.smithi153.stdout:9/555: dwrite d3/fe [0,4194304] 0 2024-09-12T01:43:05.665 INFO:tasks.workunit.client.1.smithi153.stdout:0/605: mknod d22/d30/d4c/d6e/d7f/d98/cce 0 2024-09-12T01:43:05.665 INFO:tasks.workunit.client.1.smithi153.stdout:0/606: stat d22/c77 0 2024-09-12T01:43:05.666 INFO:tasks.workunit.client.0.smithi066.stdout:1/175: truncate d5/f14 1598226 0 2024-09-12T01:43:05.668 INFO:tasks.workunit.client.1.smithi153.stdout:6/570: mkdir d1/d80/db6 0 2024-09-12T01:43:05.668 INFO:tasks.workunit.client.1.smithi153.stdout:6/571: dread - d1/d6/da/d19/d34/fa8 zero size 2024-09-12T01:43:05.668 INFO:tasks.workunit.client.0.smithi066.stdout:9/185: mkdir d0/d5/dc/d42 0 2024-09-12T01:43:05.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/186: dread d0/f3c [0,4194304] 0 2024-09-12T01:43:05.670 INFO:tasks.workunit.client.1.smithi153.stdout:7/494: mknod d12/d21/d29/d35/c94 0 2024-09-12T01:43:05.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/187: dread d0/d5/d12/f27 [0,4194304] 0 2024-09-12T01:43:05.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/188: write d0/d6/d17/d1b/f1c [3649502,120078] 0 2024-09-12T01:43:05.673 INFO:tasks.workunit.client.1.smithi153.stdout:2/508: mknod d7/db/d62/d87/ca5 0 2024-09-12T01:43:05.673 INFO:tasks.workunit.client.0.smithi066.stdout:0/241: symlink d1/dc/df/d1b/d26/l57 0 2024-09-12T01:43:05.673 INFO:tasks.workunit.client.0.smithi066.stdout:7/163: dwrite d2/d5/d6/d22/f30 [0,4194304] 0 2024-09-12T01:43:05.673 INFO:tasks.workunit.client.0.smithi066.stdout:7/164: fsync d2/d5/da/f19 0 2024-09-12T01:43:05.675 INFO:tasks.workunit.client.1.smithi153.stdout:4/477: symlink d6/d15/d38/laf 0 2024-09-12T01:43:05.675 INFO:tasks.workunit.client.1.smithi153.stdout:3/574: dwrite d1/d13/d25/da6/f5f [0,4194304] 0 2024-09-12T01:43:05.677 INFO:tasks.workunit.client.1.smithi153.stdout:1/594: rename d2/d9/d1d/f62 to d2/d9/d1d/d82/d89/fbe 0 2024-09-12T01:43:05.677 INFO:tasks.workunit.client.1.smithi153.stdout:1/595: stat d2/d9/f1a 0 2024-09-12T01:43:05.677 INFO:tasks.workunit.client.0.smithi066.stdout:8/245: dwrite d12/d26/f3b [0,4194304] 0 2024-09-12T01:43:05.678 INFO:tasks.workunit.client.1.smithi153.stdout:9/556: creat d3/d3a/d42/d72/d98/d9a/da0/fa7 x:0 0 0 2024-09-12T01:43:05.678 INFO:tasks.workunit.client.1.smithi153.stdout:9/557: chown d3/d35/f75 6305878 1 2024-09-12T01:43:05.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/223: dwrite de/d13/d1e/f23 [0,4194304] 0 2024-09-12T01:43:05.682 INFO:tasks.workunit.client.1.smithi153.stdout:6/572: creat d1/d6/d23/d98/d53/d69/d7c/fb7 x:0 0 0 2024-09-12T01:43:05.683 INFO:tasks.workunit.client.0.smithi066.stdout:0/242: dread d1/dc/de/f3c [0,4194304] 0 2024-09-12T01:43:05.683 INFO:tasks.workunit.client.1.smithi153.stdout:7/495: mkdir d12/d21/d29/d35/d95 0 2024-09-12T01:43:05.684 INFO:tasks.workunit.client.0.smithi066.stdout:7/165: truncate d2/d5/f23 2989677 0 2024-09-12T01:43:05.685 INFO:tasks.workunit.client.1.smithi153.stdout:7/496: dread d12/d21/d29/d35/f6a [0,4194304] 0 2024-09-12T01:43:05.685 INFO:tasks.workunit.client.1.smithi153.stdout:3/575: rename d1/d45/c3f to d1/d59/caa 0 2024-09-12T01:43:05.687 INFO:tasks.workunit.client.1.smithi153.stdout:1/596: creat d2/d9/d58/d74/fbf x:0 0 0 2024-09-12T01:43:05.687 INFO:tasks.workunit.client.1.smithi153.stdout:1/597: chown d2/d9/d28/f9d 149 1 2024-09-12T01:43:05.687 INFO:tasks.workunit.client.1.smithi153.stdout:1/598: readlink d2/d9/d1d/d25/l5b 0 2024-09-12T01:43:05.690 INFO:tasks.workunit.client.1.smithi153.stdout:1/599: symlink d2/d9/d17/d2f/d56/da0/lc0 0 2024-09-12T01:43:05.690 INFO:tasks.workunit.client.1.smithi153.stdout:0/607: symlink d22/d30/d4c/lcf 0 2024-09-12T01:43:05.690 INFO:tasks.workunit.client.0.smithi066.stdout:4/163: dwrite d4/f12 [0,4194304] 0 2024-09-12T01:43:05.691 INFO:tasks.workunit.client.1.smithi153.stdout:1/600: creat d2/d9/d17/d69/d95/fc1 x:0 0 0 2024-09-12T01:43:05.691 INFO:tasks.workunit.client.1.smithi153.stdout:4/478: dread d6/d9/d11/f3c [0,4194304] 0 2024-09-12T01:43:05.691 INFO:tasks.workunit.client.1.smithi153.stdout:4/479: fdatasync d6/d9/dc/d31/d7d/d94/f9e 0 2024-09-12T01:43:05.692 INFO:tasks.workunit.client.0.smithi066.stdout:1/176: dwrite d5/f9 [0,4194304] 0 2024-09-12T01:43:05.693 INFO:tasks.workunit.client.0.smithi066.stdout:8/246: truncate d12/d26/d43/f46 3723246 0 2024-09-12T01:43:05.693 INFO:tasks.workunit.client.0.smithi066.stdout:8/247: write d12/d21/f33 [12358,91143] 0 2024-09-12T01:43:05.697 INFO:tasks.workunit.client.0.smithi066.stdout:9/189: mkdir d0/d6/d43 0 2024-09-12T01:43:05.698 INFO:tasks.workunit.client.0.smithi066.stdout:9/190: stat d0/d5/d12 0 2024-09-12T01:43:05.703 INFO:tasks.workunit.client.1.smithi153.stdout:0/608: rename d22/f5a to d22/d30/d4c/d6f/d88/fd0 0 2024-09-12T01:43:05.707 INFO:tasks.workunit.client.0.smithi066.stdout:2/224: rmdir de/d13/d1e 39 2024-09-12T01:43:05.708 INFO:tasks.workunit.client.1.smithi153.stdout:1/601: write d2/d9/d1d/d25/f38 [3888518,16512] 0 2024-09-12T01:43:05.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/243: creat d1/dc/de/d46/f58 x:0 0 0 2024-09-12T01:43:05.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/244: write d1/dc/df/d20/f35 [1586449,130401] 0 2024-09-12T01:43:05.715 INFO:tasks.workunit.client.0.smithi066.stdout:8/248: mknod d12/d26/d3c/c4f 0 2024-09-12T01:43:05.718 INFO:tasks.workunit.client.0.smithi066.stdout:9/191: symlink d0/d6/d17/d28/l44 0 2024-09-12T01:43:05.721 INFO:tasks.workunit.client.0.smithi066.stdout:7/166: mknod d2/d5/c32 0 2024-09-12T01:43:05.721 INFO:tasks.workunit.client.0.smithi066.stdout:0/245: write d1/dc/df/d1b/d26/f2e [2315653,95727] 0 2024-09-12T01:43:05.722 INFO:tasks.workunit.client.0.smithi066.stdout:5/153: sync 2024-09-12T01:43:05.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/220: sync 2024-09-12T01:43:05.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/221: truncate d5/ff 663807 0 2024-09-12T01:43:05.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/222: fdatasync d5/d6/d1b/d28/f46 0 2024-09-12T01:43:05.723 INFO:tasks.workunit.client.1.smithi153.stdout:2/509: dwrite d7/f51 [0,4194304] 0 2024-09-12T01:43:05.723 INFO:tasks.workunit.client.1.smithi153.stdout:9/558: dwrite d3/d35/f75 [4194304,4194304] 0 2024-09-12T01:43:05.723 INFO:tasks.workunit.client.1.smithi153.stdout:9/559: write d3/d66/f6f [558152,28727] 0 2024-09-12T01:43:05.723 INFO:tasks.workunit.client.1.smithi153.stdout:9/560: chown d3/f2d 0 1 2024-09-12T01:43:05.723 INFO:tasks.workunit.client.1.smithi153.stdout:0/609: rename l1f to d22/d30/d4c/d6e/d7f/d98/ld1 0 2024-09-12T01:43:05.725 INFO:tasks.workunit.client.1.smithi153.stdout:1/602: getdents d2/d9/d17/d2f/d56/d83 0 2024-09-12T01:43:05.725 INFO:tasks.workunit.client.1.smithi153.stdout:1/603: dread - d2/d9/d17/d69/f7e zero size 2024-09-12T01:43:05.728 INFO:tasks.workunit.client.0.smithi066.stdout:5/154: mkdir d0/d26/d2d/d33 0 2024-09-12T01:43:05.729 INFO:tasks.workunit.client.1.smithi153.stdout:6/573: truncate d1/d80/fae 2449372 0 2024-09-12T01:43:05.730 INFO:tasks.workunit.client.0.smithi066.stdout:1/177: write d5/f9 [2488027,91566] 0 2024-09-12T01:43:05.734 INFO:tasks.workunit.client.0.smithi066.stdout:3/223: mkdir d5/d6/d48 0 2024-09-12T01:43:05.735 INFO:tasks.workunit.client.0.smithi066.stdout:4/164: dwrite d4/d6/f23 [4194304,4194304] 0 2024-09-12T01:43:05.735 INFO:tasks.workunit.client.0.smithi066.stdout:4/165: chown d4/d15 8182 1 2024-09-12T01:43:05.737 INFO:tasks.workunit.client.1.smithi153.stdout:4/480: dwrite d6/d9/dc/d31/f24 [0,4194304] 0 2024-09-12T01:43:05.737 INFO:tasks.workunit.client.1.smithi153.stdout:3/576: dwrite d1/d16/f87 [0,4194304] 0 2024-09-12T01:43:05.738 INFO:tasks.workunit.client.1.smithi153.stdout:4/481: chown d6/d9/d11/f2f 1971 1 2024-09-12T01:43:05.738 INFO:tasks.workunit.client.1.smithi153.stdout:4/482: chown d6/d9/dc/l44 80474 1 2024-09-12T01:43:05.739 INFO:tasks.workunit.client.0.smithi066.stdout:0/246: fsync d1/dc/df/d20/f35 0 2024-09-12T01:43:05.739 INFO:tasks.workunit.client.0.smithi066.stdout:2/225: write de/d13/d1e/f23 [3380551,82686] 0 2024-09-12T01:43:05.742 INFO:tasks.workunit.client.0.smithi066.stdout:9/192: link d0/d6/d17/f23 d0/d5/f45 0 2024-09-12T01:43:05.742 INFO:tasks.workunit.client.0.smithi066.stdout:9/193: chown d0/d5/dc/l2f 137890578 1 2024-09-12T01:43:05.742 INFO:tasks.workunit.client.0.smithi066.stdout:9/194: fsync d0/d5/d12/f1f 0 2024-09-12T01:43:05.745 INFO:tasks.workunit.client.0.smithi066.stdout:5/155: creat d0/d26/f34 x:0 0 0 2024-09-12T01:43:05.749 INFO:tasks.workunit.client.1.smithi153.stdout:9/561: symlink d3/d3a/d42/d72/d98/d9a/la8 0 2024-09-12T01:43:05.751 INFO:tasks.workunit.client.0.smithi066.stdout:3/224: creat d5/d6/d1b/d45/f49 x:0 0 0 2024-09-12T01:43:05.756 INFO:tasks.workunit.client.1.smithi153.stdout:1/604: creat d2/d9/d17/d2f/d56/d83/fc2 x:0 0 0 2024-09-12T01:43:05.756 INFO:tasks.workunit.client.1.smithi153.stdout:1/605: fdatasync d2/d34/f50 0 2024-09-12T01:43:05.757 INFO:tasks.workunit.client.0.smithi066.stdout:4/166: mknod d4/d6/c35 0 2024-09-12T01:43:05.758 INFO:tasks.workunit.client.1.smithi153.stdout:6/574: mknod d1/d6/da/d19/d3a/db0/cb8 0 2024-09-12T01:43:05.763 INFO:tasks.workunit.client.1.smithi153.stdout:3/577: creat d1/d1e/d9a/fab x:0 0 0 2024-09-12T01:43:05.763 INFO:tasks.workunit.client.1.smithi153.stdout:3/578: getdents d1/d13/d25/d26/d4b/d97 0 2024-09-12T01:43:05.765 INFO:tasks.workunit.client.0.smithi066.stdout:8/249: dwrite d12/d26/f3b [4194304,4194304] 0 2024-09-12T01:43:05.766 INFO:tasks.workunit.client.0.smithi066.stdout:8/250: readlink d12/d26/l4a 0 2024-09-12T01:43:05.766 INFO:tasks.workunit.client.1.smithi153.stdout:9/562: symlink d3/d55/d30/d7b/d8f/la9 0 2024-09-12T01:43:05.767 INFO:tasks.workunit.client.1.smithi153.stdout:9/563: truncate d3/d3a/f60 39511 0 2024-09-12T01:43:05.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/610: rename d22/d30/d4c/d6f/d88/f96 to d22/d30/fd2 0 2024-09-12T01:43:05.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/611: fsync d22/f7a 0 2024-09-12T01:43:05.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/612: fsync d22/d79/d8e/dae/db7/fc9 0 2024-09-12T01:43:05.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/613: stat d22/d30/d4c/f4d 0 2024-09-12T01:43:05.769 INFO:tasks.workunit.client.1.smithi153.stdout:0/614: write d22/d79/d8e/dae/db7/fc9 [1039357,14219] 0 2024-09-12T01:43:05.770 INFO:tasks.workunit.client.0.smithi066.stdout:9/195: unlink d0/c4 0 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/167: rename d4/d6/c35 to d4/d6/d27/c36 0 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/168: fsync d4/d6/d8/f1a 0 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/169: getdents d4/d6/d27/d2f 0 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/170: creat d4/f37 x:0 0 0 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/171: dread - d4/d6/d8/f32 zero size 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/172: creat d4/d15/f38 x:0 0 0 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/173: rename d4/d6/d27/d2f to d4/d6/d27/d2f/d39 22 2024-09-12T01:43:05.772 INFO:tasks.workunit.client.0.smithi066.stdout:4/174: write d4/d6/d8/f32 [662674,76272] 0 2024-09-12T01:43:05.773 INFO:tasks.workunit.client.0.smithi066.stdout:9/196: mkdir d0/d5/d12/d46 0 2024-09-12T01:43:05.774 INFO:tasks.workunit.client.1.smithi153.stdout:0/615: link d22/d30/lc2 d22/d30/d4c/d6e/ld3 0 2024-09-12T01:43:05.774 INFO:tasks.workunit.client.1.smithi153.stdout:0/616: chown d22/d30/d4c/d6e/l45 173 1 2024-09-12T01:43:05.775 INFO:tasks.workunit.client.0.smithi066.stdout:4/175: mknod d4/d6/d8/c3a 0 2024-09-12T01:43:05.776 INFO:tasks.workunit.client.0.smithi066.stdout:4/176: chown d4/d6/d27 181 1 2024-09-12T01:43:05.776 INFO:tasks.workunit.client.0.smithi066.stdout:4/177: creat d4/d6/d8/f3b x:0 0 0 2024-09-12T01:43:05.778 INFO:tasks.workunit.client.0.smithi066.stdout:4/178: link d4/d15/l20 d4/d6/l3c 0 2024-09-12T01:43:05.778 INFO:tasks.workunit.client.1.smithi153.stdout:6/575: write d1/d6/d23/f29 [908149,11639] 0 2024-09-12T01:43:05.778 INFO:tasks.workunit.client.1.smithi153.stdout:6/576: truncate d1/d6/d23/f48 761704 0 2024-09-12T01:43:05.780 INFO:tasks.workunit.client.0.smithi066.stdout:3/225: write d5/f17 [1371382,115354] 0 2024-09-12T01:43:05.780 INFO:tasks.workunit.client.0.smithi066.stdout:3/226: write d5/d6/d1b/d45/f49 [373891,91524] 0 2024-09-12T01:43:05.782 INFO:tasks.workunit.client.0.smithi066.stdout:8/251: dread d12/d21/d2f/f48 [0,4194304] 0 2024-09-12T01:43:05.782 INFO:tasks.workunit.client.1.smithi153.stdout:6/577: rename d1/df/l13 to d1/d6/d23/d98/d53/da0/lb9 0 2024-09-12T01:43:05.784 INFO:tasks.workunit.client.0.smithi066.stdout:3/227: unlink d5/d6/c30 0 2024-09-12T01:43:05.784 INFO:tasks.workunit.client.0.smithi066.stdout:8/252: stat le 0 2024-09-12T01:43:05.785 INFO:tasks.workunit.client.0.smithi066.stdout:8/253: stat d12/l18 0 2024-09-12T01:43:05.785 INFO:tasks.workunit.client.1.smithi153.stdout:0/617: dread d22/d30/d4c/f4d [0,4194304] 0 2024-09-12T01:43:05.788 INFO:tasks.workunit.client.0.smithi066.stdout:4/179: dread d4/f12 [0,4194304] 0 2024-09-12T01:43:05.788 INFO:tasks.workunit.client.0.smithi066.stdout:4/180: truncate d4/d6/f34 962784 0 2024-09-12T01:43:05.788 INFO:tasks.workunit.client.0.smithi066.stdout:4/181: fdatasync d4/f37 0 2024-09-12T01:43:05.789 INFO:tasks.workunit.client.0.smithi066.stdout:4/182: mknod d4/d6/d8/d18/c3d 0 2024-09-12T01:43:05.790 INFO:tasks.workunit.client.0.smithi066.stdout:4/183: mknod d4/d15/d33/c3e 0 2024-09-12T01:43:05.792 INFO:tasks.workunit.client.0.smithi066.stdout:4/184: rename d4/d15/c24 to d4/d6/c3f 0 2024-09-12T01:43:05.794 INFO:tasks.workunit.client.0.smithi066.stdout:4/185: rename d4/d6/d27/l31 to d4/d15/d33/l40 0 2024-09-12T01:43:05.794 INFO:tasks.workunit.client.0.smithi066.stdout:4/186: stat d4/d6/d8/f3b 0 2024-09-12T01:43:05.803 INFO:tasks.workunit.client.0.smithi066.stdout:1/178: dwrite d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:05.811 INFO:tasks.workunit.client.1.smithi153.stdout:5/526: sync 2024-09-12T01:43:05.811 INFO:tasks.workunit.client.1.smithi153.stdout:5/527: stat d0/d15/f25 0 2024-09-12T01:43:05.812 INFO:tasks.workunit.client.1.smithi153.stdout:5/528: mknod d0/d43/d68/caa 0 2024-09-12T01:43:05.812 INFO:tasks.workunit.client.1.smithi153.stdout:0/618: dread d22/f7a [0,4194304] 0 2024-09-12T01:43:05.812 INFO:tasks.workunit.client.0.smithi066.stdout:7/167: dwrite d2/d5/da/f19 [0,4194304] 0 2024-09-12T01:43:05.814 INFO:tasks.workunit.client.1.smithi153.stdout:2/510: dwrite d7/d4d/d70/d81/f8a [0,4194304] 0 2024-09-12T01:43:05.814 INFO:tasks.workunit.client.1.smithi153.stdout:2/511: write d7/db/d6c/d76/f96 [4329511,21296] 0 2024-09-12T01:43:05.815 INFO:tasks.workunit.client.1.smithi153.stdout:5/529: unlink d0/df/d83/c5e 0 2024-09-12T01:43:05.815 INFO:tasks.workunit.client.1.smithi153.stdout:5/530: getdents d0/df/d1c/d22/d2f/d55/d81 0 2024-09-12T01:43:05.815 INFO:tasks.workunit.client.0.smithi066.stdout:7/168: creat d2/d5/d6/d22/f33 x:0 0 0 2024-09-12T01:43:05.816 INFO:tasks.workunit.client.1.smithi153.stdout:8/536: sync 2024-09-12T01:43:05.816 INFO:tasks.workunit.client.1.smithi153.stdout:8/537: write d17/d1f/d4f/f45 [7033704,90644] 0 2024-09-12T01:43:05.819 INFO:tasks.workunit.client.1.smithi153.stdout:4/483: dwrite d6/d9/dc/d31/f24 [0,4194304] 0 2024-09-12T01:43:05.820 INFO:tasks.workunit.client.0.smithi066.stdout:5/156: dwrite d0/dd/d18/f23 [0,4194304] 0 2024-09-12T01:43:05.821 INFO:tasks.workunit.client.1.smithi153.stdout:6/578: dread d1/d6/d23/d98/f68 [0,4194304] 0 2024-09-12T01:43:05.821 INFO:tasks.workunit.client.1.smithi153.stdout:6/579: write d1/d6/d23/d98/d4f/fa1 [238561,127200] 0 2024-09-12T01:43:05.821 INFO:tasks.workunit.client.0.smithi066.stdout:7/169: creat d2/d20/d2f/f34 x:0 0 0 2024-09-12T01:43:05.822 INFO:tasks.workunit.client.0.smithi066.stdout:7/170: fdatasync d2/d5/d6/f26 0 2024-09-12T01:43:05.822 INFO:tasks.workunit.client.0.smithi066.stdout:9/197: write d0/d5/f36 [561900,87072] 0 2024-09-12T01:43:05.823 INFO:tasks.workunit.client.0.smithi066.stdout:0/247: dwrite d1/fa [0,4194304] 0 2024-09-12T01:43:05.823 INFO:tasks.workunit.client.0.smithi066.stdout:2/226: dwrite f1 [0,4194304] 0 2024-09-12T01:43:05.823 INFO:tasks.workunit.client.0.smithi066.stdout:3/228: write d5/d6/f9 [5304504,55806] 0 2024-09-12T01:43:05.823 INFO:tasks.workunit.client.0.smithi066.stdout:3/229: rename d5/d6/d40 to d5/d6/d40/d4a 22 2024-09-12T01:43:05.824 INFO:tasks.workunit.client.0.smithi066.stdout:4/187: rmdir d4/d15 39 2024-09-12T01:43:05.824 INFO:tasks.workunit.client.0.smithi066.stdout:3/230: dread d5/ff [0,4194304] 0 2024-09-12T01:43:05.824 INFO:tasks.workunit.client.0.smithi066.stdout:3/231: write f4 [252621,62222] 0 2024-09-12T01:43:05.826 INFO:tasks.workunit.client.0.smithi066.stdout:1/179: dwrite d5/dc/dd/f2b [0,4194304] 0 2024-09-12T01:43:05.826 INFO:tasks.workunit.client.0.smithi066.stdout:1/180: fsync d5/dc/dd/f2b 0 2024-09-12T01:43:05.826 INFO:tasks.workunit.client.0.smithi066.stdout:1/181: truncate d5/f2a 706968 0 2024-09-12T01:43:05.827 INFO:tasks.workunit.client.1.smithi153.stdout:9/564: dwrite d3/d3a/d42/f47 [0,4194304] 0 2024-09-12T01:43:05.827 INFO:tasks.workunit.client.1.smithi153.stdout:1/606: dwrite d2/d9/d17/d2f/d56/f5c [0,4194304] 0 2024-09-12T01:43:05.827 INFO:tasks.workunit.client.1.smithi153.stdout:1/607: readlink d2/l4 0 2024-09-12T01:43:05.828 INFO:tasks.workunit.client.1.smithi153.stdout:2/512: symlink d7/d4d/d7b/la6 0 2024-09-12T01:43:05.828 INFO:tasks.workunit.client.1.smithi153.stdout:2/513: write d7/f51 [4780891,110574] 0 2024-09-12T01:43:05.829 INFO:tasks.workunit.client.0.smithi066.stdout:7/171: symlink d2/d20/d25/l35 0 2024-09-12T01:43:05.830 INFO:tasks.workunit.client.0.smithi066.stdout:5/157: write d0/d26/f2e [1594775,123094] 0 2024-09-12T01:43:05.830 INFO:tasks.workunit.client.0.smithi066.stdout:5/158: creat d0/d26/f35 x:0 0 0 2024-09-12T01:43:05.832 INFO:tasks.workunit.client.1.smithi153.stdout:5/531: mknod d0/cab 0 2024-09-12T01:43:05.833 INFO:tasks.workunit.client.1.smithi153.stdout:5/532: fdatasync d0/f1f 0 2024-09-12T01:43:05.833 INFO:tasks.workunit.client.1.smithi153.stdout:5/533: fsync d0/d15/f29 0 2024-09-12T01:43:05.833 INFO:tasks.workunit.client.1.smithi153.stdout:5/534: dread - d0/df/d83/f9f zero size 2024-09-12T01:43:05.833 INFO:tasks.workunit.client.1.smithi153.stdout:5/535: readlink d0/df/d83/l89 0 2024-09-12T01:43:05.833 INFO:tasks.workunit.client.1.smithi153.stdout:5/536: truncate d0/df/d83/f9f 757814 0 2024-09-12T01:43:05.834 INFO:tasks.workunit.client.0.smithi066.stdout:9/198: unlink d0/d5/f45 0 2024-09-12T01:43:05.837 INFO:tasks.workunit.client.0.smithi066.stdout:8/254: dwrite d12/f1b [0,4194304] 0 2024-09-12T01:43:05.838 INFO:tasks.workunit.client.0.smithi066.stdout:0/248: rename d1/dc/de/c1c to d1/c59 0 2024-09-12T01:43:05.838 INFO:tasks.workunit.client.1.smithi153.stdout:4/484: dread d6/d9/dc/d98/f3f [0,4194304] 0 2024-09-12T01:43:05.840 INFO:tasks.workunit.client.0.smithi066.stdout:2/227: mkdir de/d13/d1e/d22/d4f 0 2024-09-12T01:43:05.840 INFO:tasks.workunit.client.0.smithi066.stdout:2/228: chown de/l1b 1011424 1 2024-09-12T01:43:05.840 INFO:tasks.workunit.client.0.smithi066.stdout:2/229: fdatasync f8 0 2024-09-12T01:43:05.841 INFO:tasks.workunit.client.1.smithi153.stdout:0/619: rename d22/d30/d4c/d6e/f3f to d22/d30/d4c/fd4 0 2024-09-12T01:43:05.842 INFO:tasks.workunit.client.0.smithi066.stdout:4/188: mkdir d4/d6/d27/d2f/d41 0 2024-09-12T01:43:05.843 INFO:tasks.workunit.client.0.smithi066.stdout:4/189: read - d4/f37 zero size 2024-09-12T01:43:05.845 INFO:tasks.workunit.client.0.smithi066.stdout:3/232: creat d5/d6/dd/f4b x:0 0 0 2024-09-12T01:43:05.850 INFO:tasks.workunit.client.0.smithi066.stdout:1/182: unlink d5/l2d 0 2024-09-12T01:43:05.852 INFO:tasks.workunit.client.0.smithi066.stdout:4/190: dread d4/f17 [0,4194304] 0 2024-09-12T01:43:05.852 INFO:tasks.workunit.client.0.smithi066.stdout:4/191: chown d4/d6/d8/d18/l26 179817 1 2024-09-12T01:43:05.853 INFO:tasks.workunit.client.1.smithi153.stdout:6/580: dwrite d1/d6/d23/d98/d53/f78 [0,4194304] 0 2024-09-12T01:43:05.854 INFO:tasks.workunit.client.0.smithi066.stdout:9/199: mknod d0/d6/d43/c47 0 2024-09-12T01:43:05.855 INFO:tasks.workunit.client.1.smithi153.stdout:1/608: symlink d2/d9/d28/d73/d76/lc3 0 2024-09-12T01:43:05.855 INFO:tasks.workunit.client.1.smithi153.stdout:1/609: fdatasync d2/d9/fb5 0 2024-09-12T01:43:05.855 INFO:tasks.workunit.client.1.smithi153.stdout:1/610: write d2/d9/d1d/d25/f35 [2466147,105231] 0 2024-09-12T01:43:05.858 INFO:tasks.workunit.client.1.smithi153.stdout:2/514: unlink d7/d19/d40/f23 0 2024-09-12T01:43:05.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/537: mkdir d0/d43/dac 0 2024-09-12T01:43:05.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/538: write d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d70/f5a [2019514,109713] 0 2024-09-12T01:43:05.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/539: truncate d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d71/f7c 389424 0 2024-09-12T01:43:05.868 INFO:tasks.workunit.client.1.smithi153.stdout:9/565: dwrite d3/f49 [0,4194304] 0 2024-09-12T01:43:05.870 INFO:tasks.workunit.client.1.smithi153.stdout:4/485: unlink d6/d9/dc/d31/f70 0 2024-09-12T01:43:05.872 INFO:tasks.workunit.client.0.smithi066.stdout:5/159: dwrite d0/dd/fe [0,4194304] 0 2024-09-12T01:43:05.872 INFO:tasks.workunit.client.1.smithi153.stdout:8/538: rmdir d17/d1f/d4f/d42/d67 39 2024-09-12T01:43:05.874 INFO:tasks.workunit.client.1.smithi153.stdout:0/620: creat d22/d30/d4c/d6e/d7f/d98/fd5 x:0 0 0 2024-09-12T01:43:05.882 INFO:tasks.workunit.client.0.smithi066.stdout:7/172: dwrite d2/f2b [0,4194304] 0 2024-09-12T01:43:05.882 INFO:tasks.workunit.client.0.smithi066.stdout:7/173: readlink d2/d20/d1d/l2e 0 2024-09-12T01:43:05.882 INFO:tasks.workunit.client.0.smithi066.stdout:2/230: dwrite de/d13/d28/f35 [0,4194304] 0 2024-09-12T01:43:05.884 INFO:tasks.workunit.client.0.smithi066.stdout:8/255: dwrite d12/d26/f2e [0,4194304] 0 2024-09-12T01:43:05.885 INFO:tasks.workunit.client.1.smithi153.stdout:6/581: rename d1/d6/d39/d76/f99 to d1/d6/da/d19/d3a/db0/fba 0 2024-09-12T01:43:05.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/486: dread d6/d9/d11/d13/f18 [0,4194304] 0 2024-09-12T01:43:05.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/487: write d6/d9/dc/d31/f34 [956868,26485] 0 2024-09-12T01:43:05.887 INFO:tasks.workunit.client.1.smithi153.stdout:9/566: dread d3/d35/f5d [0,4194304] 0 2024-09-12T01:43:05.889 INFO:tasks.workunit.client.1.smithi153.stdout:1/611: link d2/d9/d58/d74/l9b d2/d9/d17/d2f/d56/d71/db8/lc4 0 2024-09-12T01:43:05.889 INFO:tasks.workunit.client.1.smithi153.stdout:1/612: dread - d2/d9/d17/d69/d95/fc1 zero size 2024-09-12T01:43:05.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/613: stat d2/d9/d17/d69/f70 0 2024-09-12T01:43:05.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/614: write d2/d9/d1d/f30 [3573126,17507] 0 2024-09-12T01:43:05.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/615: truncate d2/d9/d17/f4e 1892727 0 2024-09-12T01:43:05.891 INFO:tasks.workunit.client.1.smithi153.stdout:5/540: creat d0/df/fad x:0 0 0 2024-09-12T01:43:05.891 INFO:tasks.workunit.client.0.smithi066.stdout:0/249: creat d1/dc/de/d47/f5a x:0 0 0 2024-09-12T01:43:05.891 INFO:tasks.workunit.client.0.smithi066.stdout:0/250: write d1/dc/f14 [4569139,8585] 0 2024-09-12T01:43:05.892 INFO:tasks.workunit.client.0.smithi066.stdout:3/233: symlink d5/d6/d1b/l4c 0 2024-09-12T01:43:05.894 INFO:tasks.workunit.client.0.smithi066.stdout:1/183: symlink d5/l30 0 2024-09-12T01:43:05.897 INFO:tasks.workunit.client.0.smithi066.stdout:9/200: mknod d0/d5/d12/c48 0 2024-09-12T01:43:05.899 INFO:tasks.workunit.client.1.smithi153.stdout:2/515: dwrite d7/db/d1d/f28 [4194304,4194304] 0 2024-09-12T01:43:05.900 INFO:tasks.workunit.client.1.smithi153.stdout:9/567: write d3/d3a/d42/f58 [1262772,58328] 0 2024-09-12T01:43:05.902 INFO:tasks.workunit.client.0.smithi066.stdout:8/256: write d12/f19 [6145622,115513] 0 2024-09-12T01:43:05.902 INFO:tasks.workunit.client.0.smithi066.stdout:4/192: dwrite f3 [0,4194304] 0 2024-09-12T01:43:05.902 INFO:tasks.workunit.client.0.smithi066.stdout:4/193: truncate d4/d6/f30 731578 0 2024-09-12T01:43:05.903 INFO:tasks.workunit.client.1.smithi153.stdout:8/539: dwrite d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:05.905 INFO:tasks.workunit.client.0.smithi066.stdout:7/174: creat d2/d5/da/f36 x:0 0 0 2024-09-12T01:43:05.905 INFO:tasks.workunit.client.0.smithi066.stdout:5/160: dwrite d0/d21/d27/f1e [4194304,4194304] 0 2024-09-12T01:43:05.905 INFO:tasks.workunit.client.1.smithi153.stdout:0/621: mkdir d22/d79/d8e/dc6/dd6 0 2024-09-12T01:43:05.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/582: symlink d1/d6/da/d19/d34/lbb 0 2024-09-12T01:43:05.911 INFO:tasks.workunit.client.0.smithi066.stdout:2/231: symlink de/d13/d1e/d22/d4f/l50 0 2024-09-12T01:43:05.912 INFO:tasks.workunit.client.0.smithi066.stdout:2/232: creat de/f51 x:0 0 0 2024-09-12T01:43:05.912 INFO:tasks.workunit.client.0.smithi066.stdout:2/233: chown de/f26 13872 1 2024-09-12T01:43:05.914 INFO:tasks.workunit.client.1.smithi153.stdout:4/488: unlink d6/l92 0 2024-09-12T01:43:05.914 INFO:tasks.workunit.client.1.smithi153.stdout:4/489: write d6/da4/fa5 [540430,108982] 0 2024-09-12T01:43:05.915 INFO:tasks.workunit.client.0.smithi066.stdout:7/175: dread d2/d5/d6/f2a [0,4194304] 0 2024-09-12T01:43:05.920 INFO:tasks.workunit.client.0.smithi066.stdout:0/251: mkdir d1/dc/df/d1b/d26/d5b 0 2024-09-12T01:43:05.920 INFO:tasks.workunit.client.0.smithi066.stdout:0/252: chown d1/dc/df/d20/c31 0 1 2024-09-12T01:43:05.921 INFO:tasks.workunit.client.1.smithi153.stdout:1/616: mknod d2/d9/d17/d2f/d56/d91/cc5 0 2024-09-12T01:43:05.921 INFO:tasks.workunit.client.1.smithi153.stdout:1/617: read - d2/d9/d17/d2f/d56/d71/f9c zero size 2024-09-12T01:43:05.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/541: unlink d0/df/d83/l34 0 2024-09-12T01:43:05.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/542: chown d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d70 39043 1 2024-09-12T01:43:05.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/543: write d0/df/d1c/d22/d2f/d55/d9c/d75/f8c [4697300,84600] 0 2024-09-12T01:43:05.924 INFO:tasks.workunit.client.0.smithi066.stdout:8/257: unlink d12/f24 0 2024-09-12T01:43:05.924 INFO:tasks.workunit.client.0.smithi066.stdout:8/258: truncate d12/d21/d2f/f34 268959 0 2024-09-12T01:43:05.929 INFO:tasks.workunit.client.0.smithi066.stdout:4/194: mknod d4/d6/d8/d18/c42 0 2024-09-12T01:43:05.929 INFO:tasks.workunit.client.0.smithi066.stdout:4/195: read - d4/d15/f38 zero size 2024-09-12T01:43:05.930 INFO:tasks.workunit.client.0.smithi066.stdout:6/295: sync 2024-09-12T01:43:05.933 INFO:tasks.workunit.client.0.smithi066.stdout:3/234: dwrite d5/d6/f9 [4194304,4194304] 0 2024-09-12T01:43:05.934 INFO:tasks.workunit.client.1.smithi153.stdout:6/583: dwrite d1/d6/d23/d98/d53/d8d/f93 [4194304,4194304] 0 2024-09-12T01:43:05.936 INFO:tasks.workunit.client.0.smithi066.stdout:3/235: dread d5/ff [0,4194304] 0 2024-09-12T01:43:05.936 INFO:tasks.workunit.client.0.smithi066.stdout:3/236: chown d5/d6/d1b/d28 19825936 1 2024-09-12T01:43:05.936 INFO:tasks.workunit.client.0.smithi066.stdout:3/237: fsync d5/d6/d1b/f27 0 2024-09-12T01:43:05.937 INFO:tasks.workunit.client.0.smithi066.stdout:5/161: truncate d0/d26/f2e 763683 0 2024-09-12T01:43:05.939 INFO:tasks.workunit.client.1.smithi153.stdout:1/618: dread d2/d9/d1d/d82/d89/fbe [0,4194304] 0 2024-09-12T01:43:05.941 INFO:tasks.workunit.client.1.smithi153.stdout:1/619: write d2/d34/f53 [712429,45273] 0 2024-09-12T01:43:05.941 INFO:tasks.workunit.client.1.smithi153.stdout:1/620: chown d2/l4 0 1 2024-09-12T01:43:05.941 INFO:tasks.workunit.client.1.smithi153.stdout:9/568: creat d3/d66/d80/faa x:0 0 0 2024-09-12T01:43:05.944 INFO:tasks.workunit.client.0.smithi066.stdout:0/253: rename d1/fa to d1/dc/f5c 0 2024-09-12T01:43:05.946 INFO:tasks.workunit.client.0.smithi066.stdout:9/201: link d0/d5/l30 d0/d5/dc/d42/l49 0 2024-09-12T01:43:05.946 INFO:tasks.workunit.client.0.smithi066.stdout:9/202: chown d0/d5/dc/c3d 988835615 1 2024-09-12T01:43:05.947 INFO:tasks.workunit.client.1.smithi153.stdout:7/497: sync 2024-09-12T01:43:05.947 INFO:tasks.workunit.client.1.smithi153.stdout:3/579: sync 2024-09-12T01:43:05.947 INFO:tasks.workunit.client.1.smithi153.stdout:0/622: mknod d22/d79/d8e/dc6/dd6/cd7 0 2024-09-12T01:43:05.949 INFO:tasks.workunit.client.0.smithi066.stdout:8/259: dwrite d12/d26/d3c/f40 [0,4194304] 0 2024-09-12T01:43:05.949 INFO:tasks.workunit.client.0.smithi066.stdout:8/260: write d12/f3d [1303581,3909] 0 2024-09-12T01:43:05.950 INFO:tasks.workunit.client.0.smithi066.stdout:4/196: link d4/d6/f23 d4/d6/d8/f43 0 2024-09-12T01:43:05.951 INFO:tasks.workunit.client.1.smithi153.stdout:4/490: creat d6/d9/dc/d31/d7d/fb0 x:0 0 0 2024-09-12T01:43:05.956 INFO:tasks.workunit.client.1.smithi153.stdout:6/584: link d1/d6/d46/l81 d1/d6/d23/d98/d53/d69/d7c/d7f/lbc 0 2024-09-12T01:43:05.957 INFO:tasks.workunit.client.0.smithi066.stdout:5/162: truncate d0/f20 1113540 0 2024-09-12T01:43:05.958 INFO:tasks.workunit.client.1.smithi153.stdout:2/516: creat d7/d19/d83/fa7 x:0 0 0 2024-09-12T01:43:05.959 INFO:tasks.workunit.client.0.smithi066.stdout:7/176: symlink d2/l37 0 2024-09-12T01:43:05.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/177: chown d2/d5/d6/fe 1003801 1 2024-09-12T01:43:05.962 INFO:tasks.workunit.client.1.smithi153.stdout:9/569: truncate d3/d3a/d42/d72/f7c 53718 0 2024-09-12T01:43:05.963 INFO:tasks.workunit.client.1.smithi153.stdout:9/570: stat d3/d5f/d62/c70 0 2024-09-12T01:43:05.963 INFO:tasks.workunit.client.1.smithi153.stdout:9/571: dread - d3/d55/d30/f73 zero size 2024-09-12T01:43:05.964 INFO:tasks.workunit.client.1.smithi153.stdout:8/540: rename d17/d1f/d4f/d42/d67 to d17/d1f/d4f/d34/db4 0 2024-09-12T01:43:05.965 INFO:tasks.workunit.client.0.smithi066.stdout:9/203: symlink d0/d5/d9/l4a 0 2024-09-12T01:43:05.967 INFO:tasks.workunit.client.0.smithi066.stdout:8/261: write d12/d26/f3b [1013986,100354] 0 2024-09-12T01:43:05.968 INFO:tasks.workunit.client.1.smithi153.stdout:5/544: dwrite d0/df/d1c/d69/f9a [0,4194304] 0 2024-09-12T01:43:05.968 INFO:tasks.workunit.client.1.smithi153.stdout:8/541: dread f15 [0,4194304] 0 2024-09-12T01:43:05.968 INFO:tasks.workunit.client.1.smithi153.stdout:7/498: symlink d12/d21/d29/d35/d37/l96 0 2024-09-12T01:43:05.970 INFO:tasks.workunit.client.1.smithi153.stdout:3/580: creat d1/d16/d17/d82/d92/fac x:0 0 0 2024-09-12T01:43:05.971 INFO:tasks.workunit.client.0.smithi066.stdout:4/197: unlink d4/d6/d8/fa 0 2024-09-12T01:43:05.974 INFO:tasks.workunit.client.1.smithi153.stdout:2/517: stat d7/db/d27/f29 0 2024-09-12T01:43:05.979 INFO:tasks.workunit.client.1.smithi153.stdout:9/572: rename d3/d55/d30/d88/f8c to d3/d55/d30/d88/fab 0 2024-09-12T01:43:05.979 INFO:tasks.workunit.client.1.smithi153.stdout:9/573: creat d3/d3a/d42/d72/d98/d9a/da0/fac x:0 0 0 2024-09-12T01:43:05.980 INFO:tasks.workunit.client.0.smithi066.stdout:3/238: dwrite d5/d6/dd/f14 [0,4194304] 0 2024-09-12T01:43:05.980 INFO:tasks.workunit.client.0.smithi066.stdout:9/204: mkdir d0/d5/dc/d4b 0 2024-09-12T01:43:05.984 INFO:tasks.workunit.client.1.smithi153.stdout:4/491: rename d6/d9/l21 to d6/d9/d11/lb1 0 2024-09-12T01:43:05.984 INFO:tasks.workunit.client.1.smithi153.stdout:4/492: fdatasync d6/fe 0 2024-09-12T01:43:05.985 INFO:tasks.workunit.client.0.smithi066.stdout:5/163: mkdir d0/dd/d18/d36 0 2024-09-12T01:43:05.989 INFO:tasks.workunit.client.1.smithi153.stdout:7/499: truncate d12/f53 8057538 0 2024-09-12T01:43:05.989 INFO:tasks.workunit.client.1.smithi153.stdout:7/500: creat d12/d21/d29/d35/d37/f97 x:0 0 0 2024-09-12T01:43:05.989 INFO:tasks.workunit.client.1.smithi153.stdout:7/501: chown d12/l2a 14 1 2024-09-12T01:43:05.989 INFO:tasks.workunit.client.1.smithi153.stdout:7/502: creat d12/d21/d29/d35/d37/d58/f98 x:0 0 0 2024-09-12T01:43:05.989 INFO:tasks.workunit.client.1.smithi153.stdout:7/503: creat d12/d21/d29/f99 x:0 0 0 2024-09-12T01:43:05.990 INFO:tasks.workunit.client.0.smithi066.stdout:0/254: dwrite d1/dc/df/d1b/d26/f2e [0,4194304] 0 2024-09-12T01:43:05.990 INFO:tasks.workunit.client.1.smithi153.stdout:0/623: dwrite d22/d30/d4c/d6f/d88/faa [0,4194304] 0 2024-09-12T01:43:05.991 INFO:tasks.workunit.client.1.smithi153.stdout:0/624: write d22/d30/d4c/d6f/d88/fbc [210299,125394] 0 2024-09-12T01:43:05.991 INFO:tasks.workunit.client.1.smithi153.stdout:0/625: creat d22/d79/fd8 x:0 0 0 2024-09-12T01:43:05.991 INFO:tasks.workunit.client.0.smithi066.stdout:5/164: unlink d0/dd/l1b 0 2024-09-12T01:43:05.992 INFO:tasks.workunit.client.0.smithi066.stdout:4/198: dread d4/d6/d8/f13 [0,4194304] 0 2024-09-12T01:43:05.992 INFO:tasks.workunit.client.0.smithi066.stdout:4/199: dread - d4/d15/f38 zero size 2024-09-12T01:43:05.992 INFO:tasks.workunit.client.1.smithi153.stdout:3/581: write d1/d13/d25/d26/f5a [875853,104136] 0 2024-09-12T01:43:05.997 INFO:tasks.workunit.client.0.smithi066.stdout:5/165: rmdir d0/dd/d18 39 2024-09-12T01:43:05.997 INFO:tasks.workunit.client.0.smithi066.stdout:5/166: stat d0/d26/d2f/d30 0 2024-09-12T01:43:05.998 INFO:tasks.workunit.client.0.smithi066.stdout:9/205: dread d0/f3c [0,4194304] 0 2024-09-12T01:43:06.000 INFO:tasks.workunit.client.0.smithi066.stdout:9/206: dread d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:06.000 INFO:tasks.workunit.client.1.smithi153.stdout:9/574: rename d3/d55/c38 to d3/d55/d30/d95/d84/d8b/cad 0 2024-09-12T01:43:06.001 INFO:tasks.workunit.client.1.smithi153.stdout:2/518: read d7/d19/f4b [1781809,120747] 0 2024-09-12T01:43:06.003 INFO:tasks.workunit.client.1.smithi153.stdout:6/585: dwrite d1/d6/d23/f6e [0,4194304] 0 2024-09-12T01:43:06.003 INFO:tasks.workunit.client.1.smithi153.stdout:8/542: dwrite d17/d21/d56/f84 [0,4194304] 0 2024-09-12T01:43:06.003 INFO:tasks.workunit.client.1.smithi153.stdout:8/543: creat d17/d21/fb5 x:0 0 0 2024-09-12T01:43:06.004 INFO:tasks.workunit.client.1.smithi153.stdout:8/544: dread - d17/f85 zero size 2024-09-12T01:43:06.004 INFO:tasks.workunit.client.1.smithi153.stdout:4/493: link d6/d9/c89 d6/d9/d20/cb2 0 2024-09-12T01:43:06.004 INFO:tasks.workunit.client.1.smithi153.stdout:4/494: write d6/f53 [1959553,83438] 0 2024-09-12T01:43:06.004 INFO:tasks.workunit.client.0.smithi066.stdout:0/255: dread d1/dc/de/f2a [0,4194304] 0 2024-09-12T01:43:06.005 INFO:tasks.workunit.client.0.smithi066.stdout:4/200: dread d4/d6/f23 [0,4194304] 0 2024-09-12T01:43:06.006 INFO:tasks.workunit.client.1.smithi153.stdout:1/621: dwrite d2/d9/d1d/d25/f35 [0,4194304] 0 2024-09-12T01:43:06.006 INFO:tasks.workunit.client.1.smithi153.stdout:5/545: dwrite d0/d43/f92 [0,4194304] 0 2024-09-12T01:43:06.011 INFO:tasks.workunit.client.0.smithi066.stdout:3/239: write d5/d6/d1b/d28/f2b [509627,97624] 0 2024-09-12T01:43:06.011 INFO:tasks.workunit.client.0.smithi066.stdout:3/240: truncate d5/ff 1001179 0 2024-09-12T01:43:06.011 INFO:tasks.workunit.client.0.smithi066.stdout:3/241: chown d5/d6/d1b/d31/f47 409535 1 2024-09-12T01:43:06.012 INFO:tasks.workunit.client.1.smithi153.stdout:4/495: dread d6/d9/dc/d98/f7e [0,4194304] 0 2024-09-12T01:43:06.012 INFO:tasks.workunit.client.1.smithi153.stdout:4/496: read f0 [1741325,29089] 0 2024-09-12T01:43:06.012 INFO:tasks.workunit.client.1.smithi153.stdout:4/497: chown d6/d9/lae 1015 1 2024-09-12T01:43:06.016 INFO:tasks.workunit.client.1.smithi153.stdout:9/575: dread d3/d35/f37 [0,4194304] 0 2024-09-12T01:43:06.016 INFO:tasks.workunit.client.1.smithi153.stdout:7/504: symlink d12/d7e/l9a 0 2024-09-12T01:43:06.020 INFO:tasks.workunit.client.0.smithi066.stdout:9/207: rename d0/d5/dc to d0/d6/d17/d1b/d4c 0 2024-09-12T01:43:06.028 INFO:tasks.workunit.client.1.smithi153.stdout:9/576: write d3/d5f/d62/f64 [7739423,67322] 0 2024-09-12T01:43:06.028 INFO:tasks.workunit.client.1.smithi153.stdout:9/577: write d3/f29 [204781,82598] 0 2024-09-12T01:43:06.029 INFO:tasks.workunit.client.1.smithi153.stdout:0/626: creat d22/d79/dca/fd9 x:0 0 0 2024-09-12T01:43:06.030 INFO:tasks.workunit.client.0.smithi066.stdout:0/256: creat d1/dc/df/d1b/d26/d42/f5d x:0 0 0 2024-09-12T01:43:06.032 INFO:tasks.workunit.client.1.smithi153.stdout:3/582: mknod d1/d13/d25/da6/cad 0 2024-09-12T01:43:06.032 INFO:tasks.workunit.client.0.smithi066.stdout:9/208: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:06.032 INFO:tasks.workunit.client.0.smithi066.stdout:9/209: readlink d0/d6/d17/d1b/d4c/l2f 0 2024-09-12T01:43:06.032 INFO:tasks.workunit.client.0.smithi066.stdout:9/210: stat d0/d5/d12 0 2024-09-12T01:43:06.036 INFO:tasks.workunit.client.0.smithi066.stdout:5/167: dwrite d0/d21/d27/f1e [4194304,4194304] 0 2024-09-12T01:43:06.036 INFO:tasks.workunit.client.0.smithi066.stdout:5/168: read - d0/d26/f35 zero size 2024-09-12T01:43:06.036 INFO:tasks.workunit.client.0.smithi066.stdout:3/242: creat d5/d35/f4d x:0 0 0 2024-09-12T01:43:06.038 INFO:tasks.workunit.client.0.smithi066.stdout:0/257: mkdir d1/dc/df/d20/d5e 0 2024-09-12T01:43:06.038 INFO:tasks.workunit.client.0.smithi066.stdout:0/258: chown d1 120 1 2024-09-12T01:43:06.038 INFO:tasks.workunit.client.0.smithi066.stdout:0/259: readlink d1/dc/df/d3e/l44 0 2024-09-12T01:43:06.039 INFO:tasks.workunit.client.0.smithi066.stdout:0/260: readlink d1/dc/df/d3e/l45 0 2024-09-12T01:43:06.039 INFO:tasks.workunit.client.0.smithi066.stdout:0/261: chown d1/dc/de/d46/f58 87097 1 2024-09-12T01:43:06.039 INFO:tasks.workunit.client.0.smithi066.stdout:0/262: truncate d1/f28 797137 0 2024-09-12T01:43:06.039 INFO:tasks.workunit.client.1.smithi153.stdout:6/586: link d1/d6/d23/d98/d4f/l5c d1/lbd 0 2024-09-12T01:43:06.039 INFO:tasks.workunit.client.1.smithi153.stdout:6/587: dread - d1/d6/da/f37 zero size 2024-09-12T01:43:06.040 INFO:tasks.workunit.client.0.smithi066.stdout:9/211: creat d0/d6/d17/f4d x:0 0 0 2024-09-12T01:43:06.042 INFO:tasks.workunit.client.0.smithi066.stdout:3/243: unlink d5/d6/d1b/d31/f47 0 2024-09-12T01:43:06.043 INFO:tasks.workunit.client.0.smithi066.stdout:0/263: dread d1/f28 [0,4194304] 0 2024-09-12T01:43:06.044 INFO:tasks.workunit.client.0.smithi066.stdout:3/244: rename d5/d6/dd/f4b to d5/d6/d40/f4e 0 2024-09-12T01:43:06.044 INFO:tasks.workunit.client.1.smithi153.stdout:8/545: symlink d17/d1d/lb6 0 2024-09-12T01:43:06.045 INFO:tasks.workunit.client.0.smithi066.stdout:9/212: dread d0/d5/d12/f25 [0,4194304] 0 2024-09-12T01:43:06.045 INFO:tasks.workunit.client.0.smithi066.stdout:9/213: chown d0/d6/f13 349165595 1 2024-09-12T01:43:06.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/214: rename d0/d5/d9/c3e to d0/d6/d43/c4e 0 2024-09-12T01:43:06.049 INFO:tasks.workunit.client.1.smithi153.stdout:1/622: creat d2/d9/fc6 x:0 0 0 2024-09-12T01:43:06.049 INFO:tasks.workunit.client.1.smithi153.stdout:1/623: chown d2/d9/d28/d73/fb7 385940182 1 2024-09-12T01:43:06.049 INFO:tasks.workunit.client.1.smithi153.stdout:1/624: chown d2/d9/d17/lbb 929 1 2024-09-12T01:43:06.049 INFO:tasks.workunit.client.1.smithi153.stdout:1/625: truncate d2/d9/d1d/d25/f35 4270218 0 2024-09-12T01:43:06.049 INFO:tasks.workunit.client.1.smithi153.stdout:1/626: chown d2/d9/c13 1268 1 2024-09-12T01:43:06.050 INFO:tasks.workunit.client.0.smithi066.stdout:3/245: getdents d5/d6/d1b/d28 0 2024-09-12T01:43:06.050 INFO:tasks.workunit.client.0.smithi066.stdout:5/169: dread d0/f17 [0,4194304] 0 2024-09-12T01:43:06.051 INFO:tasks.workunit.client.1.smithi153.stdout:5/546: mkdir d0/d15/dae 0 2024-09-12T01:43:06.052 INFO:tasks.workunit.client.0.smithi066.stdout:9/215: unlink d0/d5/d9/l4a 0 2024-09-12T01:43:06.053 INFO:tasks.workunit.client.1.smithi153.stdout:6/588: dread d1/df/f50 [4194304,4194304] 0 2024-09-12T01:43:06.057 INFO:tasks.workunit.client.1.smithi153.stdout:9/578: unlink d3/d35/f5c 0 2024-09-12T01:43:06.057 INFO:tasks.workunit.client.1.smithi153.stdout:2/519: dwrite d7/db/d6c/d76/fa1 [0,4194304] 0 2024-09-12T01:43:06.059 INFO:tasks.workunit.client.1.smithi153.stdout:7/505: dwrite d12/f20 [0,4194304] 0 2024-09-12T01:43:06.059 INFO:tasks.workunit.client.1.smithi153.stdout:3/583: dwrite d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:06.059 INFO:tasks.workunit.client.1.smithi153.stdout:0/627: symlink d22/d79/d8e/lda 0 2024-09-12T01:43:06.059 INFO:tasks.workunit.client.1.smithi153.stdout:3/584: creat d1/d13/d25/d26/fae x:0 0 0 2024-09-12T01:43:06.060 INFO:tasks.workunit.client.1.smithi153.stdout:3/585: stat d1/d13/d23/d47/d6c 0 2024-09-12T01:43:06.060 INFO:tasks.workunit.client.1.smithi153.stdout:3/586: truncate d1/d16/d17/d82/d92/fac 765015 0 2024-09-12T01:43:06.060 INFO:tasks.workunit.client.1.smithi153.stdout:3/587: dread - d1/d13/d23/d47/d6c/fa8 zero size 2024-09-12T01:43:06.060 INFO:tasks.workunit.client.1.smithi153.stdout:0/628: write d22/d30/fd2 [1032866,70156] 0 2024-09-12T01:43:06.060 INFO:tasks.workunit.client.1.smithi153.stdout:0/629: truncate d22/d30/d4c/d6f/f70 1285477 0 2024-09-12T01:43:06.061 INFO:tasks.workunit.client.0.smithi066.stdout:0/264: dread d1/dc/df/d1b/d26/f2e [0,4194304] 0 2024-09-12T01:43:06.061 INFO:tasks.workunit.client.1.smithi153.stdout:1/627: truncate d2/d9/f32 272486 0 2024-09-12T01:43:06.062 INFO:tasks.workunit.client.0.smithi066.stdout:4/201: dwrite d4/f16 [0,4194304] 0 2024-09-12T01:43:06.063 INFO:tasks.workunit.client.1.smithi153.stdout:1/628: dread d2/d9/d17/d69/f70 [0,4194304] 0 2024-09-12T01:43:06.069 INFO:tasks.workunit.client.1.smithi153.stdout:2/520: fsync d7/f51 0 2024-09-12T01:43:06.069 INFO:tasks.workunit.client.1.smithi153.stdout:2/521: write d7/db/f25 [4855800,93917] 0 2024-09-12T01:43:06.069 INFO:tasks.workunit.client.1.smithi153.stdout:2/522: creat d7/db/d6c/d76/fa8 x:0 0 0 2024-09-12T01:43:06.071 INFO:tasks.workunit.client.1.smithi153.stdout:7/506: creat d12/d21/d29/d35/d37/d4c/f9b x:0 0 0 2024-09-12T01:43:06.072 INFO:tasks.workunit.client.0.smithi066.stdout:3/246: dwrite d5/ff [0,4194304] 0 2024-09-12T01:43:06.072 INFO:tasks.workunit.client.0.smithi066.stdout:3/247: readlink d5/d6/d1b/l23 0 2024-09-12T01:43:06.076 INFO:tasks.workunit.client.1.smithi153.stdout:3/588: link d1/d13/d25/da6/f9e d1/d16/faf 0 2024-09-12T01:43:06.076 INFO:tasks.workunit.client.1.smithi153.stdout:3/589: readlink d1/d13/d23/d47/l95 0 2024-09-12T01:43:06.077 INFO:tasks.workunit.client.1.smithi153.stdout:0/630: link d22/d30/d4c/d6f/d88/fc3 d22/d79/d8e/dae/fdb 0 2024-09-12T01:43:06.077 INFO:tasks.workunit.client.1.smithi153.stdout:0/631: chown d22/d79/d8e/dae/db7/fc9 16 1 2024-09-12T01:43:06.078 INFO:tasks.workunit.client.0.smithi066.stdout:3/248: mkdir d5/d6/d1b/d28/d4f 0 2024-09-12T01:43:06.079 INFO:tasks.workunit.client.0.smithi066.stdout:4/202: truncate f3 6617232 0 2024-09-12T01:43:06.079 INFO:tasks.workunit.client.0.smithi066.stdout:4/203: write d4/f17 [5762667,102964] 0 2024-09-12T01:43:06.080 INFO:tasks.workunit.client.0.smithi066.stdout:4/204: write d4/d6/d8/f32 [443981,117569] 0 2024-09-12T01:43:06.081 INFO:tasks.workunit.client.1.smithi153.stdout:5/547: unlink d0/df/d83/d36/c45 0 2024-09-12T01:43:06.081 INFO:tasks.workunit.client.1.smithi153.stdout:5/548: chown d0/d43/d8d/f90 405676267 1 2024-09-12T01:43:06.083 INFO:tasks.workunit.client.0.smithi066.stdout:5/170: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:43:06.083 INFO:tasks.workunit.client.0.smithi066.stdout:5/171: chown d0/d26/f35 878 1 2024-09-12T01:43:06.083 INFO:tasks.workunit.client.0.smithi066.stdout:5/172: fdatasync d0/f4 0 2024-09-12T01:43:06.084 INFO:tasks.workunit.client.1.smithi153.stdout:6/589: dwrite d1/d6/da/d19/d3a/f9f [0,4194304] 0 2024-09-12T01:43:06.084 INFO:tasks.workunit.client.0.smithi066.stdout:4/205: mknod d4/d6/d8/d18/c44 0 2024-09-12T01:43:06.084 INFO:tasks.workunit.client.0.smithi066.stdout:4/206: truncate d4/f37 27410 0 2024-09-12T01:43:06.085 INFO:tasks.workunit.client.0.smithi066.stdout:4/207: fsync d4/d6/f34 0 2024-09-12T01:43:06.085 INFO:tasks.workunit.client.0.smithi066.stdout:4/208: read d4/f37 [11017,130288] 0 2024-09-12T01:43:06.085 INFO:tasks.workunit.client.0.smithi066.stdout:4/209: fsync d4/d6/f30 0 2024-09-12T01:43:06.087 INFO:tasks.workunit.client.0.smithi066.stdout:3/249: dread f3 [0,4194304] 0 2024-09-12T01:43:06.095 INFO:tasks.workunit.client.1.smithi153.stdout:1/629: mkdir d2/d68/d6b/d9e/dc7 0 2024-09-12T01:43:06.097 INFO:tasks.workunit.client.1.smithi153.stdout:9/579: getdents d3/d3a/d42 0 2024-09-12T01:43:06.097 INFO:tasks.workunit.client.1.smithi153.stdout:9/580: stat d3/d55/l69 0 2024-09-12T01:43:06.101 INFO:tasks.workunit.client.0.smithi066.stdout:3/250: dwrite d5/d6/d1b/d45/f49 [0,4194304] 0 2024-09-12T01:43:06.101 INFO:tasks.workunit.client.0.smithi066.stdout:9/216: rename d0/d5 to d0/d6/d17/d4f 0 2024-09-12T01:43:06.101 INFO:tasks.workunit.client.0.smithi066.stdout:0/265: rename d1/dc/df/d1b to d1/dc/df/d1b/d26/d5b/d5f 22 2024-09-12T01:43:06.102 INFO:tasks.workunit.client.0.smithi066.stdout:9/217: chown d0/d6/f2d 6172 1 2024-09-12T01:43:06.106 INFO:tasks.workunit.client.0.smithi066.stdout:4/210: unlink d4/d6/l9 0 2024-09-12T01:43:06.106 INFO:tasks.workunit.client.0.smithi066.stdout:9/218: dread d0/d6/d17/d4f/d9/fa [0,4194304] 0 2024-09-12T01:43:06.107 INFO:tasks.workunit.client.1.smithi153.stdout:7/507: creat d12/d21/d29/d35/d95/f9c x:0 0 0 2024-09-12T01:43:06.109 INFO:tasks.workunit.client.1.smithi153.stdout:3/590: mkdir d1/d64/db0 0 2024-09-12T01:43:06.111 INFO:tasks.workunit.client.1.smithi153.stdout:7/508: write d12/f1b [705827,16051] 0 2024-09-12T01:43:06.112 INFO:tasks.workunit.client.0.smithi066.stdout:0/266: dread d1/dc/f5c [4194304,4194304] 0 2024-09-12T01:43:06.112 INFO:tasks.workunit.client.1.smithi153.stdout:5/549: mknod d0/df/caf 0 2024-09-12T01:43:06.114 INFO:tasks.workunit.client.0.smithi066.stdout:0/267: write d1/dc/df/d20/f35 [583974,63734] 0 2024-09-12T01:43:06.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/590: mknod d1/df/d9d/cbe 0 2024-09-12T01:43:06.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/591: chown d1/d6/d46/d73/d8a/l74 3 1 2024-09-12T01:43:06.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/592: creat d1/d80/fbf x:0 0 0 2024-09-12T01:43:06.115 INFO:tasks.workunit.client.1.smithi153.stdout:6/593: chown d1/d6/d23/d98/d53/f85 585949 1 2024-09-12T01:43:06.116 INFO:tasks.workunit.client.0.smithi066.stdout:0/268: dread d1/f28 [0,4194304] 0 2024-09-12T01:43:06.116 INFO:tasks.workunit.client.0.smithi066.stdout:0/269: truncate d1/dc/de/d47/f5a 1020353 0 2024-09-12T01:43:06.116 INFO:tasks.workunit.client.0.smithi066.stdout:5/173: rmdir d0 39 2024-09-12T01:43:06.117 INFO:tasks.workunit.client.1.smithi153.stdout:1/630: symlink d2/d68/d6b/d9e/lc8 0 2024-09-12T01:43:06.119 INFO:tasks.workunit.client.1.smithi153.stdout:9/581: rename d3/d66/l67 to d3/d55/lae 0 2024-09-12T01:43:06.120 INFO:tasks.workunit.client.1.smithi153.stdout:9/582: read d3/f29 [1063644,75505] 0 2024-09-12T01:43:06.120 INFO:tasks.workunit.client.1.smithi153.stdout:9/583: chown d3/d3a/d42/d72/d98/d9a/da0/fac 713505542 1 2024-09-12T01:43:06.120 INFO:tasks.workunit.client.1.smithi153.stdout:9/584: fsync d3/d35/f79 0 2024-09-12T01:43:06.122 INFO:tasks.workunit.client.1.smithi153.stdout:2/523: mkdir d7/d17/da9 0 2024-09-12T01:43:06.123 INFO:tasks.workunit.client.0.smithi066.stdout:3/251: mkdir d5/d6/dd/d50 0 2024-09-12T01:43:06.125 INFO:tasks.workunit.client.1.smithi153.stdout:3/591: mkdir d1/d13/d23/d47/d71/d8e/d93/db1 0 2024-09-12T01:43:06.126 INFO:tasks.workunit.client.0.smithi066.stdout:4/211: truncate d4/d6/d8/f13 868442 0 2024-09-12T01:43:06.128 INFO:tasks.workunit.client.0.smithi066.stdout:9/219: creat d0/d6/f50 x:0 0 0 2024-09-12T01:43:06.129 INFO:tasks.workunit.client.1.smithi153.stdout:0/632: rmdir d22/d79/d8e/dae 39 2024-09-12T01:43:06.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/270: symlink d1/dc/df/l60 0 2024-09-12T01:43:06.131 INFO:tasks.workunit.client.0.smithi066.stdout:0/271: fdatasync d1/f4d 0 2024-09-12T01:43:06.132 INFO:tasks.workunit.client.1.smithi153.stdout:7/509: symlink d12/d21/d29/d35/d37/d58/l9d 0 2024-09-12T01:43:06.132 INFO:tasks.workunit.client.0.smithi066.stdout:4/212: read d4/d6/d8/f43 [3458569,110625] 0 2024-09-12T01:43:06.134 INFO:tasks.workunit.client.0.smithi066.stdout:5/174: mknod d0/d26/c37 0 2024-09-12T01:43:06.135 INFO:tasks.workunit.client.0.smithi066.stdout:5/175: dread d0/d21/d27/f10 [0,4194304] 0 2024-09-12T01:43:06.136 INFO:tasks.workunit.client.0.smithi066.stdout:3/252: rename d5/d6/d1b/f27 to d5/d6/d1b/d28/d4f/f51 0 2024-09-12T01:43:06.139 INFO:tasks.workunit.client.1.smithi153.stdout:6/594: mknod d1/d6/d46/d73/cc0 0 2024-09-12T01:43:06.139 INFO:tasks.workunit.client.1.smithi153.stdout:6/595: chown d1/d6/f44 30 1 2024-09-12T01:43:06.141 INFO:tasks.workunit.client.1.smithi153.stdout:1/631: unlink d2/d9/f1b 0 2024-09-12T01:43:06.143 INFO:tasks.workunit.client.1.smithi153.stdout:2/524: rename d7/db/d27/l57 to d7/d17/laa 0 2024-09-12T01:43:06.144 INFO:tasks.workunit.client.0.smithi066.stdout:3/253: dread d5/d6/d1b/d28/f2c [0,4194304] 0 2024-09-12T01:43:06.146 INFO:tasks.workunit.client.1.smithi153.stdout:1/632: read d2/d68/fae [46084,16184] 0 2024-09-12T01:43:06.146 INFO:tasks.workunit.client.1.smithi153.stdout:1/633: fsync d2/d9/d1d/d25/f4a 0 2024-09-12T01:43:06.146 INFO:tasks.workunit.client.1.smithi153.stdout:0/633: mknod d22/d30/d4c/d6e/d7f/dbd/cdc 0 2024-09-12T01:43:06.147 INFO:tasks.workunit.client.1.smithi153.stdout:0/634: write d22/d30/d4c/fd4 [1091361,69755] 0 2024-09-12T01:43:06.147 INFO:tasks.workunit.client.1.smithi153.stdout:7/510: mknod d12/d21/d29/d35/d37/d58/c9e 0 2024-09-12T01:43:06.149 INFO:tasks.workunit.client.1.smithi153.stdout:5/550: unlink d0/df/d83/l73 0 2024-09-12T01:43:06.151 INFO:tasks.workunit.client.1.smithi153.stdout:6/596: unlink d1/d6/da/d19/f64 0 2024-09-12T01:43:06.152 INFO:tasks.workunit.client.1.smithi153.stdout:0/635: dread d22/d82/fa4 [4194304,4194304] 0 2024-09-12T01:43:06.152 INFO:tasks.workunit.client.1.smithi153.stdout:9/585: dwrite d3/d55/d30/f86 [0,4194304] 0 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:2/234: sync 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:1/184: sync 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:8/262: sync 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:7/178: sync 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:2/235: chown de/d13/d1e/d22/f44 0 1 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:8/263: truncate d12/f23 1795153 0 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:7/179: truncate d2/d20/d2f/f34 984154 0 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:7/180: chown d2/c2c 116 1 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:6/296: sync 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:1/185: creat d5/dc/dd/f31 x:0 0 0 2024-09-12T01:43:06.153 INFO:tasks.workunit.client.0.smithi066.stdout:1/186: truncate d5/dc/f12 4311471 0 2024-09-12T01:43:06.154 INFO:tasks.workunit.client.1.smithi153.stdout:2/525: mknod d7/d17/da4/cab 0 2024-09-12T01:43:06.154 INFO:tasks.workunit.client.0.smithi066.stdout:4/213: getdents d4/d6 0 2024-09-12T01:43:06.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:06 smithi153 ceph-mon[34713]: pgmap v243: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 114 MiB/s rd, 152 MiB/s wr, 595 op/s 2024-09-12T01:43:06.155 INFO:tasks.workunit.client.1.smithi153.stdout:3/592: getdents d1/d13/d25/d26 0 2024-09-12T01:43:06.156 INFO:tasks.workunit.client.0.smithi066.stdout:2/236: dread de/d13/d28/f2f [0,4194304] 0 2024-09-12T01:43:06.157 INFO:tasks.workunit.client.0.smithi066.stdout:2/237: stat de 0 2024-09-12T01:43:06.157 INFO:tasks.workunit.client.0.smithi066.stdout:2/238: chown de/d13/l2a 386 1 2024-09-12T01:43:06.158 INFO:tasks.workunit.client.0.smithi066.stdout:8/264: mkdir d12/d26/d3c/d49/d50 0 2024-09-12T01:43:06.159 INFO:tasks.workunit.client.1.smithi153.stdout:5/551: unlink d0/d15/f2a 0 2024-09-12T01:43:06.161 INFO:tasks.workunit.client.1.smithi153.stdout:9/586: write d3/d35/f5d [3772146,130519] 0 2024-09-12T01:43:06.161 INFO:tasks.workunit.client.0.smithi066.stdout:7/181: link d2/l37 d2/d5/da/l38 0 2024-09-12T01:43:06.161 INFO:tasks.workunit.client.1.smithi153.stdout:6/597: mknod d1/d6/d23/d98/d53/d8d/cc1 0 2024-09-12T01:43:06.164 INFO:tasks.workunit.client.0.smithi066.stdout:6/297: rename d2/d21/f2c to d2/d31/d57/f66 0 2024-09-12T01:43:06.165 INFO:tasks.workunit.client.1.smithi153.stdout:2/526: write d7/db/d1d/f35 [46671,41753] 0 2024-09-12T01:43:06.166 INFO:tasks.workunit.client.1.smithi153.stdout:0/636: rename d22/d30/d4c/f9f to d22/d30/d4c/d8a/fdd 0 2024-09-12T01:43:06.171 INFO:tasks.workunit.client.0.smithi066.stdout:4/214: mkdir d4/d6/d8/d18/d45 0 2024-09-12T01:43:06.171 INFO:tasks.workunit.client.0.smithi066.stdout:4/215: truncate d4/d6/d8/f3b 337587 0 2024-09-12T01:43:06.171 INFO:tasks.workunit.client.0.smithi066.stdout:4/216: readlink d4/d15/d33/l40 0 2024-09-12T01:43:06.173 INFO:tasks.workunit.client.1.smithi153.stdout:5/552: write d0/d15/f6f [4117141,19565] 0 2024-09-12T01:43:06.174 INFO:tasks.workunit.client.1.smithi153.stdout:5/553: chown d0/df/d1c/d22/d2f/d55/d9c 13 1 2024-09-12T01:43:06.174 INFO:tasks.workunit.client.0.smithi066.stdout:7/182: dread d2/f2b [0,4194304] 0 2024-09-12T01:43:06.175 INFO:tasks.workunit.client.0.smithi066.stdout:2/239: unlink de/d13/l2a 0 2024-09-12T01:43:06.176 INFO:tasks.workunit.client.1.smithi153.stdout:3/593: dread d1/d13/d25/d26/f5a [0,4194304] 0 2024-09-12T01:43:06.177 INFO:tasks.workunit.client.1.smithi153.stdout:7/511: getdents d12/d4e 0 2024-09-12T01:43:06.177 INFO:tasks.workunit.client.1.smithi153.stdout:7/512: readlink d12/d21/d29/d35/d37/l61 0 2024-09-12T01:43:06.178 INFO:tasks.workunit.client.0.smithi066.stdout:8/265: symlink d12/d21/l51 0 2024-09-12T01:43:06.178 INFO:tasks.workunit.client.0.smithi066.stdout:8/266: creat d12/d26/d43/f52 x:0 0 0 2024-09-12T01:43:06.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/272: dwrite d1/dc/de/d46/f58 [0,4194304] 0 2024-09-12T01:43:06.183 INFO:tasks.workunit.client.0.smithi066.stdout:6/298: creat d2/d31/d57/f67 x:0 0 0 2024-09-12T01:43:06.183 INFO:tasks.workunit.client.0.smithi066.stdout:6/299: write d2/f45 [378710,42368] 0 2024-09-12T01:43:06.183 INFO:tasks.workunit.client.0.smithi066.stdout:9/220: dwrite d0/d6/f50 [0,4194304] 0 2024-09-12T01:43:06.185 INFO:tasks.workunit.client.0.smithi066.stdout:5/176: dwrite d0/d21/f32 [0,4194304] 0 2024-09-12T01:43:06.186 INFO:tasks.workunit.client.0.smithi066.stdout:7/183: dread d2/d5/d6/d22/f30 [0,4194304] 0 2024-09-12T01:43:06.186 INFO:tasks.workunit.client.0.smithi066.stdout:7/184: dread - d2/d5/d6/d22/f33 zero size 2024-09-12T01:43:06.186 INFO:tasks.workunit.client.1.smithi153.stdout:6/598: creat d1/d6/d46/d73/d8a/d84/d96/fc2 x:0 0 0 2024-09-12T01:43:06.186 INFO:tasks.workunit.client.1.smithi153.stdout:6/599: write d1/df/f8e [284481,62982] 0 2024-09-12T01:43:06.186 INFO:tasks.workunit.client.1.smithi153.stdout:6/600: readlink d1/d6/da/d19/d94/laa 0 2024-09-12T01:43:06.186 INFO:tasks.workunit.client.1.smithi153.stdout:3/594: dread d1/d13/d25/f42 [0,4194304] 0 2024-09-12T01:43:06.188 INFO:tasks.workunit.client.1.smithi153.stdout:2/527: write d7/d4d/d70/f92 [562060,8711] 0 2024-09-12T01:43:06.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/634: dwrite d2/d9/f7b [0,4194304] 0 2024-09-12T01:43:06.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/635: write d2/d9/f64 [276220,77391] 0 2024-09-12T01:43:06.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/636: fsync d2/d9/d1d/d25/f38 0 2024-09-12T01:43:06.190 INFO:tasks.workunit.client.0.smithi066.stdout:4/217: rename f3 to d4/f46 0 2024-09-12T01:43:06.190 INFO:tasks.workunit.client.0.smithi066.stdout:4/218: dread - d4/d15/f38 zero size 2024-09-12T01:43:06.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/554: dwrite d0/df/d1c/d22/d2f/f87 [0,4194304] 0 2024-09-12T01:43:06.191 INFO:tasks.workunit.client.1.smithi153.stdout:9/587: dread d3/f6a [0,4194304] 0 2024-09-12T01:43:06.191 INFO:tasks.workunit.client.1.smithi153.stdout:5/555: fsync d0/df/d1c/d22/d2f/d55/d9c/d75/f8c 0 2024-09-12T01:43:06.193 INFO:tasks.workunit.client.0.smithi066.stdout:2/240: unlink de/f26 0 2024-09-12T01:43:06.193 INFO:tasks.workunit.client.0.smithi066.stdout:2/241: write de/d13/d1e/d22/f48 [476932,21144] 0 2024-09-12T01:43:06.193 INFO:tasks.workunit.client.0.smithi066.stdout:2/242: read - de/d13/d1e/d25/f33 zero size 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/243: write de/f12 [1228953,34750] 0 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/244: fsync de/d13/d28/d3a/f4d 0 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/245: readlink de/d13/l39 0 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/246: write de/d13/d28/f35 [4705930,99872] 0 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/247: fdatasync de/d13/d1e/f36 0 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.1.smithi153.stdout:2/528: dread d7/db/d6c/d7e/f66 [0,4194304] 0 2024-09-12T01:43:06.194 INFO:tasks.workunit.client.1.smithi153.stdout:7/513: symlink d12/d21/d29/d35/d37/d58/l9f 0 2024-09-12T01:43:06.195 INFO:tasks.workunit.client.1.smithi153.stdout:1/637: dread d2/d9/d17/d2f/d56/d91/f9f [0,4194304] 0 2024-09-12T01:43:06.195 INFO:tasks.workunit.client.1.smithi153.stdout:1/638: creat d2/d9/d17/d2f/d56/fc9 x:0 0 0 2024-09-12T01:43:06.201 INFO:tasks.workunit.client.1.smithi153.stdout:6/601: mknod d1/d6/d46/d73/d8a/d84/d96/cc3 0 2024-09-12T01:43:06.203 INFO:tasks.workunit.client.0.smithi066.stdout:8/267: mkdir d12/d21/d2f/d53 0 2024-09-12T01:43:06.203 INFO:tasks.workunit.client.1.smithi153.stdout:5/556: write d0/d15/f53 [126069,77091] 0 2024-09-12T01:43:06.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/529: dread d7/db/d6c/d7e/f5f [0,4194304] 0 2024-09-12T01:43:06.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/530: chown d7/d4d/d7b/f90 1425 1 2024-09-12T01:43:06.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/531: fsync d7/d19/f4b 0 2024-09-12T01:43:06.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/532: dread - d7/d19/d83/fa7 zero size 2024-09-12T01:43:06.204 INFO:tasks.workunit.client.1.smithi153.stdout:2/533: creat d7/d19/d40/fac x:0 0 0 2024-09-12T01:43:06.205 INFO:tasks.workunit.client.1.smithi153.stdout:3/595: rename d1/d13/d25/d26/d4b/c9b to d1/d13/d23/d47/d6c/d9c/cb2 0 2024-09-12T01:43:06.205 INFO:tasks.workunit.client.1.smithi153.stdout:3/596: creat d1/d16/d1c/fb3 x:0 0 0 2024-09-12T01:43:06.206 INFO:tasks.workunit.client.0.smithi066.stdout:1/187: getdents d5/dc/dd 0 2024-09-12T01:43:06.214 INFO:tasks.workunit.client.0.smithi066.stdout:0/273: dwrite d1/f28 [0,4194304] 0 2024-09-12T01:43:06.215 INFO:tasks.workunit.client.0.smithi066.stdout:0/274: chown d1/dc/de/d47/d4a/c56 34458982 1 2024-09-12T01:43:06.215 INFO:tasks.workunit.client.1.smithi153.stdout:6/602: write d1/d6/da/d19/d34/f20 [1751085,31459] 0 2024-09-12T01:43:06.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/300: symlink d2/d31/d5e/l68 0 2024-09-12T01:43:06.219 INFO:tasks.workunit.client.0.smithi066.stdout:9/221: creat d0/d6/d17/d4f/d9/de/f51 x:0 0 0 2024-09-12T01:43:06.222 INFO:tasks.workunit.client.0.smithi066.stdout:7/185: creat d2/d5/f39 x:0 0 0 2024-09-12T01:43:06.222 INFO:tasks.workunit.client.0.smithi066.stdout:3/254: dwrite d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:06.224 INFO:tasks.workunit.client.0.smithi066.stdout:5/177: rename d0/d21/f32 to d0/dd/d18/d36/f38 0 2024-09-12T01:43:06.225 INFO:tasks.workunit.client.0.smithi066.stdout:4/219: rmdir d4/d6/d27/d2f 39 2024-09-12T01:43:06.226 INFO:tasks.workunit.client.1.smithi153.stdout:3/597: dread d1/d45/f51 [0,4194304] 0 2024-09-12T01:43:06.228 INFO:tasks.workunit.client.1.smithi153.stdout:9/588: getdents d3/d55/d30/d95/d84/d8b 0 2024-09-12T01:43:06.229 INFO:tasks.workunit.client.0.smithi066.stdout:8/268: stat d12/d21/l29 0 2024-09-12T01:43:06.232 INFO:tasks.workunit.client.0.smithi066.stdout:2/248: dwrite de/d3c/f4a [0,4194304] 0 2024-09-12T01:43:06.232 INFO:tasks.workunit.client.0.smithi066.stdout:2/249: read de/f1c [7585878,89090] 0 2024-09-12T01:43:06.235 INFO:tasks.workunit.client.1.smithi153.stdout:1/639: dwrite d2/d9/fb2 [0,4194304] 0 2024-09-12T01:43:06.235 INFO:tasks.workunit.client.1.smithi153.stdout:2/534: dwrite d7/d4d/d70/d81/f8e [0,4194304] 0 2024-09-12T01:43:06.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/514: unlink d12/d4e/l6d 0 2024-09-12T01:43:06.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/515: creat d12/d21/d29/d35/d37/fa0 x:0 0 0 2024-09-12T01:43:06.236 INFO:tasks.workunit.client.0.smithi066.stdout:1/188: dwrite f1 [4194304,4194304] 0 2024-09-12T01:43:06.237 INFO:tasks.workunit.client.1.smithi153.stdout:7/516: read d12/d21/d29/d35/f6e [181770,123492] 0 2024-09-12T01:43:06.241 INFO:tasks.workunit.client.0.smithi066.stdout:0/275: mkdir d1/dc/df/d1b/d61 0 2024-09-12T01:43:06.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/255: dread f2 [0,4194304] 0 2024-09-12T01:43:06.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/256: fdatasync d5/d35/f4d 0 2024-09-12T01:43:06.245 INFO:tasks.workunit.client.0.smithi066.stdout:6/301: stat d2/l36 0 2024-09-12T01:43:06.249 INFO:tasks.workunit.client.0.smithi066.stdout:9/222: mknod d0/d6/d43/c52 0 2024-09-12T01:43:06.252 INFO:tasks.workunit.client.0.smithi066.stdout:8/269: dwrite ff [0,4194304] 0 2024-09-12T01:43:06.252 INFO:tasks.workunit.client.0.smithi066.stdout:7/186: rename d2/c18 to d2/d5/d6/c3a 0 2024-09-12T01:43:06.252 INFO:tasks.workunit.client.0.smithi066.stdout:7/187: truncate d2/d5/d6/d22/f33 268546 0 2024-09-12T01:43:06.255 INFO:tasks.workunit.client.0.smithi066.stdout:5/178: link d0/dd/l1c d0/d26/d2d/d31/l39 0 2024-09-12T01:43:06.256 INFO:tasks.workunit.client.0.smithi066.stdout:2/250: dwrite fa [0,4194304] 0 2024-09-12T01:43:06.258 INFO:tasks.workunit.client.0.smithi066.stdout:4/220: mkdir d4/d15/d33/d47 0 2024-09-12T01:43:06.259 INFO:tasks.workunit.client.1.smithi153.stdout:6/603: mkdir d1/d6/d39/dc4 0 2024-09-12T01:43:06.262 INFO:tasks.workunit.client.1.smithi153.stdout:5/557: dread d0/df/d83/f4c [0,4194304] 0 2024-09-12T01:43:06.264 INFO:tasks.workunit.client.1.smithi153.stdout:3/598: rename d1/d13/d25/d26/f5a to d1/d64/fb4 0 2024-09-12T01:43:06.265 INFO:tasks.workunit.client.1.smithi153.stdout:3/599: chown d1/d13/d25/d26/d4b 491881 1 2024-09-12T01:43:06.265 INFO:tasks.workunit.client.1.smithi153.stdout:9/589: creat d3/d3a/d42/faf x:0 0 0 2024-09-12T01:43:06.268 INFO:tasks.workunit.client.0.smithi066.stdout:1/189: mknod d5/dc/c32 0 2024-09-12T01:43:06.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/276: unlink d1/dc/df/d1b/d26/l57 0 2024-09-12T01:43:06.273 INFO:tasks.workunit.client.1.smithi153.stdout:1/640: write d2/d9/d28/fbc [529862,45040] 0 2024-09-12T01:43:06.274 INFO:tasks.workunit.client.0.smithi066.stdout:3/257: mkdir d5/d6/d1b/d28/d52 0 2024-09-12T01:43:06.275 INFO:tasks.workunit.client.1.smithi153.stdout:2/535: symlink d7/db/d27/lad 0 2024-09-12T01:43:06.276 INFO:tasks.workunit.client.0.smithi066.stdout:6/302: stat d2/db/d12/d49/c4b 0 2024-09-12T01:43:06.279 INFO:tasks.workunit.client.1.smithi153.stdout:6/604: dwrite d1/d6/d23/f29 [0,4194304] 0 2024-09-12T01:43:06.281 INFO:tasks.workunit.client.0.smithi066.stdout:9/223: write d0/d6/d17/f23 [531960,24971] 0 2024-09-12T01:43:06.281 INFO:tasks.workunit.client.0.smithi066.stdout:9/224: truncate d0/d6/d17/f23 778517 0 2024-09-12T01:43:06.283 INFO:tasks.workunit.client.1.smithi153.stdout:7/517: truncate d12/d21/d4d/f59 1533499 0 2024-09-12T01:43:06.285 INFO:tasks.workunit.client.0.smithi066.stdout:8/270: creat d12/d21/d2f/f54 x:0 0 0 2024-09-12T01:43:06.288 INFO:tasks.workunit.client.1.smithi153.stdout:3/600: mkdir d1/d13/d23/d47/d71/d8e/d93/d79/db5 0 2024-09-12T01:43:06.289 INFO:tasks.workunit.client.0.smithi066.stdout:7/188: creat d2/d20/d1d/f3b x:0 0 0 2024-09-12T01:43:06.289 INFO:tasks.workunit.client.0.smithi066.stdout:7/189: write d2/d5/d6/d22/f33 [669572,83085] 0 2024-09-12T01:43:06.290 INFO:tasks.workunit.client.0.smithi066.stdout:7/190: readlink d2/d5/da/l38 0 2024-09-12T01:43:06.291 INFO:tasks.workunit.client.0.smithi066.stdout:6/303: write d2/f4e [3213406,21949] 0 2024-09-12T01:43:06.291 INFO:tasks.workunit.client.0.smithi066.stdout:6/304: creat d2/d31/f69 x:0 0 0 2024-09-12T01:43:06.291 INFO:tasks.workunit.client.0.smithi066.stdout:6/305: write d2/f38 [622103,84107] 0 2024-09-12T01:43:06.293 INFO:tasks.workunit.client.1.smithi153.stdout:9/590: mknod d3/d35/cb0 0 2024-09-12T01:43:06.294 INFO:tasks.workunit.client.1.smithi153.stdout:1/641: fsync d2/d9/d17/d2f/d56/d83/fc2 0 2024-09-12T01:43:06.296 INFO:tasks.workunit.client.0.smithi066.stdout:5/179: truncate d0/f4 1774696 0 2024-09-12T01:43:06.296 INFO:tasks.workunit.client.0.smithi066.stdout:5/180: write d0/f17 [4099576,91886] 0 2024-09-12T01:43:06.297 INFO:tasks.workunit.client.1.smithi153.stdout:6/605: mknod d1/d6/d23/d98/d53/d8d/cc5 0 2024-09-12T01:43:06.298 INFO:tasks.workunit.client.1.smithi153.stdout:5/558: dwrite d0/df/d1c/d22/f38 [0,4194304] 0 2024-09-12T01:43:06.298 INFO:tasks.workunit.client.1.smithi153.stdout:5/559: truncate d0/d43/d8d/f90 470489 0 2024-09-12T01:43:06.300 INFO:tasks.workunit.client.1.smithi153.stdout:9/591: unlink d3/d3a/l40 0 2024-09-12T01:43:06.300 INFO:tasks.workunit.client.1.smithi153.stdout:9/592: write d3/d3a/d42/fa2 [234883,10416] 0 2024-09-12T01:43:06.300 INFO:tasks.workunit.client.1.smithi153.stdout:9/593: dread - d3/d3a/d42/d72/f94 zero size 2024-09-12T01:43:06.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/601: write d1/d16/d17/f18 [2386242,100691] 0 2024-09-12T01:43:06.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/602: chown d1/d59 967 1 2024-09-12T01:43:06.303 INFO:tasks.workunit.client.0.smithi066.stdout:2/251: link f8 de/d13/d28/f52 0 2024-09-12T01:43:06.303 INFO:tasks.workunit.client.0.smithi066.stdout:2/252: write de/d13/d28/f38 [4996241,68986] 0 2024-09-12T01:43:06.305 INFO:tasks.workunit.client.0.smithi066.stdout:4/221: getdents d4/d6/d14 0 2024-09-12T01:43:06.308 INFO:tasks.workunit.client.0.smithi066.stdout:1/190: link d5/f14 d5/dc/f33 0 2024-09-12T01:43:06.308 INFO:tasks.workunit.client.0.smithi066.stdout:1/191: read d5/f9 [2566447,77345] 0 2024-09-12T01:43:06.308 INFO:tasks.workunit.client.0.smithi066.stdout:1/192: chown d5/f7 817971151 1 2024-09-12T01:43:06.308 INFO:tasks.workunit.client.1.smithi153.stdout:2/536: dwrite d7/db/d62/f7f [0,4194304] 0 2024-09-12T01:43:06.309 INFO:tasks.workunit.client.1.smithi153.stdout:5/560: mkdir d0/d43/dac/db0 0 2024-09-12T01:43:06.309 INFO:tasks.workunit.client.0.smithi066.stdout:3/258: dwrite d5/ff [0,4194304] 0 2024-09-12T01:43:06.309 INFO:tasks.workunit.client.0.smithi066.stdout:3/259: read - d5/f44 zero size 2024-09-12T01:43:06.310 INFO:tasks.workunit.client.0.smithi066.stdout:0/277: mkdir d1/d62 0 2024-09-12T01:43:06.311 INFO:tasks.workunit.client.1.smithi153.stdout:9/594: link d3/d55/l69 d3/d55/d30/d95/d84/d8b/lb1 0 2024-09-12T01:43:06.311 INFO:tasks.workunit.client.1.smithi153.stdout:9/595: creat d3/d3a/fb2 x:0 0 0 2024-09-12T01:43:06.312 INFO:tasks.workunit.client.0.smithi066.stdout:9/225: symlink d0/d6/d37/l53 0 2024-09-12T01:43:06.313 INFO:tasks.workunit.client.1.smithi153.stdout:7/518: dwrite d12/d21/d29/d35/d37/f76 [0,4194304] 0 2024-09-12T01:43:06.313 INFO:tasks.workunit.client.1.smithi153.stdout:1/642: mknod d2/d9/cca 0 2024-09-12T01:43:06.314 INFO:tasks.workunit.client.0.smithi066.stdout:8/271: mknod d12/d21/d2f/d53/c55 0 2024-09-12T01:43:06.315 INFO:tasks.workunit.client.1.smithi153.stdout:3/603: write d1/d16/faf [2845686,17952] 0 2024-09-12T01:43:06.321 INFO:tasks.workunit.client.1.smithi153.stdout:6/606: dwrite d1/f38 [4194304,4194304] 0 2024-09-12T01:43:06.321 INFO:tasks.workunit.client.1.smithi153.stdout:2/537: mkdir d7/d4d/d70/d81/dae 0 2024-09-12T01:43:06.324 INFO:tasks.workunit.client.1.smithi153.stdout:5/561: symlink d0/df/d1c/d22/d2f/d55/d9c/lb1 0 2024-09-12T01:43:06.324 INFO:tasks.workunit.client.1.smithi153.stdout:5/562: truncate d0/df/d1c/d22/d2f/d55/d9c/d75/d58/f85 979101 0 2024-09-12T01:43:06.325 INFO:tasks.workunit.client.0.smithi066.stdout:6/306: unlink d2/l14 0 2024-09-12T01:43:06.325 INFO:tasks.workunit.client.0.smithi066.stdout:8/272: write ff [1529928,74290] 0 2024-09-12T01:43:06.325 INFO:tasks.workunit.client.0.smithi066.stdout:8/273: chown d12/f31 810526 1 2024-09-12T01:43:06.325 INFO:tasks.workunit.client.0.smithi066.stdout:8/274: write d12/f3d [1523371,16664] 0 2024-09-12T01:43:06.325 INFO:tasks.workunit.client.0.smithi066.stdout:8/275: getdents d12/d26/d3c/d49/d50 0 2024-09-12T01:43:06.327 INFO:tasks.workunit.client.0.smithi066.stdout:3/260: write d5/d6/d1b/f3f [1627159,77700] 0 2024-09-12T01:43:06.327 INFO:tasks.workunit.client.0.smithi066.stdout:3/261: readlink d5/d6/d1b/l34 0 2024-09-12T01:43:06.328 INFO:tasks.workunit.client.0.smithi066.stdout:3/262: readlink d5/d35/l43 0 2024-09-12T01:43:06.329 INFO:tasks.workunit.client.0.smithi066.stdout:5/181: rename d0/d21/d27/f10 to d0/d21/d27/f3a 0 2024-09-12T01:43:06.330 INFO:tasks.workunit.client.1.smithi153.stdout:4/498: sync 2024-09-12T01:43:06.330 INFO:tasks.workunit.client.1.smithi153.stdout:8/546: sync 2024-09-12T01:43:06.330 INFO:tasks.workunit.client.1.smithi153.stdout:9/596: mknod d3/d55/d30/d90/cb3 0 2024-09-12T01:43:06.330 INFO:tasks.workunit.client.1.smithi153.stdout:9/597: creat d3/d55/fb4 x:0 0 0 2024-09-12T01:43:06.330 INFO:tasks.workunit.client.1.smithi153.stdout:9/598: fsync d3/d35/f37 0 2024-09-12T01:43:06.332 INFO:tasks.workunit.client.0.smithi066.stdout:5/182: dread d0/d26/f2e [0,4194304] 0 2024-09-12T01:43:06.334 INFO:tasks.workunit.client.0.smithi066.stdout:2/253: mknod de/c53 0 2024-09-12T01:43:06.335 INFO:tasks.workunit.client.1.smithi153.stdout:2/538: write d7/db/d27/d56/f6e [85854,65444] 0 2024-09-12T01:43:06.336 INFO:tasks.workunit.client.0.smithi066.stdout:8/276: write d12/d21/f32 [3729947,44784] 0 2024-09-12T01:43:06.337 INFO:tasks.workunit.client.0.smithi066.stdout:4/222: rename d4/d15/d33/d47 to d4/d6/d48 0 2024-09-12T01:43:06.340 INFO:tasks.workunit.client.0.smithi066.stdout:0/278: dread d1/dc/f4f [0,4194304] 0 2024-09-12T01:43:06.340 INFO:tasks.workunit.client.0.smithi066.stdout:0/279: chown d1/dc/df/d1b/c23 97 1 2024-09-12T01:43:06.341 INFO:tasks.workunit.client.0.smithi066.stdout:1/193: unlink d5/dc/dd/l17 0 2024-09-12T01:43:06.344 INFO:tasks.workunit.client.0.smithi066.stdout:9/226: symlink d0/d6/d17/d4f/d9/l54 0 2024-09-12T01:43:06.346 INFO:tasks.workunit.client.0.smithi066.stdout:7/191: mkdir d2/d3c 0 2024-09-12T01:43:06.346 INFO:tasks.workunit.client.0.smithi066.stdout:7/192: creat d2/d5/d6/f3d x:0 0 0 2024-09-12T01:43:06.349 INFO:tasks.workunit.client.1.smithi153.stdout:3/604: creat d1/d13/d23/d47/d71/d8e/d93/fb6 x:0 0 0 2024-09-12T01:43:06.349 INFO:tasks.workunit.client.1.smithi153.stdout:3/605: chown d1/d45/f51 120402 1 2024-09-12T01:43:06.351 INFO:tasks.workunit.client.0.smithi066.stdout:3/263: symlink d5/d6/dd/d50/l53 0 2024-09-12T01:43:06.352 INFO:tasks.workunit.client.0.smithi066.stdout:6/307: dwrite d2/f5 [0,4194304] 0 2024-09-12T01:43:06.352 INFO:tasks.workunit.client.1.smithi153.stdout:6/607: symlink d1/d6/d23/d98/d53/d69/d7c/lc6 0 2024-09-12T01:43:06.353 INFO:tasks.workunit.client.1.smithi153.stdout:6/608: fsync d1/d6/d23/d98/d4f/fa1 0 2024-09-12T01:43:06.353 INFO:tasks.workunit.client.0.smithi066.stdout:5/183: mkdir d0/d26/d2f/d3b 0 2024-09-12T01:43:06.357 INFO:tasks.workunit.client.1.smithi153.stdout:5/563: unlink d0/df/d83/d36/d39/f60 0 2024-09-12T01:43:06.359 INFO:tasks.workunit.client.0.smithi066.stdout:2/254: unlink de/f51 0 2024-09-12T01:43:06.359 INFO:tasks.workunit.client.0.smithi066.stdout:2/255: chown de/d13/d28/d3d/l4e 1342166392 1 2024-09-12T01:43:06.362 INFO:tasks.workunit.client.0.smithi066.stdout:6/308: write d2/f7 [2726156,51614] 0 2024-09-12T01:43:06.363 INFO:tasks.workunit.client.0.smithi066.stdout:8/277: unlink d12/d21/c42 0 2024-09-12T01:43:06.365 INFO:tasks.workunit.client.0.smithi066.stdout:4/223: symlink d4/d6/d27/l49 0 2024-09-12T01:43:06.367 INFO:tasks.workunit.client.0.smithi066.stdout:0/280: link d1/dc/c12 d1/dc/df/c63 0 2024-09-12T01:43:06.367 INFO:tasks.workunit.client.0.smithi066.stdout:0/281: fdatasync d1/dc/de/f1d 0 2024-09-12T01:43:06.367 INFO:tasks.workunit.client.0.smithi066.stdout:0/282: chown d1/l4 4078 1 2024-09-12T01:43:06.368 INFO:tasks.workunit.client.0.smithi066.stdout:9/227: rename d0/d6/d17/d28/f41 to d0/d6/d37/f55 0 2024-09-12T01:43:06.371 INFO:tasks.workunit.client.0.smithi066.stdout:7/193: mknod d2/d3c/c3e 0 2024-09-12T01:43:06.372 INFO:tasks.workunit.client.0.smithi066.stdout:3/264: dwrite d5/d6/f29 [0,4194304] 0 2024-09-12T01:43:06.372 INFO:tasks.workunit.client.0.smithi066.stdout:3/265: chown d5/l19 3996 1 2024-09-12T01:43:06.373 INFO:tasks.workunit.client.1.smithi153.stdout:2/539: dwrite d7/db/f64 [0,4194304] 0 2024-09-12T01:43:06.373 INFO:tasks.workunit.client.1.smithi153.stdout:2/540: write d7/d19/d83/fa7 [840308,93904] 0 2024-09-12T01:43:06.373 INFO:tasks.workunit.client.1.smithi153.stdout:2/541: fdatasync d7/db/d1d/d1e/f26 0 2024-09-12T01:43:06.373 INFO:tasks.workunit.client.1.smithi153.stdout:8/547: unlink d17/d1f/d4f/d34/f5f 0 2024-09-12T01:43:06.374 INFO:tasks.workunit.client.0.smithi066.stdout:1/194: dwrite d5/dc/f1f [0,4194304] 0 2024-09-12T01:43:06.374 INFO:tasks.workunit.client.0.smithi066.stdout:5/184: symlink d0/d26/d2f/d30/l3c 0 2024-09-12T01:43:06.374 INFO:tasks.workunit.client.0.smithi066.stdout:5/185: dread - d0/d21/d27/f1f zero size 2024-09-12T01:43:06.374 INFO:tasks.workunit.client.0.smithi066.stdout:5/186: dread - d0/d26/f34 zero size 2024-09-12T01:43:06.375 INFO:tasks.workunit.client.1.smithi153.stdout:4/499: mknod d6/d9/dc/d31/cb3 0 2024-09-12T01:43:06.380 INFO:tasks.workunit.client.0.smithi066.stdout:6/309: creat d2/db/f6a x:0 0 0 2024-09-12T01:43:06.382 INFO:tasks.workunit.client.0.smithi066.stdout:3/266: dread d5/d6/d1b/d31/f3b [0,4194304] 0 2024-09-12T01:43:06.382 INFO:tasks.workunit.client.0.smithi066.stdout:0/283: mkdir d1/dc/de/d47/d64 0 2024-09-12T01:43:06.382 INFO:tasks.workunit.client.0.smithi066.stdout:0/284: fsync d1/dc/df/f1a 0 2024-09-12T01:43:06.384 INFO:tasks.workunit.client.0.smithi066.stdout:9/228: symlink d0/d6/d17/d1b/d4c/l56 0 2024-09-12T01:43:06.385 INFO:tasks.workunit.client.0.smithi066.stdout:9/229: read d0/d6/d17/d4f/d12/f25 [255972,60352] 0 2024-09-12T01:43:06.385 INFO:tasks.workunit.client.1.smithi153.stdout:8/548: dread d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:06.386 INFO:tasks.workunit.client.0.smithi066.stdout:7/194: mkdir d2/d5/da/d3f 0 2024-09-12T01:43:06.386 INFO:tasks.workunit.client.0.smithi066.stdout:7/195: dread - d2/d5/f31 zero size 2024-09-12T01:43:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:05 smithi066 ceph-mon[27875]: pgmap v243: 65 pgs: 65 active+clean; 1.1 GiB data, 5.0 GiB used, 531 GiB / 536 GiB avail; 114 MiB/s rd, 152 MiB/s wr, 595 op/s 2024-09-12T01:43:06.391 INFO:tasks.workunit.client.0.smithi066.stdout:8/278: dwrite d12/d26/f3b [0,4194304] 0 2024-09-12T01:43:06.391 INFO:tasks.workunit.client.1.smithi153.stdout:2/542: dread d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:06.392 INFO:tasks.workunit.client.1.smithi153.stdout:2/543: chown d7/d4d/d70/d81/f8e 49643 1 2024-09-12T01:43:06.392 INFO:tasks.workunit.client.0.smithi066.stdout:4/224: dwrite d4/d6/d8/f32 [0,4194304] 0 2024-09-12T01:43:06.392 INFO:tasks.workunit.client.0.smithi066.stdout:4/225: write d4/d6/d8/f13 [1479690,108463] 0 2024-09-12T01:43:06.393 INFO:tasks.workunit.client.1.smithi153.stdout:2/544: write d7/db/d6c/d7e/f66 [4428,96204] 0 2024-09-12T01:43:06.393 INFO:tasks.workunit.client.0.smithi066.stdout:1/195: unlink d5/f9 0 2024-09-12T01:43:06.393 INFO:tasks.workunit.client.0.smithi066.stdout:1/196: creat d5/dc/f34 x:0 0 0 2024-09-12T01:43:06.393 INFO:tasks.workunit.client.0.smithi066.stdout:1/197: write d5/d15/f1b [103231,21624] 0 2024-09-12T01:43:06.400 INFO:tasks.workunit.client.0.smithi066.stdout:0/285: dread d1/f4d [0,4194304] 0 2024-09-12T01:43:06.400 INFO:tasks.workunit.client.0.smithi066.stdout:5/187: creat d0/dd/d18/f3d x:0 0 0 2024-09-12T01:43:06.400 INFO:tasks.workunit.client.0.smithi066.stdout:5/188: chown d0/l3 52521894 1 2024-09-12T01:43:06.400 INFO:tasks.workunit.client.0.smithi066.stdout:5/189: read d0/f17 [2038467,112136] 0 2024-09-12T01:43:06.403 INFO:tasks.workunit.client.0.smithi066.stdout:2/256: getdents de/d13/d1e/d22 0 2024-09-12T01:43:06.404 INFO:tasks.workunit.client.1.smithi153.stdout:7/519: rmdir d12/d21/d29 39 2024-09-12T01:43:06.405 INFO:tasks.workunit.client.0.smithi066.stdout:0/286: write d1/f4d [3808532,86205] 0 2024-09-12T01:43:06.405 INFO:tasks.workunit.client.0.smithi066.stdout:6/310: rename d2/d31/d50 to d2/db/d12/d1d/d6b 0 2024-09-12T01:43:06.405 INFO:tasks.workunit.client.0.smithi066.stdout:6/311: fdatasync d2/f5f 0 2024-09-12T01:43:06.409 INFO:tasks.workunit.client.0.smithi066.stdout:3/267: link d5/l1d d5/d6/d40/l54 0 2024-09-12T01:43:06.409 INFO:tasks.workunit.client.0.smithi066.stdout:3/268: chown d5/d6/dd/l1f 1742910 1 2024-09-12T01:43:06.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/606: mknod d1/d64/cb7 0 2024-09-12T01:43:06.410 INFO:tasks.workunit.client.1.smithi153.stdout:3/607: readlink d1/d13/d23/l89 0 2024-09-12T01:43:06.410 INFO:tasks.workunit.client.0.smithi066.stdout:3/269: write d5/d6/d1b/d28/d4f/f51 [38615,89682] 0 2024-09-12T01:43:06.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/230: symlink d0/d6/d17/l57 0 2024-09-12T01:43:06.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/231: chown d0/d6/c34 500 1 2024-09-12T01:43:06.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/232: write d0/d6/d17/d4f/d12/f1f [974488,125292] 0 2024-09-12T01:43:06.412 INFO:tasks.workunit.client.1.smithi153.stdout:6/609: symlink d1/d6/lc7 0 2024-09-12T01:43:06.412 INFO:tasks.workunit.client.1.smithi153.stdout:6/610: fdatasync d1/d6/d23/d98/d53/d69/d7c/d7f/f9b 0 2024-09-12T01:43:06.413 INFO:tasks.workunit.client.0.smithi066.stdout:7/196: mkdir d2/d5/d6/d40 0 2024-09-12T01:43:06.413 INFO:tasks.workunit.client.0.smithi066.stdout:7/197: dread - d2/d5/f31 zero size 2024-09-12T01:43:06.416 INFO:tasks.workunit.client.0.smithi066.stdout:8/279: mkdir d12/d26/d3c/d49/d50/d56 0 2024-09-12T01:43:06.419 INFO:tasks.workunit.client.1.smithi153.stdout:4/500: rename d6/d15/d38 to d6/d15/db4 0 2024-09-12T01:43:06.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/599: rename d3/c23 to d3/d55/d30/d95/cb5 0 2024-09-12T01:43:06.422 INFO:tasks.workunit.client.1.smithi153.stdout:0/637: sync 2024-09-12T01:43:06.422 INFO:tasks.workunit.client.1.smithi153.stdout:0/638: creat d22/fde x:0 0 0 2024-09-12T01:43:06.424 INFO:tasks.workunit.client.1.smithi153.stdout:8/549: mkdir d17/d21/d56/d95/db7 0 2024-09-12T01:43:06.424 INFO:tasks.workunit.client.0.smithi066.stdout:4/226: truncate d4/d6/d8/f1a 957355 0 2024-09-12T01:43:06.426 INFO:tasks.workunit.client.1.smithi153.stdout:5/564: write d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d71/f7e [271021,48718] 0 2024-09-12T01:43:06.427 INFO:tasks.workunit.client.1.smithi153.stdout:5/565: chown d0/df/fad 24585 1 2024-09-12T01:43:06.430 INFO:tasks.workunit.client.1.smithi153.stdout:2/545: symlink d7/db/d62/laf 0 2024-09-12T01:43:06.433 INFO:tasks.workunit.client.0.smithi066.stdout:6/312: dwrite d2/d31/d57/f67 [0,4194304] 0 2024-09-12T01:43:06.434 INFO:tasks.workunit.client.1.smithi153.stdout:3/608: dwrite d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:06.434 INFO:tasks.workunit.client.1.smithi153.stdout:3/609: fdatasync d1/d13/d25/d26/fae 0 2024-09-12T01:43:06.434 INFO:tasks.workunit.client.1.smithi153.stdout:7/520: creat d12/d21/d29/d35/d37/d4c/d8e/fa1 x:0 0 0 2024-09-12T01:43:06.434 INFO:tasks.workunit.client.1.smithi153.stdout:7/521: chown d12/d21/d29/d2d/l4a 546835 1 2024-09-12T01:43:06.434 INFO:tasks.workunit.client.1.smithi153.stdout:7/522: dread - d12/d7e/f68 zero size 2024-09-12T01:43:06.436 INFO:tasks.workunit.client.1.smithi153.stdout:1/643: truncate d2/d9/d1d/f30 2652918 0 2024-09-12T01:43:06.437 INFO:tasks.workunit.client.1.smithi153.stdout:6/611: getdents d1/d6/da/d19/d3a/db0 0 2024-09-12T01:43:06.439 INFO:tasks.workunit.client.1.smithi153.stdout:4/501: symlink d6/d9/dc/d98/d3e/lb5 0 2024-09-12T01:43:06.441 INFO:tasks.workunit.client.1.smithi153.stdout:0/639: mknod d22/d79/d8e/cdf 0 2024-09-12T01:43:06.442 INFO:tasks.workunit.client.1.smithi153.stdout:8/550: unlink d17/f28 0 2024-09-12T01:43:06.444 INFO:tasks.workunit.client.1.smithi153.stdout:2/546: mknod d7/d4d/d70/cb0 0 2024-09-12T01:43:06.445 INFO:tasks.workunit.client.1.smithi153.stdout:2/547: write d7/d17/f3c [4508903,7527] 0 2024-09-12T01:43:06.448 INFO:tasks.workunit.client.0.smithi066.stdout:2/257: link de/d13/d1e/f23 de/d13/d1e/d22/f54 0 2024-09-12T01:43:06.449 INFO:tasks.workunit.client.1.smithi153.stdout:3/610: truncate d1/d16/f53 3604737 0 2024-09-12T01:43:06.449 INFO:tasks.workunit.client.1.smithi153.stdout:7/523: creat d12/d21/d29/d35/d37/fa2 x:0 0 0 2024-09-12T01:43:06.450 INFO:tasks.workunit.client.1.smithi153.stdout:1/644: dread d2/f6 [0,4194304] 0 2024-09-12T01:43:06.452 INFO:tasks.workunit.client.1.smithi153.stdout:4/502: mknod d6/d9/dc/d31/d76/d99/cb6 0 2024-09-12T01:43:06.452 INFO:tasks.workunit.client.1.smithi153.stdout:4/503: readlink d6/d9/dc/d98/d3e/la8 0 2024-09-12T01:43:06.452 INFO:tasks.workunit.client.1.smithi153.stdout:4/504: read - d6/d9/dc/d31/d7d/fb0 zero size 2024-09-12T01:43:06.453 INFO:tasks.workunit.client.0.smithi066.stdout:0/287: truncate d1/dc/de/d46/f58 3484028 0 2024-09-12T01:43:06.453 INFO:tasks.workunit.client.1.smithi153.stdout:6/612: write d1/d6/d39/d76/f42 [3312218,121370] 0 2024-09-12T01:43:06.454 INFO:tasks.workunit.client.1.smithi153.stdout:0/640: dread d22/d30/d4c/d6f/fab [0,4194304] 0 2024-09-12T01:43:06.454 INFO:tasks.workunit.client.1.smithi153.stdout:3/611: link d1/d13/d23/d47/d71/d8e/d93/c76 d1/d13/cb8 0 2024-09-12T01:43:06.454 INFO:tasks.workunit.client.1.smithi153.stdout:3/612: write d1/f19 [7153274,27808] 0 2024-09-12T01:43:06.454 INFO:tasks.workunit.client.1.smithi153.stdout:3/613: write d1/d16/d1c/f91 [978447,89626] 0 2024-09-12T01:43:06.456 INFO:tasks.workunit.client.0.smithi066.stdout:5/190: rename d0/dd/d18/l25 to d0/d26/d2f/d3b/l3e 0 2024-09-12T01:43:06.459 INFO:tasks.workunit.client.1.smithi153.stdout:9/600: dwrite d3/d55/d30/d7b/f89 [0,4194304] 0 2024-09-12T01:43:06.459 INFO:tasks.workunit.client.1.smithi153.stdout:1/645: creat d2/d9/d1d/da5/fcb x:0 0 0 2024-09-12T01:43:06.459 INFO:tasks.workunit.client.1.smithi153.stdout:2/548: write d7/db/f25 [3900846,85183] 0 2024-09-12T01:43:06.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/566: dwrite d0/d43/f92 [0,4194304] 0 2024-09-12T01:43:06.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/567: readlink d0/d43/d8d/l9e 0 2024-09-12T01:43:06.463 INFO:tasks.workunit.client.1.smithi153.stdout:7/524: read d12/d21/d29/d35/d37/d4c/f75 [3669285,57797] 0 2024-09-12T01:43:06.464 INFO:tasks.workunit.client.0.smithi066.stdout:3/270: creat d5/d6/d1b/d28/d52/f55 x:0 0 0 2024-09-12T01:43:06.464 INFO:tasks.workunit.client.0.smithi066.stdout:3/271: chown d5/d6/d1b 1416 1 2024-09-12T01:43:06.466 INFO:tasks.workunit.client.1.smithi153.stdout:6/613: rename d1/d6/f8 to d1/d6/d39/dc4/fc8 0 2024-09-12T01:43:06.466 INFO:tasks.workunit.client.1.smithi153.stdout:6/614: creat d1/d6/d23/d98/d53/da0/fc9 x:0 0 0 2024-09-12T01:43:06.466 INFO:tasks.workunit.client.1.smithi153.stdout:9/601: read d3/d55/f2a [555698,25133] 0 2024-09-12T01:43:06.466 INFO:tasks.workunit.client.1.smithi153.stdout:9/602: chown d3/f5 344145477 1 2024-09-12T01:43:06.467 INFO:tasks.workunit.client.1.smithi153.stdout:6/615: write d1/d6/d23/d98/d53/d69/d7c/fb7 [707169,100849] 0 2024-09-12T01:43:06.470 INFO:tasks.workunit.client.1.smithi153.stdout:0/641: symlink d22/d79/d8e/dae/db7/le0 0 2024-09-12T01:43:06.471 INFO:tasks.workunit.client.0.smithi066.stdout:9/233: symlink d0/d6/d17/d1b/d4c/d4b/l58 0 2024-09-12T01:43:06.474 INFO:tasks.workunit.client.1.smithi153.stdout:3/614: truncate d1/d16/f87 2766373 0 2024-09-12T01:43:06.474 INFO:tasks.workunit.client.1.smithi153.stdout:3/615: creat d1/d13/d23/d47/d6c/fb9 x:0 0 0 2024-09-12T01:43:06.474 INFO:tasks.workunit.client.1.smithi153.stdout:3/616: write d1/d16/d1c/f33 [1507677,30674] 0 2024-09-12T01:43:06.475 INFO:tasks.workunit.client.1.smithi153.stdout:3/617: truncate d1/d16/d1c/f2d 3269713 0 2024-09-12T01:43:06.475 INFO:tasks.workunit.client.1.smithi153.stdout:3/618: truncate d1/d16/d1c/f2d 3764407 0 2024-09-12T01:43:06.476 INFO:tasks.workunit.client.1.smithi153.stdout:5/568: dread d0/d43/f92 [0,4194304] 0 2024-09-12T01:43:06.476 INFO:tasks.workunit.client.1.smithi153.stdout:5/569: stat d0/df/d1c/d22/d2f/d55/d9c/d75/d58/f85 0 2024-09-12T01:43:06.476 INFO:tasks.workunit.client.1.smithi153.stdout:5/570: truncate d0/df/d1c/d22/d2f/d55/d9c/d75/f6a 537974 0 2024-09-12T01:43:06.476 INFO:tasks.workunit.client.1.smithi153.stdout:5/571: readlink d0/d15/l61 0 2024-09-12T01:43:06.478 INFO:tasks.workunit.client.1.smithi153.stdout:4/505: dwrite d6/d15/db4/f68 [0,4194304] 0 2024-09-12T01:43:06.482 INFO:tasks.workunit.client.0.smithi066.stdout:6/313: symlink d2/db/d12/d1d/d6b/l6c 0 2024-09-12T01:43:06.483 INFO:tasks.workunit.client.0.smithi066.stdout:6/314: creat d2/db/d12/d49/f6d x:0 0 0 2024-09-12T01:43:06.483 INFO:tasks.workunit.client.0.smithi066.stdout:6/315: stat d2/d31/c59 0 2024-09-12T01:43:06.483 INFO:tasks.workunit.client.0.smithi066.stdout:6/316: write d2/f5f [632531,29287] 0 2024-09-12T01:43:06.483 INFO:tasks.workunit.client.0.smithi066.stdout:6/317: creat d2/db/d12/f6e x:0 0 0 2024-09-12T01:43:06.483 INFO:tasks.workunit.client.1.smithi153.stdout:7/525: write d12/f17 [2911527,88665] 0 2024-09-12T01:43:06.483 INFO:tasks.workunit.client.1.smithi153.stdout:4/506: read d6/d9/dc/d31/f9a [817636,53318] 0 2024-09-12T01:43:06.484 INFO:tasks.workunit.client.1.smithi153.stdout:1/646: symlink d2/d9/d17/d2f/d56/d71/d9a/lcc 0 2024-09-12T01:43:06.484 INFO:tasks.workunit.client.0.smithi066.stdout:2/258: symlink de/d13/d28/d3d/l55 0 2024-09-12T01:43:06.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/259: chown de/d13/d28/d3d/l4e 15 1 2024-09-12T01:43:06.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/260: chown de/d13/d28/d3d/l4e 0 1 2024-09-12T01:43:06.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/261: chown de/d49 8580464 1 2024-09-12T01:43:06.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/262: creat de/d13/d28/f56 x:0 0 0 2024-09-12T01:43:06.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/263: stat de/l2e 0 2024-09-12T01:43:06.487 INFO:tasks.workunit.client.0.smithi066.stdout:0/288: mkdir d1/dc/de/d47/d4a/d65 0 2024-09-12T01:43:06.488 INFO:tasks.workunit.client.1.smithi153.stdout:6/616: read d1/d6/d23/d98/d53/d69/d7c/d7f/f95 [460258,125051] 0 2024-09-12T01:43:06.490 INFO:tasks.workunit.client.0.smithi066.stdout:3/272: dwrite d5/f44 [0,4194304] 0 2024-09-12T01:43:06.492 INFO:tasks.workunit.client.1.smithi153.stdout:0/642: dread f6 [0,4194304] 0 2024-09-12T01:43:06.492 INFO:tasks.workunit.client.1.smithi153.stdout:2/549: symlink d7/d17/da9/lb1 0 2024-09-12T01:43:06.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/198: mkdir d2/d41 0 2024-09-12T01:43:06.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/199: chown d2/d20/l15 0 1 2024-09-12T01:43:06.495 INFO:tasks.workunit.client.0.smithi066.stdout:5/191: dwrite d0/d21/d27/f1e [0,4194304] 0 2024-09-12T01:43:06.497 INFO:tasks.workunit.client.0.smithi066.stdout:7/200: dread d2/d5/d6/d22/f33 [0,4194304] 0 2024-09-12T01:43:06.498 INFO:tasks.workunit.client.0.smithi066.stdout:8/280: rmdir d12/d21/d2f 39 2024-09-12T01:43:06.507 INFO:tasks.workunit.client.1.smithi153.stdout:3/619: creat d1/d1e/fba x:0 0 0 2024-09-12T01:43:06.507 INFO:tasks.workunit.client.1.smithi153.stdout:3/620: write d1/d64/f86 [2737575,22269] 0 2024-09-12T01:43:06.509 INFO:tasks.workunit.client.0.smithi066.stdout:6/318: mknod d2/db/d12/d1d/d6b/c6f 0 2024-09-12T01:43:06.514 INFO:tasks.workunit.client.0.smithi066.stdout:2/264: creat de/d13/d1e/d22/f57 x:0 0 0 2024-09-12T01:43:06.523 INFO:tasks.workunit.client.0.smithi066.stdout:9/234: mknod d0/c59 0 2024-09-12T01:43:06.525 INFO:tasks.workunit.client.0.smithi066.stdout:5/192: creat d0/d26/d2d/f3f x:0 0 0 2024-09-12T01:43:06.528 INFO:tasks.workunit.client.1.smithi153.stdout:5/572: rmdir d0/df/d1c/d69 39 2024-09-12T01:43:06.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/281: truncate d12/f3d 1264931 0 2024-09-12T01:43:06.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/282: chown d12/f31 814587352 1 2024-09-12T01:43:06.531 INFO:tasks.workunit.client.0.smithi066.stdout:2/265: truncate de/f15 314612 0 2024-09-12T01:43:06.533 INFO:tasks.workunit.client.0.smithi066.stdout:8/283: dread d12/d21/d2f/f48 [0,4194304] 0 2024-09-12T01:43:06.533 INFO:tasks.workunit.client.0.smithi066.stdout:8/284: chown c7 1336494375 1 2024-09-12T01:43:06.535 INFO:tasks.workunit.client.0.smithi066.stdout:7/201: mknod d2/c42 0 2024-09-12T01:43:06.535 INFO:tasks.workunit.client.0.smithi066.stdout:7/202: dread - d2/d5/f31 zero size 2024-09-12T01:43:06.535 INFO:tasks.workunit.client.0.smithi066.stdout:7/203: write d2/d20/d1d/f3b [107719,67811] 0 2024-09-12T01:43:06.537 INFO:tasks.workunit.client.0.smithi066.stdout:5/193: rename d0/dd/d18/c1a to d0/d26/d2f/d3b/c40 0 2024-09-12T01:43:06.537 INFO:tasks.workunit.client.0.smithi066.stdout:5/194: fsync d0/d26/f2e 0 2024-09-12T01:43:06.537 INFO:tasks.workunit.client.1.smithi153.stdout:1/647: dwrite d2/d9/d17/d2f/d56/f79 [0,4194304] 0 2024-09-12T01:43:06.537 INFO:tasks.workunit.client.1.smithi153.stdout:1/648: readlink d2/l4 0 2024-09-12T01:43:06.538 INFO:tasks.workunit.client.1.smithi153.stdout:4/507: dwrite d6/d9/dc/d98/d3e/f61 [0,4194304] 0 2024-09-12T01:43:06.538 INFO:tasks.workunit.client.1.smithi153.stdout:4/508: write d6/d9/d11/d13/f65 [1162018,91084] 0 2024-09-12T01:43:06.539 INFO:tasks.workunit.client.1.smithi153.stdout:0/643: rmdir d22/d30/d4c 39 2024-09-12T01:43:06.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/550: rename d7/l4e to d7/db/d6c/d9f/lb2 0 2024-09-12T01:43:06.543 INFO:tasks.workunit.client.1.smithi153.stdout:2/551: chown d7/db/d6c/d7e/f5f 5444515 1 2024-09-12T01:43:06.544 INFO:tasks.workunit.client.0.smithi066.stdout:6/319: write d2/d21/f52 [2682761,53235] 0 2024-09-12T01:43:06.544 INFO:tasks.workunit.client.0.smithi066.stdout:6/320: creat d2/d31/f70 x:0 0 0 2024-09-12T01:43:06.544 INFO:tasks.workunit.client.1.smithi153.stdout:5/573: mkdir d0/d43/d68/db2 0 2024-09-12T01:43:06.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/649: unlink d2/d9/d17/lbb 0 2024-09-12T01:43:06.547 INFO:tasks.workunit.client.1.smithi153.stdout:7/526: dwrite d12/d21/d29/d35/d37/d58/f81 [0,4194304] 0 2024-09-12T01:43:06.547 INFO:tasks.workunit.client.1.smithi153.stdout:7/527: chown d12/d21/d4d 40848 1 2024-09-12T01:43:06.547 INFO:tasks.workunit.client.1.smithi153.stdout:3/621: dwrite d1/f1a [0,4194304] 0 2024-09-12T01:43:06.549 INFO:tasks.workunit.client.0.smithi066.stdout:9/235: dread d0/d6/f50 [0,4194304] 0 2024-09-12T01:43:06.549 INFO:tasks.workunit.client.0.smithi066.stdout:9/236: write d0/d6/d17/d1b/f1c [1657599,58365] 0 2024-09-12T01:43:06.552 INFO:tasks.workunit.client.0.smithi066.stdout:6/321: creat d2/d31/d5e/f71 x:0 0 0 2024-09-12T01:43:06.553 INFO:tasks.workunit.client.0.smithi066.stdout:6/322: fsync d2/f22 0 2024-09-12T01:43:06.553 INFO:tasks.workunit.client.0.smithi066.stdout:6/323: stat d2/db/d12/d1d/l62 0 2024-09-12T01:43:06.553 INFO:tasks.workunit.client.1.smithi153.stdout:6/617: dwrite d1/d6/d23/d98/d53/d69/f7d [0,4194304] 0 2024-09-12T01:43:06.553 INFO:tasks.workunit.client.1.smithi153.stdout:6/618: stat d1/d6/da/f1a 0 2024-09-12T01:43:06.553 INFO:tasks.workunit.client.0.smithi066.stdout:3/273: dwrite d5/d6/f9 [4194304,4194304] 0 2024-09-12T01:43:06.555 INFO:tasks.workunit.client.0.smithi066.stdout:5/195: write d0/dd/fe [197119,60892] 0 2024-09-12T01:43:06.556 INFO:tasks.workunit.client.0.smithi066.stdout:9/237: creat d0/d6/d17/d1b/d4c/d42/f5a x:0 0 0 2024-09-12T01:43:06.557 INFO:tasks.workunit.client.0.smithi066.stdout:9/238: fdatasync d0/f3c 0 2024-09-12T01:43:06.559 INFO:tasks.workunit.client.1.smithi153.stdout:2/552: rename d7/db/d6c/d76/fa1 to d7/db/d27/d56/da3/fb3 0 2024-09-12T01:43:06.559 INFO:tasks.workunit.client.1.smithi153.stdout:4/509: write d6/d9/dc/d98/d3e/f50 [2451114,54557] 0 2024-09-12T01:43:06.559 INFO:tasks.workunit.client.0.smithi066.stdout:6/324: mkdir d2/db/d72 0 2024-09-12T01:43:06.561 INFO:tasks.workunit.client.0.smithi066.stdout:2/266: dread de/d13/d1e/d22/f54 [0,4194304] 0 2024-09-12T01:43:06.564 INFO:tasks.workunit.client.0.smithi066.stdout:3/274: rmdir d5/d6/d40 39 2024-09-12T01:43:06.566 INFO:tasks.workunit.client.1.smithi153.stdout:0/644: dread d22/d30/d4c/f58 [0,4194304] 0 2024-09-12T01:43:06.568 INFO:tasks.workunit.client.1.smithi153.stdout:6/619: write d1/d6/d46/d73/f91 [5391868,74567] 0 2024-09-12T01:43:06.568 INFO:tasks.workunit.client.1.smithi153.stdout:6/620: fdatasync d1/d6/da/d19/fab 0 2024-09-12T01:43:06.568 INFO:tasks.workunit.client.0.smithi066.stdout:3/275: dread d5/d6/d1b/d31/f3b [0,4194304] 0 2024-09-12T01:43:06.569 INFO:tasks.workunit.client.0.smithi066.stdout:5/196: mknod d0/d26/d2f/d3b/c41 0 2024-09-12T01:43:06.569 INFO:tasks.workunit.client.0.smithi066.stdout:5/197: write d0/d21/d27/f28 [485058,74146] 0 2024-09-12T01:43:06.571 INFO:tasks.workunit.client.0.smithi066.stdout:9/239: truncate d0/d6/d17/d4f/f36 987531 0 2024-09-12T01:43:06.571 INFO:tasks.workunit.client.0.smithi066.stdout:9/240: truncate d0/d6/d17/d4f/d12/f27 1104435 0 2024-09-12T01:43:06.571 INFO:tasks.workunit.client.0.smithi066.stdout:9/241: stat d0/d6/d17/d4f/d12/l38 0 2024-09-12T01:43:06.575 INFO:tasks.workunit.client.0.smithi066.stdout:6/325: truncate d2/f1a 5607233 0 2024-09-12T01:43:06.575 INFO:tasks.workunit.client.0.smithi066.stdout:6/326: chown d2/d31/c59 171790 1 2024-09-12T01:43:06.575 INFO:tasks.workunit.client.0.smithi066.stdout:6/327: chown d2/d21/l23 389 1 2024-09-12T01:43:06.576 INFO:tasks.workunit.client.0.smithi066.stdout:6/328: creat d2/db/f73 x:0 0 0 2024-09-12T01:43:06.579 INFO:tasks.workunit.client.0.smithi066.stdout:7/204: dwrite d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:06.580 INFO:tasks.workunit.client.0.smithi066.stdout:2/267: rmdir de/d49 0 2024-09-12T01:43:06.584 INFO:tasks.workunit.client.0.smithi066.stdout:7/205: dread d2/d5/d6/d22/f30 [0,4194304] 0 2024-09-12T01:43:06.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/198: mkdir d0/d26/d2d/d42 0 2024-09-12T01:43:06.585 INFO:tasks.workunit.client.0.smithi066.stdout:6/329: read d2/db/f3d [1562205,24600] 0 2024-09-12T01:43:06.589 INFO:tasks.workunit.client.0.smithi066.stdout:3/276: rename d5/d6/f7 to d5/f56 0 2024-09-12T01:43:06.591 INFO:tasks.workunit.client.0.smithi066.stdout:7/206: symlink d2/d5/da/d3f/l43 0 2024-09-12T01:43:06.593 INFO:tasks.workunit.client.0.smithi066.stdout:6/330: rename d2/db/d12/l20 to d2/db/d12/d1d/d6b/l74 0 2024-09-12T01:43:06.593 INFO:tasks.workunit.client.0.smithi066.stdout:6/331: chown d2/l8 16220 1 2024-09-12T01:43:06.593 INFO:tasks.workunit.client.0.smithi066.stdout:6/332: dread - d2/db/f6a zero size 2024-09-12T01:43:06.594 INFO:tasks.workunit.client.1.smithi153.stdout:5/574: symlink d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d71/lb3 0 2024-09-12T01:43:06.595 INFO:tasks.workunit.client.0.smithi066.stdout:3/277: mknod d5/d6/c57 0 2024-09-12T01:43:06.595 INFO:tasks.workunit.client.0.smithi066.stdout:3/278: creat d5/d35/f58 x:0 0 0 2024-09-12T01:43:06.597 INFO:tasks.workunit.client.1.smithi153.stdout:6/621: creat d1/d6/da/fca x:0 0 0 2024-09-12T01:43:06.598 INFO:tasks.workunit.client.1.smithi153.stdout:5/575: mknod d0/d43/dac/cb4 0 2024-09-12T01:43:06.599 INFO:tasks.workunit.client.1.smithi153.stdout:7/528: dwrite d12/d21/d29/d35/d37/d4c/f71 [0,4194304] 0 2024-09-12T01:43:06.599 INFO:tasks.workunit.client.1.smithi153.stdout:0/645: dwrite d22/f3c [0,4194304] 0 2024-09-12T01:43:06.599 INFO:tasks.workunit.client.1.smithi153.stdout:0/646: chown d22/f5f 737831 1 2024-09-12T01:43:06.600 INFO:tasks.workunit.client.1.smithi153.stdout:3/622: dwrite d1/d16/f6f [0,4194304] 0 2024-09-12T01:43:06.600 INFO:tasks.workunit.client.0.smithi066.stdout:9/242: dwrite d0/d6/d17/f4d [0,4194304] 0 2024-09-12T01:43:06.600 INFO:tasks.workunit.client.0.smithi066.stdout:9/243: chown d0/d6/d17/d1b/d4c/c3f 51324380 1 2024-09-12T01:43:06.601 INFO:tasks.workunit.client.1.smithi153.stdout:6/622: mkdir d1/d6/d39/dc4/dcb 0 2024-09-12T01:43:06.602 INFO:tasks.workunit.client.1.smithi153.stdout:5/576: mknod d0/d15/dae/cb5 0 2024-09-12T01:43:06.602 INFO:tasks.workunit.client.0.smithi066.stdout:6/333: dread d2/f5 [4194304,4194304] 0 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.1.smithi153.stdout:3/623: dread d1/d45/f58 [0,4194304] 0 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.1.smithi153.stdout:3/624: dread - d1/d13/f83 zero size 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.1.smithi153.stdout:3/625: stat d1/d13/d25/da6/f8b 0 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.1.smithi153.stdout:3/626: write d1/d13/d25/da6/f43 [1010736,130615] 0 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.1.smithi153.stdout:3/627: truncate d1/d13/d23/d47/d71/d8e/d93/fb6 515245 0 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.0.smithi066.stdout:5/199: dread d0/dd/d18/d36/f38 [0,4194304] 0 2024-09-12T01:43:06.605 INFO:tasks.workunit.client.0.smithi066.stdout:5/200: truncate d0/dd/f13 2043316 0 2024-09-12T01:43:06.609 INFO:tasks.workunit.client.0.smithi066.stdout:9/244: creat d0/d6/d17/d4f/d9/de/f5b x:0 0 0 2024-09-12T01:43:06.610 INFO:tasks.workunit.client.0.smithi066.stdout:3/279: dwrite d5/d6/d1b/d28/f2c [4194304,4194304] 0 2024-09-12T01:43:06.610 INFO:tasks.workunit.client.0.smithi066.stdout:3/280: readlink d5/d6/dd/l1f 0 2024-09-12T01:43:06.613 INFO:tasks.workunit.client.1.smithi153.stdout:7/529: creat d12/d21/d29/d35/d37/d4c/d5c/fa3 x:0 0 0 2024-09-12T01:43:06.613 INFO:tasks.workunit.client.1.smithi153.stdout:8/551: sync 2024-09-12T01:43:06.613 INFO:tasks.workunit.client.1.smithi153.stdout:8/552: readlink d17/d21/d56/d96/l49 0 2024-09-12T01:43:06.614 INFO:tasks.workunit.client.1.smithi153.stdout:0/647: truncate d22/f5f 3061745 0 2024-09-12T01:43:06.618 INFO:tasks.workunit.client.0.smithi066.stdout:6/334: mkdir d2/d75 0 2024-09-12T01:43:06.620 INFO:tasks.workunit.client.0.smithi066.stdout:5/201: unlink d0/d26/d2d/f3f 0 2024-09-12T01:43:06.621 INFO:tasks.workunit.client.1.smithi153.stdout:6/623: getdents d1/df/d9d 0 2024-09-12T01:43:06.621 INFO:tasks.workunit.client.1.smithi153.stdout:6/624: fdatasync d1/d6/d39/d76/f3c 0 2024-09-12T01:43:06.623 INFO:tasks.workunit.client.0.smithi066.stdout:9/245: rename d0/d6/d17/d1b/d4c/c3d to d0/d6/d17/d28/c5c 0 2024-09-12T01:43:06.623 INFO:tasks.workunit.client.0.smithi066.stdout:9/246: chown d0/d6/d17/d1b/d4c/l56 312756230 1 2024-09-12T01:43:06.625 INFO:tasks.workunit.client.0.smithi066.stdout:9/247: dread d0/d6/d17/f23 [0,4194304] 0 2024-09-12T01:43:06.625 INFO:tasks.workunit.client.0.smithi066.stdout:9/248: creat d0/d6/d17/d1b/d4c/d42/f5d x:0 0 0 2024-09-12T01:43:06.625 INFO:tasks.workunit.client.1.smithi153.stdout:3/628: dwrite d1/f19 [4194304,4194304] 0 2024-09-12T01:43:06.625 INFO:tasks.workunit.client.1.smithi153.stdout:3/629: fdatasync d1/f54 0 2024-09-12T01:43:06.626 INFO:tasks.workunit.client.1.smithi153.stdout:7/530: dread d12/d21/d29/d2d/f80 [0,4194304] 0 2024-09-12T01:43:06.626 INFO:tasks.workunit.client.1.smithi153.stdout:7/531: chown d12/d7e 737 1 2024-09-12T01:43:06.626 INFO:tasks.workunit.client.1.smithi153.stdout:5/577: mknod d0/d43/d8d/d8e/cb6 0 2024-09-12T01:43:06.626 INFO:tasks.workunit.client.0.smithi066.stdout:5/202: dread d0/dd/d18/d36/f38 [0,4194304] 0 2024-09-12T01:43:06.627 INFO:tasks.workunit.client.0.smithi066.stdout:5/203: truncate d0/f4 2414528 0 2024-09-12T01:43:06.627 INFO:tasks.workunit.client.0.smithi066.stdout:5/204: truncate d0/f2 4398809 0 2024-09-12T01:43:06.629 INFO:tasks.workunit.client.0.smithi066.stdout:3/281: symlink d5/d6/dd/l59 0 2024-09-12T01:43:06.630 INFO:tasks.workunit.client.1.smithi153.stdout:8/553: getdents d17/d21/d56/d96/d6c/d89 0 2024-09-12T01:43:06.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/335: rename d2/d75 to d2/db/d72/d76 0 2024-09-12T01:43:06.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/336: fsync d2/f7 0 2024-09-12T01:43:06.633 INFO:tasks.workunit.client.1.smithi153.stdout:0/648: creat d22/d30/d4c/d6f/fe1 x:0 0 0 2024-09-12T01:43:06.634 INFO:tasks.workunit.client.0.smithi066.stdout:5/205: dread d0/f17 [0,4194304] 0 2024-09-12T01:43:06.636 INFO:tasks.workunit.client.1.smithi153.stdout:7/532: dread d12/d21/d4d/f7d [0,4194304] 0 2024-09-12T01:43:06.637 INFO:tasks.workunit.client.1.smithi153.stdout:6/625: rename d1/d6/da/l1c to d1/d6/d23/d98/d53/da4/lcc 0 2024-09-12T01:43:06.637 INFO:tasks.workunit.client.0.smithi066.stdout:3/282: dread d5/d6/d1b/d28/f2c [4194304,4194304] 0 2024-09-12T01:43:06.638 INFO:tasks.workunit.client.0.smithi066.stdout:9/249: truncate d0/f2 3100978 0 2024-09-12T01:43:06.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/250: read d0/d6/d17/f23 [337215,100397] 0 2024-09-12T01:43:06.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/251: creat d0/d6/d17/d1b/d4c/d42/f5e x:0 0 0 2024-09-12T01:43:06.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/252: creat d0/d6/d17/d28/f5f x:0 0 0 2024-09-12T01:43:06.640 INFO:tasks.workunit.client.0.smithi066.stdout:9/253: read - d0/d6/d17/d4f/d9/de/f5b zero size 2024-09-12T01:43:06.642 INFO:tasks.workunit.client.1.smithi153.stdout:3/630: dwrite d1/d16/f6f [0,4194304] 0 2024-09-12T01:43:06.642 INFO:tasks.workunit.client.1.smithi153.stdout:3/631: truncate d1/d16/d1c/f33 4772250 0 2024-09-12T01:43:06.642 INFO:tasks.workunit.client.1.smithi153.stdout:3/632: fsync d1/d13/d25/da6/f9e 0 2024-09-12T01:43:06.645 INFO:tasks.workunit.client.1.smithi153.stdout:8/554: symlink d17/d21/d56/d96/d6c/d6e/d7f/lb8 0 2024-09-12T01:43:06.646 INFO:tasks.workunit.client.1.smithi153.stdout:0/649: symlink d22/d79/d8e/dae/db7/le2 0 2024-09-12T01:43:06.646 INFO:tasks.workunit.client.1.smithi153.stdout:0/650: fsync d22/d30/d4c/d6e/d7f/fa3 0 2024-09-12T01:43:06.651 INFO:tasks.workunit.client.0.smithi066.stdout:3/283: symlink d5/d35/l5a 0 2024-09-12T01:43:06.651 INFO:tasks.workunit.client.0.smithi066.stdout:3/284: write d5/d35/f4d [567291,126255] 0 2024-09-12T01:43:06.651 INFO:tasks.workunit.client.1.smithi153.stdout:8/555: rmdir d17/d1d/d93 39 2024-09-12T01:43:06.656 INFO:tasks.workunit.client.0.smithi066.stdout:9/254: rmdir d0/d6/d17/d4f 39 2024-09-12T01:43:06.656 INFO:tasks.workunit.client.1.smithi153.stdout:5/578: dread d0/fd [0,4194304] 0 2024-09-12T01:43:06.657 INFO:tasks.workunit.client.1.smithi153.stdout:8/556: write d17/d21/f88 [1489993,19344] 0 2024-09-12T01:43:06.657 INFO:tasks.workunit.client.1.smithi153.stdout:8/557: chown d17/d1f/d4f 4 1 2024-09-12T01:43:06.657 INFO:tasks.workunit.client.1.smithi153.stdout:8/558: fsync d17/d21/d56/d96/d6c/d6e/d7f/fa3 0 2024-09-12T01:43:06.657 INFO:tasks.workunit.client.1.smithi153.stdout:0/651: rename d22/d30/c6c to d22/d30/d4c/d6f/ce3 0 2024-09-12T01:43:06.662 INFO:tasks.workunit.client.1.smithi153.stdout:8/559: symlink d17/d1f/d4f/d42/d79/dac/lb9 0 2024-09-12T01:43:06.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/652: symlink d22/d82/le4 0 2024-09-12T01:43:06.666 INFO:tasks.workunit.client.1.smithi153.stdout:0/653: write d22/d30/d4c/d6f/fe1 [536683,72953] 0 2024-09-12T01:43:06.668 INFO:tasks.workunit.client.1.smithi153.stdout:6/626: dwrite d1/d6/da/d19/f6b [0,4194304] 0 2024-09-12T01:43:06.668 INFO:tasks.workunit.client.1.smithi153.stdout:3/633: dwrite d1/f19 [0,4194304] 0 2024-09-12T01:43:06.669 INFO:tasks.workunit.client.1.smithi153.stdout:3/634: creat d1/d13/d23/d47/d71/fbb x:0 0 0 2024-09-12T01:43:06.669 INFO:tasks.workunit.client.1.smithi153.stdout:3/635: readlink d1/l56 0 2024-09-12T01:43:06.669 INFO:tasks.workunit.client.1.smithi153.stdout:3/636: write d1/d16/f69 [5675247,119957] 0 2024-09-12T01:43:06.669 INFO:tasks.workunit.client.1.smithi153.stdout:5/579: rename d0/df/d1c/d22/d2f/d55/d81 to d0/df/d1c/d22/d2f/d55/d9c/d75/d58/d71/db7 0 2024-09-12T01:43:06.670 INFO:tasks.workunit.client.0.smithi066.stdout:9/255: write d0/d6/d17/f18 [2795643,98474] 0 2024-09-12T01:43:06.670 INFO:tasks.workunit.client.0.smithi066.stdout:9/256: chown d0/d6/d17/d1b/l3b 5814830 1 2024-09-12T01:43:06.672 INFO:tasks.workunit.client.1.smithi153.stdout:8/560: symlink d17/d1f/d4f/d34/lba 0 2024-09-12T01:43:06.678 INFO:tasks.workunit.client.1.smithi153.stdout:0/654: write d22/d30/d4c/d6f/f73 [1344534,111706] 0 2024-09-12T01:43:06.678 INFO:tasks.workunit.client.1.smithi153.stdout:7/533: dwrite d12/d21/d29/f5a [0,4194304] 0 2024-09-12T01:43:06.678 INFO:tasks.workunit.client.1.smithi153.stdout:7/534: write d12/d21/d29/f5a [6921791,126357] 0 2024-09-12T01:43:06.680 INFO:tasks.workunit.client.1.smithi153.stdout:6/627: read d1/d6/d23/d98/d4f/f66 [3283392,115329] 0 2024-09-12T01:43:06.681 INFO:tasks.workunit.client.1.smithi153.stdout:6/628: truncate d1/d6/da/f37 913118 0 2024-09-12T01:43:06.681 INFO:tasks.workunit.client.1.smithi153.stdout:6/629: creat d1/d6/da/fcd x:0 0 0 2024-09-12T01:43:06.682 INFO:tasks.workunit.client.1.smithi153.stdout:3/637: write d1/d13/d25/d26/f9f [3806386,27205] 0 2024-09-12T01:43:06.682 INFO:tasks.workunit.client.1.smithi153.stdout:3/638: chown d1/d16/l5b 16317959 1 2024-09-12T01:43:06.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/337: getdents d2/db 0 2024-09-12T01:43:06.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/338: creat d2/f77 x:0 0 0 2024-09-12T01:43:06.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/339: chown d2/fa 2038002408 1 2024-09-12T01:43:06.686 INFO:tasks.workunit.client.0.smithi066.stdout:3/285: creat d5/f5b x:0 0 0 2024-09-12T01:43:06.690 INFO:tasks.workunit.client.0.smithi066.stdout:9/257: dwrite d0/d6/d17/d1b/d4c/d42/f5a [0,4194304] 0 2024-09-12T01:43:06.692 INFO:tasks.workunit.client.1.smithi153.stdout:8/561: link d17/f24 d17/d21/d56/d95/db7/fbb 0 2024-09-12T01:43:06.694 INFO:tasks.workunit.client.1.smithi153.stdout:0/655: rename d22/d30/d4c/d6f/ca5 to d22/d30/d4c/d6f/ce5 0 2024-09-12T01:43:06.694 INFO:tasks.workunit.client.1.smithi153.stdout:0/656: chown d22/d30/d4c/lcf 40225 1 2024-09-12T01:43:06.694 INFO:tasks.workunit.client.1.smithi153.stdout:0/657: creat d22/d79/fe6 x:0 0 0 2024-09-12T01:43:06.694 INFO:tasks.workunit.client.1.smithi153.stdout:0/658: write d22/d30/d4c/d6f/d88/fbe [776118,93] 0 2024-09-12T01:43:06.695 INFO:tasks.workunit.client.0.smithi066.stdout:6/340: getdents d2/db/d12/d1d 0 2024-09-12T01:43:06.696 INFO:tasks.workunit.client.0.smithi066.stdout:3/286: mkdir d5/d6/d1b/d31/d5c 0 2024-09-12T01:43:06.701 INFO:tasks.workunit.client.1.smithi153.stdout:6/630: symlink d1/d6/da/lce 0 2024-09-12T01:43:06.702 INFO:tasks.workunit.client.0.smithi066.stdout:9/258: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:06.705 INFO:tasks.workunit.client.1.smithi153.stdout:0/659: unlink d22/d30/d4c/d6e/d7f/d98/ld1 0 2024-09-12T01:43:06.705 INFO:tasks.workunit.client.1.smithi153.stdout:0/660: fdatasync d22/d30/d4c/d6f/d88/f89 0 2024-09-12T01:43:06.707 INFO:tasks.workunit.client.1.smithi153.stdout:5/580: rename d0/df/d1c/d22 to d0/df/db8 0 2024-09-12T01:43:06.707 INFO:tasks.workunit.client.1.smithi153.stdout:5/581: getdents d0/d43/dac/db0 0 2024-09-12T01:43:06.707 INFO:tasks.workunit.client.1.smithi153.stdout:0/661: mknod d22/d82/ce7 0 2024-09-12T01:43:06.709 INFO:tasks.workunit.client.1.smithi153.stdout:5/582: truncate d0/f12 336960 0 2024-09-12T01:43:06.709 INFO:tasks.workunit.client.1.smithi153.stdout:6/631: rename d1/d80/f92 to d1/fcf 0 2024-09-12T01:43:06.711 INFO:tasks.workunit.client.1.smithi153.stdout:6/632: unlink d1/d6/da/d19/f6b 0 2024-09-12T01:43:06.711 INFO:tasks.workunit.client.1.smithi153.stdout:6/633: truncate d1/d6/d23/d98/d4f/f83 5216615 0 2024-09-12T01:43:06.711 INFO:tasks.workunit.client.1.smithi153.stdout:6/634: write d1/d6/d23/d98/d53/da0/fc9 [561109,82224] 0 2024-09-12T01:43:06.716 INFO:tasks.workunit.client.1.smithi153.stdout:6/635: symlink d1/d6/d46/d73/d8a/ld0 0 2024-09-12T01:43:06.718 INFO:tasks.workunit.client.0.smithi066.stdout:9/259: dread d0/f7 [0,4194304] 0 2024-09-12T01:43:06.725 INFO:tasks.workunit.client.0.smithi066.stdout:9/260: dread d0/d6/f50 [0,4194304] 0 2024-09-12T01:43:06.727 INFO:tasks.workunit.client.0.smithi066.stdout:9/261: mknod d0/d6/d37/c60 0 2024-09-12T01:43:06.727 INFO:tasks.workunit.client.0.smithi066.stdout:9/262: fsync d0/d6/f13 0 2024-09-12T01:43:06.727 INFO:tasks.workunit.client.0.smithi066.stdout:9/263: readlink d0/d6/d17/d1b/l3b 0 2024-09-12T01:43:06.731 INFO:tasks.workunit.client.0.smithi066.stdout:6/341: dwrite d2/fa [0,4194304] 0 2024-09-12T01:43:06.748 INFO:tasks.workunit.client.0.smithi066.stdout:3/287: dwrite d5/f17 [0,4194304] 0 2024-09-12T01:43:06.748 INFO:tasks.workunit.client.0.smithi066.stdout:9/264: dread d0/d6/d17/d1b/d4c/f2b [0,4194304] 0 2024-09-12T01:43:06.748 INFO:tasks.workunit.client.0.smithi066.stdout:9/265: write d0/d6/d37/f55 [914225,31926] 0 2024-09-12T01:43:06.749 INFO:tasks.workunit.client.1.smithi153.stdout:0/662: dwrite d22/d30/d4c/d6f/d88/fc3 [0,4194304] 0 2024-09-12T01:43:06.749 INFO:tasks.workunit.client.0.smithi066.stdout:9/266: getdents d0/d6/d17/d4f 0 2024-09-12T01:43:06.752 INFO:tasks.workunit.client.0.smithi066.stdout:9/267: unlink d0/d6/d17/d4f/d9/c31 0 2024-09-12T01:43:06.753 INFO:tasks.workunit.client.0.smithi066.stdout:9/268: read d0/d6/d17/f18 [1683198,20277] 0 2024-09-12T01:43:06.753 INFO:tasks.workunit.client.0.smithi066.stdout:9/269: fsync d0/d6/f10 0 2024-09-12T01:43:06.753 INFO:tasks.workunit.client.0.smithi066.stdout:9/270: chown d0/d6/d17/d1b/d4c/l2f 516348534 1 2024-09-12T01:43:06.754 INFO:tasks.workunit.client.0.smithi066.stdout:9/271: creat d0/d6/d17/d1b/f61 x:0 0 0 2024-09-12T01:43:06.754 INFO:tasks.workunit.client.0.smithi066.stdout:9/272: write d0/f7 [2130806,56624] 0 2024-09-12T01:43:06.757 INFO:tasks.workunit.client.1.smithi153.stdout:7/535: dread d12/d21/d29/d35/d37/f91 [0,4194304] 0 2024-09-12T01:43:06.759 INFO:tasks.workunit.client.1.smithi153.stdout:6/636: dwrite d1/d6/da/f1a [0,4194304] 0 2024-09-12T01:43:06.759 INFO:tasks.workunit.client.1.smithi153.stdout:6/637: write d1/d6/d23/d98/d53/f97 [1561802,72367] 0 2024-09-12T01:43:06.759 INFO:tasks.workunit.client.0.smithi066.stdout:9/273: dread d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:06.759 INFO:tasks.workunit.client.0.smithi066.stdout:9/274: fdatasync d0/d6/d17/d1b/d4c/f2a 0 2024-09-12T01:43:06.759 INFO:tasks.workunit.client.1.smithi153.stdout:7/536: mknod d12/d21/d29/d35/d37/d4c/d5c/ca4 0 2024-09-12T01:43:06.760 INFO:tasks.workunit.client.0.smithi066.stdout:9/275: dread d0/d6/d17/f23 [0,4194304] 0 2024-09-12T01:43:06.765 INFO:tasks.workunit.client.1.smithi153.stdout:7/537: getdents d12/d21/d29/d35/d37/d58 0 2024-09-12T01:43:06.765 INFO:tasks.workunit.client.1.smithi153.stdout:7/538: rename d12 to d12/d4e/da5 22 2024-09-12T01:43:06.765 INFO:tasks.workunit.client.1.smithi153.stdout:7/539: stat d12/d21/d29/d35/d37/d58/f98 0 2024-09-12T01:43:06.765 INFO:tasks.workunit.client.1.smithi153.stdout:0/663: dread d22/f2b [0,4194304] 0 2024-09-12T01:43:06.767 INFO:tasks.workunit.client.0.smithi066.stdout:9/276: mknod d0/d6/c62 0 2024-09-12T01:43:06.767 INFO:tasks.workunit.client.0.smithi066.stdout:9/277: readlink d0/d6/d17/d4f/d9/de/l15 0 2024-09-12T01:43:06.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/664: mkdir d22/d79/d8e/dae/db7/de8 0 2024-09-12T01:43:06.767 INFO:tasks.workunit.client.1.smithi153.stdout:0/665: write d22/d30/d4c/f4d [5015944,81546] 0 2024-09-12T01:43:06.774 INFO:tasks.workunit.client.1.smithi153.stdout:8/562: dwrite d17/f85 [0,4194304] 0 2024-09-12T01:43:06.778 INFO:tasks.workunit.client.0.smithi066.stdout:3/288: dwrite d5/d6/d1b/d28/d52/f55 [0,4194304] 0 2024-09-12T01:43:06.778 INFO:tasks.workunit.client.1.smithi153.stdout:7/540: write d12/f20 [602477,48618] 0 2024-09-12T01:43:06.781 INFO:tasks.workunit.client.1.smithi153.stdout:8/563: truncate d17/d1d/d93/fa5 699483 0 2024-09-12T01:43:06.781 INFO:tasks.workunit.client.1.smithi153.stdout:8/564: truncate d17/d1f/d4f/d42/f59 1577110 0 2024-09-12T01:43:06.784 INFO:tasks.workunit.client.1.smithi153.stdout:7/541: getdents d12/d21/d29/d35/d37/d4c 0 2024-09-12T01:43:06.784 INFO:tasks.workunit.client.1.smithi153.stdout:5/583: dwrite d0/df/db8/d6e/f7a [0,4194304] 0 2024-09-12T01:43:06.786 INFO:tasks.workunit.client.1.smithi153.stdout:8/565: mkdir d17/d21/d56/d95/dbc 0 2024-09-12T01:43:06.788 INFO:tasks.workunit.client.0.smithi066.stdout:6/342: dwrite d2/db/f73 [0,4194304] 0 2024-09-12T01:43:06.792 INFO:tasks.workunit.client.1.smithi153.stdout:9/603: sync 2024-09-12T01:43:06.792 INFO:tasks.workunit.client.1.smithi153.stdout:9/604: dread - d3/d3a/d42/d72/f94 zero size 2024-09-12T01:43:06.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/638: dwrite d1/df/f51 [0,4194304] 0 2024-09-12T01:43:06.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/639: dread - d1/fcf zero size 2024-09-12T01:43:06.792 INFO:tasks.workunit.client.1.smithi153.stdout:0/666: dwrite d22/d30/d4c/fa2 [0,4194304] 0 2024-09-12T01:43:06.793 INFO:tasks.workunit.client.1.smithi153.stdout:0/667: dread - d22/d30/d4c/d6e/d7f/f93 zero size 2024-09-12T01:43:06.793 INFO:tasks.workunit.client.1.smithi153.stdout:0/668: read - d22/d30/d4c/d6e/f8f zero size 2024-09-12T01:43:06.793 INFO:tasks.workunit.client.1.smithi153.stdout:0/669: truncate d22/f9e 492468 0 2024-09-12T01:43:06.793 INFO:tasks.workunit.client.1.smithi153.stdout:0/670: fdatasync f20 0 2024-09-12T01:43:06.796 INFO:tasks.workunit.client.0.smithi066.stdout:3/289: symlink d5/d6/l5d 0 2024-09-12T01:43:06.801 INFO:tasks.workunit.client.0.smithi066.stdout:3/290: dread f3 [0,4194304] 0 2024-09-12T01:43:06.802 INFO:tasks.workunit.client.1.smithi153.stdout:7/542: mkdir d12/d21/d29/d2d/da6 0 2024-09-12T01:43:06.802 INFO:tasks.workunit.client.1.smithi153.stdout:7/543: chown d12/d7e/c78 7079 1 2024-09-12T01:43:06.807 INFO:tasks.workunit.client.1.smithi153.stdout:9/605: creat d3/d55/d30/d95/d84/d8b/fb6 x:0 0 0 2024-09-12T01:43:06.807 INFO:tasks.workunit.client.1.smithi153.stdout:5/584: dwrite d0/df/f35 [0,4194304] 0 2024-09-12T01:43:06.808 INFO:tasks.workunit.client.1.smithi153.stdout:5/585: chown d0/df/d83/d36/c4d 227 1 2024-09-12T01:43:06.809 INFO:tasks.workunit.client.0.smithi066.stdout:9/278: rmdir d0/d6 39 2024-09-12T01:43:06.810 INFO:tasks.workunit.client.1.smithi153.stdout:0/671: rmdir d22/d79/d8e/dae/db7 39 2024-09-12T01:43:06.813 INFO:tasks.workunit.client.1.smithi153.stdout:8/566: dwrite d17/d1f/d4f/f57 [4194304,4194304] 0 2024-09-12T01:43:06.817 INFO:tasks.workunit.client.1.smithi153.stdout:5/586: dread d0/df/d83/d36/f3b [0,4194304] 0 2024-09-12T01:43:06.844 INFO:tasks.workunit.client.1.smithi153.stdout:7/544: creat d12/d21/d29/d35/d37/d58/fa7 x:0 0 0 2024-09-12T01:43:06.845 INFO:tasks.workunit.client.1.smithi153.stdout:9/606: truncate d3/d55/f59 11409 0 2024-09-12T01:43:06.845 INFO:tasks.workunit.client.1.smithi153.stdout:9/607: truncate d3/f13 4837451 0 2024-09-12T01:43:06.847 INFO:tasks.workunit.client.0.smithi066.stdout:9/279: mkdir d0/d6/d17/d28/d63 0 2024-09-12T01:43:06.849 INFO:tasks.workunit.client.1.smithi153.stdout:6/640: getdents d1/d6/da/d19 0 2024-09-12T01:43:06.849 INFO:tasks.workunit.client.1.smithi153.stdout:6/641: write d1/d6/da/f37 [1095201,29783] 0 2024-09-12T01:43:06.850 INFO:tasks.workunit.client.1.smithi153.stdout:6/642: write d1/d6/f4c [3061748,23023] 0 2024-09-12T01:43:06.852 INFO:tasks.workunit.client.1.smithi153.stdout:8/567: creat d17/d1d/fbd x:0 0 0 2024-09-12T01:43:06.854 INFO:tasks.workunit.client.1.smithi153.stdout:5/587: unlink d0/c3 0 2024-09-12T01:43:06.858 INFO:tasks.workunit.client.1.smithi153.stdout:7/545: link d12/d21/d29/d35/d37/l61 d12/d21/d5f/la8 0 2024-09-12T01:43:06.859 INFO:tasks.workunit.client.1.smithi153.stdout:2/553: sync 2024-09-12T01:43:06.859 INFO:tasks.workunit.client.1.smithi153.stdout:4/510: sync 2024-09-12T01:43:06.859 INFO:tasks.workunit.client.1.smithi153.stdout:1/650: sync 2024-09-12T01:43:06.859 INFO:tasks.workunit.client.1.smithi153.stdout:6/643: mknod d1/cd1 0 2024-09-12T01:43:06.861 INFO:tasks.workunit.client.1.smithi153.stdout:0/672: rename d22/d30/d4c/c8c to d22/ce9 0 2024-09-12T01:43:06.862 INFO:tasks.workunit.client.1.smithi153.stdout:5/588: creat d0/fb9 x:0 0 0 2024-09-12T01:43:06.864 INFO:tasks.workunit.client.1.smithi153.stdout:7/546: creat d12/d21/d29/d35/d95/fa9 x:0 0 0 2024-09-12T01:43:06.865 INFO:tasks.workunit.client.1.smithi153.stdout:0/673: write d22/d30/d4c/d6f/d88/fd0 [631147,39901] 0 2024-09-12T01:43:06.867 INFO:tasks.workunit.client.1.smithi153.stdout:4/511: truncate d6/d9/dc/d98/d3e/f61 2900110 0 2024-09-12T01:43:06.867 INFO:tasks.workunit.client.1.smithi153.stdout:4/512: fsync d6/f53 0 2024-09-12T01:43:06.867 INFO:tasks.workunit.client.1.smithi153.stdout:4/513: fsync f0 0 2024-09-12T01:43:06.869 INFO:tasks.workunit.client.1.smithi153.stdout:1/651: mknod d2/d9/d17/dab/ccd 0 2024-09-12T01:43:06.869 INFO:tasks.workunit.client.1.smithi153.stdout:1/652: chown d2/d9/d17/f2d 1962839280 1 2024-09-12T01:43:06.870 INFO:tasks.workunit.client.1.smithi153.stdout:6/644: unlink d1/d6/d23/d98/d4f/f83 0 2024-09-12T01:43:06.872 INFO:tasks.workunit.client.1.smithi153.stdout:7/547: symlink d12/d21/d29/d35/d37/d4c/d5c/laa 0 2024-09-12T01:43:06.873 INFO:tasks.workunit.client.1.smithi153.stdout:7/548: write d12/d21/d29/d35/d37/f97 [947749,118472] 0 2024-09-12T01:43:06.874 INFO:tasks.workunit.client.1.smithi153.stdout:2/554: getdents d7/d19/d40 0 2024-09-12T01:43:06.874 INFO:tasks.workunit.client.1.smithi153.stdout:2/555: write d7/db/d27/d56/f6e [85124,114848] 0 2024-09-12T01:43:06.874 INFO:tasks.workunit.client.1.smithi153.stdout:2/556: dread - d7/db/d27/d56/f9a zero size 2024-09-12T01:43:06.876 INFO:tasks.workunit.client.1.smithi153.stdout:1/653: truncate d2/d9/d1d/d25/f4a 213240 0 2024-09-12T01:43:06.878 INFO:tasks.workunit.client.1.smithi153.stdout:7/549: symlink d12/d21/d29/d35/d37/d4c/d5c/lab 0 2024-09-12T01:43:06.880 INFO:tasks.workunit.client.1.smithi153.stdout:1/654: mkdir d2/d34/d8a/da7/dce 0 2024-09-12T01:43:06.880 INFO:tasks.workunit.client.1.smithi153.stdout:1/655: write d2/d68/fae [568869,38841] 0 2024-09-12T01:43:06.880 INFO:tasks.workunit.client.1.smithi153.stdout:0/674: dread d22/d30/d4c/d6e/d7f/fa3 [0,4194304] 0 2024-09-12T01:43:06.881 INFO:tasks.workunit.client.1.smithi153.stdout:7/550: getdents d12/d21/d29 0 2024-09-12T01:43:06.885 INFO:tasks.workunit.client.1.smithi153.stdout:0/675: symlink d22/lea 0 2024-09-12T01:43:06.885 INFO:tasks.workunit.client.1.smithi153.stdout:0/676: read - d22/d30/d4c/fad zero size 2024-09-12T01:43:06.888 INFO:tasks.workunit.client.1.smithi153.stdout:0/677: mkdir d22/d30/d4c/d6e/d7f/dbd/deb 0 2024-09-12T01:43:06.889 INFO:tasks.workunit.client.1.smithi153.stdout:1/656: rmdir d2/d9/d58/d74 39 2024-09-12T01:43:06.889 INFO:tasks.workunit.client.1.smithi153.stdout:1/657: chown d2/d9/d17/d2f/l51 2389 1 2024-09-12T01:43:06.891 INFO:tasks.workunit.client.1.smithi153.stdout:1/658: creat d2/d9/fcf x:0 0 0 2024-09-12T01:43:06.891 INFO:tasks.workunit.client.1.smithi153.stdout:1/659: write d2/d9/d28/d73/fb7 [1351433,74157] 0 2024-09-12T01:43:06.891 INFO:tasks.workunit.client.1.smithi153.stdout:1/660: readlink d2/d9/d58/d74/l9b 0 2024-09-12T01:43:06.892 INFO:tasks.workunit.client.1.smithi153.stdout:1/661: symlink d2/d68/ld0 0 2024-09-12T01:43:06.892 INFO:tasks.workunit.client.1.smithi153.stdout:0/678: dread d22/d82/fa4 [4194304,4194304] 0 2024-09-12T01:43:06.892 INFO:tasks.workunit.client.0.smithi066.stdout:9/280: dwrite d0/d6/d17/d4f/d9/de/f51 [0,4194304] 0 2024-09-12T01:43:06.893 INFO:tasks.workunit.client.1.smithi153.stdout:1/662: truncate d2/d9/d17/d2f/d56/d71/f7a 3078599 0 2024-09-12T01:43:06.895 INFO:tasks.workunit.client.1.smithi153.stdout:0/679: truncate f20 733720 0 2024-09-12T01:43:06.896 INFO:tasks.workunit.client.1.smithi153.stdout:6/645: write d1/df/fa7 [949410,48063] 0 2024-09-12T01:43:06.896 INFO:tasks.workunit.client.1.smithi153.stdout:6/646: write d1/d80/fbf [67323,38373] 0 2024-09-12T01:43:06.897 INFO:tasks.workunit.client.1.smithi153.stdout:1/663: symlink d2/d34/d8a/ld1 0 2024-09-12T01:43:06.897 INFO:tasks.workunit.client.1.smithi153.stdout:1/664: creat d2/d9/d17/d2f/d56/d83/fd2 x:0 0 0 2024-09-12T01:43:06.900 INFO:tasks.workunit.client.0.smithi066.stdout:9/281: rename d0/d6/d17/d4f/l33 to d0/d6/d17/d4f/l64 0 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:6/647: getdents d1/d6/d46/d73/d8a/d84 0 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/639: sync 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/640: creat d1/d1e/fbc x:0 0 0 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/641: fsync d1/d13/d25/da6/f5f 0 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:0/680: write f6 [2736955,33400] 0 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:0/681: chown d22/d79/fb8 895 1 2024-09-12T01:43:06.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/568: dwrite f14 [0,4194304] 0 2024-09-12T01:43:06.902 INFO:tasks.workunit.client.1.smithi153.stdout:8/569: write d17/d21/d56/f63 [804612,9892] 0 2024-09-12T01:43:06.902 INFO:tasks.workunit.client.1.smithi153.stdout:0/682: read d22/f74 [414631,75434] 0 2024-09-12T01:43:06.903 INFO:tasks.workunit.client.0.smithi066.stdout:9/282: symlink d0/d6/d37/l65 0 2024-09-12T01:43:06.904 INFO:tasks.workunit.client.1.smithi153.stdout:1/665: mknod d2/d9/d17/d2f/d56/d97/cd3 0 2024-09-12T01:43:06.904 INFO:tasks.workunit.client.1.smithi153.stdout:1/666: chown d2/d34/f50 486492719 1 2024-09-12T01:43:06.904 INFO:tasks.workunit.client.1.smithi153.stdout:1/667: fsync d2/d9/d1d/d82/d89/fbe 0 2024-09-12T01:43:06.907 INFO:tasks.workunit.client.1.smithi153.stdout:6/648: mkdir d1/d6/d23/d98/d53/d69/d7c/d7f/dd2 0 2024-09-12T01:43:06.907 INFO:tasks.workunit.client.1.smithi153.stdout:6/649: creat d1/d6/d23/d98/d53/d8d/fd3 x:0 0 0 2024-09-12T01:43:06.912 INFO:tasks.workunit.client.1.smithi153.stdout:2/557: dwrite d7/d17/f8c [0,4194304] 0 2024-09-12T01:43:06.912 INFO:tasks.workunit.client.1.smithi153.stdout:2/558: chown d7/db/d6c 6217 1 2024-09-12T01:43:06.912 INFO:tasks.workunit.client.1.smithi153.stdout:2/559: fsync d7/db/ff 0 2024-09-12T01:43:06.913 INFO:tasks.workunit.client.0.smithi066.stdout:6/343: dwrite d2/db/f73 [4194304,4194304] 0 2024-09-12T01:43:06.913 INFO:tasks.workunit.client.0.smithi066.stdout:1/198: sync 2024-09-12T01:43:06.913 INFO:tasks.workunit.client.1.smithi153.stdout:9/608: dwrite d3/d55/d30/d7b/f85 [0,4194304] 0 2024-09-12T01:43:06.913 INFO:tasks.workunit.client.1.smithi153.stdout:0/683: dread d22/d30/d4c/d6e/f48 [0,4194304] 0 2024-09-12T01:43:06.914 INFO:tasks.workunit.client.1.smithi153.stdout:9/609: chown d3/d3a/f8e 1991 1 2024-09-12T01:43:06.914 INFO:tasks.workunit.client.1.smithi153.stdout:7/551: dwrite d12/d21/d29/d35/d37/d4c/d5c/fa3 [0,4194304] 0 2024-09-12T01:43:06.922 INFO:tasks.workunit.client.1.smithi153.stdout:2/560: dread d7/db/d1d/f35 [0,4194304] 0 2024-09-12T01:43:06.922 INFO:tasks.workunit.client.1.smithi153.stdout:2/561: read - d7/d4d/d7b/f90 zero size 2024-09-12T01:43:06.923 INFO:tasks.workunit.client.1.smithi153.stdout:8/570: write d17/d21/d56/f84 [3121576,115059] 0 2024-09-12T01:43:06.923 INFO:tasks.workunit.client.1.smithi153.stdout:8/571: fdatasync d17/d21/d56/d96/d6c/d89/f8e 0 2024-09-12T01:43:06.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/589: dwrite d0/df/d1c/d69/f80 [0,4194304] 0 2024-09-12T01:43:06.924 INFO:tasks.workunit.client.1.smithi153.stdout:9/610: dread d3/d55/f77 [0,4194304] 0 2024-09-12T01:43:06.924 INFO:tasks.workunit.client.1.smithi153.stdout:9/611: write d3/f4 [4785529,127715] 0 2024-09-12T01:43:06.967 INFO:tasks.workunit.client.0.smithi066.stdout:6/344: symlink d2/d31/l78 0 2024-09-12T01:43:06.967 INFO:tasks.workunit.client.0.smithi066.stdout:6/345: write d2/db/f58 [504908,34219] 0 2024-09-12T01:43:06.967 INFO:tasks.workunit.client.0.smithi066.stdout:6/346: dread - d2/d21/f41 zero size 2024-09-12T01:43:06.967 INFO:tasks.workunit.client.0.smithi066.stdout:6/347: chown d2/db/f73 0 1 2024-09-12T01:43:06.967 INFO:tasks.workunit.client.0.smithi066.stdout:6/348: fdatasync d2/db/d12/f53 0 2024-09-12T01:43:06.967 INFO:tasks.workunit.client.0.smithi066.stdout:6/349: write d2/d31/d5e/f71 [916052,110860] 0 2024-09-12T01:43:06.968 INFO:tasks.workunit.client.1.smithi153.stdout:6/650: creat d1/df/fd4 x:0 0 0 2024-09-12T01:43:06.982 INFO:tasks.workunit.client.0.smithi066.stdout:9/283: rmdir d0 39 2024-09-12T01:43:06.987 INFO:tasks.workunit.client.0.smithi066.stdout:6/350: dwrite d2/db/d12/f53 [0,4194304] 0 2024-09-12T01:43:06.987 INFO:tasks.workunit.client.0.smithi066.stdout:6/351: chown d2/d31/d5e/l64 522763974 1 2024-09-12T01:43:06.987 INFO:tasks.workunit.client.0.smithi066.stdout:6/352: getdents d2/db/d72/d76 0 2024-09-12T01:43:06.988 INFO:tasks.workunit.client.1.smithi153.stdout:3/642: getdents d1/d1e 0 2024-09-12T01:43:06.990 INFO:tasks.workunit.client.1.smithi153.stdout:0/684: mkdir d22/d79/dca/dec 0 2024-09-12T01:43:07.011 INFO:tasks.workunit.client.1.smithi153.stdout:2/562: link d7/d19/f4b d7/db/d27/d56/fb4 0 2024-09-12T01:43:07.013 INFO:tasks.workunit.client.1.smithi153.stdout:2/563: dread d7/d19/d83/fa7 [0,4194304] 0 2024-09-12T01:43:07.022 INFO:tasks.workunit.client.0.smithi066.stdout:9/284: symlink d0/d6/d17/d28/d63/l66 0 2024-09-12T01:43:07.024 INFO:tasks.workunit.client.1.smithi153.stdout:8/572: getdents d17/d1f/d4f/d42/d79 0 2024-09-12T01:43:07.026 INFO:tasks.workunit.client.1.smithi153.stdout:5/590: link d0/df/d83/d36/f7d d0/df/d83/d36/d39/da4/fba 0 2024-09-12T01:43:07.038 INFO:tasks.workunit.client.0.smithi066.stdout:6/353: link d2/db/f60 d2/db/d12/d49/f79 0 2024-09-12T01:43:07.041 INFO:tasks.workunit.client.0.smithi066.stdout:9/285: creat d0/d6/d17/d4f/d12/f67 x:0 0 0 2024-09-12T01:43:07.042 INFO:tasks.workunit.client.1.smithi153.stdout:9/612: mkdir d3/d66/d80/db7 0 2024-09-12T01:43:07.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/286: mkdir d0/d6/d17/d4f/d12/d46/d68 0 2024-09-12T01:43:07.054 INFO:tasks.workunit.client.0.smithi066.stdout:9/287: link d0/d6/d17/d4f/d12/f27 d0/d6/f69 0 2024-09-12T01:43:07.054 INFO:tasks.workunit.client.0.smithi066.stdout:9/288: chown d0/d6/d17/d4f/f36 3831 1 2024-09-12T01:43:07.058 INFO:tasks.workunit.client.0.smithi066.stdout:9/289: truncate d0/d6/d17/d1b/d4c/f2a 471589 0 2024-09-12T01:43:07.073 INFO:tasks.workunit.client.0.smithi066.stdout:9/290: dwrite d0/d6/d17/d4f/d12/f27 [0,4194304] 0 2024-09-12T01:43:07.091 INFO:tasks.workunit.client.0.smithi066.stdout:9/291: dwrite d0/d6/f20 [0,4194304] 0 2024-09-12T01:43:07.091 INFO:tasks.workunit.client.0.smithi066.stdout:9/292: chown d0/d6/d17/d28/d63/l66 1 1 2024-09-12T01:43:07.108 INFO:tasks.workunit.client.0.smithi066.stdout:9/293: dwrite d0/d6/d17/d4f/d9/de/f51 [0,4194304] 0 2024-09-12T01:43:07.111 INFO:tasks.workunit.client.0.smithi066.stdout:9/294: creat d0/f6a x:0 0 0 2024-09-12T01:43:07.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/643: mknod d1/d59/cbd 0 2024-09-12T01:43:07.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/644: readlink d1/d13/d23/d47/d71/d8e/d93/l73 0 2024-09-12T01:43:07.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/645: fdatasync d1/d13/d25/f42 0 2024-09-12T01:43:07.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/646: readlink d1/d16/d1c/l1d 0 2024-09-12T01:43:07.114 INFO:tasks.workunit.client.1.smithi153.stdout:3/647: write d1/d13/d25/d26/f44 [2237509,115105] 0 2024-09-12T01:43:07.115 INFO:tasks.workunit.client.1.smithi153.stdout:0/685: rmdir d22/d30/d4c/d8a 39 2024-09-12T01:43:07.118 INFO:tasks.workunit.client.1.smithi153.stdout:7/552: getdents d12/d21/d29/d35/d37/d58 0 2024-09-12T01:43:07.118 INFO:tasks.workunit.client.1.smithi153.stdout:7/553: readlink d12/l47 0 2024-09-12T01:43:07.119 INFO:tasks.workunit.client.1.smithi153.stdout:8/573: truncate d17/d1f/d4f/d34/f47 4287871 0 2024-09-12T01:43:07.122 INFO:tasks.workunit.client.1.smithi153.stdout:5/591: mkdir d0/d43/d8d/d8e/dbb 0 2024-09-12T01:43:07.122 INFO:tasks.workunit.client.1.smithi153.stdout:3/648: dread d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:07.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/613: symlink d3/d5f/d62/lb8 0 2024-09-12T01:43:07.126 INFO:tasks.workunit.client.1.smithi153.stdout:0/686: mkdir d22/d79/dca/ded 0 2024-09-12T01:43:07.127 INFO:tasks.workunit.client.1.smithi153.stdout:7/554: truncate d12/d21/f6b 2583506 0 2024-09-12T01:43:07.131 INFO:tasks.workunit.client.1.smithi153.stdout:9/614: link d3/d55/c7f d3/d3a/d42/d72/d98/cb9 0 2024-09-12T01:43:07.131 INFO:tasks.workunit.client.1.smithi153.stdout:9/615: chown d3/d55/d30/d7b 6 1 2024-09-12T01:43:07.133 INFO:tasks.workunit.client.1.smithi153.stdout:0/687: link d22/d30/d4c/f4d d22/d79/dca/fee 0 2024-09-12T01:43:07.133 INFO:tasks.workunit.client.0.smithi066.stdout:9/295: dwrite d0/f3c [0,4194304] 0 2024-09-12T01:43:07.134 INFO:tasks.workunit.client.1.smithi153.stdout:3/649: rmdir d1/d13/d25/d26/d4b 39 2024-09-12T01:43:07.134 INFO:tasks.workunit.client.1.smithi153.stdout:3/650: write d1/d13/d23/d47/d6c/f6d [590235,56873] 0 2024-09-12T01:43:07.134 INFO:tasks.workunit.client.1.smithi153.stdout:3/651: truncate d1/d13/d25/d26/fae 735892 0 2024-09-12T01:43:07.134 INFO:tasks.workunit.client.1.smithi153.stdout:3/652: write d1/d64/fb4 [4829671,117258] 0 2024-09-12T01:43:07.135 INFO:tasks.workunit.client.0.smithi066.stdout:1/199: rename d5/f14 to d5/dc/dd/d1c/f35 0 2024-09-12T01:43:07.137 INFO:tasks.workunit.client.1.smithi153.stdout:9/616: dread d3/f18 [0,4194304] 0 2024-09-12T01:43:07.140 INFO:tasks.workunit.client.0.smithi066.stdout:1/200: mkdir d5/dc/d36 0 2024-09-12T01:43:07.142 INFO:tasks.workunit.client.1.smithi153.stdout:9/617: link d3/d55/d30/l6c d3/d3a/d42/d72/lba 0 2024-09-12T01:43:07.144 INFO:tasks.workunit.client.1.smithi153.stdout:3/653: dread d1/d13/d25/da6/f7e [0,4194304] 0 2024-09-12T01:43:07.144 INFO:tasks.workunit.client.1.smithi153.stdout:8/574: dwrite d17/d1f/d4f/d42/f86 [0,4194304] 0 2024-09-12T01:43:07.146 INFO:tasks.workunit.client.1.smithi153.stdout:0/688: write d22/d30/d4c/d6f/d88/faa [3864129,55772] 0 2024-09-12T01:43:07.147 INFO:tasks.workunit.client.1.smithi153.stdout:0/689: chown d22/d79/l94 1924178 1 2024-09-12T01:43:07.147 INFO:tasks.workunit.client.1.smithi153.stdout:0/690: stat d22/d79/fb8 0 2024-09-12T01:43:07.147 INFO:tasks.workunit.client.1.smithi153.stdout:0/691: fdatasync d22/d30/d4c/fd4 0 2024-09-12T01:43:07.151 INFO:tasks.workunit.client.0.smithi066.stdout:1/201: write d5/dc/f1f [2823468,44307] 0 2024-09-12T01:43:07.151 INFO:tasks.workunit.client.0.smithi066.stdout:1/202: write d5/d15/f1b [277474,115616] 0 2024-09-12T01:43:07.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/654: mknod d1/d64/cbe 0 2024-09-12T01:43:07.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/655: chown d1/d16/d1c/c3c 547914 1 2024-09-12T01:43:07.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/656: fdatasync d1/d16/d17/f67 0 2024-09-12T01:43:07.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/657: truncate d1/d45/f61 296490 0 2024-09-12T01:43:07.155 INFO:tasks.workunit.client.1.smithi153.stdout:5/592: mknod d0/df/db8/cbc 0 2024-09-12T01:43:07.156 INFO:tasks.workunit.client.1.smithi153.stdout:0/692: dread d22/d30/d4c/d6f/d88/fc3 [0,4194304] 0 2024-09-12T01:43:07.157 INFO:tasks.workunit.client.1.smithi153.stdout:3/658: creat d1/d13/d23/d47/d71/d8e/d93/db1/fbf x:0 0 0 2024-09-12T01:43:07.158 INFO:tasks.workunit.client.1.smithi153.stdout:5/593: creat d0/df/db8/d2f/d55/d9c/d75/d58/d71/fbd x:0 0 0 2024-09-12T01:43:07.158 INFO:tasks.workunit.client.0.smithi066.stdout:1/203: symlink d5/d15/l37 0 2024-09-12T01:43:07.161 INFO:tasks.workunit.client.1.smithi153.stdout:3/659: link d1/d13/d23/d47/d6c/d9c/cb2 d1/d13/d25/d26/d4b/d97/cc0 0 2024-09-12T01:43:07.161 INFO:tasks.workunit.client.1.smithi153.stdout:3/660: chown d1/d13/f77 1 1 2024-09-12T01:43:07.161 INFO:tasks.workunit.client.0.smithi066.stdout:9/296: dwrite d0/d6/d17/d4f/f36 [0,4194304] 0 2024-09-12T01:43:07.163 INFO:tasks.workunit.client.0.smithi066.stdout:1/204: unlink d5/f1a 0 2024-09-12T01:43:07.163 INFO:tasks.workunit.client.1.smithi153.stdout:3/661: mknod d1/d13/d23/d47/d71/cc1 0 2024-09-12T01:43:07.165 INFO:tasks.workunit.client.1.smithi153.stdout:0/693: dread d22/d30/d4c/d8a/fdd [0,4194304] 0 2024-09-12T01:43:07.166 INFO:tasks.workunit.client.1.smithi153.stdout:3/662: mkdir d1/d45/dc2 0 2024-09-12T01:43:07.169 INFO:tasks.workunit.client.0.smithi066.stdout:1/205: mknod d5/d15/c38 0 2024-09-12T01:43:07.169 INFO:tasks.workunit.client.0.smithi066.stdout:1/206: fdatasync d5/dc/dd/f23 0 2024-09-12T01:43:07.169 INFO:tasks.workunit.client.0.smithi066.stdout:1/207: getdents d5/dc/d36 0 2024-09-12T01:43:07.169 INFO:tasks.workunit.client.0.smithi066.stdout:1/208: chown d5/f7 1175490 1 2024-09-12T01:43:07.169 INFO:tasks.workunit.client.0.smithi066.stdout:1/209: read d5/dc/f33 [956985,91937] 0 2024-09-12T01:43:07.170 INFO:tasks.workunit.client.1.smithi153.stdout:0/694: mknod d22/d79/d8e/dae/db7/cef 0 2024-09-12T01:43:07.171 INFO:tasks.workunit.client.0.smithi066.stdout:1/210: creat d5/dc/d36/f39 x:0 0 0 2024-09-12T01:43:07.175 INFO:tasks.workunit.client.0.smithi066.stdout:1/211: creat d5/d15/f3a x:0 0 0 2024-09-12T01:43:07.179 INFO:tasks.workunit.client.1.smithi153.stdout:3/663: write d1/f1a [629860,129905] 0 2024-09-12T01:43:07.181 INFO:tasks.workunit.client.1.smithi153.stdout:5/594: dwrite d0/df/d83/d36/d39/f74 [0,4194304] 0 2024-09-12T01:43:07.185 INFO:tasks.workunit.client.1.smithi153.stdout:3/664: symlink d1/d13/d23/d47/d71/d8e/d93/d79/lc3 0 2024-09-12T01:43:07.186 INFO:tasks.workunit.client.0.smithi066.stdout:1/212: read d5/dc/dd/f2b [1907992,99594] 0 2024-09-12T01:43:07.190 INFO:tasks.workunit.client.1.smithi153.stdout:5/595: mkdir d0/df/db8/d2f/d55/d9c/d75/d58/d70/dbe 0 2024-09-12T01:43:07.190 INFO:tasks.workunit.client.0.smithi066.stdout:9/297: dwrite d0/d6/d17/f18 [0,4194304] 0 2024-09-12T01:43:07.191 INFO:tasks.workunit.client.0.smithi066.stdout:1/213: dread d5/dc/dd/f2b [0,4194304] 0 2024-09-12T01:43:07.197 INFO:tasks.workunit.client.0.smithi066.stdout:1/214: creat d5/f3b x:0 0 0 2024-09-12T01:43:07.199 INFO:tasks.workunit.client.0.smithi066.stdout:1/215: mknod d5/c3c 0 2024-09-12T01:43:07.199 INFO:tasks.workunit.client.0.smithi066.stdout:1/216: fsync d5/fa 0 2024-09-12T01:43:07.199 INFO:tasks.workunit.client.0.smithi066.stdout:1/217: symlink d5/dc/dd/d1c/l3d 0 2024-09-12T01:43:07.201 INFO:tasks.workunit.client.0.smithi066.stdout:1/218: truncate d5/dc/dd/f23 1424477 0 2024-09-12T01:43:07.201 INFO:tasks.workunit.client.0.smithi066.stdout:1/219: read - d5/f3b zero size 2024-09-12T01:43:07.202 INFO:tasks.workunit.client.0.smithi066.stdout:1/220: symlink d5/dc/dd/d1c/l3e 0 2024-09-12T01:43:07.204 INFO:tasks.workunit.client.1.smithi153.stdout:5/596: write d0/df/db8/f2b [498498,46392] 0 2024-09-12T01:43:07.209 INFO:tasks.workunit.client.0.smithi066.stdout:6/354: rename d2/db/l46 to d2/db/d12/d49/l7a 0 2024-09-12T01:43:07.211 INFO:tasks.workunit.client.0.smithi066.stdout:6/355: rmdir d2/db/d12 39 2024-09-12T01:43:07.212 INFO:tasks.workunit.client.0.smithi066.stdout:6/356: stat d2/f1a 0 2024-09-12T01:43:07.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/298: dwrite d0/d6/d17/d4f/d12/f67 [0,4194304] 0 2024-09-12T01:43:07.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/299: creat d0/d6/d17/d4f/d12/f6b x:0 0 0 2024-09-12T01:43:07.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/300: fsync d0/d6/d17/f4d 0 2024-09-12T01:43:07.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/301: read d0/d6/d17/d1b/d4c/f2a [215503,104763] 0 2024-09-12T01:43:07.214 INFO:tasks.workunit.client.0.smithi066.stdout:9/302: write d0/d6/f13 [2159046,68268] 0 2024-09-12T01:43:07.218 INFO:tasks.workunit.client.1.smithi153.stdout:1/668: rename d2/d9/d58/lbd to d2/d34/ld4 0 2024-09-12T01:43:07.219 INFO:tasks.workunit.client.0.smithi066.stdout:9/303: symlink d0/d6/d17/d28/d63/l6c 0 2024-09-12T01:43:07.219 INFO:tasks.workunit.client.0.smithi066.stdout:9/304: symlink d0/d6/d17/d4f/d9/l6d 0 2024-09-12T01:43:07.220 INFO:tasks.workunit.client.0.smithi066.stdout:6/357: dread d2/db/f63 [0,4194304] 0 2024-09-12T01:43:07.221 INFO:tasks.workunit.client.0.smithi066.stdout:9/305: creat d0/d6/d43/f6e x:0 0 0 2024-09-12T01:43:07.223 INFO:tasks.workunit.client.0.smithi066.stdout:6/358: unlink c1 0 2024-09-12T01:43:07.224 INFO:tasks.workunit.client.0.smithi066.stdout:9/306: creat d0/d6/d17/d28/f6f x:0 0 0 2024-09-12T01:43:07.226 INFO:tasks.workunit.client.0.smithi066.stdout:6/359: getdents d2 0 2024-09-12T01:43:07.227 INFO:tasks.workunit.client.1.smithi153.stdout:5/597: dwrite d0/d43/f92 [4194304,4194304] 0 2024-09-12T01:43:07.227 INFO:tasks.workunit.client.1.smithi153.stdout:5/598: chown d0/df/db8/d2f/f3a 74450 1 2024-09-12T01:43:07.227 INFO:tasks.workunit.client.1.smithi153.stdout:5/599: readlink d0/df/db8/l3c 0 2024-09-12T01:43:07.227 INFO:tasks.workunit.client.0.smithi066.stdout:1/221: dwrite d5/f2a [0,4194304] 0 2024-09-12T01:43:07.228 INFO:tasks.workunit.client.0.smithi066.stdout:9/307: creat d0/d6/d17/d4f/d12/d46/d68/f70 x:0 0 0 2024-09-12T01:43:07.233 INFO:tasks.workunit.client.1.smithi153.stdout:5/600: rename d0/d43/d8d/d8e/c98 to d0/d15/dae/cbf 0 2024-09-12T01:43:07.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/360: dread d2/db/d12/f53 [0,4194304] 0 2024-09-12T01:43:07.236 INFO:tasks.workunit.client.1.smithi153.stdout:5/601: dread d0/df/f52 [0,4194304] 0 2024-09-12T01:43:07.239 INFO:tasks.workunit.client.0.smithi066.stdout:6/361: dread d2/d21/f34 [0,4194304] 0 2024-09-12T01:43:07.243 INFO:tasks.workunit.client.1.smithi153.stdout:5/602: mkdir d0/d20/dc0 0 2024-09-12T01:43:07.245 INFO:tasks.workunit.client.0.smithi066.stdout:9/308: creat d0/d6/d17/f71 x:0 0 0 2024-09-12T01:43:07.245 INFO:tasks.workunit.client.0.smithi066.stdout:9/309: fsync d0/d6/d17/d1b/f1c 0 2024-09-12T01:43:07.245 INFO:tasks.workunit.client.0.smithi066.stdout:9/310: fdatasync d0/d6/d17/d1b/d4c/d42/f5d 0 2024-09-12T01:43:07.245 INFO:tasks.workunit.client.0.smithi066.stdout:9/311: dread - d0/d6/f2d zero size 2024-09-12T01:43:07.246 INFO:tasks.workunit.client.0.smithi066.stdout:6/362: mkdir d2/db/d7b 0 2024-09-12T01:43:07.247 INFO:tasks.workunit.client.0.smithi066.stdout:6/363: truncate d2/d31/d5e/f71 1179735 0 2024-09-12T01:43:07.247 INFO:tasks.workunit.client.0.smithi066.stdout:6/364: creat d2/d21/f7c x:0 0 0 2024-09-12T01:43:07.248 INFO:tasks.workunit.client.1.smithi153.stdout:5/603: mknod d0/df/d1c/cc1 0 2024-09-12T01:43:07.253 INFO:tasks.workunit.client.1.smithi153.stdout:5/604: mknod d0/df/d99/cc2 0 2024-09-12T01:43:07.256 INFO:tasks.workunit.client.1.smithi153.stdout:5/605: symlink d0/df/db8/d2f/d55/d9c/d75/d58/d71/db7/lc3 0 2024-09-12T01:43:07.258 INFO:tasks.workunit.client.0.smithi066.stdout:6/365: dread d2/f4e [0,4194304] 0 2024-09-12T01:43:07.258 INFO:tasks.workunit.client.0.smithi066.stdout:6/366: dread - d2/db/d12/f6e zero size 2024-09-12T01:43:07.258 INFO:tasks.workunit.client.0.smithi066.stdout:6/367: fdatasync d2/db/d12/d1d/f26 0 2024-09-12T01:43:07.258 INFO:tasks.workunit.client.0.smithi066.stdout:6/368: symlink d2/d31/d5e/l7d 0 2024-09-12T01:43:07.258 INFO:tasks.workunit.client.0.smithi066.stdout:6/369: fdatasync d2/fe 0 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:2/268: sync 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:7/207: sync 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:8/285: sync 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:8/286: readlink d12/l18 0 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:0/289: sync 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:1/222: truncate d5/dc/f1f 1881029 0 2024-09-12T01:43:07.270 INFO:tasks.workunit.client.0.smithi066.stdout:1/223: truncate d5/d15/f3a 627617 0 2024-09-12T01:43:07.271 INFO:tasks.workunit.client.0.smithi066.stdout:4/227: sync 2024-09-12T01:43:07.272 INFO:tasks.workunit.client.0.smithi066.stdout:7/208: symlink d2/d5/d6/l44 0 2024-09-12T01:43:07.275 INFO:tasks.workunit.client.0.smithi066.stdout:5/206: sync 2024-09-12T01:43:07.275 INFO:tasks.workunit.client.0.smithi066.stdout:5/207: fdatasync d0/dd/d18/d36/f38 0 2024-09-12T01:43:07.275 INFO:tasks.workunit.client.0.smithi066.stdout:5/208: stat d0/d26/f2e 0 2024-09-12T01:43:07.275 INFO:tasks.workunit.client.0.smithi066.stdout:5/209: fsync d0/f4 0 2024-09-12T01:43:07.276 INFO:tasks.workunit.client.0.smithi066.stdout:3/291: sync 2024-09-12T01:43:07.276 INFO:tasks.workunit.client.0.smithi066.stdout:0/290: dread d1/dc/de/f4b [0,4194304] 0 2024-09-12T01:43:07.277 INFO:tasks.workunit.client.0.smithi066.stdout:9/312: dwrite d0/d6/d37/f55 [0,4194304] 0 2024-09-12T01:43:07.277 INFO:tasks.workunit.client.0.smithi066.stdout:9/313: fdatasync d0/d6/d37/f55 0 2024-09-12T01:43:07.278 INFO:tasks.workunit.client.0.smithi066.stdout:1/224: stat c2 0 2024-09-12T01:43:07.278 INFO:tasks.workunit.client.0.smithi066.stdout:1/225: creat d5/dc/f3f x:0 0 0 2024-09-12T01:43:07.283 INFO:tasks.workunit.client.0.smithi066.stdout:0/291: unlink d1/dc/c12 0 2024-09-12T01:43:07.285 INFO:tasks.workunit.client.0.smithi066.stdout:2/269: dread de/d3c/f4a [0,4194304] 0 2024-09-12T01:43:07.285 INFO:tasks.workunit.client.0.smithi066.stdout:2/270: stat de/d13/d1e 0 2024-09-12T01:43:07.286 INFO:tasks.workunit.client.0.smithi066.stdout:2/271: write de/d13/d28/f30 [963210,109598] 0 2024-09-12T01:43:07.290 INFO:tasks.workunit.client.0.smithi066.stdout:7/209: mknod d2/d5/c45 0 2024-09-12T01:43:07.291 INFO:tasks.workunit.client.0.smithi066.stdout:7/210: write d2/d5/f23 [3997998,61932] 0 2024-09-12T01:43:07.292 INFO:tasks.workunit.client.0.smithi066.stdout:8/287: rename d12/d26 to d12/d21/d2f/d57 0 2024-09-12T01:43:07.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/272: mkdir de/d13/d1e/d41/d58 0 2024-09-12T01:43:07.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/273: creat de/d13/d28/f59 x:0 0 0 2024-09-12T01:43:07.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/274: dread - de/d13/d1e/d22/f44 zero size 2024-09-12T01:43:07.294 INFO:tasks.workunit.client.1.smithi153.stdout:5/606: dwrite d0/f1f [0,4194304] 0 2024-09-12T01:43:07.294 INFO:tasks.workunit.client.1.smithi153.stdout:5/607: truncate d0/df/db8/d2f/d55/d9c/d75/d58/f94 4685983 0 2024-09-12T01:43:07.296 INFO:tasks.workunit.client.1.smithi153.stdout:0/695: creat d22/d30/ff0 x:0 0 0 2024-09-12T01:43:07.297 INFO:tasks.workunit.client.0.smithi066.stdout:3/292: rename d5/d6/d40 to d5/d6/d1b/d28/d4f/d5e 0 2024-09-12T01:43:07.297 INFO:tasks.workunit.client.0.smithi066.stdout:6/370: dwrite d2/d21/f52 [0,4194304] 0 2024-09-12T01:43:07.299 INFO:tasks.workunit.client.0.smithi066.stdout:4/228: dwrite d4/d6/f34 [0,4194304] 0 2024-09-12T01:43:07.299 INFO:tasks.workunit.client.0.smithi066.stdout:4/229: write d4/d6/d8/f3b [1356075,8428] 0 2024-09-12T01:43:07.299 INFO:tasks.workunit.client.0.smithi066.stdout:4/230: chown d4/d6/d27/d2f/d41 2796 1 2024-09-12T01:43:07.307 INFO:tasks.workunit.client.0.smithi066.stdout:7/211: mkdir d2/d46 0 2024-09-12T01:43:07.307 INFO:tasks.workunit.client.0.smithi066.stdout:7/212: write d2/d5/f23 [4883904,14406] 0 2024-09-12T01:43:07.310 INFO:tasks.workunit.client.1.smithi153.stdout:5/608: dread d0/fd [0,4194304] 0 2024-09-12T01:43:07.311 INFO:tasks.workunit.client.0.smithi066.stdout:6/371: write d2/f5 [4816925,49916] 0 2024-09-12T01:43:07.311 INFO:tasks.workunit.client.0.smithi066.stdout:3/293: symlink d5/d6/d1b/d31/l5f 0 2024-09-12T01:43:07.312 INFO:tasks.workunit.client.0.smithi066.stdout:8/288: dread d12/d21/f32 [0,4194304] 0 2024-09-12T01:43:07.312 INFO:tasks.workunit.client.0.smithi066.stdout:8/289: chown d12 7 1 2024-09-12T01:43:07.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/275: getdents de/d13 0 2024-09-12T01:43:07.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/276: readlink de/d13/d28/d3d/l55 0 2024-09-12T01:43:07.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/277: getdents de/d13/d1e/d25 0 2024-09-12T01:43:07.324 INFO:tasks.workunit.client.1.smithi153.stdout:5/609: dread d0/d20/f41 [0,4194304] 0 2024-09-12T01:43:07.325 INFO:tasks.workunit.client.0.smithi066.stdout:9/314: rename d0/d6/c34 to d0/d6/d17/d4f/d9/de/c72 0 2024-09-12T01:43:07.329 INFO:tasks.workunit.client.0.smithi066.stdout:2/278: unlink de/ff 0 2024-09-12T01:43:07.334 INFO:tasks.workunit.client.0.smithi066.stdout:9/315: getdents d0/d6/d17/d1b 0 2024-09-12T01:43:07.335 INFO:tasks.workunit.client.0.smithi066.stdout:2/279: mknod de/d13/d1e/c5a 0 2024-09-12T01:43:07.337 INFO:tasks.workunit.client.1.smithi153.stdout:0/696: dwrite d22/d30/f42 [4194304,4194304] 0 2024-09-12T01:43:07.338 INFO:tasks.workunit.client.0.smithi066.stdout:0/292: rename d1/dc/df to d1/d66 0 2024-09-12T01:43:07.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/280: creat de/d13/d1e/d25/f5b x:0 0 0 2024-09-12T01:43:07.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/281: chown de/c10 7 1 2024-09-12T01:43:07.343 INFO:tasks.workunit.client.1.smithi153.stdout:6/651: sync 2024-09-12T01:43:07.343 INFO:tasks.workunit.client.1.smithi153.stdout:4/514: sync 2024-09-12T01:43:07.343 INFO:tasks.workunit.client.1.smithi153.stdout:6/652: dread - d1/fcf zero size 2024-09-12T01:43:07.343 INFO:tasks.workunit.client.1.smithi153.stdout:6/653: chown d1/d6/d23/d98/d53/f77 71 1 2024-09-12T01:43:07.343 INFO:tasks.workunit.client.1.smithi153.stdout:4/515: truncate d6/da4/fa5 935791 0 2024-09-12T01:43:07.343 INFO:tasks.workunit.client.1.smithi153.stdout:2/564: sync 2024-09-12T01:43:07.344 INFO:tasks.workunit.client.0.smithi066.stdout:4/231: rename d4/d6/d27/d2f/d41 to d4/d6/d8/d4a 0 2024-09-12T01:43:07.344 INFO:tasks.workunit.client.0.smithi066.stdout:4/232: chown d4/d6/d14 0 1 2024-09-12T01:43:07.345 INFO:tasks.workunit.client.1.smithi153.stdout:0/697: write d22/d30/d4c/d6f/fab [2025820,78616] 0 2024-09-12T01:43:07.347 INFO:tasks.workunit.client.1.smithi153.stdout:4/516: rmdir d6/da4 39 2024-09-12T01:43:07.348 INFO:tasks.workunit.client.0.smithi066.stdout:8/290: rename le to d12/d21/l58 0 2024-09-12T01:43:07.348 INFO:tasks.workunit.client.0.smithi066.stdout:8/291: write d12/f3d [1662214,105441] 0 2024-09-12T01:43:07.350 INFO:tasks.workunit.client.0.smithi066.stdout:4/233: symlink d4/d6/l4b 0 2024-09-12T01:43:07.350 INFO:tasks.workunit.client.0.smithi066.stdout:4/234: fsync d4/f46 0 2024-09-12T01:43:07.351 INFO:tasks.workunit.client.1.smithi153.stdout:6/654: mknod d1/d6/d46/cd5 0 2024-09-12T01:43:07.356 INFO:tasks.workunit.client.1.smithi153.stdout:4/517: rmdir d6/d9/dc/d31/d76/dac 0 2024-09-12T01:43:07.358 INFO:tasks.workunit.client.0.smithi066.stdout:9/316: rename d0/d6/d17/d28/c5c to d0/c73 0 2024-09-12T01:43:07.358 INFO:tasks.workunit.client.0.smithi066.stdout:9/317: creat d0/d6/d17/f74 x:0 0 0 2024-09-12T01:43:07.360 INFO:tasks.workunit.client.0.smithi066.stdout:3/294: dwrite d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:07.360 INFO:tasks.workunit.client.0.smithi066.stdout:3/295: truncate d5/d6/d1b/d28/f46 610922 0 2024-09-12T01:43:07.362 INFO:tasks.workunit.client.0.smithi066.stdout:3/296: symlink d5/d6/d1b/d28/l60 0 2024-09-12T01:43:07.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/297: link d5/d6/d1b/f3f d5/d6/f61 0 2024-09-12T01:43:07.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/298: write d5/d6/d1b/f3f [2767118,26648] 0 2024-09-12T01:43:07.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/299: creat d5/d6/d1b/f62 x:0 0 0 2024-09-12T01:43:07.365 INFO:tasks.workunit.client.0.smithi066.stdout:3/300: truncate d5/d6/d1b/d28/d52/f55 1043930 0 2024-09-12T01:43:07.365 INFO:tasks.workunit.client.0.smithi066.stdout:3/301: getdents d5/d6/d1b/d31/d5c 0 2024-09-12T01:43:07.365 INFO:tasks.workunit.client.0.smithi066.stdout:3/302: write d5/d6/dd/f1a [2207831,64017] 0 2024-09-12T01:43:07.367 INFO:tasks.workunit.client.1.smithi153.stdout:8/575: creat d17/d1f/d4f/d34/fbe x:0 0 0 2024-09-12T01:43:07.368 INFO:tasks.workunit.client.0.smithi066.stdout:3/303: mknod d5/d6/d1b/d28/d4f/c63 0 2024-09-12T01:43:07.368 INFO:tasks.workunit.client.0.smithi066.stdout:3/304: write d5/d6/d1b/d28/f46 [1590532,1010] 0 2024-09-12T01:43:07.369 INFO:tasks.workunit.client.1.smithi153.stdout:6/655: dread d1/d6/d23/d98/d53/d69/f7d [0,4194304] 0 2024-09-12T01:43:07.371 INFO:tasks.workunit.client.1.smithi153.stdout:5/610: dwrite d0/df/d1c/d69/f80 [0,4194304] 0 2024-09-12T01:43:07.373 INFO:tasks.workunit.client.0.smithi066.stdout:1/226: dwrite d5/dc/dd/f23 [0,4194304] 0 2024-09-12T01:43:07.375 INFO:tasks.workunit.client.1.smithi153.stdout:8/576: link d17/d21/d56/d96/d6c/f80 d17/d1f/d4f/d34/fbf 0 2024-09-12T01:43:07.376 INFO:tasks.workunit.client.0.smithi066.stdout:3/305: unlink d5/d6/d1b/d28/l3a 0 2024-09-12T01:43:07.377 INFO:tasks.workunit.client.1.smithi153.stdout:0/698: dwrite d22/f39 [0,4194304] 0 2024-09-12T01:43:07.377 INFO:tasks.workunit.client.1.smithi153.stdout:0/699: chown d22/d30/d4c/d6e/c9c 345966 1 2024-09-12T01:43:07.377 INFO:tasks.workunit.client.1.smithi153.stdout:0/700: stat d22/f5f 0 2024-09-12T01:43:07.380 INFO:tasks.workunit.client.1.smithi153.stdout:5/611: rmdir d0/df/db8/d2f 39 2024-09-12T01:43:07.383 INFO:tasks.workunit.client.1.smithi153.stdout:6/656: dread d1/df/f30 [0,4194304] 0 2024-09-12T01:43:07.383 INFO:tasks.workunit.client.1.smithi153.stdout:6/657: readlink d1/d6/da/lce 0 2024-09-12T01:43:07.383 INFO:tasks.workunit.client.1.smithi153.stdout:6/658: chown d1/d6/d23/d98/d53/da0/fad 50427 1 2024-09-12T01:43:07.385 INFO:tasks.workunit.client.1.smithi153.stdout:9/618: mkdir d3/d5f/dbb 0 2024-09-12T01:43:07.389 INFO:tasks.workunit.client.0.smithi066.stdout:3/306: dread d5/ff [0,4194304] 0 2024-09-12T01:43:07.391 INFO:tasks.workunit.client.1.smithi153.stdout:8/577: read d17/d1f/d4f/d34/f47 [4270068,48673] 0 2024-09-12T01:43:07.391 INFO:tasks.workunit.client.1.smithi153.stdout:4/518: dwrite d6/d9/d20/f87 [0,4194304] 0 2024-09-12T01:43:07.392 INFO:tasks.workunit.client.0.smithi066.stdout:6/372: rmdir d2/d21 39 2024-09-12T01:43:07.393 INFO:tasks.workunit.client.0.smithi066.stdout:8/292: dwrite d12/d21/d2f/f45 [0,4194304] 0 2024-09-12T01:43:07.395 INFO:tasks.workunit.client.0.smithi066.stdout:3/307: rename d5/d35/f58 to d5/d35/f64 0 2024-09-12T01:43:07.395 INFO:tasks.workunit.client.0.smithi066.stdout:3/308: chown d5/d6/d1b/d31/l2f 3 1 2024-09-12T01:43:07.395 INFO:tasks.workunit.client.0.smithi066.stdout:3/309: chown d5/d6/d1b/l34 4060 1 2024-09-12T01:43:07.405 INFO:tasks.workunit.client.1.smithi153.stdout:5/612: dread d0/df/d83/f7f [0,4194304] 0 2024-09-12T01:43:07.405 INFO:tasks.workunit.client.1.smithi153.stdout:5/613: chown d0/df/db8/d2f/d55/d9c/d75/d58/f94 144585 1 2024-09-12T01:43:07.405 INFO:tasks.workunit.client.1.smithi153.stdout:5/614: write d0/df/f10 [1492871,99560] 0 2024-09-12T01:43:07.405 INFO:tasks.workunit.client.1.smithi153.stdout:6/659: symlink d1/d6/da/d19/d3a/db0/ld6 0 2024-09-12T01:43:07.406 INFO:tasks.workunit.client.0.smithi066.stdout:1/227: dwrite d5/f2a [0,4194304] 0 2024-09-12T01:43:07.407 INFO:tasks.workunit.client.0.smithi066.stdout:8/293: creat d12/d21/d2f/d57/d3c/d49/d50/d56/f59 x:0 0 0 2024-09-12T01:43:07.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/578: rename d17/d1f/d4f/d42/d79/dac/lb9 to d17/d1f/d4f/d42/d79/dac/lc0 0 2024-09-12T01:43:07.411 INFO:tasks.workunit.client.1.smithi153.stdout:8/579: read d17/d1d/fa2 [577895,111131] 0 2024-09-12T01:43:07.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/519: mkdir d6/d9/d11/d90/db7 0 2024-09-12T01:43:07.414 INFO:tasks.workunit.client.1.smithi153.stdout:4/520: chown d6/d9/cb 4273 1 2024-09-12T01:43:07.414 INFO:tasks.workunit.client.1.smithi153.stdout:9/619: dwrite d3/d55/d30/d7b/f85 [4194304,4194304] 0 2024-09-12T01:43:07.414 INFO:tasks.workunit.client.1.smithi153.stdout:9/620: dread - d3/d3a/d42/f68 zero size 2024-09-12T01:43:07.414 INFO:tasks.workunit.client.1.smithi153.stdout:9/621: truncate d3/d66/f6f 901351 0 2024-09-12T01:43:07.414 INFO:tasks.workunit.client.1.smithi153.stdout:0/701: dwrite d22/d30/d4c/d6e/d7f/dbd/fc8 [0,4194304] 0 2024-09-12T01:43:07.414 INFO:tasks.workunit.client.1.smithi153.stdout:0/702: truncate d22/f74 1418479 0 2024-09-12T01:43:07.415 INFO:tasks.workunit.client.1.smithi153.stdout:5/615: creat d0/df/d1c/fc4 x:0 0 0 2024-09-12T01:43:07.417 INFO:tasks.workunit.client.1.smithi153.stdout:6/660: mknod d1/d6/d39/dc4/dcb/cd7 0 2024-09-12T01:43:07.418 INFO:tasks.workunit.client.1.smithi153.stdout:4/521: mknod d6/d6a/cb8 0 2024-09-12T01:43:07.419 INFO:tasks.workunit.client.1.smithi153.stdout:9/622: mknod d3/d55/d30/d7b/d8f/cbc 0 2024-09-12T01:43:07.421 INFO:tasks.workunit.client.0.smithi066.stdout:1/228: write d5/dc/dd/f23 [3954030,93522] 0 2024-09-12T01:43:07.428 INFO:tasks.workunit.client.1.smithi153.stdout:8/580: dread d17/d1f/d4f/d42/f48 [0,4194304] 0 2024-09-12T01:43:07.428 INFO:tasks.workunit.client.0.smithi066.stdout:7/213: rmdir d2/d5 39 2024-09-12T01:43:07.430 INFO:tasks.workunit.client.0.smithi066.stdout:3/310: dwrite f2 [0,4194304] 0 2024-09-12T01:43:07.430 INFO:tasks.workunit.client.1.smithi153.stdout:5/616: dread d0/df/f21 [0,4194304] 0 2024-09-12T01:43:07.431 INFO:tasks.workunit.client.1.smithi153.stdout:5/617: chown d0/df/db8/d2f/d55/d9c/d75 138662424 1 2024-09-12T01:43:07.431 INFO:tasks.workunit.client.0.smithi066.stdout:3/311: write d5/d35/f4d [361437,82304] 0 2024-09-12T01:43:07.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/312: write d5/fa [902564,120756] 0 2024-09-12T01:43:07.432 INFO:tasks.workunit.client.1.smithi153.stdout:5/618: dread d0/df/d83/f7f [0,4194304] 0 2024-09-12T01:43:07.432 INFO:tasks.workunit.client.1.smithi153.stdout:0/703: symlink d22/d30/d4c/lf1 0 2024-09-12T01:43:07.437 INFO:tasks.workunit.client.1.smithi153.stdout:9/623: dwrite d3/d55/d30/d88/fab [0,4194304] 0 2024-09-12T01:43:07.437 INFO:tasks.workunit.client.1.smithi153.stdout:0/704: mkdir d22/d79/dca/df2 0 2024-09-12T01:43:07.438 INFO:tasks.workunit.client.1.smithi153.stdout:0/705: fdatasync d22/f65 0 2024-09-12T01:43:07.438 INFO:tasks.workunit.client.1.smithi153.stdout:9/624: dread d3/d55/f59 [0,4194304] 0 2024-09-12T01:43:07.441 INFO:tasks.workunit.client.1.smithi153.stdout:0/706: rename d22/d30/d4c/d6f/d88/fbe to d22/d79/d8e/dc6/dd6/ff3 0 2024-09-12T01:43:07.442 INFO:tasks.workunit.client.0.smithi066.stdout:7/214: getdents d2/d3c 0 2024-09-12T01:43:07.443 INFO:tasks.workunit.client.1.smithi153.stdout:9/625: symlink d3/d55/d30/d95/d84/d8b/lbd 0 2024-09-12T01:43:07.443 INFO:tasks.workunit.client.1.smithi153.stdout:9/626: write d3/f18 [360381,50389] 0 2024-09-12T01:43:07.445 INFO:tasks.workunit.client.1.smithi153.stdout:0/707: mknod d22/d79/d8e/cf4 0 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:3/313: mkdir d5/d6/d1b/d65 0 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:3/314: dread - d5/f5b zero size 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:3/315: chown d5/d6/d48 133215 1 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/229: getdents d5/dc/d36 0 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/230: creat d5/dc/f40 x:0 0 0 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/231: chown d5/dc/dd/d1c/l26 7277 1 2024-09-12T01:43:07.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/232: write d5/dc/dd/d1c/f35 [2419978,3473] 0 2024-09-12T01:43:07.448 INFO:tasks.workunit.client.1.smithi153.stdout:0/708: mknod d22/d79/cf5 0 2024-09-12T01:43:07.448 INFO:tasks.workunit.client.1.smithi153.stdout:0/709: chown d22/d30/d4c/d6f/d88/f90 0 1 2024-09-12T01:43:07.453 INFO:tasks.workunit.client.1.smithi153.stdout:5/619: dwrite d0/d15/f29 [4194304,4194304] 0 2024-09-12T01:43:07.453 INFO:tasks.workunit.client.1.smithi153.stdout:5/620: read d0/df/f10 [2482064,4853] 0 2024-09-12T01:43:07.453 INFO:tasks.workunit.client.1.smithi153.stdout:5/621: write d0/df/db8/d2f/d55/d9c/d75/d58/d71/fbd [954014,102770] 0 2024-09-12T01:43:07.453 INFO:tasks.workunit.client.1.smithi153.stdout:5/622: truncate d0/d20/fa1 180065 0 2024-09-12T01:43:07.453 INFO:tasks.workunit.client.1.smithi153.stdout:8/581: dwrite d17/d1f/d4f/d42/f4e [0,4194304] 0 2024-09-12T01:43:07.454 INFO:tasks.workunit.client.1.smithi153.stdout:0/710: creat d22/d79/d8e/dae/db7/de8/ff6 x:0 0 0 2024-09-12T01:43:07.459 INFO:tasks.workunit.client.0.smithi066.stdout:7/215: symlink d2/d5/l47 0 2024-09-12T01:43:07.464 INFO:tasks.workunit.client.1.smithi153.stdout:6/661: getdents d1/d6/d46 0 2024-09-12T01:43:07.464 INFO:tasks.workunit.client.0.smithi066.stdout:1/233: rmdir d5/dc/dd/d1c 39 2024-09-12T01:43:07.465 INFO:tasks.workunit.client.0.smithi066.stdout:1/234: dread - d5/dc/dd/f31 zero size 2024-09-12T01:43:07.469 INFO:tasks.workunit.client.1.smithi153.stdout:9/627: dwrite d3/d5f/d62/fa4 [0,4194304] 0 2024-09-12T01:43:07.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/662: dread d1/df/f8e [0,4194304] 0 2024-09-12T01:43:07.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/663: creat d1/d6/d46/d73/d8a/d84/d96/fd8 x:0 0 0 2024-09-12T01:43:07.470 INFO:tasks.workunit.client.1.smithi153.stdout:8/582: symlink d17/d1f/lc1 0 2024-09-12T01:43:07.474 INFO:tasks.workunit.client.1.smithi153.stdout:0/711: mknod d22/d79/d8e/dae/db7/de8/cf7 0 2024-09-12T01:43:07.474 INFO:tasks.workunit.client.1.smithi153.stdout:0/712: write d22/d30/d4c/d6f/f73 [4614897,66501] 0 2024-09-12T01:43:07.476 INFO:tasks.workunit.client.1.smithi153.stdout:5/623: dwrite d0/df/d83/d36/da5/fa6 [0,4194304] 0 2024-09-12T01:43:07.476 INFO:tasks.workunit.client.0.smithi066.stdout:7/216: creat d2/d20/d25/f48 x:0 0 0 2024-09-12T01:43:07.476 INFO:tasks.workunit.client.0.smithi066.stdout:7/217: creat d2/d20/d25/f49 x:0 0 0 2024-09-12T01:43:07.477 INFO:tasks.workunit.client.0.smithi066.stdout:7/218: chown d2/d5/d6/f3d 503758175 1 2024-09-12T01:43:07.478 INFO:tasks.workunit.client.0.smithi066.stdout:1/235: symlink d5/dc/dd/d1c/l41 0 2024-09-12T01:43:07.481 INFO:tasks.workunit.client.1.smithi153.stdout:9/628: dread d3/f7 [0,4194304] 0 2024-09-12T01:43:07.482 INFO:tasks.workunit.client.0.smithi066.stdout:7/219: rename d2/d20/d1d/l2e to d2/d20/d1d/l4a 0 2024-09-12T01:43:07.483 INFO:tasks.workunit.client.0.smithi066.stdout:7/220: creat d2/d20/d1d/f4b x:0 0 0 2024-09-12T01:43:07.485 INFO:tasks.workunit.client.1.smithi153.stdout:5/624: dread d0/df/db8/d2f/f3a [0,4194304] 0 2024-09-12T01:43:07.487 INFO:tasks.workunit.client.0.smithi066.stdout:7/221: getdents d2/d5/da/d3f 0 2024-09-12T01:43:07.487 INFO:tasks.workunit.client.0.smithi066.stdout:7/222: truncate d2/d5/f39 307279 0 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/665: sync 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:1/669: sync 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:7/555: sync 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/666: fsync d1/d13/f83 0 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/667: fsync d1/d45/f58 0 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/668: fdatasync d1/d1e/fba 0 2024-09-12T01:43:07.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/669: chown d1/d13/d25/d26/d4b/d97/c99 118 1 2024-09-12T01:43:07.490 INFO:tasks.workunit.client.1.smithi153.stdout:3/670: write d1/d16/fa9 [1809635,126260] 0 2024-09-12T01:43:07.490 INFO:tasks.workunit.client.1.smithi153.stdout:3/671: readlink d1/d13/d23/l89 0 2024-09-12T01:43:07.493 INFO:tasks.workunit.client.1.smithi153.stdout:8/583: rename d17/d1f/la1 to d17/d1d/d93/lc2 0 2024-09-12T01:43:07.495 INFO:tasks.workunit.client.1.smithi153.stdout:0/713: mkdir d22/d79/dca/ded/df8 0 2024-09-12T01:43:07.495 INFO:tasks.workunit.client.1.smithi153.stdout:0/714: write d22/d30/d4c/d6f/f70 [2014571,493] 0 2024-09-12T01:43:07.496 INFO:tasks.workunit.client.1.smithi153.stdout:9/629: truncate d3/d55/d30/d5b/f7d 1583694 0 2024-09-12T01:43:07.497 INFO:tasks.workunit.client.1.smithi153.stdout:7/556: dread d12/d21/d29/f3d [0,4194304] 0 2024-09-12T01:43:07.498 INFO:tasks.workunit.client.1.smithi153.stdout:7/557: chown d12/d21/d29/d35/d37/l96 1688587 1 2024-09-12T01:43:07.498 INFO:tasks.workunit.client.1.smithi153.stdout:3/672: mknod d1/d45/cc4 0 2024-09-12T01:43:07.498 INFO:tasks.workunit.client.1.smithi153.stdout:3/673: chown d1/d1e/f2a 0 1 2024-09-12T01:43:07.498 INFO:tasks.workunit.client.1.smithi153.stdout:3/674: chown d1/d16/d17/f18 1470673 1 2024-09-12T01:43:07.499 INFO:tasks.workunit.client.0.smithi066.stdout:1/236: dwrite d5/dc/f40 [0,4194304] 0 2024-09-12T01:43:07.501 INFO:tasks.workunit.client.1.smithi153.stdout:5/625: rename d0/df/db8/d2f/f3a to d0/d15/dae/fc5 0 2024-09-12T01:43:07.501 INFO:tasks.workunit.client.1.smithi153.stdout:5/626: stat d0/d43/dac 0 2024-09-12T01:43:07.501 INFO:tasks.workunit.client.1.smithi153.stdout:1/670: dread d2/d9/d17/f41 [0,4194304] 0 2024-09-12T01:43:07.501 INFO:tasks.workunit.client.1.smithi153.stdout:8/584: creat d17/d21/d56/d96/fc3 x:0 0 0 2024-09-12T01:43:07.502 INFO:tasks.workunit.client.1.smithi153.stdout:8/585: read - d17/d1d/f94 zero size 2024-09-12T01:43:07.502 INFO:tasks.workunit.client.1.smithi153.stdout:8/586: write d17/d21/faf [183521,46318] 0 2024-09-12T01:43:07.502 INFO:tasks.workunit.client.1.smithi153.stdout:8/587: creat d17/fc4 x:0 0 0 2024-09-12T01:43:07.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/237: stat d5/d15/c2f 0 2024-09-12T01:43:07.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/238: dread - d5/dc/dd/f31 zero size 2024-09-12T01:43:07.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/239: getdents d5/dc/d36 0 2024-09-12T01:43:07.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/240: write d5/dc/d36/f39 [688865,73771] 0 2024-09-12T01:43:07.508 INFO:tasks.workunit.client.1.smithi153.stdout:9/630: creat d3/d5f/dbb/fbe x:0 0 0 2024-09-12T01:43:07.508 INFO:tasks.workunit.client.1.smithi153.stdout:9/631: chown d3/d66/d80 22815 1 2024-09-12T01:43:07.509 INFO:tasks.workunit.client.1.smithi153.stdout:3/675: truncate d1/d1e/f5e 4515023 0 2024-09-12T01:43:07.509 INFO:tasks.workunit.client.1.smithi153.stdout:3/676: readlink d1/d13/d25/l57 0 2024-09-12T01:43:07.509 INFO:tasks.workunit.client.1.smithi153.stdout:3/677: chown d1/d13/d23/d47/d6c/fa8 5591 1 2024-09-12T01:43:07.511 INFO:tasks.workunit.client.1.smithi153.stdout:5/627: mkdir d0/df/db8/d2f/dc6 0 2024-09-12T01:43:07.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/664: getdents d1/d6/d39/dc4/dcb 0 2024-09-12T01:43:07.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/665: write d1/d6/d39/d76/f42 [4786308,121092] 0 2024-09-12T01:43:07.514 INFO:tasks.workunit.client.1.smithi153.stdout:1/671: getdents d2/d9 0 2024-09-12T01:43:07.516 INFO:tasks.workunit.client.1.smithi153.stdout:7/558: dwrite d12/d21/d29/f3d [4194304,4194304] 0 2024-09-12T01:43:07.516 INFO:tasks.workunit.client.1.smithi153.stdout:7/559: stat cf 0 2024-09-12T01:43:07.516 INFO:tasks.workunit.client.1.smithi153.stdout:7/560: write d12/d21/d29/f2c [88859,119777] 0 2024-09-12T01:43:07.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/588: mknod d17/d21/d56/d96/d6c/cc5 0 2024-09-12T01:43:07.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/589: chown f14 15791820 1 2024-09-12T01:43:07.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/590: truncate f10 1736922 0 2024-09-12T01:43:07.521 INFO:tasks.workunit.client.1.smithi153.stdout:9/632: unlink d3/d3a/d42/l45 0 2024-09-12T01:43:07.522 INFO:tasks.workunit.client.1.smithi153.stdout:1/672: dread d2/d68/fae [0,4194304] 0 2024-09-12T01:43:07.526 INFO:tasks.workunit.client.1.smithi153.stdout:3/678: dwrite d1/d16/f27 [4194304,4194304] 0 2024-09-12T01:43:07.527 INFO:tasks.workunit.client.1.smithi153.stdout:5/628: dread d0/d20/f4a [0,4194304] 0 2024-09-12T01:43:07.531 INFO:tasks.workunit.client.1.smithi153.stdout:8/591: mkdir d17/d1f/dc6 0 2024-09-12T01:43:07.532 INFO:tasks.workunit.client.1.smithi153.stdout:9/633: getdents d3/d35 0 2024-09-12T01:43:07.532 INFO:tasks.workunit.client.1.smithi153.stdout:9/634: fsync d3/f63 0 2024-09-12T01:43:07.533 INFO:tasks.workunit.client.1.smithi153.stdout:3/679: link d1/d13/d23/d47/d71/d8e/d93/l85 d1/d16/d1c/lc5 0 2024-09-12T01:43:07.534 INFO:tasks.workunit.client.1.smithi153.stdout:6/666: write d1/df/f50 [8228649,125820] 0 2024-09-12T01:43:07.536 INFO:tasks.workunit.client.1.smithi153.stdout:1/673: write d2/d9/d17/f41 [511681,73742] 0 2024-09-12T01:43:07.538 INFO:tasks.workunit.client.1.smithi153.stdout:3/680: getdents d1/d1e/d9a 0 2024-09-12T01:43:07.538 INFO:tasks.workunit.client.1.smithi153.stdout:3/681: stat d1/d13/d25/da6/c35 0 2024-09-12T01:43:07.538 INFO:tasks.workunit.client.1.smithi153.stdout:3/682: read - d1/d13/d25/da6/f8b zero size 2024-09-12T01:43:07.539 INFO:tasks.workunit.client.1.smithi153.stdout:6/667: truncate d1/d6/d23/d98/f68 326624 0 2024-09-12T01:43:07.539 INFO:tasks.workunit.client.1.smithi153.stdout:7/561: dwrite d12/d21/d29/d35/d37/f76 [0,4194304] 0 2024-09-12T01:43:07.541 INFO:tasks.workunit.client.1.smithi153.stdout:5/629: write d0/d43/f92 [5356553,35959] 0 2024-09-12T01:43:07.544 INFO:tasks.workunit.client.1.smithi153.stdout:7/562: dread d12/d21/d29/d35/d37/f97 [0,4194304] 0 2024-09-12T01:43:07.549 INFO:tasks.workunit.client.1.smithi153.stdout:3/683: dread d1/d13/d25/d26/f9f [0,4194304] 0 2024-09-12T01:43:07.551 INFO:tasks.workunit.client.0.smithi066.stdout:0/293: rename d1/d66 to d1/dc/de/d47/d4a/d67 0 2024-09-12T01:43:07.552 INFO:tasks.workunit.client.1.smithi153.stdout:3/684: dread d1/d16/d17/d82/d92/fac [0,4194304] 0 2024-09-12T01:43:07.552 INFO:tasks.workunit.client.1.smithi153.stdout:8/592: dread d17/d1f/d4f/d42/f4e [0,4194304] 0 2024-09-12T01:43:07.552 INFO:tasks.workunit.client.1.smithi153.stdout:3/685: write d1/f12 [416253,102189] 0 2024-09-12T01:43:07.553 INFO:tasks.workunit.client.1.smithi153.stdout:3/686: write d1/d13/d23/d47/d6c/f6d [233460,119045] 0 2024-09-12T01:43:07.556 INFO:tasks.workunit.client.0.smithi066.stdout:8/294: rename d12/c13 to d12/d21/d2f/d53/c5a 0 2024-09-12T01:43:07.556 INFO:tasks.workunit.client.0.smithi066.stdout:8/295: creat d12/f5b x:0 0 0 2024-09-12T01:43:07.556 INFO:tasks.workunit.client.0.smithi066.stdout:8/296: chown d12/d21/f33 153241 1 2024-09-12T01:43:07.558 INFO:tasks.workunit.client.0.smithi066.stdout:1/241: rmdir d5 39 2024-09-12T01:43:07.558 INFO:tasks.workunit.client.0.smithi066.stdout:1/242: write d5/d15/f3a [1478771,52540] 0 2024-09-12T01:43:07.565 INFO:tasks.workunit.client.1.smithi153.stdout:8/593: rmdir d17/d1f 39 2024-09-12T01:43:07.565 INFO:tasks.workunit.client.1.smithi153.stdout:8/594: dread - d17/d21/d56/d96/fa4 zero size 2024-09-12T01:43:07.565 INFO:tasks.workunit.client.1.smithi153.stdout:8/595: chown d17/d1d/d93 2141189318 1 2024-09-12T01:43:07.567 INFO:tasks.workunit.client.0.smithi066.stdout:1/243: unlink d5/dc/f3f 0 2024-09-12T01:43:07.571 INFO:tasks.workunit.client.1.smithi153.stdout:3/687: unlink d1/d13/d23/d47/d71/cc1 0 2024-09-12T01:43:07.571 INFO:tasks.workunit.client.0.smithi066.stdout:0/294: read d1/dc/de/d47/d4a/d67/d20/f30 [1142127,18909] 0 2024-09-12T01:43:07.572 INFO:tasks.workunit.client.0.smithi066.stdout:1/244: unlink d5/dc/dd/d1c/l3e 0 2024-09-12T01:43:07.575 INFO:tasks.workunit.client.0.smithi066.stdout:3/316: rename d5/d6/d1b/d31 to d5/d6/d1b/d45/d66 0 2024-09-12T01:43:07.575 INFO:tasks.workunit.client.0.smithi066.stdout:3/317: dread - d5/d6/d1b/f62 zero size 2024-09-12T01:43:07.576 INFO:tasks.workunit.client.1.smithi153.stdout:6/668: symlink d1/df/ld9 0 2024-09-12T01:43:07.576 INFO:tasks.workunit.client.1.smithi153.stdout:6/669: fsync d1/d6/d23/d98/d53/f78 0 2024-09-12T01:43:07.576 INFO:tasks.workunit.client.1.smithi153.stdout:0/715: rmdir d22/d79/dca 39 2024-09-12T01:43:07.577 INFO:tasks.workunit.client.1.smithi153.stdout:6/670: dread d1/df/f8e [0,4194304] 0 2024-09-12T01:43:07.577 INFO:tasks.workunit.client.1.smithi153.stdout:8/596: rename d17/d1f/f5d to d17/fc7 0 2024-09-12T01:43:07.579 INFO:tasks.workunit.client.0.smithi066.stdout:0/295: creat d1/dc/de/d47/d4a/f68 x:0 0 0 2024-09-12T01:43:07.579 INFO:tasks.workunit.client.0.smithi066.stdout:0/296: fdatasync d1/f27 0 2024-09-12T01:43:07.580 INFO:tasks.workunit.client.1.smithi153.stdout:0/716: stat l2 0 2024-09-12T01:43:07.580 INFO:tasks.workunit.client.1.smithi153.stdout:0/717: write d22/d30/d4c/d6f/d88/f89 [743229,61422] 0 2024-09-12T01:43:07.580 INFO:tasks.workunit.client.1.smithi153.stdout:5/630: dwrite d0/df/db8/d2f/d55/d9c/d75/f8c [0,4194304] 0 2024-09-12T01:43:07.581 INFO:tasks.workunit.client.1.smithi153.stdout:7/563: dwrite d12/d21/d29/d35/d37/f97 [0,4194304] 0 2024-09-12T01:43:07.581 INFO:tasks.workunit.client.1.smithi153.stdout:7/564: fsync d12/d21/d29/d35/f7c 0 2024-09-12T01:43:07.582 INFO:tasks.workunit.client.0.smithi066.stdout:7/223: rename d2/d5/d6/f3d to d2/d20/d1d/f4c 0 2024-09-12T01:43:07.582 INFO:tasks.workunit.client.0.smithi066.stdout:7/224: dread - d2/d20/d25/f49 zero size 2024-09-12T01:43:07.585 INFO:tasks.workunit.client.0.smithi066.stdout:3/318: mkdir d5/d6/d1b/d45/d66/d67 0 2024-09-12T01:43:07.586 INFO:tasks.workunit.client.1.smithi153.stdout:8/597: mknod d17/d75/cc8 0 2024-09-12T01:43:07.587 INFO:tasks.workunit.client.0.smithi066.stdout:7/225: mkdir d2/d20/d25/d4d 0 2024-09-12T01:43:07.589 INFO:tasks.workunit.client.1.smithi153.stdout:0/718: creat d22/d30/d4c/d6e/d7f/dbd/ff9 x:0 0 0 2024-09-12T01:43:07.590 INFO:tasks.workunit.client.1.smithi153.stdout:6/671: read d1/d6/f35 [1681,5039] 0 2024-09-12T01:43:07.590 INFO:tasks.workunit.client.1.smithi153.stdout:6/672: fsync d1/d6/f35 0 2024-09-12T01:43:07.591 INFO:tasks.workunit.client.1.smithi153.stdout:1/674: dwrite d2/d9/fcf [0,4194304] 0 2024-09-12T01:43:07.591 INFO:tasks.workunit.client.1.smithi153.stdout:1/675: creat d2/d9/d17/d2f/d56/d83/fd5 x:0 0 0 2024-09-12T01:43:07.591 INFO:tasks.workunit.client.0.smithi066.stdout:1/245: rename d5/dc/cf to d5/dc/dd/c42 0 2024-09-12T01:43:07.591 INFO:tasks.workunit.client.0.smithi066.stdout:1/246: dread - d5/f3b zero size 2024-09-12T01:43:07.591 INFO:tasks.workunit.client.0.smithi066.stdout:1/247: chown d5/dc/dd/l13 2 1 2024-09-12T01:43:07.591 INFO:tasks.workunit.client.0.smithi066.stdout:1/248: dread - d5/dc/f29 zero size 2024-09-12T01:43:07.594 INFO:tasks.workunit.client.1.smithi153.stdout:5/631: rename d0/d43/d68/f93 to d0/df/db8/d2f/d55/fc7 0 2024-09-12T01:43:07.594 INFO:tasks.workunit.client.1.smithi153.stdout:5/632: dread - d0/df/db8/f86 zero size 2024-09-12T01:43:07.594 INFO:tasks.workunit.client.1.smithi153.stdout:5/633: creat d0/df/d1c/fc8 x:0 0 0 2024-09-12T01:43:07.595 INFO:tasks.workunit.client.1.smithi153.stdout:9/635: dread d3/d55/d30/d5b/f7d [0,4194304] 0 2024-09-12T01:43:07.597 INFO:tasks.workunit.client.0.smithi066.stdout:3/319: rename d5/d6/f61 to d5/d6/d48/f68 0 2024-09-12T01:43:07.598 INFO:tasks.workunit.client.0.smithi066.stdout:7/226: read d2/d5/d6/fe [1545274,68355] 0 2024-09-12T01:43:07.599 INFO:tasks.workunit.client.0.smithi066.stdout:8/297: dwrite d12/f44 [0,4194304] 0 2024-09-12T01:43:07.599 INFO:tasks.workunit.client.0.smithi066.stdout:8/298: fsync d12/f44 0 2024-09-12T01:43:07.601 INFO:tasks.workunit.client.1.smithi153.stdout:3/688: dwrite d1/f11 [0,4194304] 0 2024-09-12T01:43:07.601 INFO:tasks.workunit.client.0.smithi066.stdout:1/249: dread d5/dc/f10 [0,4194304] 0 2024-09-12T01:43:07.601 INFO:tasks.workunit.client.1.smithi153.stdout:7/565: truncate d12/f53 2024661 0 2024-09-12T01:43:07.603 INFO:tasks.workunit.client.1.smithi153.stdout:7/566: dread d12/d21/d29/d35/d37/f57 [0,4194304] 0 2024-09-12T01:43:07.603 INFO:tasks.workunit.client.0.smithi066.stdout:3/320: rename d5/d6/d1b/d28/f2c to d5/d6/d1b/d45/d66/d67/f69 0 2024-09-12T01:43:07.603 INFO:tasks.workunit.client.0.smithi066.stdout:3/321: readlink d5/d6/dd/l20 0 2024-09-12T01:43:07.603 INFO:tasks.workunit.client.0.smithi066.stdout:3/322: chown d5/d6/d1b/d45/d66/l2f 184052015 1 2024-09-12T01:43:07.605 INFO:tasks.workunit.client.1.smithi153.stdout:6/673: creat d1/d6/fda x:0 0 0 2024-09-12T01:43:07.605 INFO:tasks.workunit.client.1.smithi153.stdout:6/674: write d1/d6/d39/d76/f79 [1217930,125178] 0 2024-09-12T01:43:07.605 INFO:tasks.workunit.client.1.smithi153.stdout:6/675: read - d1/d6/fda zero size 2024-09-12T01:43:07.606 INFO:tasks.workunit.client.1.smithi153.stdout:3/689: dread d1/d59/f78 [0,4194304] 0 2024-09-12T01:43:07.606 INFO:tasks.workunit.client.1.smithi153.stdout:3/690: write d1/d13/d23/d47/d71/fbb [16512,87273] 0 2024-09-12T01:43:07.608 INFO:tasks.workunit.client.0.smithi066.stdout:7/227: rename d2/d5/d6/d22/f33 to d2/d5/d6/d22/f4e 0 2024-09-12T01:43:07.608 INFO:tasks.workunit.client.0.smithi066.stdout:7/228: chown d2/d20/d25 55 1 2024-09-12T01:43:07.609 INFO:tasks.workunit.client.1.smithi153.stdout:2/565: sync 2024-09-12T01:43:07.609 INFO:tasks.workunit.client.1.smithi153.stdout:2/566: truncate d7/d17/f8d 848115 0 2024-09-12T01:43:07.611 INFO:tasks.workunit.client.1.smithi153.stdout:1/676: dread d2/d9/d17/d2f/fb6 [4194304,4194304] 0 2024-09-12T01:43:07.611 INFO:tasks.workunit.client.1.smithi153.stdout:1/677: truncate d2/d9/d1d/da5/fcb 257082 0 2024-09-12T01:43:07.611 INFO:tasks.workunit.client.0.smithi066.stdout:0/297: dwrite d1/dc/de/d47/d4a/d67/d20/f35 [0,4194304] 0 2024-09-12T01:43:07.616 INFO:tasks.workunit.client.0.smithi066.stdout:8/299: symlink d12/l5c 0 2024-09-12T01:43:07.617 INFO:tasks.workunit.client.1.smithi153.stdout:8/598: dwrite d17/d21/d56/d96/fa4 [0,4194304] 0 2024-09-12T01:43:07.618 INFO:tasks.workunit.client.1.smithi153.stdout:0/719: dwrite d22/f3c [0,4194304] 0 2024-09-12T01:43:07.618 INFO:tasks.workunit.client.1.smithi153.stdout:0/720: write d22/fde [172227,91152] 0 2024-09-12T01:43:07.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/250: rmdir d5/dc/dd 39 2024-09-12T01:43:07.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/251: stat d5/fa 0 2024-09-12T01:43:07.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/252: chown d5/d15 52 1 2024-09-12T01:43:07.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/253: chown d5/c22 28333281 1 2024-09-12T01:43:07.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/634: symlink d0/df/db8/d2f/d55/d9c/d7b/lc9 0 2024-09-12T01:43:07.620 INFO:tasks.workunit.client.1.smithi153.stdout:5/635: write d0/df/db8/d2f/d55/fc7 [172556,92840] 0 2024-09-12T01:43:07.623 INFO:tasks.workunit.client.1.smithi153.stdout:9/636: unlink d3/d35/c46 0 2024-09-12T01:43:07.623 INFO:tasks.workunit.client.1.smithi153.stdout:4/522: sync 2024-09-12T01:43:07.626 INFO:tasks.workunit.client.1.smithi153.stdout:7/567: creat d12/d21/d29/d2d/fac x:0 0 0 2024-09-12T01:43:07.628 INFO:tasks.workunit.client.0.smithi066.stdout:7/229: unlink d2/d5/da/d3f/l43 0 2024-09-12T01:43:07.631 INFO:tasks.workunit.client.1.smithi153.stdout:6/676: mkdir d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb 0 2024-09-12T01:43:07.631 INFO:tasks.workunit.client.1.smithi153.stdout:6/677: creat d1/d6/d46/d73/d8a/d84/d96/fdc x:0 0 0 2024-09-12T01:43:07.634 INFO:tasks.workunit.client.1.smithi153.stdout:2/567: mknod d7/db/cb5 0 2024-09-12T01:43:07.634 INFO:tasks.workunit.client.1.smithi153.stdout:2/568: creat d7/d4d/d7b/fb6 x:0 0 0 2024-09-12T01:43:07.634 INFO:tasks.workunit.client.1.smithi153.stdout:2/569: chown d7/db/d62/laf 120 1 2024-09-12T01:43:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr fail", "who": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: Activating manager daemon smithi153.jpnqza 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: osdmap e45: 6 total, 6 up, 6 in 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "mgr fail", "who": "smithi066.qdwcrh"}]': finished 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: mgrmap e21: smithi153.jpnqza(active, starting, since 0.0267318s) 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:43:07.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:43:07.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: Manager daemon smithi153.jpnqza is now available 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/trash_purge_schedule"}]: dispatch 2024-09-12T01:43:07.642 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:07 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/trash_purge_schedule"}]: dispatch 2024-09-12T01:43:07.644 INFO:tasks.workunit.client.1.smithi153.stdout:1/678: dwrite d2/d9/d28/d73/d76/fb0 [0,4194304] 0 2024-09-12T01:43:07.646 INFO:tasks.workunit.client.0.smithi066.stdout:8/300: link d12/d21/d2f/d57/f3b d12/d21/f5d 0 2024-09-12T01:43:07.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/599: rename d17/d21/d56/d96/d6c/f80 to d17/d1f/d4f/d42/d79/dac/fc9 0 2024-09-12T01:43:07.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/600: write d17/d1f/d4f/d42/d79/f98 [231151,106538] 0 2024-09-12T01:43:07.652 INFO:tasks.workunit.client.0.smithi066.stdout:1/254: creat d5/d15/f43 x:0 0 0 2024-09-12T01:43:07.654 INFO:tasks.workunit.client.1.smithi153.stdout:0/721: mkdir d22/d30/d4c/d6f/dfa 0 2024-09-12T01:43:07.654 INFO:tasks.workunit.client.1.smithi153.stdout:0/722: fdatasync d22/d30/d4c/d6f/fab 0 2024-09-12T01:43:07.655 INFO:tasks.workunit.client.1.smithi153.stdout:1/679: dread d2/d9/d17/d2c/f93 [0,4194304] 0 2024-09-12T01:43:07.655 INFO:tasks.workunit.client.1.smithi153.stdout:1/680: creat d2/d68/d6b/d9e/fd6 x:0 0 0 2024-09-12T01:43:07.658 INFO:tasks.workunit.client.0.smithi066.stdout:3/323: mknod d5/c6a 0 2024-09-12T01:43:07.660 INFO:tasks.workunit.client.0.smithi066.stdout:7/230: creat d2/d20/d25/d4d/f4f x:0 0 0 2024-09-12T01:43:07.663 INFO:tasks.workunit.client.0.smithi066.stdout:0/298: creat d1/dc/de/d47/d4a/d67/d3e/f69 x:0 0 0 2024-09-12T01:43:07.671 INFO:tasks.workunit.client.0.smithi066.stdout:1/255: creat d5/dc/d36/f44 x:0 0 0 2024-09-12T01:43:07.673 INFO:tasks.workunit.client.0.smithi066.stdout:7/231: creat d2/d5/da/f50 x:0 0 0 2024-09-12T01:43:07.674 INFO:tasks.workunit.client.0.smithi066.stdout:3/324: dread d5/d6/dd/f14 [0,4194304] 0 2024-09-12T01:43:07.675 INFO:tasks.workunit.client.1.smithi153.stdout:9/637: dwrite d3/d3a/d42/faf [0,4194304] 0 2024-09-12T01:43:07.677 INFO:tasks.workunit.client.1.smithi153.stdout:5/636: dwrite d0/fb9 [0,4194304] 0 2024-09-12T01:43:07.677 INFO:tasks.workunit.client.1.smithi153.stdout:4/523: dwrite d6/d9/d11/f1c [4194304,4194304] 0 2024-09-12T01:43:07.678 INFO:tasks.workunit.client.1.smithi153.stdout:6/678: dwrite d1/d6/d23/d98/d53/d8d/f93 [4194304,4194304] 0 2024-09-12T01:43:07.680 INFO:tasks.workunit.client.1.smithi153.stdout:0/723: dwrite d22/d79/d8e/dae/db7/fc7 [0,4194304] 0 2024-09-12T01:43:07.684 INFO:tasks.workunit.client.0.smithi066.stdout:1/256: rename d5/d15/f1b to d5/dc/dd/d1c/f45 0 2024-09-12T01:43:07.684 INFO:tasks.workunit.client.0.smithi066.stdout:1/257: chown d5/dc/f29 514791351 1 2024-09-12T01:43:07.685 INFO:tasks.workunit.client.1.smithi153.stdout:0/724: read d22/d30/d4c/d6f/f99 [46782,114717] 0 2024-09-12T01:43:07.685 INFO:tasks.workunit.client.1.smithi153.stdout:0/725: readlink d22/d30/d4c/d6e/l69 0 2024-09-12T01:43:07.685 INFO:tasks.workunit.client.1.smithi153.stdout:0/726: stat d22/d79/d8e/dc6/dd6 0 2024-09-12T01:43:07.685 INFO:tasks.workunit.client.1.smithi153.stdout:0/727: chown d22/fde 28040788 1 2024-09-12T01:43:07.685 INFO:tasks.workunit.client.1.smithi153.stdout:4/524: dread d6/d9/dc/d98/f3f [0,4194304] 0 2024-09-12T01:43:07.685 INFO:tasks.workunit.client.0.smithi066.stdout:8/301: dwrite d12/d21/d2f/f48 [0,4194304] 0 2024-09-12T01:43:07.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/568: unlink d12/l4b 0 2024-09-12T01:43:07.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/569: creat d12/d7e/fad x:0 0 0 2024-09-12T01:43:07.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/570: fsync d12/d21/d5f/f8c 0 2024-09-12T01:43:07.686 INFO:tasks.workunit.client.1.smithi153.stdout:7/571: chown l5 365 1 2024-09-12T01:43:07.687 INFO:tasks.workunit.client.0.smithi066.stdout:3/325: mknod d5/d6/d1b/d28/d52/c6b 0 2024-09-12T01:43:07.687 INFO:tasks.workunit.client.0.smithi066.stdout:3/326: dread - d5/d6/d1b/d28/d4f/d5e/f4e zero size 2024-09-12T01:43:07.693 INFO:tasks.workunit.client.1.smithi153.stdout:2/570: chown d7/ca2 74511 1 2024-09-12T01:43:07.693 INFO:tasks.workunit.client.1.smithi153.stdout:2/571: fdatasync d7/d17/f48 0 2024-09-12T01:43:07.693 INFO:tasks.workunit.client.1.smithi153.stdout:2/572: chown d7/db/d1d/f28 329066 1 2024-09-12T01:43:07.693 INFO:tasks.workunit.client.1.smithi153.stdout:2/573: chown d7/d19/d40/fac 82881642 1 2024-09-12T01:43:07.693 INFO:tasks.workunit.client.1.smithi153.stdout:2/574: fsync d7/db/d27/f7d 0 2024-09-12T01:43:07.694 INFO:tasks.workunit.client.1.smithi153.stdout:2/575: dread - d7/db/d36/f84 zero size 2024-09-12T01:43:07.694 INFO:tasks.workunit.client.1.smithi153.stdout:7/572: write d12/d21/f6b [1435798,54504] 0 2024-09-12T01:43:07.698 INFO:tasks.workunit.client.0.smithi066.stdout:1/258: write f1 [995825,19357] 0 2024-09-12T01:43:07.701 INFO:tasks.workunit.client.1.smithi153.stdout:8/601: rename d17/d1f/d4f/d42/c60 to d17/d1d/cca 0 2024-09-12T01:43:07.702 INFO:tasks.workunit.client.0.smithi066.stdout:1/259: dread d5/d15/f3a [0,4194304] 0 2024-09-12T01:43:07.704 INFO:tasks.workunit.client.0.smithi066.stdout:3/327: creat d5/d6/d1b/d45/d66/f6c x:0 0 0 2024-09-12T01:43:07.704 INFO:tasks.workunit.client.0.smithi066.stdout:3/328: fdatasync d5/d6/d1b/d45/f49 0 2024-09-12T01:43:07.704 INFO:tasks.workunit.client.0.smithi066.stdout:3/329: readlink d5/d6/dd/l11 0 2024-09-12T01:43:07.705 INFO:tasks.workunit.client.0.smithi066.stdout:1/260: dread d5/d15/f3a [0,4194304] 0 2024-09-12T01:43:07.705 INFO:tasks.workunit.client.0.smithi066.stdout:1/261: write d5/dc/dd/f2b [2097095,108831] 0 2024-09-12T01:43:07.707 INFO:tasks.workunit.client.1.smithi153.stdout:1/681: mkdir d2/dd7 0 2024-09-12T01:43:07.707 INFO:tasks.workunit.client.1.smithi153.stdout:1/682: fdatasync d2/d9/d17/f4e 0 2024-09-12T01:43:07.710 INFO:tasks.workunit.client.0.smithi066.stdout:1/262: symlink d5/dc/dd/d1c/l46 0 2024-09-12T01:43:07.713 INFO:tasks.workunit.client.1.smithi153.stdout:9/638: dwrite d3/d3a/d42/f68 [0,4194304] 0 2024-09-12T01:43:07.713 INFO:tasks.workunit.client.0.smithi066.stdout:0/299: dwrite d1/dc/de/d47/d4a/d67/d20/f21 [4194304,4194304] 0 2024-09-12T01:43:07.716 INFO:tasks.workunit.client.1.smithi153.stdout:5/637: link d0/df/d83/d36/f3b d0/df/fca 0 2024-09-12T01:43:07.717 INFO:tasks.workunit.client.1.smithi153.stdout:4/525: dwrite d6/d9/d26/f62 [0,4194304] 0 2024-09-12T01:43:07.718 INFO:tasks.workunit.client.0.smithi066.stdout:8/302: dwrite d12/d21/d2f/f45 [0,4194304] 0 2024-09-12T01:43:07.719 INFO:tasks.workunit.client.0.smithi066.stdout:8/303: fsync d12/d21/d2f/f48 0 2024-09-12T01:43:07.728 INFO:tasks.workunit.client.1.smithi153.stdout:5/638: dread d0/d20/f65 [0,4194304] 0 2024-09-12T01:43:07.728 INFO:tasks.workunit.client.1.smithi153.stdout:5/639: write d0/d15/f25 [1616550,69646] 0 2024-09-12T01:43:07.728 INFO:tasks.workunit.client.1.smithi153.stdout:5/640: readlink d0/d43/d8d/l9e 0 2024-09-12T01:43:07.728 INFO:tasks.workunit.client.1.smithi153.stdout:4/526: write d6/d9/d26/f62 [2903550,9406] 0 2024-09-12T01:43:07.739 INFO:tasks.workunit.client.0.smithi066.stdout:1/263: dwrite d5/dc/dd/f11 [0,4194304] 0 2024-09-12T01:43:07.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/527: write d6/d9/d11/f1e [2574196,109391] 0 2024-09-12T01:43:07.740 INFO:tasks.workunit.client.1.smithi153.stdout:4/528: fdatasync d6/d9/dc/d98/f57 0 2024-09-12T01:43:07.740 INFO:tasks.workunit.client.1.smithi153.stdout:4/529: write d6/da4/fa5 [26871,119800] 0 2024-09-12T01:43:07.845 INFO:tasks.workunit.client.0.smithi066.stdout:8/304: link d12/d21/l29 d12/d21/d2f/d57/d3c/l5e 0 2024-09-12T01:43:07.845 INFO:tasks.workunit.client.0.smithi066.stdout:8/305: dread - d12/d21/d2f/d57/d43/f52 zero size 2024-09-12T01:43:07.846 INFO:tasks.workunit.client.0.smithi066.stdout:8/306: write d12/f23 [842062,87782] 0 2024-09-12T01:43:07.846 INFO:tasks.workunit.client.0.smithi066.stdout:8/307: fsync d12/f47 0 2024-09-12T01:43:07.846 INFO:tasks.workunit.client.0.smithi066.stdout:8/308: creat d12/f5f x:0 0 0 2024-09-12T01:43:07.847 INFO:tasks.workunit.client.1.smithi153.stdout:0/728: truncate fa 1239653 0 2024-09-12T01:43:07.850 INFO:tasks.workunit.client.1.smithi153.stdout:0/729: dread d22/d79/d8e/dae/db7/fc9 [0,4194304] 0 2024-09-12T01:43:07.850 INFO:tasks.workunit.client.1.smithi153.stdout:0/730: dread - d22/d79/d8e/fac zero size 2024-09-12T01:43:07.850 INFO:tasks.workunit.client.1.smithi153.stdout:0/731: read d22/d30/d4c/f4d [4213291,62987] 0 2024-09-12T01:43:07.851 INFO:tasks.workunit.client.1.smithi153.stdout:0/732: readlink d22/d79/lb1 0 2024-09-12T01:43:07.853 INFO:tasks.workunit.client.0.smithi066.stdout:5/210: sync 2024-09-12T01:43:07.856 INFO:tasks.workunit.client.1.smithi153.stdout:2/576: dread d7/fe [0,4194304] 0 2024-09-12T01:43:07.856 INFO:tasks.workunit.client.1.smithi153.stdout:7/573: mkdir d12/d21/d4d/dae 0 2024-09-12T01:43:07.856 INFO:tasks.workunit.client.1.smithi153.stdout:7/574: dread - d12/d4e/f86 zero size 2024-09-12T01:43:07.857 INFO:tasks.workunit.client.1.smithi153.stdout:7/575: chown d12/f36 0 1 2024-09-12T01:43:07.858 INFO:tasks.workunit.client.1.smithi153.stdout:1/683: creat d2/d34/d3d/d80/fd8 x:0 0 0 2024-09-12T01:43:07.858 INFO:tasks.workunit.client.1.smithi153.stdout:1/684: chown d2/d9/d17/d2f/d56/d71 1703496 1 2024-09-12T01:43:07.859 INFO:tasks.workunit.client.0.smithi066.stdout:0/300: rmdir d1 39 2024-09-12T01:43:07.862 INFO:tasks.workunit.client.0.smithi066.stdout:1/264: creat d5/f47 x:0 0 0 2024-09-12T01:43:07.880 INFO:tasks.workunit.client.1.smithi153.stdout:6/679: symlink d1/df/ldd 0 2024-09-12T01:43:07.881 INFO:tasks.workunit.client.1.smithi153.stdout:5/641: creat d0/df/db8/d6e/fcb x:0 0 0 2024-09-12T01:43:07.881 INFO:tasks.workunit.client.0.smithi066.stdout:8/309: getdents d12/d21/d2f/d57/d3c 0 2024-09-12T01:43:07.881 INFO:tasks.workunit.client.0.smithi066.stdout:3/330: rename d5/d6/d1b/d28/d52 to d5/d6/d1b/d45/d66/d67/d6d 0 2024-09-12T01:43:07.882 INFO:tasks.workunit.client.0.smithi066.stdout:1/265: creat d5/dc/dd/f48 x:0 0 0 2024-09-12T01:43:07.883 INFO:tasks.workunit.client.0.smithi066.stdout:5/211: dwrite d0/f2 [4194304,4194304] 0 2024-09-12T01:43:07.885 INFO:tasks.workunit.client.0.smithi066.stdout:8/310: rename d12/f44 to d12/d21/d2f/d57/d3c/d49/f60 0 2024-09-12T01:43:07.885 INFO:tasks.workunit.client.0.smithi066.stdout:8/311: chown d12/d21/c25 4181755 1 2024-09-12T01:43:07.885 INFO:tasks.workunit.client.0.smithi066.stdout:8/312: creat d12/d21/f61 x:0 0 0 2024-09-12T01:43:07.886 INFO:tasks.workunit.client.0.smithi066.stdout:3/331: getdents d5/d6/dd/d50 0 2024-09-12T01:43:07.886 INFO:tasks.workunit.client.0.smithi066.stdout:3/332: readlink d5/d6/d1b/l4c 0 2024-09-12T01:43:07.886 INFO:tasks.workunit.client.0.smithi066.stdout:3/333: readlink d5/d6/l1e 0 2024-09-12T01:43:07.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/530: unlink d6/d9/d20/cb2 0 2024-09-12T01:43:07.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/531: chown d6/d9/dc/d31/fa9 1128 1 2024-09-12T01:43:07.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/532: fsync d6/fe 0 2024-09-12T01:43:07.887 INFO:tasks.workunit.client.1.smithi153.stdout:4/533: truncate d6/d9/dc/d31/d76/d99/f6b 74605 0 2024-09-12T01:43:07.891 INFO:tasks.workunit.client.0.smithi066.stdout:0/301: dwrite d1/dc/de/f1f [0,4194304] 0 2024-09-12T01:43:07.891 INFO:tasks.workunit.client.0.smithi066.stdout:0/302: stat d1/dc/de/d47/d64 0 2024-09-12T01:43:07.892 INFO:tasks.workunit.client.1.smithi153.stdout:2/577: dwrite d7/db/d36/f42 [4194304,4194304] 0 2024-09-12T01:43:07.898 INFO:tasks.workunit.client.0.smithi066.stdout:1/266: dread d5/f2a [0,4194304] 0 2024-09-12T01:43:07.900 INFO:tasks.workunit.client.1.smithi153.stdout:0/733: dread - d22/d30/d4c/f86 zero size 2024-09-12T01:43:07.900 INFO:tasks.workunit.client.1.smithi153.stdout:0/734: write d22/d30/f59 [802453,73196] 0 2024-09-12T01:43:07.901 INFO:tasks.workunit.client.0.smithi066.stdout:5/212: rmdir d0/d26/d2d 39 2024-09-12T01:43:07.901 INFO:tasks.workunit.client.0.smithi066.stdout:5/213: chown d0/d21 1 1 2024-09-12T01:43:07.903 INFO:tasks.workunit.client.1.smithi153.stdout:7/576: mknod d12/d21/d29/d2d/d8b/caf 0 2024-09-12T01:43:07.904 INFO:tasks.workunit.client.0.smithi066.stdout:8/313: dwrite d12/d21/d2f/d57/f36 [0,4194304] 0 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr fail", "who": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: Activating manager daemon smithi153.jpnqza 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: osdmap e45: 6 total, 6 up, 6 in 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.14208 172.21.15.66:0/1274901628' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "mgr fail", "who": "smithi066.qdwcrh"}]': finished 2024-09-12T01:43:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: mgrmap e21: smithi153.jpnqza(active, starting, since 0.0267318s) 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:43:07.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: Manager daemon smithi153.jpnqza is now available 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/trash_purge_schedule"}]: dispatch 2024-09-12T01:43:07.907 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:07 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi153.jpnqza/trash_purge_schedule"}]: dispatch 2024-09-12T01:43:07.908 INFO:tasks.workunit.client.1.smithi153.stdout:1/685: unlink d2/d9/fc6 0 2024-09-12T01:43:07.908 INFO:tasks.workunit.client.1.smithi153.stdout:1/686: creat d2/d9/d1d/da5/fd9 x:0 0 0 2024-09-12T01:43:07.910 INFO:tasks.workunit.client.1.smithi153.stdout:9/639: rename d3/d55/d30/c65 to d3/d3a/d42/d72/d98/d9a/da0/cbf 0 2024-09-12T01:43:07.910 INFO:tasks.workunit.client.1.smithi153.stdout:9/640: creat d3/d66/fc0 x:0 0 0 2024-09-12T01:43:07.910 INFO:tasks.workunit.client.1.smithi153.stdout:9/641: creat d3/d3a/d42/d72/d98/d9a/da0/fc1 x:0 0 0 2024-09-12T01:43:07.911 INFO:tasks.workunit.client.0.smithi066.stdout:2/282: sync 2024-09-12T01:43:07.913 INFO:tasks.workunit.client.1.smithi153.stdout:4/534: dwrite d6/d9/f10 [4194304,4194304] 0 2024-09-12T01:43:07.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/680: mknod d1/d6/d23/d98/d4f/cde 0 2024-09-12T01:43:07.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/681: fsync d1/d6/d23/d98/d4f/fa1 0 2024-09-12T01:43:07.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/682: write d1/d6/d23/d98/d53/da0/fc9 [915257,122681] 0 2024-09-12T01:43:07.913 INFO:tasks.workunit.client.1.smithi153.stdout:6/683: chown d1/d6/d46/d73/d8a/d84/d96 198201 1 2024-09-12T01:43:07.915 INFO:tasks.workunit.client.1.smithi153.stdout:5/642: mkdir d0/d43/d68/dcc 0 2024-09-12T01:43:07.916 INFO:tasks.workunit.client.0.smithi066.stdout:3/334: link d5/d6/d1b/l34 d5/l6e 0 2024-09-12T01:43:07.916 INFO:tasks.workunit.client.0.smithi066.stdout:3/335: stat d5/ff 0 2024-09-12T01:43:07.917 INFO:tasks.workunit.client.1.smithi153.stdout:2/578: truncate d7/d19/d40/f37 3592554 0 2024-09-12T01:43:07.920 INFO:tasks.workunit.client.0.smithi066.stdout:5/214: unlink d0/d21/d27/f1e 0 2024-09-12T01:43:07.921 INFO:tasks.workunit.client.1.smithi153.stdout:7/577: mknod d12/d21/d29/d35/d95/cb0 0 2024-09-12T01:43:07.923 INFO:tasks.workunit.client.1.smithi153.stdout:3/691: sync 2024-09-12T01:43:07.923 INFO:tasks.workunit.client.1.smithi153.stdout:8/602: sync 2024-09-12T01:43:07.924 INFO:tasks.workunit.client.1.smithi153.stdout:8/603: stat d17/d21/d56/d96/fc3 0 2024-09-12T01:43:07.924 INFO:tasks.workunit.client.1.smithi153.stdout:8/604: fdatasync d17/f72 0 2024-09-12T01:43:07.928 INFO:tasks.workunit.client.0.smithi066.stdout:8/314: creat d12/d21/d2f/f62 x:0 0 0 2024-09-12T01:43:07.930 INFO:tasks.workunit.client.0.smithi066.stdout:2/283: dread - de/f21 zero size 2024-09-12T01:43:07.935 INFO:tasks.workunit.client.1.smithi153.stdout:9/642: unlink d3/d55/d30/l4b 0 2024-09-12T01:43:07.937 INFO:tasks.workunit.client.1.smithi153.stdout:2/579: dwrite d7/db/d27/d56/da3/fb3 [0,4194304] 0 2024-09-12T01:43:07.942 INFO:tasks.workunit.client.0.smithi066.stdout:0/303: unlink d1/dc/de/d47/d4a/d67/l60 0 2024-09-12T01:43:07.943 INFO:tasks.workunit.client.1.smithi153.stdout:4/535: link d6/d9/dc/d98/f88 d6/d9/dc/d98/d3e/d66/fb9 0 2024-09-12T01:43:07.944 INFO:tasks.workunit.client.0.smithi066.stdout:0/304: read d1/dc/de/f19 [259041,38084] 0 2024-09-12T01:43:07.944 INFO:tasks.workunit.client.0.smithi066.stdout:0/305: chown d1/dc/de/d47/d4a/d67/d3e/l45 114999 1 2024-09-12T01:43:07.944 INFO:tasks.workunit.client.0.smithi066.stdout:1/267: rmdir d5/d15 39 2024-09-12T01:43:07.946 INFO:tasks.workunit.client.0.smithi066.stdout:3/336: symlink d5/d6/d1b/d45/d66/d5c/l6f 0 2024-09-12T01:43:07.948 INFO:tasks.workunit.client.1.smithi153.stdout:5/643: rename d0/df/f10 to d0/d43/fcd 0 2024-09-12T01:43:07.948 INFO:tasks.workunit.client.1.smithi153.stdout:5/644: truncate d0/d20/f41 4578997 0 2024-09-12T01:43:07.949 INFO:tasks.workunit.client.0.smithi066.stdout:5/215: symlink d0/d26/l43 0 2024-09-12T01:43:07.949 INFO:tasks.workunit.client.0.smithi066.stdout:5/216: chown d0/dd/d18/d36 14055 1 2024-09-12T01:43:07.951 INFO:tasks.workunit.client.1.smithi153.stdout:7/578: link d12/d21/d29/d35/f6e d12/d21/d29/d35/d95/fb1 0 2024-09-12T01:43:07.952 INFO:tasks.workunit.client.1.smithi153.stdout:7/579: chown d12/d21/d4d/f5d 107 1 2024-09-12T01:43:07.953 INFO:tasks.workunit.client.0.smithi066.stdout:4/235: sync 2024-09-12T01:43:07.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/373: sync 2024-09-12T01:43:07.953 INFO:tasks.workunit.client.0.smithi066.stdout:9/318: sync 2024-09-12T01:43:07.954 INFO:tasks.workunit.client.0.smithi066.stdout:8/315: getdents d12/d21/d2f/d57/d3c/d49/d50 0 2024-09-12T01:43:07.955 INFO:tasks.workunit.client.0.smithi066.stdout:8/316: creat d12/d21/d2f/f63 x:0 0 0 2024-09-12T01:43:07.957 INFO:tasks.workunit.client.0.smithi066.stdout:3/337: dread d5/f44 [0,4194304] 0 2024-09-12T01:43:07.957 INFO:tasks.workunit.client.1.smithi153.stdout:3/692: link d1/d59/caa d1/d13/d23/cc6 0 2024-09-12T01:43:07.959 INFO:tasks.workunit.client.0.smithi066.stdout:4/236: dread d4/d6/d8/f3b [0,4194304] 0 2024-09-12T01:43:07.960 INFO:tasks.workunit.client.0.smithi066.stdout:8/317: dread d12/f3d [0,4194304] 0 2024-09-12T01:43:07.960 INFO:tasks.workunit.client.0.smithi066.stdout:5/217: write d0/dd/d18/f23 [3775753,102678] 0 2024-09-12T01:43:07.962 INFO:tasks.workunit.client.1.smithi153.stdout:1/687: getdents d2/d34/d3d/d80 0 2024-09-12T01:43:07.964 INFO:tasks.workunit.client.0.smithi066.stdout:0/306: symlink d1/dc/de/d47/d4a/l6a 0 2024-09-12T01:43:07.965 INFO:tasks.workunit.client.1.smithi153.stdout:9/643: truncate d3/d3a/f8e 1587551 0 2024-09-12T01:43:07.969 INFO:tasks.workunit.client.0.smithi066.stdout:1/268: stat d5/dc/dd/c42 0 2024-09-12T01:43:07.969 INFO:tasks.workunit.client.0.smithi066.stdout:1/269: truncate d5/dc/f33 3471058 0 2024-09-12T01:43:07.969 INFO:tasks.workunit.client.0.smithi066.stdout:3/338: dread d5/d6/d1b/d45/d66/d67/f69 [4194304,4194304] 0 2024-09-12T01:43:07.971 INFO:tasks.workunit.client.0.smithi066.stdout:9/319: mknod d0/d6/d17/d28/d63/c75 0 2024-09-12T01:43:07.972 INFO:tasks.workunit.client.1.smithi153.stdout:2/580: link d7/db/c67 d7/d17/da9/cb7 0 2024-09-12T01:43:07.972 INFO:tasks.workunit.client.1.smithi153.stdout:2/581: write d7/d4d/d7b/f90 [943766,123187] 0 2024-09-12T01:43:07.974 INFO:tasks.workunit.client.0.smithi066.stdout:7/232: sync 2024-09-12T01:43:07.975 INFO:tasks.workunit.client.1.smithi153.stdout:5/645: dwrite d0/f1f [0,4194304] 0 2024-09-12T01:43:07.979 INFO:tasks.workunit.client.0.smithi066.stdout:4/237: truncate d4/d15/f28 52453 0 2024-09-12T01:43:07.979 INFO:tasks.workunit.client.1.smithi153.stdout:4/536: creat d6/d9/dc/d31/d76/d99/fba x:0 0 0 2024-09-12T01:43:07.981 INFO:tasks.workunit.client.1.smithi153.stdout:1/688: dread d2/d34/d3d/f59 [0,4194304] 0 2024-09-12T01:43:07.981 INFO:tasks.workunit.client.0.smithi066.stdout:8/318: rename d12/d21/d2f/d53/c5a to d12/d21/d2f/d57/d43/c64 0 2024-09-12T01:43:07.981 INFO:tasks.workunit.client.0.smithi066.stdout:8/319: read d12/d21/f32 [609501,89555] 0 2024-09-12T01:43:07.982 INFO:tasks.workunit.client.1.smithi153.stdout:6/684: rmdir d1/d6/d23/d98/d53/da0 39 2024-09-12T01:43:07.982 INFO:tasks.workunit.client.1.smithi153.stdout:8/605: write d17/d1f/d4f/d42/f59 [1393833,77277] 0 2024-09-12T01:43:07.982 INFO:tasks.workunit.client.1.smithi153.stdout:8/606: chown d17/d1d/fbd 8304714 1 2024-09-12T01:43:07.983 INFO:tasks.workunit.client.0.smithi066.stdout:5/218: creat d0/d21/f44 x:0 0 0 2024-09-12T01:43:07.984 INFO:tasks.workunit.client.1.smithi153.stdout:7/580: mkdir d12/d7e/db2 0 2024-09-12T01:43:07.985 INFO:tasks.workunit.client.0.smithi066.stdout:2/284: mkdir de/d13/d5c 0 2024-09-12T01:43:07.986 INFO:tasks.workunit.client.0.smithi066.stdout:1/270: mknod d5/dc/dd/c49 0 2024-09-12T01:43:07.986 INFO:tasks.workunit.client.1.smithi153.stdout:9/644: truncate d3/d55/f77 2541197 0 2024-09-12T01:43:07.987 INFO:tasks.workunit.client.0.smithi066.stdout:3/339: symlink d5/d6/d1b/d28/l70 0 2024-09-12T01:43:07.988 INFO:tasks.workunit.client.0.smithi066.stdout:3/340: chown d5/l1d 1076973 1 2024-09-12T01:43:07.989 INFO:tasks.workunit.client.1.smithi153.stdout:2/582: mkdir d7/db/d6c/d76/db8 0 2024-09-12T01:43:07.990 INFO:tasks.workunit.client.0.smithi066.stdout:4/238: dread d4/f17 [0,4194304] 0 2024-09-12T01:43:07.990 INFO:tasks.workunit.client.1.smithi153.stdout:3/693: dwrite d1/d13/d25/da6/f5f [0,4194304] 0 2024-09-12T01:43:07.991 INFO:tasks.workunit.client.1.smithi153.stdout:5/646: dread d0/df/fca [0,4194304] 0 2024-09-12T01:43:07.992 INFO:tasks.workunit.client.0.smithi066.stdout:9/320: creat d0/d6/d17/d1b/f76 x:0 0 0 2024-09-12T01:43:07.992 INFO:tasks.workunit.client.0.smithi066.stdout:9/321: creat d0/d6/d17/d28/f77 x:0 0 0 2024-09-12T01:43:07.993 INFO:tasks.workunit.client.0.smithi066.stdout:6/374: dwrite d2/db/d12/d1d/f26 [0,4194304] 0 2024-09-12T01:43:07.993 INFO:tasks.workunit.client.0.smithi066.stdout:6/375: fsync d2/d31/d5e/f71 0 2024-09-12T01:43:07.993 INFO:tasks.workunit.client.0.smithi066.stdout:6/376: stat d2/db/d12/d49/c54 0 2024-09-12T01:43:07.993 INFO:tasks.workunit.client.0.smithi066.stdout:6/377: truncate d2/d31/f69 475260 0 2024-09-12T01:43:07.994 INFO:tasks.workunit.client.0.smithi066.stdout:5/219: symlink d0/d26/d2f/l45 0 2024-09-12T01:43:07.995 INFO:tasks.workunit.client.1.smithi153.stdout:4/537: creat d6/d15/db4/fbb x:0 0 0 2024-09-12T01:43:07.995 INFO:tasks.workunit.client.1.smithi153.stdout:4/538: stat d6/d9/d11/c5c 0 2024-09-12T01:43:07.995 INFO:tasks.workunit.client.1.smithi153.stdout:4/539: write d6/d9/dc/d31/f9a [289145,56562] 0 2024-09-12T01:43:07.996 INFO:tasks.workunit.client.0.smithi066.stdout:2/285: dread de/d13/d28/d3d/f3f [0,4194304] 0 2024-09-12T01:43:07.996 INFO:tasks.workunit.client.0.smithi066.stdout:0/307: dwrite d1/dc/de/d47/d4a/d67/d20/f35 [0,4194304] 0 2024-09-12T01:43:07.997 INFO:tasks.workunit.client.0.smithi066.stdout:4/239: mknod d4/d6/d8/d18/c4c 0 2024-09-12T01:43:07.998 INFO:tasks.workunit.client.1.smithi153.stdout:1/689: rmdir d2/d9/d58 39 2024-09-12T01:43:08.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/322: symlink d0/d6/d37/l78 0 2024-09-12T01:43:08.002 INFO:tasks.workunit.client.0.smithi066.stdout:9/323: chown d0/d6/d17/f74 671647 1 2024-09-12T01:43:08.002 INFO:tasks.workunit.client.1.smithi153.stdout:6/685: mkdir d1/d6/d23/d98/d53/da4/ddf 0 2024-09-12T01:43:08.002 INFO:tasks.workunit.client.1.smithi153.stdout:8/607: write d17/d1f/f39 [301928,94213] 0 2024-09-12T01:43:08.005 INFO:tasks.workunit.client.0.smithi066.stdout:6/378: symlink d2/d31/d5e/l7e 0 2024-09-12T01:43:08.006 INFO:tasks.workunit.client.1.smithi153.stdout:7/581: symlink d12/d7e/db2/lb3 0 2024-09-12T01:43:08.006 INFO:tasks.workunit.client.1.smithi153.stdout:7/582: read d12/d21/d29/d35/f6a [305893,56176] 0 2024-09-12T01:43:08.007 INFO:tasks.workunit.client.1.smithi153.stdout:9/645: creat d3/d55/fc2 x:0 0 0 2024-09-12T01:43:08.007 INFO:tasks.workunit.client.1.smithi153.stdout:9/646: dread - d3/d66/d80/faa zero size 2024-09-12T01:43:08.009 INFO:tasks.workunit.client.0.smithi066.stdout:5/220: symlink d0/d26/d2d/d33/l46 0 2024-09-12T01:43:08.011 INFO:tasks.workunit.client.1.smithi153.stdout:2/583: truncate d7/db/f30 2029610 0 2024-09-12T01:43:08.011 INFO:tasks.workunit.client.1.smithi153.stdout:2/584: write d7/db/d27/d56/f9e [220277,27677] 0 2024-09-12T01:43:08.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/286: truncate de/d13/d28/f2f 85518 0 2024-09-12T01:43:08.014 INFO:tasks.workunit.client.1.smithi153.stdout:3/694: creat d1/d64/db0/fc7 x:0 0 0 2024-09-12T01:43:08.014 INFO:tasks.workunit.client.1.smithi153.stdout:3/695: chown d1/d1e 961 1 2024-09-12T01:43:08.017 INFO:tasks.workunit.client.1.smithi153.stdout:5/647: creat d0/df/db8/fce x:0 0 0 2024-09-12T01:43:08.020 INFO:tasks.workunit.client.0.smithi066.stdout:1/271: dwrite d5/d15/f3a [0,4194304] 0 2024-09-12T01:43:08.020 INFO:tasks.workunit.client.0.smithi066.stdout:1/272: truncate d5/dc/dd/d1c/f45 4339000 0 2024-09-12T01:43:08.020 INFO:tasks.workunit.client.1.smithi153.stdout:4/540: rename d6/f5a to d6/d6a/d9c/fbc 0 2024-09-12T01:43:08.021 INFO:tasks.workunit.client.1.smithi153.stdout:4/541: write d6/d9/d11/f1e [3878988,31635] 0 2024-09-12T01:43:08.022 INFO:tasks.workunit.client.0.smithi066.stdout:0/308: rename d1/dc/de/f2c to d1/dc/de/d47/f6b 0 2024-09-12T01:43:08.025 INFO:tasks.workunit.client.1.smithi153.stdout:1/690: link d2/d9/d17/d2f/f31 d2/d9/d17/d2f/d56/d97/fda 0 2024-09-12T01:43:08.026 INFO:tasks.workunit.client.0.smithi066.stdout:4/240: mkdir d4/d6/d8/d18/d4d 0 2024-09-12T01:43:08.026 INFO:tasks.workunit.client.0.smithi066.stdout:3/341: dwrite d5/fa [0,4194304] 0 2024-09-12T01:43:08.029 INFO:tasks.workunit.client.0.smithi066.stdout:9/324: mkdir d0/d6/d17/d28/d79 0 2024-09-12T01:43:08.029 INFO:tasks.workunit.client.0.smithi066.stdout:9/325: dread - d0/d6/d17/d1b/d4c/d42/f5e zero size 2024-09-12T01:43:08.029 INFO:tasks.workunit.client.0.smithi066.stdout:9/326: stat d0/d6/d17/f23 0 2024-09-12T01:43:08.029 INFO:tasks.workunit.client.0.smithi066.stdout:9/327: stat d0/d6/d37/l65 0 2024-09-12T01:43:08.029 INFO:tasks.workunit.client.0.smithi066.stdout:9/328: creat d0/d6/d17/d28/f7a x:0 0 0 2024-09-12T01:43:08.030 INFO:tasks.workunit.client.1.smithi153.stdout:8/608: symlink d17/d21/d56/d95/dbc/lcb 0 2024-09-12T01:43:08.031 INFO:tasks.workunit.client.1.smithi153.stdout:9/647: dwrite d3/d3a/d42/f47 [0,4194304] 0 2024-09-12T01:43:08.033 INFO:tasks.workunit.client.0.smithi066.stdout:6/379: mknod d2/d31/c7f 0 2024-09-12T01:43:08.034 INFO:tasks.workunit.client.1.smithi153.stdout:7/583: mknod d12/d21/d4d/cb4 0 2024-09-12T01:43:08.034 INFO:tasks.workunit.client.1.smithi153.stdout:7/584: write d12/d21/d29/d35/d37/d4c/f73 [5086081,127030] 0 2024-09-12T01:43:08.037 INFO:tasks.workunit.client.1.smithi153.stdout:6/686: dwrite d1/d6/da/d19/d3a/f7e [0,4194304] 0 2024-09-12T01:43:08.037 INFO:tasks.workunit.client.0.smithi066.stdout:5/221: link d0/d21/d27/l29 d0/d26/d2f/d3b/l47 0 2024-09-12T01:43:08.037 INFO:tasks.workunit.client.0.smithi066.stdout:5/222: write d0/dd/d18/f23 [373776,58656] 0 2024-09-12T01:43:08.042 INFO:tasks.workunit.client.1.smithi153.stdout:2/585: creat d7/db/d62/d87/fb9 x:0 0 0 2024-09-12T01:43:08.046 INFO:tasks.workunit.client.1.smithi153.stdout:5/648: creat d0/d43/d68/db2/fcf x:0 0 0 2024-09-12T01:43:08.046 INFO:tasks.workunit.client.1.smithi153.stdout:5/649: write d0/df/f35 [5014803,52224] 0 2024-09-12T01:43:08.047 INFO:tasks.workunit.client.0.smithi066.stdout:2/287: dread de/d13/d28/f30 [0,4194304] 0 2024-09-12T01:43:08.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/329: read d0/d6/d37/f55 [2815171,20316] 0 2024-09-12T01:43:08.049 INFO:tasks.workunit.client.0.smithi066.stdout:4/241: truncate d4/f46 5628090 0 2024-09-12T01:43:08.049 INFO:tasks.workunit.client.0.smithi066.stdout:4/242: fsync d4/d6/d8/f1a 0 2024-09-12T01:43:08.050 INFO:tasks.workunit.client.0.smithi066.stdout:4/243: chown d4/d6/d8/d18/c4c 865 1 2024-09-12T01:43:08.050 INFO:tasks.workunit.client.0.smithi066.stdout:4/244: creat d4/d6/d8/f4e x:0 0 0 2024-09-12T01:43:08.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/542: mkdir d6/d15/db4/dbd 0 2024-09-12T01:43:08.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/543: chown d6/d9/l48 15 1 2024-09-12T01:43:08.056 INFO:tasks.workunit.client.1.smithi153.stdout:7/585: write d12/d21/d29/d35/d37/d58/f63 [1504687,72454] 0 2024-09-12T01:43:08.056 INFO:tasks.workunit.client.1.smithi153.stdout:7/586: readlink d12/d7e/l9a 0 2024-09-12T01:43:08.056 INFO:tasks.workunit.client.1.smithi153.stdout:2/586: dread d7/db/d27/d56/f5b [0,4194304] 0 2024-09-12T01:43:08.056 INFO:tasks.workunit.client.1.smithi153.stdout:2/587: chown d7/d4d/d70/cb0 3 1 2024-09-12T01:43:08.058 INFO:tasks.workunit.client.1.smithi153.stdout:2/588: dread d7/d17/f48 [0,4194304] 0 2024-09-12T01:43:08.058 INFO:tasks.workunit.client.1.smithi153.stdout:2/589: creat d7/d17/fba x:0 0 0 2024-09-12T01:43:08.061 INFO:tasks.workunit.client.0.smithi066.stdout:2/288: read de/d13/d1e/d25/f2b [2639788,103720] 0 2024-09-12T01:43:08.061 INFO:tasks.workunit.client.0.smithi066.stdout:2/289: fdatasync de/d13/f1f 0 2024-09-12T01:43:08.062 INFO:tasks.workunit.client.1.smithi153.stdout:8/609: rename d17/d1d/f5b to d17/d1f/d4f/d34/db4/fcc 0 2024-09-12T01:43:08.064 INFO:tasks.workunit.client.0.smithi066.stdout:0/309: dwrite d1/dc/de/d47/d4a/d67/d3e/f69 [0,4194304] 0 2024-09-12T01:43:08.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/696: dwrite d1/d13/d23/d47/d71/fbb [0,4194304] 0 2024-09-12T01:43:08.064 INFO:tasks.workunit.client.1.smithi153.stdout:3/697: write d1/f1a [1663678,115731] 0 2024-09-12T01:43:08.064 INFO:tasks.workunit.client.0.smithi066.stdout:9/330: dread d0/d6/d17/d4f/d9/fa [0,4194304] 0 2024-09-12T01:43:08.065 INFO:tasks.workunit.client.0.smithi066.stdout:3/342: dwrite d5/d35/f4d [0,4194304] 0 2024-09-12T01:43:08.065 INFO:tasks.workunit.client.0.smithi066.stdout:6/380: dwrite d2/d31/f70 [0,4194304] 0 2024-09-12T01:43:08.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/381: dread d2/d31/f69 [0,4194304] 0 2024-09-12T01:43:08.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/382: fdatasync d2/d21/f34 0 2024-09-12T01:43:08.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/383: readlink d2/db/d12/d1d/d6b/l6c 0 2024-09-12T01:43:08.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/384: creat d2/d31/d5e/f80 x:0 0 0 2024-09-12T01:43:08.067 INFO:tasks.workunit.client.1.smithi153.stdout:6/687: mkdir d1/d6/d23/d98/d53/de0 0 2024-09-12T01:43:08.069 INFO:tasks.workunit.client.0.smithi066.stdout:5/223: rmdir d0/d26/d2d 39 2024-09-12T01:43:08.071 INFO:tasks.workunit.client.1.smithi153.stdout:5/650: mknod d0/df/db8/d2f/d55/d9c/d75/d58/d71/db7/cd0 0 2024-09-12T01:43:08.071 INFO:tasks.workunit.client.1.smithi153.stdout:5/651: fsync d0/df/db8/d2f/d55/d9c/d75/f6a 0 2024-09-12T01:43:08.072 INFO:tasks.workunit.client.1.smithi153.stdout:5/652: write d0/df/db8/f2b [4903497,47774] 0 2024-09-12T01:43:08.072 INFO:tasks.workunit.client.1.smithi153.stdout:5/653: readlink d0/df/d1c/l49 0 2024-09-12T01:43:08.074 INFO:tasks.workunit.client.0.smithi066.stdout:4/245: mkdir d4/d4f 0 2024-09-12T01:43:08.074 INFO:tasks.workunit.client.0.smithi066.stdout:4/246: chown d4/f2b 22405106 1 2024-09-12T01:43:08.074 INFO:tasks.workunit.client.0.smithi066.stdout:4/247: stat d4/d15/f38 0 2024-09-12T01:43:08.075 INFO:tasks.workunit.client.1.smithi153.stdout:1/691: rmdir d2/d9/d28/d73 39 2024-09-12T01:43:08.077 INFO:tasks.workunit.client.0.smithi066.stdout:2/290: symlink de/d13/d28/l5d 0 2024-09-12T01:43:08.079 INFO:tasks.workunit.client.0.smithi066.stdout:4/248: write d4/f17 [3879016,29163] 0 2024-09-12T01:43:08.081 INFO:tasks.workunit.client.0.smithi066.stdout:2/291: dread de/d13/d28/f2f [0,4194304] 0 2024-09-12T01:43:08.081 INFO:tasks.workunit.client.0.smithi066.stdout:2/292: chown fd 7802 1 2024-09-12T01:43:08.081 INFO:tasks.workunit.client.1.smithi153.stdout:7/587: unlink l5 0 2024-09-12T01:43:08.081 INFO:tasks.workunit.client.1.smithi153.stdout:7/588: creat d12/d21/d29/d35/d37/d4c/d8e/fb5 x:0 0 0 2024-09-12T01:43:08.082 INFO:tasks.workunit.client.1.smithi153.stdout:4/544: dwrite d6/d9/dc/f64 [0,4194304] 0 2024-09-12T01:43:08.082 INFO:tasks.workunit.client.1.smithi153.stdout:6/688: dwrite d1/d6/da/d19/f87 [0,4194304] 0 2024-09-12T01:43:08.082 INFO:tasks.workunit.client.1.smithi153.stdout:6/689: dread - d1/d6/d46/d73/d8a/d84/d96/fd8 zero size 2024-09-12T01:43:08.083 INFO:tasks.workunit.client.0.smithi066.stdout:0/310: write d1/dc/de/d47/d4a/d67/d1b/d26/d42/f5d [168278,33546] 0 2024-09-12T01:43:08.084 INFO:tasks.workunit.client.0.smithi066.stdout:6/385: write d2/f2a [1498822,89204] 0 2024-09-12T01:43:08.084 INFO:tasks.workunit.client.0.smithi066.stdout:4/249: dread d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:08.085 INFO:tasks.workunit.client.0.smithi066.stdout:9/331: mknod d0/d6/d17/d1b/d4c/d42/c7b 0 2024-09-12T01:43:08.085 INFO:tasks.workunit.client.1.smithi153.stdout:2/590: mkdir d7/db/d62/dbb 0 2024-09-12T01:43:08.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/610: link d17/d75/fa6 d17/d21/d56/d95/dbc/fcd 0 2024-09-12T01:43:08.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/611: chown d17/d21/d56/d96/d6c/d89/f8e 1 1 2024-09-12T01:43:08.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/612: dread d17/f1a [0,4194304] 0 2024-09-12T01:43:08.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/613: write d17/d1f/d4f/d42/f97 [217173,42539] 0 2024-09-12T01:43:08.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/614: truncate d17/d21/d56/d95/dbc/fcd 654414 0 2024-09-12T01:43:08.090 INFO:tasks.workunit.client.1.smithi153.stdout:8/615: fdatasync d17/fc4 0 2024-09-12T01:43:08.096 INFO:tasks.workunit.client.0.smithi066.stdout:5/224: rename d0/d26/d2d/d33/l46 to d0/d26/d2f/d30/l48 0 2024-09-12T01:43:08.098 INFO:tasks.workunit.client.0.smithi066.stdout:5/225: dread d0/d26/f2e [0,4194304] 0 2024-09-12T01:43:08.098 INFO:tasks.workunit.client.0.smithi066.stdout:2/293: mkdir de/d13/d1e/d25/d5e 0 2024-09-12T01:43:08.098 INFO:tasks.workunit.client.0.smithi066.stdout:5/226: write d0/d26/f35 [674728,47619] 0 2024-09-12T01:43:08.098 INFO:tasks.workunit.client.0.smithi066.stdout:5/227: write d0/d26/f2e [1586386,87437] 0 2024-09-12T01:43:08.101 INFO:tasks.workunit.client.0.smithi066.stdout:4/250: symlink d4/d6/d27/l50 0 2024-09-12T01:43:08.101 INFO:tasks.workunit.client.0.smithi066.stdout:4/251: fdatasync d4/d6/d8/f4e 0 2024-09-12T01:43:08.102 INFO:tasks.workunit.client.0.smithi066.stdout:4/252: fsync d4/d15/f28 0 2024-09-12T01:43:08.103 INFO:tasks.workunit.client.0.smithi066.stdout:9/332: mknod d0/d6/d17/d1b/d4c/d42/c7c 0 2024-09-12T01:43:08.103 INFO:tasks.workunit.client.0.smithi066.stdout:9/333: write d0/d6/d17/d4f/d12/f25 [1079795,96346] 0 2024-09-12T01:43:08.106 INFO:tasks.workunit.client.0.smithi066.stdout:2/294: dread de/d13/d1e/d25/f2b [4194304,4194304] 0 2024-09-12T01:43:08.106 INFO:tasks.workunit.client.0.smithi066.stdout:3/343: rmdir d5/d6/d1b/d45 39 2024-09-12T01:43:08.109 INFO:tasks.workunit.client.0.smithi066.stdout:0/311: rename d1/dc/de/d47/d4a/d67/d1b/d26/d42 to d1/d62/d6c 0 2024-09-12T01:43:08.110 INFO:tasks.workunit.client.0.smithi066.stdout:5/228: rmdir d0/d26/d2f 39 2024-09-12T01:43:08.111 INFO:tasks.workunit.client.0.smithi066.stdout:3/344: read d5/d6/d1b/d45/d66/d67/d6d/f55 [19722,95945] 0 2024-09-12T01:43:08.112 INFO:tasks.workunit.client.1.smithi153.stdout:3/698: creat d1/d45/dc2/fc8 x:0 0 0 2024-09-12T01:43:08.113 INFO:tasks.workunit.client.0.smithi066.stdout:4/253: creat d4/d6/d8/d18/d4d/f51 x:0 0 0 2024-09-12T01:43:08.113 INFO:tasks.workunit.client.0.smithi066.stdout:3/345: dread d5/d6/d1b/d45/d66/d67/d6d/f55 [0,4194304] 0 2024-09-12T01:43:08.113 INFO:tasks.workunit.client.0.smithi066.stdout:3/346: chown d5/d6/d1b/d28/d4f/f51 31850245 1 2024-09-12T01:43:08.113 INFO:tasks.workunit.client.0.smithi066.stdout:3/347: write d5/d6/d1b/d45/d66/f3b [2896832,91362] 0 2024-09-12T01:43:08.116 INFO:tasks.workunit.client.0.smithi066.stdout:2/295: creat de/d13/d28/d3d/f5f x:0 0 0 2024-09-12T01:43:08.118 INFO:tasks.workunit.client.1.smithi153.stdout:7/589: creat d12/d21/d29/d35/fb6 x:0 0 0 2024-09-12T01:43:08.119 INFO:tasks.workunit.client.0.smithi066.stdout:2/296: write de/d13/d28/f52 [1511054,112102] 0 2024-09-12T01:43:08.119 INFO:tasks.workunit.client.0.smithi066.stdout:6/386: rename d2/db/d12/d49/f6d to d2/d31/f81 0 2024-09-12T01:43:08.119 INFO:tasks.workunit.client.0.smithi066.stdout:6/387: fdatasync d2/f5 0 2024-09-12T01:43:08.121 INFO:tasks.workunit.client.1.smithi153.stdout:4/545: mknod d6/d9/dc/d31/d7d/cbe 0 2024-09-12T01:43:08.122 INFO:tasks.workunit.client.0.smithi066.stdout:5/229: creat d0/d26/d2d/f49 x:0 0 0 2024-09-12T01:43:08.124 INFO:tasks.workunit.client.0.smithi066.stdout:4/254: creat d4/f52 x:0 0 0 2024-09-12T01:43:08.127 INFO:tasks.workunit.client.0.smithi066.stdout:4/255: fsync d4/f17 0 2024-09-12T01:43:08.128 INFO:tasks.workunit.client.1.smithi153.stdout:6/690: creat d1/d6/d23/d98/d53/da0/fe1 x:0 0 0 2024-09-12T01:43:08.128 INFO:tasks.workunit.client.1.smithi153.stdout:6/691: chown d1/d6/d23/d98/d53/d69 676430466 1 2024-09-12T01:43:08.128 INFO:tasks.workunit.client.1.smithi153.stdout:6/692: chown d1/d6/d46/d73/f91 1815 1 2024-09-12T01:43:08.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/348: creat d5/d6/d48/f71 x:0 0 0 2024-09-12T01:43:08.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/349: stat d5/c3e 0 2024-09-12T01:43:08.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/350: creat d5/d6/dd/f72 x:0 0 0 2024-09-12T01:43:08.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/351: chown d5/d6/l5d 13 1 2024-09-12T01:43:08.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/352: creat d5/d35/f73 x:0 0 0 2024-09-12T01:43:08.129 INFO:tasks.workunit.client.0.smithi066.stdout:3/353: write d5/d35/f64 [562,54883] 0 2024-09-12T01:43:08.130 INFO:tasks.workunit.client.0.smithi066.stdout:2/297: truncate f2 3273198 0 2024-09-12T01:43:08.130 INFO:tasks.workunit.client.1.smithi153.stdout:0/735: sync 2024-09-12T01:43:08.133 INFO:tasks.workunit.client.0.smithi066.stdout:9/334: rename d0/d6/d17/d28/d63 to d0/d6/d17/d1b/d4c/d4b/d7d 0 2024-09-12T01:43:08.133 INFO:tasks.workunit.client.0.smithi066.stdout:9/335: chown d0/d6/d17/d1b/d4c/f2b 225994 1 2024-09-12T01:43:08.134 INFO:tasks.workunit.client.1.smithi153.stdout:8/616: mkdir d17/d1f/d4f/d42/d79/dac/dce 0 2024-09-12T01:43:08.135 INFO:tasks.workunit.client.0.smithi066.stdout:0/312: link d1/dc/de/d47/d4a/d67/c2b d1/dc/de/d47/d4a/d67/d1b/c6d 0 2024-09-12T01:43:08.139 INFO:tasks.workunit.client.1.smithi153.stdout:3/699: creat d1/d1e/d9a/fc9 x:0 0 0 2024-09-12T01:43:08.140 INFO:tasks.workunit.client.0.smithi066.stdout:4/256: symlink d4/d6/l53 0 2024-09-12T01:43:08.141 INFO:tasks.workunit.client.1.smithi153.stdout:5/654: rename d0/df/f27 to d0/df/db8/d2f/d55/d9c/d75/d58/d71/fd1 0 2024-09-12T01:43:08.145 INFO:tasks.workunit.client.1.smithi153.stdout:7/590: link d12/d21/d29/f3b d12/d21/d29/d35/fb7 0 2024-09-12T01:43:08.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/736: mkdir d22/d30/d4c/d6f/dfb 0 2024-09-12T01:43:08.150 INFO:tasks.workunit.client.0.smithi066.stdout:3/354: mknod d5/d6/dd/c74 0 2024-09-12T01:43:08.150 INFO:tasks.workunit.client.0.smithi066.stdout:3/355: truncate d5/d6/d1b/d28/d4f/d5e/f4e 298086 0 2024-09-12T01:43:08.151 INFO:tasks.workunit.client.0.smithi066.stdout:6/388: dwrite d2/d21/f52 [4194304,4194304] 0 2024-09-12T01:43:08.151 INFO:tasks.workunit.client.0.smithi066.stdout:6/389: stat d2/db/f1c 0 2024-09-12T01:43:08.151 INFO:tasks.workunit.client.0.smithi066.stdout:6/390: fsync d2/db/f58 0 2024-09-12T01:43:08.151 INFO:tasks.workunit.client.0.smithi066.stdout:6/391: fsync d2/f4e 0 2024-09-12T01:43:08.152 INFO:tasks.workunit.client.1.smithi153.stdout:2/591: mknod d7/cbc 0 2024-09-12T01:43:08.153 INFO:tasks.workunit.client.0.smithi066.stdout:2/298: creat de/d13/d1e/d41/d58/f60 x:0 0 0 2024-09-12T01:43:08.153 INFO:tasks.workunit.client.0.smithi066.stdout:2/299: creat de/d13/d1e/d41/d58/f61 x:0 0 0 2024-09-12T01:43:08.156 INFO:tasks.workunit.client.1.smithi153.stdout:4/546: rename d6/d9/dc/d98/d3e/l96 to d6/d9/d11/d13/lbf 0 2024-09-12T01:43:08.160 INFO:tasks.workunit.client.1.smithi153.stdout:5/655: creat d0/df/db8/d2f/d55/d9c/d7b/fd2 x:0 0 0 2024-09-12T01:43:08.161 INFO:tasks.workunit.client.0.smithi066.stdout:6/392: creat d2/db/f82 x:0 0 0 2024-09-12T01:43:08.162 INFO:tasks.workunit.client.0.smithi066.stdout:6/393: fsync d2/f7 0 2024-09-12T01:43:08.164 INFO:tasks.workunit.client.1.smithi153.stdout:0/737: symlink d22/d79/dca/dec/lfc 0 2024-09-12T01:43:08.164 INFO:tasks.workunit.client.1.smithi153.stdout:0/738: fdatasync d22/d30/d4c/d8a/fdd 0 2024-09-12T01:43:08.165 INFO:tasks.workunit.client.0.smithi066.stdout:0/313: mkdir d1/dc/de/d47/d4a/d67/d6e 0 2024-09-12T01:43:08.166 INFO:tasks.workunit.client.1.smithi153.stdout:2/592: mknod d7/d4d/d70/d81/cbd 0 2024-09-12T01:43:08.167 INFO:tasks.workunit.client.0.smithi066.stdout:6/394: creat d2/db/d72/d76/f83 x:0 0 0 2024-09-12T01:43:08.169 INFO:tasks.workunit.client.1.smithi153.stdout:8/617: rmdir d17/d1f/d4f/d34 39 2024-09-12T01:43:08.169 INFO:tasks.workunit.client.1.smithi153.stdout:8/618: chown d17/d1f/d4f/d42/f48 1805 1 2024-09-12T01:43:08.171 INFO:tasks.workunit.client.1.smithi153.stdout:7/591: write d12/d21/d29/d35/d37/d4c/d5c/f7a [28592,119562] 0 2024-09-12T01:43:08.171 INFO:tasks.workunit.client.1.smithi153.stdout:0/739: creat d22/d79/d8e/dae/ffd x:0 0 0 2024-09-12T01:43:08.172 INFO:tasks.workunit.client.1.smithi153.stdout:0/740: write d22/d79/fb8 [306574,98007] 0 2024-09-12T01:43:08.173 INFO:tasks.workunit.client.1.smithi153.stdout:2/593: getdents d7/d4d 0 2024-09-12T01:43:08.174 INFO:tasks.workunit.client.1.smithi153.stdout:8/619: mkdir d17/d1f/dcf 0 2024-09-12T01:43:08.176 INFO:tasks.workunit.client.1.smithi153.stdout:5/656: unlink d0/df/d83/l31 0 2024-09-12T01:43:08.178 INFO:tasks.workunit.client.1.smithi153.stdout:7/592: rename d12/d21/d29/d35/l93 to d12/d21/d5f/lb8 0 2024-09-12T01:43:08.178 INFO:tasks.workunit.client.1.smithi153.stdout:7/593: write d12/d21/d29/d35/d37/d4c/d8e/fb5 [249106,68398] 0 2024-09-12T01:43:08.181 INFO:tasks.workunit.client.1.smithi153.stdout:2/594: rename d7/db/d36/f42 to d7/d4d/fbe 0 2024-09-12T01:43:08.181 INFO:tasks.workunit.client.1.smithi153.stdout:2/595: readlink d7/d19/d40/l61 0 2024-09-12T01:43:08.181 INFO:tasks.workunit.client.1.smithi153.stdout:2/596: dread - d7/db/d6c/d76/fa8 zero size 2024-09-12T01:43:08.181 INFO:tasks.workunit.client.1.smithi153.stdout:2/597: write d7/d19/f4b [1033538,56410] 0 2024-09-12T01:43:08.182 INFO:tasks.workunit.client.0.smithi066.stdout:6/395: write d2/db/d12/d1d/f2b [1302009,47443] 0 2024-09-12T01:43:08.185 INFO:tasks.workunit.client.1.smithi153.stdout:2/598: unlink d7/d17/l2e 0 2024-09-12T01:43:08.185 INFO:tasks.workunit.client.1.smithi153.stdout:2/599: write f1 [1331305,51617] 0 2024-09-12T01:43:08.186 INFO:tasks.workunit.client.0.smithi066.stdout:6/396: mknod d2/d31/d5e/c84 0 2024-09-12T01:43:08.187 INFO:tasks.workunit.client.1.smithi153.stdout:7/594: dread d12/d21/f49 [0,4194304] 0 2024-09-12T01:43:08.187 INFO:tasks.workunit.client.1.smithi153.stdout:7/595: rename d12/d21/d29/d2d to d12/d21/d29/d2d/db9 22 2024-09-12T01:43:08.188 INFO:tasks.workunit.client.0.smithi066.stdout:9/336: dwrite d0/d6/d17/d4f/d9/de/f5b [0,4194304] 0 2024-09-12T01:43:08.189 INFO:tasks.workunit.client.1.smithi153.stdout:3/700: dwrite d1/d13/d23/d47/d6c/f6d [0,4194304] 0 2024-09-12T01:43:08.189 INFO:tasks.workunit.client.1.smithi153.stdout:2/600: symlink d7/db/d1d/d59/lbf 0 2024-09-12T01:43:08.189 INFO:tasks.workunit.client.1.smithi153.stdout:2/601: creat d7/db/d6c/d76/fc0 x:0 0 0 2024-09-12T01:43:08.189 INFO:tasks.workunit.client.0.smithi066.stdout:4/257: dwrite d4/d6/f30 [0,4194304] 0 2024-09-12T01:43:08.190 INFO:tasks.workunit.client.0.smithi066.stdout:4/258: truncate d4/d6/d8/f13 2160502 0 2024-09-12T01:43:08.190 INFO:tasks.workunit.client.0.smithi066.stdout:4/259: fdatasync d4/d6/d8/f43 0 2024-09-12T01:43:08.190 INFO:tasks.workunit.client.0.smithi066.stdout:4/260: fsync d4/d6/f23 0 2024-09-12T01:43:08.190 INFO:tasks.workunit.client.1.smithi153.stdout:6/693: dwrite d1/d6/d39/d76/f42 [4194304,4194304] 0 2024-09-12T01:43:08.190 INFO:tasks.workunit.client.1.smithi153.stdout:6/694: write d1/d6/d46/d73/d8a/f89 [741992,114579] 0 2024-09-12T01:43:08.190 INFO:tasks.workunit.client.1.smithi153.stdout:6/695: chown d1/d6/d23/d98/d53/da0/fe1 584878 1 2024-09-12T01:43:08.191 INFO:tasks.workunit.client.1.smithi153.stdout:4/547: dwrite d6/d15/f22 [4194304,4194304] 0 2024-09-12T01:43:08.194 INFO:tasks.workunit.client.1.smithi153.stdout:7/596: unlink d12/d21/d29/d35/d95/cb0 0 2024-09-12T01:43:08.195 INFO:tasks.workunit.client.1.smithi153.stdout:4/548: read d6/d15/f22 [927610,15626] 0 2024-09-12T01:43:08.196 INFO:tasks.workunit.client.0.smithi066.stdout:2/300: dread fa [0,4194304] 0 2024-09-12T01:43:08.196 INFO:tasks.workunit.client.0.smithi066.stdout:5/230: dwrite d0/dd/d18/f23 [4194304,4194304] 0 2024-09-12T01:43:08.198 INFO:tasks.workunit.client.0.smithi066.stdout:3/356: dread d5/f17 [0,4194304] 0 2024-09-12T01:43:08.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/337: dread d0/d6/f69 [0,4194304] 0 2024-09-12T01:43:08.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/338: fdatasync d0/d6/d17/f18 0 2024-09-12T01:43:08.202 INFO:tasks.workunit.client.1.smithi153.stdout:3/701: truncate d1/d16/d1c/f2d 256978 0 2024-09-12T01:43:08.204 INFO:tasks.workunit.client.0.smithi066.stdout:4/261: creat d4/d6/d27/d2f/f54 x:0 0 0 2024-09-12T01:43:08.206 INFO:tasks.workunit.client.1.smithi153.stdout:8/620: dwrite d17/d1d/d27/f6b [0,4194304] 0 2024-09-12T01:43:08.206 INFO:tasks.workunit.client.1.smithi153.stdout:2/602: rename d7/db/d62/l6a to d7/db/d6c/d76/lc1 0 2024-09-12T01:43:08.206 INFO:tasks.workunit.client.1.smithi153.stdout:2/603: write d7/fe [825221,107963] 0 2024-09-12T01:43:08.206 INFO:tasks.workunit.client.1.smithi153.stdout:2/604: chown d7/db/d6c 342 1 2024-09-12T01:43:08.207 INFO:tasks.workunit.client.1.smithi153.stdout:4/549: dread d6/d15/f4c [0,4194304] 0 2024-09-12T01:43:08.207 INFO:tasks.workunit.client.0.smithi066.stdout:0/314: dwrite d1/f4d [0,4194304] 0 2024-09-12T01:43:08.207 INFO:tasks.workunit.client.0.smithi066.stdout:6/397: rmdir d2/d31/d57 39 2024-09-12T01:43:08.209 INFO:tasks.workunit.client.1.smithi153.stdout:5/657: dwrite d0/d43/fcd [4194304,4194304] 0 2024-09-12T01:43:08.209 INFO:tasks.workunit.client.1.smithi153.stdout:5/658: readlink d0/d15/l28 0 2024-09-12T01:43:08.209 INFO:tasks.workunit.client.1.smithi153.stdout:5/659: truncate d0/d43/f6b 893602 0 2024-09-12T01:43:08.209 INFO:tasks.workunit.client.1.smithi153.stdout:0/741: dwrite d22/f65 [0,4194304] 0 2024-09-12T01:43:08.212 INFO:tasks.workunit.client.0.smithi066.stdout:2/301: rmdir de 39 2024-09-12T01:43:08.213 INFO:tasks.workunit.client.0.smithi066.stdout:2/302: write de/f21 [399656,105312] 0 2024-09-12T01:43:08.214 INFO:tasks.workunit.client.0.smithi066.stdout:5/231: rmdir d0/d26/d2d/d31 39 2024-09-12T01:43:08.214 INFO:tasks.workunit.client.0.smithi066.stdout:5/232: read - d0/dd/d18/f3d zero size 2024-09-12T01:43:08.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/398: write d2/db/d12/f53 [2066695,71429] 0 2024-09-12T01:43:08.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/399: chown d2/db/d12/d49/c54 64 1 2024-09-12T01:43:08.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/400: chown d2/db/f82 134 1 2024-09-12T01:43:08.215 INFO:tasks.workunit.client.0.smithi066.stdout:3/357: rmdir d5/d6/d1b/d45/d66/d5c 39 2024-09-12T01:43:08.215 INFO:tasks.workunit.client.0.smithi066.stdout:3/358: readlink d5/d6/d1b/l23 0 2024-09-12T01:43:08.219 INFO:tasks.workunit.client.0.smithi066.stdout:4/262: symlink d4/d4f/l55 0 2024-09-12T01:43:08.226 INFO:tasks.workunit.client.0.smithi066.stdout:4/263: dread d4/f16 [0,4194304] 0 2024-09-12T01:43:08.226 INFO:tasks.workunit.client.0.smithi066.stdout:4/264: truncate d4/f29 443248 0 2024-09-12T01:43:08.227 INFO:tasks.workunit.client.0.smithi066.stdout:4/265: dread d4/f29 [0,4194304] 0 2024-09-12T01:43:08.227 INFO:tasks.workunit.client.0.smithi066.stdout:4/266: truncate d4/f37 646719 0 2024-09-12T01:43:08.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/702: creat d1/d13/d23/d47/d71/d8e/fca x:0 0 0 2024-09-12T01:43:08.232 INFO:tasks.workunit.client.1.smithi153.stdout:3/703: write d1/d16/d17/d82/fa3 [587256,3755] 0 2024-09-12T01:43:08.234 INFO:tasks.workunit.client.0.smithi066.stdout:6/401: dwrite d2/fe [0,4194304] 0 2024-09-12T01:43:08.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/402: chown d2/d21/f30 1618 1 2024-09-12T01:43:08.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/403: dread - d2/d31/d5e/f80 zero size 2024-09-12T01:43:08.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/404: stat d2/db/f6a 0 2024-09-12T01:43:08.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/405: stat d2/db/l1b 0 2024-09-12T01:43:08.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/406: write d2/d21/f25 [316631,16044] 0 2024-09-12T01:43:08.236 INFO:tasks.workunit.client.1.smithi153.stdout:8/621: truncate d17/d1f/d4f/f45 4436509 0 2024-09-12T01:43:08.241 INFO:tasks.workunit.client.1.smithi153.stdout:2/605: symlink d7/d4d/d70/d81/dae/lc2 0 2024-09-12T01:43:08.241 INFO:tasks.workunit.client.1.smithi153.stdout:2/606: write d7/db/ff [279208,61120] 0 2024-09-12T01:43:08.244 INFO:tasks.workunit.client.1.smithi153.stdout:4/550: unlink d6/d9/l48 0 2024-09-12T01:43:08.244 INFO:tasks.workunit.client.1.smithi153.stdout:4/551: creat d6/d15/db4/fc0 x:0 0 0 2024-09-12T01:43:08.246 INFO:tasks.workunit.client.1.smithi153.stdout:5/660: symlink d0/df/db8/d88/ld3 0 2024-09-12T01:43:08.246 INFO:tasks.workunit.client.1.smithi153.stdout:5/661: chown d0/df/db8/d2f/d55/d9c/d75/l8f 23807 1 2024-09-12T01:43:08.246 INFO:tasks.workunit.client.1.smithi153.stdout:5/662: creat d0/df/db8/d6e/fd4 x:0 0 0 2024-09-12T01:43:08.249 INFO:tasks.workunit.client.1.smithi153.stdout:0/742: stat d22/c36 0 2024-09-12T01:43:08.250 INFO:tasks.workunit.client.0.smithi066.stdout:0/315: creat d1/dc/f6f x:0 0 0 2024-09-12T01:43:08.252 INFO:tasks.workunit.client.0.smithi066.stdout:4/267: dwrite d4/d6/d8/f43 [0,4194304] 0 2024-09-12T01:43:08.252 INFO:tasks.workunit.client.1.smithi153.stdout:3/704: dwrite d1/d45/f51 [4194304,4194304] 0 2024-09-12T01:43:08.253 INFO:tasks.workunit.client.0.smithi066.stdout:2/303: mknod de/d13/d1e/d25/c62 0 2024-09-12T01:43:08.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/233: creat d0/f4a x:0 0 0 2024-09-12T01:43:08.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/234: chown d0/d26/d2d/f49 361 1 2024-09-12T01:43:08.260 INFO:tasks.workunit.client.0.smithi066.stdout:3/359: mkdir d5/d6/d1b/d45/d66/d67/d75 0 2024-09-12T01:43:08.261 INFO:tasks.workunit.client.1.smithi153.stdout:3/705: dread d1/d16/d1c/f33 [4194304,4194304] 0 2024-09-12T01:43:08.261 INFO:tasks.workunit.client.0.smithi066.stdout:9/339: mknod d0/d6/d17/d4f/d9/de/c7e 0 2024-09-12T01:43:08.261 INFO:tasks.workunit.client.0.smithi066.stdout:9/340: write d0/d6/d43/f6e [846197,100463] 0 2024-09-12T01:43:08.263 INFO:tasks.workunit.client.0.smithi066.stdout:6/407: dwrite d2/f77 [0,4194304] 0 2024-09-12T01:43:08.266 INFO:tasks.workunit.client.1.smithi153.stdout:2/607: rename d7/d17/da9/lb1 to d7/db/d27/d56/lc3 0 2024-09-12T01:43:08.273 INFO:tasks.workunit.client.1.smithi153.stdout:5/663: creat d0/df/db8/d2f/d55/fd5 x:0 0 0 2024-09-12T01:43:08.276 INFO:tasks.workunit.client.1.smithi153.stdout:0/743: mknod d22/d30/d4c/d6f/dfa/cfe 0 2024-09-12T01:43:08.276 INFO:tasks.workunit.client.1.smithi153.stdout:0/744: chown d22/d30/d4c/d6f/d88 79 1 2024-09-12T01:43:08.277 INFO:tasks.workunit.client.0.smithi066.stdout:7/233: sync 2024-09-12T01:43:08.279 INFO:tasks.workunit.client.0.smithi066.stdout:8/320: sync 2024-09-12T01:43:08.280 INFO:tasks.workunit.client.0.smithi066.stdout:6/408: write d2/f77 [2808164,120263] 0 2024-09-12T01:43:08.281 INFO:tasks.workunit.client.0.smithi066.stdout:0/316: creat d1/dc/de/d47/d4a/d67/f70 x:0 0 0 2024-09-12T01:43:08.282 INFO:tasks.workunit.client.0.smithi066.stdout:2/304: rmdir de/d13/d1e/d22/d4f 39 2024-09-12T01:43:08.282 INFO:tasks.workunit.client.1.smithi153.stdout:2/608: dread d7/f51 [0,4194304] 0 2024-09-12T01:43:08.283 INFO:tasks.workunit.client.1.smithi153.stdout:4/552: dwrite d6/d15/db4/fbb [0,4194304] 0 2024-09-12T01:43:08.283 INFO:tasks.workunit.client.1.smithi153.stdout:4/553: stat d6/d9/d11/d90 0 2024-09-12T01:43:08.283 INFO:tasks.workunit.client.0.smithi066.stdout:9/341: dwrite d0/d6/d17/f71 [0,4194304] 0 2024-09-12T01:43:08.283 INFO:tasks.workunit.client.0.smithi066.stdout:4/268: dwrite d4/d6/d8/f3b [0,4194304] 0 2024-09-12T01:43:08.284 INFO:tasks.workunit.client.0.smithi066.stdout:5/235: getdents d0/d26/d2d/d33 0 2024-09-12T01:43:08.284 INFO:tasks.workunit.client.0.smithi066.stdout:5/236: chown d0/dd/d18/d36 2674031 1 2024-09-12T01:43:08.286 INFO:tasks.workunit.client.0.smithi066.stdout:3/360: link d5/d6/d1b/d28/l70 d5/d6/d1b/l76 0 2024-09-12T01:43:08.287 INFO:tasks.workunit.client.1.smithi153.stdout:8/622: rmdir d17/d21/d56/d96 39 2024-09-12T01:43:08.289 INFO:tasks.workunit.client.1.smithi153.stdout:5/664: dread d0/df/db8/d2f/f87 [0,4194304] 0 2024-09-12T01:43:08.289 INFO:tasks.workunit.client.1.smithi153.stdout:5/665: dread - d0/d43/d68/db2/fcf zero size 2024-09-12T01:43:08.291 INFO:tasks.workunit.client.1.smithi153.stdout:0/745: mkdir d22/d79/d8e/dae/dff 0 2024-09-12T01:43:08.291 INFO:tasks.workunit.client.1.smithi153.stdout:0/746: write d22/f2a [4301702,13544] 0 2024-09-12T01:43:08.291 INFO:tasks.workunit.client.1.smithi153.stdout:0/747: fdatasync d22/d79/fb8 0 2024-09-12T01:43:08.291 INFO:tasks.workunit.client.0.smithi066.stdout:7/234: mkdir d2/d5/d6/d40/d51 0 2024-09-12T01:43:08.292 INFO:tasks.workunit.client.0.smithi066.stdout:3/361: dread d5/f17 [0,4194304] 0 2024-09-12T01:43:08.293 INFO:tasks.workunit.client.1.smithi153.stdout:2/609: mknod d7/db/d1d/d1e/d6d/cc4 0 2024-09-12T01:43:08.293 INFO:tasks.workunit.client.1.smithi153.stdout:2/610: chown d7/db/d6c/d7e 1 1 2024-09-12T01:43:08.295 INFO:tasks.workunit.client.0.smithi066.stdout:8/321: rename d12/d21/d2f/d57/d43/c64 to d12/d21/d2f/d57/d3c/d49/d50/d56/c65 0 2024-09-12T01:43:08.299 INFO:tasks.workunit.client.0.smithi066.stdout:1/273: sync 2024-09-12T01:43:08.306 INFO:tasks.workunit.client.0.smithi066.stdout:4/269: link d4/d6/d27/d2f/f54 d4/d4f/f56 0 2024-09-12T01:43:08.308 INFO:tasks.workunit.client.1.smithi153.stdout:4/554: link d6/d9/d11/c4f d6/d9/dc/d98/cc1 0 2024-09-12T01:43:08.310 INFO:tasks.workunit.client.0.smithi066.stdout:5/237: unlink d0/d21/d27/f1f 0 2024-09-12T01:43:08.310 INFO:tasks.workunit.client.0.smithi066.stdout:5/238: write d0/d21/d27/f28 [1294486,6700] 0 2024-09-12T01:43:08.311 INFO:tasks.workunit.client.1.smithi153.stdout:3/706: mknod d1/d13/d23/d47/ccb 0 2024-09-12T01:43:08.311 INFO:tasks.workunit.client.1.smithi153.stdout:3/707: fsync d1/d13/f83 0 2024-09-12T01:43:08.311 INFO:tasks.workunit.client.0.smithi066.stdout:7/235: mkdir d2/d5/da/d3f/d52 0 2024-09-12T01:43:08.312 INFO:tasks.workunit.client.0.smithi066.stdout:7/236: dread - d2/d20/d25/d4d/f4f zero size 2024-09-12T01:43:08.312 INFO:tasks.workunit.client.0.smithi066.stdout:7/237: dread - d2/d20/d25/f48 zero size 2024-09-12T01:43:08.312 INFO:tasks.workunit.client.1.smithi153.stdout:5/666: symlink d0/d20/dc0/ld6 0 2024-09-12T01:43:08.313 INFO:tasks.workunit.client.1.smithi153.stdout:5/667: fsync d0/f32 0 2024-09-12T01:43:08.313 INFO:tasks.workunit.client.0.smithi066.stdout:3/362: mkdir d5/d6/d1b/d77 0 2024-09-12T01:43:08.317 INFO:tasks.workunit.client.1.smithi153.stdout:0/748: mkdir d22/d79/d8e/dc6/dd6/d100 0 2024-09-12T01:43:08.317 INFO:tasks.workunit.client.0.smithi066.stdout:6/409: rename d2/db/d12/d49/f79 to d2/d31/f85 0 2024-09-12T01:43:08.317 INFO:tasks.workunit.client.0.smithi066.stdout:6/410: dread - d2/db/d12/d49/f55 zero size 2024-09-12T01:43:08.318 INFO:tasks.workunit.client.1.smithi153.stdout:8/623: dwrite d17/d1f/d4f/f65 [0,4194304] 0 2024-09-12T01:43:08.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/624: chown d17/d1f/dcf 194 1 2024-09-12T01:43:08.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/625: chown d17/d1f/f2a 359567325 1 2024-09-12T01:43:08.320 INFO:tasks.workunit.client.1.smithi153.stdout:2/611: mknod d7/d4d/d70/d81/dae/cc5 0 2024-09-12T01:43:08.320 INFO:tasks.workunit.client.1.smithi153.stdout:2/612: creat d7/db/d36/fc6 x:0 0 0 2024-09-12T01:43:08.320 INFO:tasks.workunit.client.0.smithi066.stdout:8/322: mkdir d12/d21/d2f/d57/d43/d66 0 2024-09-12T01:43:08.322 INFO:tasks.workunit.client.1.smithi153.stdout:3/708: dread d1/d16/f6f [0,4194304] 0 2024-09-12T01:43:08.323 INFO:tasks.workunit.client.0.smithi066.stdout:5/239: write d0/f2 [1154923,64736] 0 2024-09-12T01:43:08.323 INFO:tasks.workunit.client.1.smithi153.stdout:4/555: unlink d6/d9/dc/d98/d3e/d66/l8a 0 2024-09-12T01:43:08.326 INFO:tasks.workunit.client.0.smithi066.stdout:4/270: dwrite d4/f2b [0,4194304] 0 2024-09-12T01:43:08.326 INFO:tasks.workunit.client.0.smithi066.stdout:4/271: stat d4/d6/d8/d18/c42 0 2024-09-12T01:43:08.328 INFO:tasks.workunit.client.0.smithi066.stdout:0/317: getdents d1/dc 0 2024-09-12T01:43:08.329 INFO:tasks.workunit.client.1.smithi153.stdout:5/668: getdents d0/df/d83/d36/d39/da4 0 2024-09-12T01:43:08.329 INFO:tasks.workunit.client.0.smithi066.stdout:2/305: symlink de/d3c/l63 0 2024-09-12T01:43:08.329 INFO:tasks.workunit.client.0.smithi066.stdout:2/306: fdatasync de/d13/d1e/d25/f33 0 2024-09-12T01:43:08.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/749: link d22/d79/d8e/c95 d22/d79/d8e/dc6/dd6/c101 0 2024-09-12T01:43:08.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/750: chown d22/d30/d4c/d6e/l45 428736 1 2024-09-12T01:43:08.332 INFO:tasks.workunit.client.1.smithi153.stdout:8/626: read d17/d21/d56/d96/fa4 [3111176,84277] 0 2024-09-12T01:43:08.332 INFO:tasks.workunit.client.1.smithi153.stdout:8/627: chown d17/d1d/d27/l33 1817 1 2024-09-12T01:43:08.335 INFO:tasks.workunit.client.0.smithi066.stdout:1/274: symlink d5/dc/dd/d1c/l4a 0 2024-09-12T01:43:08.337 INFO:tasks.workunit.client.0.smithi066.stdout:0/318: dread d1/dc/de/f4b [0,4194304] 0 2024-09-12T01:43:08.338 INFO:tasks.workunit.client.0.smithi066.stdout:0/319: chown d1/dc/de/d47/d4a/d67/d3e/l3f 4 1 2024-09-12T01:43:08.338 INFO:tasks.workunit.client.0.smithi066.stdout:9/342: mkdir d0/d6/d7f 0 2024-09-12T01:43:08.338 INFO:tasks.workunit.client.0.smithi066.stdout:9/343: stat d0/d6/d17/d1b/d4c/f2b 0 2024-09-12T01:43:08.341 INFO:tasks.workunit.client.0.smithi066.stdout:7/238: mkdir d2/d41/d53 0 2024-09-12T01:43:08.344 INFO:tasks.workunit.client.1.smithi153.stdout:2/613: symlink d7/d17/da4/lc7 0 2024-09-12T01:43:08.344 INFO:tasks.workunit.client.1.smithi153.stdout:2/614: readlink d7/d4d/d7b/la6 0 2024-09-12T01:43:08.344 INFO:tasks.workunit.client.1.smithi153.stdout:2/615: fsync d7/db/f64 0 2024-09-12T01:43:08.344 INFO:tasks.workunit.client.1.smithi153.stdout:2/616: fsync d7/db/d27/d56/f9a 0 2024-09-12T01:43:08.345 INFO:tasks.workunit.client.0.smithi066.stdout:6/411: creat d2/db/d12/d1d/d6b/f86 x:0 0 0 2024-09-12T01:43:08.348 INFO:tasks.workunit.client.1.smithi153.stdout:4/556: link d6/d9/d11/f6c d6/d9/dc/d31/d76/fc2 0 2024-09-12T01:43:08.348 INFO:tasks.workunit.client.1.smithi153.stdout:4/557: chown d6/c12 4107657 1 2024-09-12T01:43:08.349 INFO:tasks.workunit.client.0.smithi066.stdout:8/323: mknod d12/d21/d2f/d57/d3c/c67 0 2024-09-12T01:43:08.349 INFO:tasks.workunit.client.1.smithi153.stdout:9/648: sync 2024-09-12T01:43:08.349 INFO:tasks.workunit.client.1.smithi153.stdout:6/696: sync 2024-09-12T01:43:08.349 INFO:tasks.workunit.client.1.smithi153.stdout:1/692: sync 2024-09-12T01:43:08.349 INFO:tasks.workunit.client.1.smithi153.stdout:7/597: sync 2024-09-12T01:43:08.350 INFO:tasks.workunit.client.0.smithi066.stdout:1/275: write d5/dc/f40 [1110879,49571] 0 2024-09-12T01:43:08.351 INFO:tasks.workunit.client.0.smithi066.stdout:0/320: write d1/dc/f14 [130766,129181] 0 2024-09-12T01:43:08.352 INFO:tasks.workunit.client.1.smithi153.stdout:5/669: truncate d0/df/db8/f38 2632359 0 2024-09-12T01:43:08.353 INFO:tasks.workunit.client.1.smithi153.stdout:6/697: dread d1/df/f8e [0,4194304] 0 2024-09-12T01:43:08.354 INFO:tasks.workunit.client.1.smithi153.stdout:8/628: rmdir d17/d21/d56/d96 39 2024-09-12T01:43:08.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/272: dwrite d4/f29 [0,4194304] 0 2024-09-12T01:43:08.356 INFO:tasks.workunit.client.1.smithi153.stdout:4/558: rmdir d6/d9/d11 39 2024-09-12T01:43:08.356 INFO:tasks.workunit.client.1.smithi153.stdout:4/559: fsync d6/d9/d26/f47 0 2024-09-12T01:43:08.356 INFO:tasks.workunit.client.1.smithi153.stdout:4/560: write d6/d15/db4/fc0 [974042,92232] 0 2024-09-12T01:43:08.358 INFO:tasks.workunit.client.1.smithi153.stdout:9/649: mkdir d3/d3a/d42/d72/dc3 0 2024-09-12T01:43:08.360 INFO:tasks.workunit.client.1.smithi153.stdout:2/617: dread d7/d19/f4b [0,4194304] 0 2024-09-12T01:43:08.361 INFO:tasks.workunit.client.0.smithi066.stdout:2/307: rename de/d13/l39 to de/d3c/l64 0 2024-09-12T01:43:08.361 INFO:tasks.workunit.client.0.smithi066.stdout:5/240: dwrite d0/f4a [0,4194304] 0 2024-09-12T01:43:08.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/618: read d7/db/d6c/d7e/f5f [488543,75143] 0 2024-09-12T01:43:08.362 INFO:tasks.workunit.client.1.smithi153.stdout:1/693: symlink d2/d34/d8a/da7/ldb 0 2024-09-12T01:43:08.362 INFO:tasks.workunit.client.1.smithi153.stdout:1/694: write d2/d68/d6b/d9e/fd6 [534153,24245] 0 2024-09-12T01:43:08.367 INFO:tasks.workunit.client.1.smithi153.stdout:7/598: link cf d12/cba 0 2024-09-12T01:43:08.367 INFO:tasks.workunit.client.1.smithi153.stdout:4/561: creat d6/d15/fc3 x:0 0 0 2024-09-12T01:43:08.369 INFO:tasks.workunit.client.0.smithi066.stdout:9/344: symlink d0/d6/d17/d28/d79/l80 0 2024-09-12T01:43:08.369 INFO:tasks.workunit.client.0.smithi066.stdout:5/241: dread d0/f20 [0,4194304] 0 2024-09-12T01:43:08.369 INFO:tasks.workunit.client.0.smithi066.stdout:0/321: dread d1/dc/de/d47/d4a/d67/d3e/f69 [0,4194304] 0 2024-09-12T01:43:08.370 INFO:tasks.workunit.client.1.smithi153.stdout:9/650: mkdir d3/d5f/dc4 0 2024-09-12T01:43:08.371 INFO:tasks.workunit.client.0.smithi066.stdout:7/239: mknod d2/d20/c54 0 2024-09-12T01:43:08.371 INFO:tasks.workunit.client.1.smithi153.stdout:2/619: symlink d7/d17/da9/lc8 0 2024-09-12T01:43:08.371 INFO:tasks.workunit.client.1.smithi153.stdout:0/751: dwrite d22/d30/d4c/d6e/d7f/d98/fd5 [0,4194304] 0 2024-09-12T01:43:08.372 INFO:tasks.workunit.client.0.smithi066.stdout:6/412: mkdir d2/db/d72/d87 0 2024-09-12T01:43:08.372 INFO:tasks.workunit.client.0.smithi066.stdout:6/413: write d2/f4e [3132724,103418] 0 2024-09-12T01:43:08.376 INFO:tasks.workunit.client.1.smithi153.stdout:1/695: rename d2/d9/d1d/d82/d89/c8c to d2/d9/d17/d2f/d56/d71/d9a/cdc 0 2024-09-12T01:43:08.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/276: unlink d5/c3c 0 2024-09-12T01:43:08.380 INFO:tasks.workunit.client.0.smithi066.stdout:1/277: read d5/dc/f33 [1816452,90540] 0 2024-09-12T01:43:08.380 INFO:tasks.workunit.client.0.smithi066.stdout:1/278: stat d5 0 2024-09-12T01:43:08.380 INFO:tasks.workunit.client.0.smithi066.stdout:1/279: truncate d5/dc/dd/f48 290850 0 2024-09-12T01:43:08.381 INFO:tasks.workunit.client.1.smithi153.stdout:4/562: mknod d6/d6a/cc4 0 2024-09-12T01:43:08.383 INFO:tasks.workunit.client.0.smithi066.stdout:8/324: dwrite d12/d21/d2f/d57/d3c/f40 [4194304,4194304] 0 2024-09-12T01:43:08.383 INFO:tasks.workunit.client.1.smithi153.stdout:5/670: dwrite d0/df/db8/d2f/d55/d9c/d75/d58/f85 [0,4194304] 0 2024-09-12T01:43:08.384 INFO:tasks.workunit.client.0.smithi066.stdout:4/273: dwrite d4/f29 [0,4194304] 0 2024-09-12T01:43:08.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/651: symlink d3/d55/d30/lc5 0 2024-09-12T01:43:08.386 INFO:tasks.workunit.client.1.smithi153.stdout:2/620: mkdir d7/db/d62/d87/dc9 0 2024-09-12T01:43:08.388 INFO:tasks.workunit.client.0.smithi066.stdout:1/280: dread d5/dc/f10 [0,4194304] 0 2024-09-12T01:43:08.389 INFO:tasks.workunit.client.0.smithi066.stdout:1/281: write d5/dc/f40 [4494155,62092] 0 2024-09-12T01:43:08.396 INFO:tasks.workunit.client.0.smithi066.stdout:9/345: creat d0/d6/d17/d4f/f81 x:0 0 0 2024-09-12T01:43:08.396 INFO:tasks.workunit.client.0.smithi066.stdout:1/282: dread d5/dc/f1f [0,4194304] 0 2024-09-12T01:43:08.396 INFO:tasks.workunit.client.0.smithi066.stdout:1/283: truncate d5/d15/f43 858757 0 2024-09-12T01:43:08.398 INFO:tasks.workunit.client.1.smithi153.stdout:0/752: rmdir d22/d30/d4c/d6e/d7f/dbd/deb 0 2024-09-12T01:43:08.399 INFO:tasks.workunit.client.0.smithi066.stdout:5/242: mknod d0/d26/d2f/d30/c4b 0 2024-09-12T01:43:08.401 INFO:tasks.workunit.client.1.smithi153.stdout:7/599: rename d12/d21/d29/f99 to d12/d21/d29/d35/d37/fbb 0 2024-09-12T01:43:08.401 INFO:tasks.workunit.client.1.smithi153.stdout:7/600: readlink d12/d21/d29/d35/d37/l38 0 2024-09-12T01:43:08.402 INFO:tasks.workunit.client.1.smithi153.stdout:7/601: truncate d12/d7e/f68 554242 0 2024-09-12T01:43:08.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 -- 172.21.15.66:0/186414555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5544065af0 msgr2=0x7f55440fef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 --2- 172.21.15.66:0/186414555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5544065af0 0x7f55440fef90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55380048d0 tx=0x7f5538009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 -- 172.21.15.66:0/186414555 shutdown_connections 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 --2- 172.21.15.66:0/186414555 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55440ff4d0 0x7f55441018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 --2- 172.21.15.66:0/186414555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5544065af0 0x7f55440fef90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 -- 172.21.15.66:0/186414555 >> 172.21.15.66:0/186414555 conn(0x7f55440f6a40 msgr2=0x7f55440f8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 -- 172.21.15.66:0/186414555 shutdown_connections 2024-09-12T01:43:08.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.402+0000 7f55498e4640 1 -- 172.21.15.66:0/186414555 wait complete. 2024-09-12T01:43:08.405 INFO:tasks.workunit.client.0.smithi066.stdout:0/322: creat d1/dc/de/d47/d4a/d65/f71 x:0 0 0 2024-09-12T01:43:08.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.405+0000 7f55498e4640 1 Processor -- start 2024-09-12T01:43:08.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.406+0000 7f55498e4640 1 -- start start 2024-09-12T01:43:08.407 INFO:tasks.workunit.client.1.smithi153.stdout:5/671: dwrite d0/d15/f1a [0,4194304] 0 2024-09-12T01:43:08.407 INFO:tasks.workunit.client.1.smithi153.stdout:5/672: readlink d0/df/l8a 0 2024-09-12T01:43:08.407 INFO:tasks.workunit.client.1.smithi153.stdout:1/696: mkdir d2/d9/d17/d2c/ddd 0 2024-09-12T01:43:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.407+0000 7f55498e4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 0x7f554410cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f55498e4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55440ff4d0 0x7f554410d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f55488e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 0x7f554410cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f55498e4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554410da90 con 0x7f5544065af0 2024-09-12T01:43:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f55488e2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 0x7f554410cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58502/0 (socket says 172.21.15.66:58502) 2024-09-12T01:43:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f55488e2640 1 -- 172.21.15.66:0/2918401960 learned_addr learned my addr 172.21.15.66:0/2918401960 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554410e2b0 con 0x7f55440ff4d0 2024-09-12T01:43:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.408+0000 7f5543fff640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55440ff4d0 0x7f554410d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.409 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.409+0000 7f55488e2640 1 -- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55440ff4d0 msgr2=0x7f554410d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.409+0000 7f55488e2640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55440ff4d0 0x7f554410d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.409+0000 7f55488e2640 1 -- 172.21.15.66:0/2918401960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538005040 con 0x7f5544065af0 2024-09-12T01:43:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.410+0000 7f55488e2640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 0x7f554410cf00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f55380048a0 tx=0x7f5538009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.410 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.410+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5538038070 con 0x7f5544065af0 2024-09-12T01:43:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.411+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5538004290 con 0x7f5544065af0 2024-09-12T01:43:08.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/346: dread d0/f3c [0,4194304] 0 2024-09-12T01:43:08.411 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.411+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f553803e650 con 0x7f5544065af0 2024-09-12T01:43:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.412+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554410e4e0 con 0x7f5544065af0 2024-09-12T01:43:08.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.412+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554410ea80 con 0x7f5544065af0 2024-09-12T01:43:08.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/563: creat d6/d6a/fc5 x:0 0 0 2024-09-12T01:43:08.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/564: rename d6/d15/db4/d7b to d6/d15/db4/d7b/dc6 22 2024-09-12T01:43:08.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/565: fdatasync d6/d9/d11/d13/f18 0 2024-09-12T01:43:08.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/566: write d6/d9/dc/d98/d3e/d66/fb9 [1200660,39045] 0 2024-09-12T01:43:08.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/567: creat d6/d9/dc/d31/d7d/fc7 x:0 0 0 2024-09-12T01:43:08.413 INFO:tasks.workunit.client.1.smithi153.stdout:4/568: write d6/d9/d26/f74 [1470028,83470] 0 2024-09-12T01:43:08.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.413+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554405ed70 con 0x7f5544065af0 2024-09-12T01:43:08.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.413+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 22) v1 ==== 45945+0+0 (secure 0 0 0) 0x7f5538030020 con 0x7f5544065af0 2024-09-12T01:43:08.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.414+0000 7f55417fa640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f5534038a70 0x7f553403af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.414+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f553806c310 con 0x7f5544065af0 2024-09-12T01:43:08.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.414+0000 7f5543fff640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f5534038a70 0x7f553403af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.415 INFO:tasks.workunit.client.1.smithi153.stdout:4/569: write d6/d9/d11/f6c [421758,16781] 0 2024-09-12T01:43:08.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.416+0000 7f5543fff640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f5534038a70 0x7f553403af20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f554410ccb0 tx=0x7f553000b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.416 INFO:tasks.workunit.client.0.smithi066.stdout:6/414: mknod d2/db/d12/d1d/c88 0 2024-09-12T01:43:08.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.422+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f553803d980 con 0x7f5544065af0 2024-09-12T01:43:08.424 INFO:tasks.workunit.client.0.smithi066.stdout:5/243: dwrite d0/f17 [0,4194304] 0 2024-09-12T01:43:08.425 INFO:tasks.workunit.client.0.smithi066.stdout:0/323: dwrite d1/dc/de/d47/d4a/d67/f70 [0,4194304] 0 2024-09-12T01:43:08.429 INFO:tasks.workunit.client.1.smithi153.stdout:9/652: mkdir d3/d55/d30/d88/dc6 0 2024-09-12T01:43:08.429 INFO:tasks.workunit.client.1.smithi153.stdout:9/653: write d3/f11 [131996,55629] 0 2024-09-12T01:43:08.430 INFO:tasks.workunit.client.1.smithi153.stdout:2/621: mkdir d7/d17/da4/dca 0 2024-09-12T01:43:08.434 INFO:tasks.workunit.client.1.smithi153.stdout:0/753: rename d22/d79/fd8 to d22/d79/f102 0 2024-09-12T01:43:08.436 INFO:tasks.workunit.client.1.smithi153.stdout:7/602: symlink d12/d4e/lbc 0 2024-09-12T01:43:08.436 INFO:tasks.workunit.client.1.smithi153.stdout:7/603: write d12/d21/d29/d2d/f30 [233623,125253] 0 2024-09-12T01:43:08.439 INFO:tasks.workunit.client.1.smithi153.stdout:5/673: read d0/df/db8/d2f/d55/d9c/d75/d58/d71/f7c [360057,122137] 0 2024-09-12T01:43:08.441 INFO:tasks.workunit.client.1.smithi153.stdout:1/697: symlink d2/d9/d17/d2f/d56/d83/lde 0 2024-09-12T01:43:08.442 INFO:tasks.workunit.client.1.smithi153.stdout:1/698: fsync d2/d9/f1a 0 2024-09-12T01:43:08.446 INFO:tasks.workunit.client.0.smithi066.stdout:7/240: getdents d2 0 2024-09-12T01:43:08.446 INFO:tasks.workunit.client.0.smithi066.stdout:7/241: fsync d2/d20/d25/f48 0 2024-09-12T01:43:08.446 INFO:tasks.workunit.client.0.smithi066.stdout:7/242: truncate d2/d5/f23 5310893 0 2024-09-12T01:43:08.449 INFO:tasks.workunit.client.0.smithi066.stdout:5/244: truncate d0/d21/d27/f3a 1072302 0 2024-09-12T01:43:08.449 INFO:tasks.workunit.client.0.smithi066.stdout:5/245: write d0/f17 [4303041,5569] 0 2024-09-12T01:43:08.467 INFO:tasks.workunit.client.1.smithi153.stdout:9/654: link d3/d3a/f7a d3/d3a/d42/d72/dc3/fc7 0 2024-09-12T01:43:08.469 INFO:tasks.workunit.client.1.smithi153.stdout:2/622: mknod d7/d17/da4/ccb 0 2024-09-12T01:43:08.470 INFO:tasks.workunit.client.0.smithi066.stdout:7/243: mknod d2/d5/d6/d22/c55 0 2024-09-12T01:43:08.471 INFO:tasks.workunit.client.1.smithi153.stdout:0/754: mknod d22/d79/d8e/dae/c103 0 2024-09-12T01:43:08.473 INFO:tasks.workunit.client.0.smithi066.stdout:5/246: mkdir d0/dd/d18/d36/d4c 0 2024-09-12T01:43:08.473 INFO:tasks.workunit.client.0.smithi066.stdout:5/247: fdatasync d0/f20 0 2024-09-12T01:43:08.473 INFO:tasks.workunit.client.0.smithi066.stdout:5/248: truncate d0/d26/d2d/f49 170449 0 2024-09-12T01:43:08.473 INFO:tasks.workunit.client.0.smithi066.stdout:5/249: dread - d0/d21/f44 zero size 2024-09-12T01:43:08.475 INFO:tasks.workunit.client.1.smithi153.stdout:7/604: rmdir d12/d21 39 2024-09-12T01:43:08.478 INFO:tasks.workunit.client.1.smithi153.stdout:5/674: mkdir d0/d43/d8d/d8e/dd7 0 2024-09-12T01:43:08.480 INFO:tasks.workunit.client.0.smithi066.stdout:0/324: rename d1/dc to d1/d72 0 2024-09-12T01:43:08.482 INFO:tasks.workunit.client.1.smithi153.stdout:1/699: truncate d2/d34/f39 855333 0 2024-09-12T01:43:08.487 INFO:tasks.workunit.client.0.smithi066.stdout:5/250: link d0/dd/d18/c1d d0/d26/d2f/d3b/c4d 0 2024-09-12T01:43:08.488 INFO:tasks.workunit.client.0.smithi066.stdout:5/251: dread d0/d26/d2d/f49 [0,4194304] 0 2024-09-12T01:43:08.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/675: write d0/df/d83/d36/d39/f74 [1650340,20874] 0 2024-09-12T01:43:08.489 INFO:tasks.workunit.client.1.smithi153.stdout:5/676: write d0/d20/fa1 [305227,87689] 0 2024-09-12T01:43:08.492 INFO:tasks.workunit.client.0.smithi066.stdout:0/325: creat d1/d72/de/d47/d4a/d67/d1b/d26/d5b/f73 x:0 0 0 2024-09-12T01:43:08.492 INFO:tasks.workunit.client.0.smithi066.stdout:0/326: write d1/f2d [421810,48241] 0 2024-09-12T01:43:08.493 INFO:tasks.workunit.client.1.smithi153.stdout:2/623: dwrite d7/d19/d40/f37 [0,4194304] 0 2024-09-12T01:43:08.493 INFO:tasks.workunit.client.1.smithi153.stdout:2/624: dread - d7/d19/d40/f82 zero size 2024-09-12T01:43:08.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/570: getdents d6/d9/dc/d98/d3e/d66 0 2024-09-12T01:43:08.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/571: chown d6/d15/db4/laf 222096179 1 2024-09-12T01:43:08.496 INFO:tasks.workunit.client.0.smithi066.stdout:7/244: mkdir d2/d5/d56 0 2024-09-12T01:43:08.496 INFO:tasks.workunit.client.0.smithi066.stdout:7/245: truncate d2/d20/d2f/f34 1758860 0 2024-09-12T01:43:08.496 INFO:tasks.workunit.client.0.smithi066.stdout:7/246: dread - d2/d5/f31 zero size 2024-09-12T01:43:08.497 INFO:tasks.workunit.client.0.smithi066.stdout:0/327: stat d1/d72/de/c29 0 2024-09-12T01:43:08.500 INFO:tasks.workunit.client.0.smithi066.stdout:0/328: dread d1/d72/de/d47/d4a/d67/f52 [0,4194304] 0 2024-09-12T01:43:08.501 INFO:tasks.workunit.client.0.smithi066.stdout:0/329: chown d1/d72/de/c29 40656050 1 2024-09-12T01:43:08.504 INFO:tasks.workunit.client.1.smithi153.stdout:9/655: link d3/d3a/d42/d72/lba d3/d35/lc8 0 2024-09-12T01:43:08.504 INFO:tasks.workunit.client.1.smithi153.stdout:9/656: readlink d3/d55/l41 0 2024-09-12T01:43:08.504 INFO:tasks.workunit.client.1.smithi153.stdout:7/605: dwrite d12/f33 [0,4194304] 0 2024-09-12T01:43:08.505 INFO:tasks.workunit.client.0.smithi066.stdout:4/274: truncate d4/d6/f23 6353127 0 2024-09-12T01:43:08.506 INFO:tasks.workunit.client.1.smithi153.stdout:2/625: dread d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:08.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/330: rename d1/f28 to d1/d62/d6c/f74 0 2024-09-12T01:43:08.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/331: truncate d1/d72/de/d47/d4a/d67/f52 442778 0 2024-09-12T01:43:08.508 INFO:tasks.workunit.client.1.smithi153.stdout:1/700: mknod d2/d68/cdf 0 2024-09-12T01:43:08.509 INFO:tasks.workunit.client.0.smithi066.stdout:7/247: dread d2/d5/d6/f2a [0,4194304] 0 2024-09-12T01:43:08.510 INFO:tasks.workunit.client.0.smithi066.stdout:4/275: creat d4/d6/d8/d18/d45/f57 x:0 0 0 2024-09-12T01:43:08.510 INFO:tasks.workunit.client.0.smithi066.stdout:5/252: dwrite d0/d26/d2d/f49 [0,4194304] 0 2024-09-12T01:43:08.515 INFO:tasks.workunit.client.0.smithi066.stdout:0/332: unlink d1/d72/de/d47/d4a/d67/d3e/f69 0 2024-09-12T01:43:08.515 INFO:tasks.workunit.client.0.smithi066.stdout:0/333: chown d1/d72/de/c51 1684541356 1 2024-09-12T01:43:08.516 INFO:tasks.workunit.client.1.smithi153.stdout:5/677: mkdir d0/df/db8/d2f/d55/dd8 0 2024-09-12T01:43:08.519 INFO:tasks.workunit.client.0.smithi066.stdout:7/248: creat d2/d5/da/d3f/f57 x:0 0 0 2024-09-12T01:43:08.519 INFO:tasks.workunit.client.0.smithi066.stdout:7/249: fsync d2/d20/d25/d4d/f4f 0 2024-09-12T01:43:08.523 INFO:tasks.workunit.client.0.smithi066.stdout:4/276: mkdir d4/d4f/d58 0 2024-09-12T01:43:08.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/755: dwrite d22/d30/d4c/f55 [0,4194304] 0 2024-09-12T01:43:08.527 INFO:tasks.workunit.client.1.smithi153.stdout:5/678: write d0/df/d83/d36/f7d [2856646,120986] 0 2024-09-12T01:43:08.530 INFO:tasks.workunit.client.1.smithi153.stdout:7/606: creat d12/d7e/db2/fbd x:0 0 0 2024-09-12T01:43:08.531 INFO:tasks.workunit.client.0.smithi066.stdout:7/250: creat d2/d5/d56/f58 x:0 0 0 2024-09-12T01:43:08.533 INFO:tasks.workunit.client.1.smithi153.stdout:2/626: symlink d7/db/d27/lcc 0 2024-09-12T01:43:08.534 INFO:tasks.workunit.client.1.smithi153.stdout:1/701: symlink d2/d9/d17/d2f/le0 0 2024-09-12T01:43:08.535 INFO:tasks.workunit.client.1.smithi153.stdout:1/702: dread - d2/d9/d58/d74/fbf zero size 2024-09-12T01:43:08.535 INFO:tasks.workunit.client.1.smithi153.stdout:5/679: dread d0/df/d83/d36/f3b [0,4194304] 0 2024-09-12T01:43:08.536 INFO:tasks.workunit.client.0.smithi066.stdout:7/251: truncate d2/d5/d6/fe 1091010 0 2024-09-12T01:43:08.542 INFO:tasks.workunit.client.1.smithi153.stdout:0/756: dread d22/d30/d4c/f4d [0,4194304] 0 2024-09-12T01:43:08.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/627: getdents d7/db/d6c/d9f 0 2024-09-12T01:43:08.542 INFO:tasks.workunit.client.1.smithi153.stdout:1/703: mkdir d2/d9/d17/d2f/d56/d71/db8/de1 0 2024-09-12T01:43:08.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/628: fsync f1 0 2024-09-12T01:43:08.544 INFO:tasks.workunit.client.1.smithi153.stdout:5/680: creat d0/d43/dac/db0/fd9 x:0 0 0 2024-09-12T01:43:08.545 INFO:tasks.workunit.client.1.smithi153.stdout:5/681: chown d0/df/db8/d2f/d55/d9c/d75/d58/d70/l64 48813 1 2024-09-12T01:43:08.545 INFO:tasks.workunit.client.1.smithi153.stdout:5/682: chown d0/df/db8/d2f/d55/d9c/d75/d58/d71/db7/lc3 817903580 1 2024-09-12T01:43:08.545 INFO:tasks.workunit.client.1.smithi153.stdout:5/683: chown d0/df/d99 24932898 1 2024-09-12T01:43:08.546 INFO:tasks.workunit.client.1.smithi153.stdout:0/757: truncate d22/d79/dca/fee 3484806 0 2024-09-12T01:43:08.549 INFO:tasks.workunit.client.1.smithi153.stdout:1/704: rmdir d2/d9/d28/d73/d76 39 2024-09-12T01:43:08.549 INFO:tasks.workunit.client.1.smithi153.stdout:1/705: fsync d2/d9/d17/d2c/f85 0 2024-09-12T01:43:08.549 INFO:tasks.workunit.client.1.smithi153.stdout:1/706: fdatasync d2/d34/d8a/f94 0 2024-09-12T01:43:08.549 INFO:tasks.workunit.client.1.smithi153.stdout:1/707: write d2/d9/f1a [5088645,4690] 0 2024-09-12T01:43:08.553 INFO:tasks.workunit.client.1.smithi153.stdout:5/684: symlink d0/df/d1c/d69/lda 0 2024-09-12T01:43:08.553 INFO:tasks.workunit.client.1.smithi153.stdout:8/629: sync 2024-09-12T01:43:08.553 INFO:tasks.workunit.client.1.smithi153.stdout:6/698: sync 2024-09-12T01:43:08.553 INFO:tasks.workunit.client.1.smithi153.stdout:8/630: readlink d17/d21/d56/d96/l4c 0 2024-09-12T01:43:08.553 INFO:tasks.workunit.client.1.smithi153.stdout:3/709: sync 2024-09-12T01:43:08.553 INFO:tasks.workunit.client.1.smithi153.stdout:0/758: link d22/d30/d4c/d6e/c9c d22/d79/dca/ded/df8/c104 0 2024-09-12T01:43:08.554 INFO:tasks.workunit.client.1.smithi153.stdout:0/759: read - d22/d79/dca/fd9 zero size 2024-09-12T01:43:08.561 INFO:tasks.workunit.client.1.smithi153.stdout:0/760: dread d22/d30/d4c/d6f/d88/fbc [0,4194304] 0 2024-09-12T01:43:08.561 INFO:tasks.workunit.client.1.smithi153.stdout:0/761: truncate d22/d79/d8e/fc4 668652 0 2024-09-12T01:43:08.564 INFO:tasks.workunit.client.0.smithi066.stdout:5/253: dwrite d0/d26/f34 [0,4194304] 0 2024-09-12T01:43:08.566 INFO:tasks.workunit.client.0.smithi066.stdout:0/334: dwrite d1/d72/de/f2a [0,4194304] 0 2024-09-12T01:43:08.569 INFO:tasks.workunit.client.1.smithi153.stdout:6/699: dread d1/d6/d23/f2b [0,4194304] 0 2024-09-12T01:43:08.569 INFO:tasks.workunit.client.0.smithi066.stdout:5/254: mknod d0/dd/c4e 0 2024-09-12T01:43:08.569 INFO:tasks.workunit.client.0.smithi066.stdout:4/277: dwrite d4/d6/f30 [0,4194304] 0 2024-09-12T01:43:08.571 INFO:tasks.workunit.client.0.smithi066.stdout:0/335: creat d1/d72/de/d47/d4a/d67/d3e/f75 x:0 0 0 2024-09-12T01:43:08.573 INFO:tasks.workunit.client.1.smithi153.stdout:6/700: creat d1/d6/da/d19/d3a/fe2 x:0 0 0 2024-09-12T01:43:08.575 INFO:tasks.workunit.client.0.smithi066.stdout:5/255: unlink d0/d26/l2b 0 2024-09-12T01:43:08.575 INFO:tasks.workunit.client.0.smithi066.stdout:5/256: chown d0/dd/l1c 281384295 1 2024-09-12T01:43:08.578 INFO:tasks.workunit.client.0.smithi066.stdout:4/278: symlink d4/d6/d8/d4a/l59 0 2024-09-12T01:43:08.578 INFO:tasks.workunit.client.0.smithi066.stdout:4/279: readlink d4/d15/d33/l40 0 2024-09-12T01:43:08.579 INFO:tasks.workunit.client.0.smithi066.stdout:4/280: chown d4/d6/d8 10902 1 2024-09-12T01:43:08.579 INFO:tasks.workunit.client.0.smithi066.stdout:4/281: chown d4/f46 4 1 2024-09-12T01:43:08.579 INFO:tasks.workunit.client.0.smithi066.stdout:4/282: dread - d4/f52 zero size 2024-09-12T01:43:08.581 INFO:tasks.workunit.client.1.smithi153.stdout:7/607: dwrite d12/d21/d29/d2d/f30 [0,4194304] 0 2024-09-12T01:43:08.581 INFO:tasks.workunit.client.0.smithi066.stdout:5/257: link d0/d21/d27/f3a d0/d26/d2d/d33/f4f 0 2024-09-12T01:43:08.581 INFO:tasks.workunit.client.0.smithi066.stdout:5/258: stat d0/dd/c4e 0 2024-09-12T01:43:08.582 INFO:tasks.workunit.client.0.smithi066.stdout:4/283: mkdir d4/d6/d48/d5a 0 2024-09-12T01:43:08.582 INFO:tasks.workunit.client.0.smithi066.stdout:4/284: chown d4/c11 17 1 2024-09-12T01:43:08.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/259: mknod d0/d21/c50 0 2024-09-12T01:43:08.588 INFO:tasks.workunit.client.0.smithi066.stdout:5/260: mknod d0/d26/d2d/d33/c51 0 2024-09-12T01:43:08.590 INFO:tasks.workunit.client.0.smithi066.stdout:5/261: symlink d0/d26/d2d/l52 0 2024-09-12T01:43:08.593 INFO:tasks.workunit.client.0.smithi066.stdout:5/262: rename d0/f4a to d0/dd/d18/f53 0 2024-09-12T01:43:08.593 INFO:tasks.workunit.client.0.smithi066.stdout:5/263: write d0/dd/fe [4277649,7867] 0 2024-09-12T01:43:08.593 INFO:tasks.workunit.client.0.smithi066.stdout:5/264: fdatasync d0/f20 0 2024-09-12T01:43:08.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/265: creat d0/d26/d2f/d3b/f54 x:0 0 0 2024-09-12T01:43:08.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/266: chown d0/dd/fe 1014 1 2024-09-12T01:43:08.599 INFO:tasks.workunit.client.1.smithi153.stdout:2/629: dwrite d7/db/f64 [4194304,4194304] 0 2024-09-12T01:43:08.602 INFO:tasks.workunit.client.1.smithi153.stdout:2/630: unlink d7/db/d6c/d7e/f52 0 2024-09-12T01:43:08.602 INFO:tasks.workunit.client.1.smithi153.stdout:2/631: stat d7/d4d/d70/d81/l97 0 2024-09-12T01:43:08.604 INFO:tasks.workunit.client.1.smithi153.stdout:2/632: symlink d7/d4d/d70/d81/lcd 0 2024-09-12T01:43:08.605 INFO:tasks.workunit.client.1.smithi153.stdout:2/633: creat d7/fce x:0 0 0 2024-09-12T01:43:08.605 INFO:tasks.workunit.client.1.smithi153.stdout:2/634: chown d7/d4d/d70/d81/dae 3 1 2024-09-12T01:43:08.605 INFO:tasks.workunit.client.1.smithi153.stdout:2/635: chown d7/db/d27/lcc 54266032 1 2024-09-12T01:43:08.605 INFO:tasks.workunit.client.1.smithi153.stdout:2/636: dread - d7/db/d36/fc6 zero size 2024-09-12T01:43:08.610 INFO:tasks.workunit.client.1.smithi153.stdout:1/708: dwrite d2/d34/d8a/f94 [0,4194304] 0 2024-09-12T01:43:08.613 INFO:tasks.workunit.client.0.smithi066.stdout:7/252: dwrite d2/d5/d6/d22/f30 [4194304,4194304] 0 2024-09-12T01:43:08.617 INFO:tasks.workunit.client.1.smithi153.stdout:3/710: dwrite d1/d13/d25/da6/f5f [4194304,4194304] 0 2024-09-12T01:43:08.622 INFO:tasks.workunit.client.1.smithi153.stdout:6/701: dwrite d1/d6/d23/d98/d53/d69/f7d [4194304,4194304] 0 2024-09-12T01:43:08.622 INFO:tasks.workunit.client.1.smithi153.stdout:6/702: fdatasync d1/d6/d23/f6e 0 2024-09-12T01:43:08.622 INFO:tasks.workunit.client.1.smithi153.stdout:6/703: chown d1/df/d9d/cbe 241876 1 2024-09-12T01:43:08.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/285: dwrite d4/d6/d8/f4e [0,4194304] 0 2024-09-12T01:43:08.623 INFO:tasks.workunit.client.1.smithi153.stdout:0/762: dwrite f20 [0,4194304] 0 2024-09-12T01:43:08.624 INFO:tasks.workunit.client.1.smithi153.stdout:5/685: dwrite d0/df/db8/d2f/d55/fd5 [0,4194304] 0 2024-09-12T01:43:08.624 INFO:tasks.workunit.client.1.smithi153.stdout:5/686: stat d0/df/db8/l59 0 2024-09-12T01:43:08.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/267: dwrite d0/dd/d18/f23 [0,4194304] 0 2024-09-12T01:43:08.627 INFO:tasks.workunit.client.1.smithi153.stdout:8/631: dwrite d17/d1f/d4f/d34/d6f/f70 [0,4194304] 0 2024-09-12T01:43:08.627 INFO:tasks.workunit.client.0.smithi066.stdout:5/268: write d0/dd/f13 [1825028,25311] 0 2024-09-12T01:43:08.628 INFO:tasks.workunit.client.1.smithi153.stdout:3/711: mknod d1/d13/d23/d47/d71/d8e/d93/d79/ccc 0 2024-09-12T01:43:08.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/269: write d0/dd/d18/d36/f38 [3247632,59899] 0 2024-09-12T01:43:08.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/270: chown d0/d26/d2f/d30 3 1 2024-09-12T01:43:08.646 INFO:tasks.workunit.client.0.smithi066.stdout:5/271: write d0/dd/d18/f3d [718841,109336] 0 2024-09-12T01:43:08.649 INFO:tasks.workunit.client.1.smithi153.stdout:1/709: dwrite d2/d9/d17/d2f/d56/d83/fd2 [0,4194304] 0 2024-09-12T01:43:08.649 INFO:tasks.workunit.client.1.smithi153.stdout:1/710: truncate d2/d34/d3d/d80/fd8 574741 0 2024-09-12T01:43:08.649 INFO:tasks.workunit.client.1.smithi153.stdout:2/637: dwrite d7/d4d/d7b/f90 [0,4194304] 0 2024-09-12T01:43:08.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/763: mknod d22/d79/dca/c105 0 2024-09-12T01:43:08.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/764: chown d22/d79/dca/df2 1689 1 2024-09-12T01:43:08.650 INFO:tasks.workunit.client.1.smithi153.stdout:0/765: chown d22/d30/d4c/d6f/d88/faa 952 1 2024-09-12T01:43:08.650 INFO:tasks.workunit.client.0.smithi066.stdout:7/253: dwrite d2/d5/da/f36 [0,4194304] 0 2024-09-12T01:43:08.653 INFO:tasks.workunit.client.0.smithi066.stdout:4/286: mknod d4/d15/c5b 0 2024-09-12T01:43:08.656 INFO:tasks.workunit.client.0.smithi066.stdout:4/287: dread d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:08.664 INFO:tasks.workunit.client.0.smithi066.stdout:4/288: mknod d4/d4f/d58/c5c 0 2024-09-12T01:43:08.664 INFO:tasks.workunit.client.0.smithi066.stdout:4/289: write d4/d15/f38 [831608,49872] 0 2024-09-12T01:43:08.666 INFO:tasks.workunit.client.1.smithi153.stdout:3/712: unlink d1/d13/d25/da6/f8b 0 2024-09-12T01:43:08.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/713: write d1/d13/d23/d47/d6c/fb9 [975,39909] 0 2024-09-12T01:43:08.667 INFO:tasks.workunit.client.1.smithi153.stdout:3/714: dread - d1/d1e/fbc zero size 2024-09-12T01:43:08.667 INFO:tasks.workunit.client.0.smithi066.stdout:7/254: getdents d2/d20/d2f 0 2024-09-12T01:43:08.667 INFO:tasks.workunit.client.0.smithi066.stdout:7/255: dread - d2/d5/f31 zero size 2024-09-12T01:43:08.668 INFO:tasks.workunit.client.0.smithi066.stdout:7/256: write d2/d20/d2f/f34 [53414,104881] 0 2024-09-12T01:43:08.669 INFO:tasks.workunit.client.1.smithi153.stdout:2/638: dread d7/db/f64 [4194304,4194304] 0 2024-09-12T01:43:08.670 INFO:tasks.workunit.client.1.smithi153.stdout:1/711: rename d2/d9/d17/cad to d2/d9/d1d/d82/ce2 0 2024-09-12T01:43:08.671 INFO:tasks.workunit.client.1.smithi153.stdout:1/712: read d2/d9/d17/f23 [452520,4078] 0 2024-09-12T01:43:08.671 INFO:tasks.workunit.client.0.smithi066.stdout:7/257: creat d2/d5/d6/d22/f59 x:0 0 0 2024-09-12T01:43:08.671 INFO:tasks.workunit.client.0.smithi066.stdout:7/258: dread - d2/d5/da/d3f/f57 zero size 2024-09-12T01:43:08.672 INFO:tasks.workunit.client.0.smithi066.stdout:7/259: chown d2/d5/da/c21 8 1 2024-09-12T01:43:08.674 INFO:tasks.workunit.client.0.smithi066.stdout:9/347: sync 2024-09-12T01:43:08.674 INFO:tasks.workunit.client.0.smithi066.stdout:8/325: sync 2024-09-12T01:43:08.674 INFO:tasks.workunit.client.0.smithi066.stdout:2/308: sync 2024-09-12T01:43:08.674 INFO:tasks.workunit.client.0.smithi066.stdout:2/309: write de/f21 [747304,97065] 0 2024-09-12T01:43:08.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/766: truncate f6 3845674 0 2024-09-12T01:43:08.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/767: chown d22/d30/d4c/d6f/fab 16638348 1 2024-09-12T01:43:08.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/768: write d22/d79/d8e/dae/db7/de8/ff6 [675332,51230] 0 2024-09-12T01:43:08.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/769: stat d22/d79/d8e/dae/dff 0 2024-09-12T01:43:08.675 INFO:tasks.workunit.client.1.smithi153.stdout:0/770: creat d22/d79/d8e/dae/db7/de8/f106 x:0 0 0 2024-09-12T01:43:08.679 INFO:tasks.workunit.client.1.smithi153.stdout:8/632: dwrite d17/d1d/fa2 [0,4194304] 0 2024-09-12T01:43:08.679 INFO:tasks.workunit.client.1.smithi153.stdout:1/713: link d2/d34/f39 d2/d9/d17/d2f/d56/fe3 0 2024-09-12T01:43:08.680 INFO:tasks.workunit.client.0.smithi066.stdout:8/326: rmdir d12/d21/d2f/d57/d3c 39 2024-09-12T01:43:08.680 INFO:tasks.workunit.client.1.smithi153.stdout:6/704: dwrite d1/d6/da/d19/d34/f61 [0,4194304] 0 2024-09-12T01:43:08.680 INFO:tasks.workunit.client.1.smithi153.stdout:6/705: readlink d1/d6/d23/d98/d53/d69/l90 0 2024-09-12T01:43:08.680 INFO:tasks.workunit.client.1.smithi153.stdout:6/706: chown d1/d6/d39/d76/f9a 805483 1 2024-09-12T01:43:08.681 INFO:tasks.workunit.client.0.smithi066.stdout:2/310: creat de/f65 x:0 0 0 2024-09-12T01:43:08.682 INFO:tasks.workunit.client.0.smithi066.stdout:5/272: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:43:08.685 INFO:tasks.workunit.client.0.smithi066.stdout:4/290: write d4/f12 [680402,57936] 0 2024-09-12T01:43:08.685 INFO:tasks.workunit.client.0.smithi066.stdout:8/327: rename d12/d21/d2f/d57/d3c/f40 to d12/d21/d2f/d57/d43/d66/f68 0 2024-09-12T01:43:08.685 INFO:tasks.workunit.client.0.smithi066.stdout:1/284: sync 2024-09-12T01:43:08.685 INFO:tasks.workunit.client.0.smithi066.stdout:3/363: sync 2024-09-12T01:43:08.685 INFO:tasks.workunit.client.0.smithi066.stdout:3/364: chown d5/d6/d1b/d45/d66/d67/d6d/f55 12460 1 2024-09-12T01:43:08.685 INFO:tasks.workunit.client.0.smithi066.stdout:6/415: sync 2024-09-12T01:43:08.690 INFO:tasks.workunit.client.1.smithi153.stdout:5/687: dwrite d0/df/db8/d2f/d55/d9c/d75/d58/f66 [0,4194304] 0 2024-09-12T01:43:08.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/348: mknod d0/d6/c82 0 2024-09-12T01:43:08.695 INFO:tasks.workunit.client.1.smithi153.stdout:6/707: creat d1/df/d9d/fe3 x:0 0 0 2024-09-12T01:43:08.695 INFO:tasks.workunit.client.1.smithi153.stdout:6/708: fsync d1/d6/d46/d73/f91 0 2024-09-12T01:43:08.695 INFO:tasks.workunit.client.1.smithi153.stdout:6/709: truncate d1/d6/da/fca 345228 0 2024-09-12T01:43:08.700 INFO:tasks.workunit.client.1.smithi153.stdout:4/572: sync 2024-09-12T01:43:08.700 INFO:tasks.workunit.client.1.smithi153.stdout:9/657: sync 2024-09-12T01:43:08.701 INFO:tasks.workunit.client.0.smithi066.stdout:8/328: write d12/d21/d2f/d57/d3c/d49/f60 [469910,15489] 0 2024-09-12T01:43:08.701 INFO:tasks.workunit.client.0.smithi066.stdout:8/329: readlink d12/d21/d2f/d57/l39 0 2024-09-12T01:43:08.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/349: mkdir d0/d6/d17/d1b/d4c/d4b/d7d/d83 0 2024-09-12T01:43:08.706 INFO:tasks.workunit.client.1.smithi153.stdout:6/710: write d1/df/f6f [1145854,50565] 0 2024-09-12T01:43:08.707 INFO:tasks.workunit.client.0.smithi066.stdout:5/273: getdents d0/d21 0 2024-09-12T01:43:08.709 INFO:tasks.workunit.client.1.smithi153.stdout:5/688: mknod d0/d79/cdb 0 2024-09-12T01:43:08.710 INFO:tasks.workunit.client.1.smithi153.stdout:4/573: symlink d6/d9/dc/d98/d3e/lc8 0 2024-09-12T01:43:08.711 INFO:tasks.workunit.client.0.smithi066.stdout:8/330: mkdir d12/d21/d2f/d57/d3c/d49/d50/d56/d69 0 2024-09-12T01:43:08.711 INFO:tasks.workunit.client.0.smithi066.stdout:8/331: truncate d12/f5b 782691 0 2024-09-12T01:43:08.712 INFO:tasks.workunit.client.1.smithi153.stdout:9/658: mknod d3/d35/cc9 0 2024-09-12T01:43:08.712 INFO:tasks.workunit.client.1.smithi153.stdout:9/659: chown d3/d66/l82 15203195 1 2024-09-12T01:43:08.713 INFO:tasks.workunit.client.0.smithi066.stdout:9/350: mkdir d0/d6/d17/d4f/d12/d84 0 2024-09-12T01:43:08.713 INFO:tasks.workunit.client.1.smithi153.stdout:6/711: mknod d1/d6/da/d19/d3a/db0/ce4 0 2024-09-12T01:43:08.713 INFO:tasks.workunit.client.1.smithi153.stdout:6/712: fsync d1/d80/fbf 0 2024-09-12T01:43:08.714 INFO:tasks.workunit.client.0.smithi066.stdout:5/274: rmdir d0/d26/d2d/d31 39 2024-09-12T01:43:08.714 INFO:tasks.workunit.client.1.smithi153.stdout:5/689: creat d0/d20/dc0/fdc x:0 0 0 2024-09-12T01:43:08.715 INFO:tasks.workunit.client.0.smithi066.stdout:1/285: rename d5/dc/dd to d5/dc/d36/d4b 0 2024-09-12T01:43:08.715 INFO:tasks.workunit.client.0.smithi066.stdout:1/286: fsync d5/dc/f1f 0 2024-09-12T01:43:08.716 INFO:tasks.workunit.client.0.smithi066.stdout:6/416: dread d2/fa [0,4194304] 0 2024-09-12T01:43:08.716 INFO:tasks.workunit.client.0.smithi066.stdout:1/287: write d5/dc/d36/d4b/f48 [1175543,92919] 0 2024-09-12T01:43:08.716 INFO:tasks.workunit.client.0.smithi066.stdout:1/288: write f1 [8496552,62079] 0 2024-09-12T01:43:08.716 INFO:tasks.workunit.client.0.smithi066.stdout:1/289: chown f4 0 1 2024-09-12T01:43:08.717 INFO:tasks.workunit.client.1.smithi153.stdout:4/574: rename d6/d9/d20/f8f to d6/d9/fc9 0 2024-09-12T01:43:08.718 INFO:tasks.workunit.client.0.smithi066.stdout:8/332: mknod d12/c6a 0 2024-09-12T01:43:08.718 INFO:tasks.workunit.client.0.smithi066.stdout:8/333: fsync d12/f1b 0 2024-09-12T01:43:08.719 INFO:tasks.workunit.client.1.smithi153.stdout:6/713: creat d1/d6/d39/dc4/fe5 x:0 0 0 2024-09-12T01:43:08.720 INFO:tasks.workunit.client.0.smithi066.stdout:9/351: rename d0/d6/d17/d1b/d4c/d4b/d7d/d83 to d0/d6/d37/d85 0 2024-09-12T01:43:08.721 INFO:tasks.workunit.client.0.smithi066.stdout:9/352: chown d0/d6/d7f 78186 1 2024-09-12T01:43:08.721 INFO:tasks.workunit.client.0.smithi066.stdout:9/353: chown d0/d6/d17/d1b/d4c/d42/c7c 0 1 2024-09-12T01:43:08.721 INFO:tasks.workunit.client.1.smithi153.stdout:4/575: rename d6/d6a/d9c/ca3 to d6/da4/cca 0 2024-09-12T01:43:08.722 INFO:tasks.workunit.client.1.smithi153.stdout:6/714: truncate d1/d6/d39/dc4/fc8 4325097 0 2024-09-12T01:43:08.724 INFO:tasks.workunit.client.0.smithi066.stdout:1/290: mknod d5/dc/d36/d4b/d1c/c4c 0 2024-09-12T01:43:08.726 INFO:tasks.workunit.client.1.smithi153.stdout:4/576: mkdir d6/d6a/dcb 0 2024-09-12T01:43:08.726 INFO:tasks.workunit.client.1.smithi153.stdout:4/577: fdatasync d6/d9/dc/d98/d3e/d66/fb9 0 2024-09-12T01:43:08.727 INFO:tasks.workunit.client.1.smithi153.stdout:3/715: dwrite d1/d45/f51 [8388608,4194304] 0 2024-09-12T01:43:08.727 INFO:tasks.workunit.client.0.smithi066.stdout:8/334: creat d12/d21/d2f/d53/f6b x:0 0 0 2024-09-12T01:43:08.727 INFO:tasks.workunit.client.0.smithi066.stdout:8/335: fsync d12/d21/f61 0 2024-09-12T01:43:08.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/715: symlink d1/d6/da/d19/d94/le6 0 2024-09-12T01:43:08.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/716: dread - d1/d6/d23/d98/d53/da0/fe1 zero size 2024-09-12T01:43:08.728 INFO:tasks.workunit.client.1.smithi153.stdout:9/660: write d3/d3a/d42/d72/dc3/fc7 [3828792,46011] 0 2024-09-12T01:43:08.728 INFO:tasks.workunit.client.1.smithi153.stdout:9/661: chown d3/f5 20 1 2024-09-12T01:43:08.728 INFO:tasks.workunit.client.1.smithi153.stdout:9/662: write d3/d55/f59 [324929,25329] 0 2024-09-12T01:43:08.730 INFO:tasks.workunit.client.0.smithi066.stdout:7/260: dwrite d2/d5/d56/f58 [0,4194304] 0 2024-09-12T01:43:08.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/275: dread d0/d26/f34 [0,4194304] 0 2024-09-12T01:43:08.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/276: chown d0/d21 3680 1 2024-09-12T01:43:08.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/277: stat d0/d26/f2e 0 2024-09-12T01:43:08.731 INFO:tasks.workunit.client.1.smithi153.stdout:2/639: dwrite d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:08.731 INFO:tasks.workunit.client.1.smithi153.stdout:4/578: symlink d6/d9/d20/lcc 0 2024-09-12T01:43:08.731 INFO:tasks.workunit.client.1.smithi153.stdout:2/640: read - d7/db/d36/f84 zero size 2024-09-12T01:43:08.732 INFO:tasks.workunit.client.1.smithi153.stdout:1/714: dwrite d2/d9/d17/d2f/d56/fe3 [0,4194304] 0 2024-09-12T01:43:08.732 INFO:tasks.workunit.client.1.smithi153.stdout:1/715: creat d2/d9/d17/d2f/d56/d71/fe4 x:0 0 0 2024-09-12T01:43:08.736 INFO:tasks.workunit.client.0.smithi066.stdout:8/336: rename fb to d12/d21/d2f/d57/d3c/f6c 0 2024-09-12T01:43:08.736 INFO:tasks.workunit.client.0.smithi066.stdout:3/365: dwrite d5/d6/d1b/f62 [0,4194304] 0 2024-09-12T01:43:08.736 INFO:tasks.workunit.client.0.smithi066.stdout:2/311: dwrite fd [0,4194304] 0 2024-09-12T01:43:08.738 INFO:tasks.workunit.client.1.smithi153.stdout:4/579: dread d6/da4/fa5 [0,4194304] 0 2024-09-12T01:43:08.742 INFO:tasks.workunit.client.0.smithi066.stdout:4/291: dwrite d4/d6/f30 [4194304,4194304] 0 2024-09-12T01:43:08.744 INFO:tasks.workunit.client.0.smithi066.stdout:6/417: dwrite d2/d31/f69 [0,4194304] 0 2024-09-12T01:43:08.755 INFO:tasks.workunit.client.1.smithi153.stdout:3/716: getdents d1/d64 0 2024-09-12T01:43:08.755 INFO:tasks.workunit.client.0.smithi066.stdout:5/278: mkdir d0/d26/d2d/d33/d55 0 2024-09-12T01:43:08.755 INFO:tasks.workunit.client.0.smithi066.stdout:5/279: truncate d0/f4 5120839 0 2024-09-12T01:43:08.757 INFO:tasks.workunit.client.1.smithi153.stdout:7/608: sync 2024-09-12T01:43:08.758 INFO:tasks.workunit.client.1.smithi153.stdout:6/717: dwrite d1/f38 [4194304,4194304] 0 2024-09-12T01:43:08.758 INFO:tasks.workunit.client.1.smithi153.stdout:6/718: chown d1/d6/d39/dc4/fe5 36 1 2024-09-12T01:43:08.759 INFO:tasks.workunit.client.1.smithi153.stdout:9/663: symlink d3/d3a/lca 0 2024-09-12T01:43:08.759 INFO:tasks.workunit.client.0.smithi066.stdout:1/291: mkdir d5/d15/d4d 0 2024-09-12T01:43:08.761 INFO:tasks.workunit.client.0.smithi066.stdout:8/337: link d12/d21/d2f/f34 d12/d21/d2f/d57/d3c/f6d 0 2024-09-12T01:43:08.762 INFO:tasks.workunit.client.1.smithi153.stdout:2/641: dwrite d7/db/d36/f84 [0,4194304] 0 2024-09-12T01:43:08.762 INFO:tasks.workunit.client.1.smithi153.stdout:2/642: read d7/db/d27/f31 [674449,69530] 0 2024-09-12T01:43:08.762 INFO:tasks.workunit.client.1.smithi153.stdout:2/643: write d7/db/d6c/d76/f96 [339286,79423] 0 2024-09-12T01:43:08.767 INFO:tasks.workunit.client.0.smithi066.stdout:9/354: rmdir d0/d6/d17/d4f/d12 39 2024-09-12T01:43:08.767 INFO:tasks.workunit.client.1.smithi153.stdout:1/716: getdents d2/d9/d1d 0 2024-09-12T01:43:08.767 INFO:tasks.workunit.client.0.smithi066.stdout:6/418: write d2/d21/f30 [3417649,24833] 0 2024-09-12T01:43:08.768 INFO:tasks.workunit.client.1.smithi153.stdout:7/609: dread d12/d21/d4d/f5d [8388608,4194304] 0 2024-09-12T01:43:08.771 INFO:tasks.workunit.client.1.smithi153.stdout:4/580: unlink d6/d9/dc/d31/d76/d99/fba 0 2024-09-12T01:43:08.772 INFO:tasks.workunit.client.0.smithi066.stdout:2/312: creat de/f66 x:0 0 0 2024-09-12T01:43:08.777 INFO:tasks.workunit.client.0.smithi066.stdout:7/261: dread d2/d20/d2f/f34 [0,4194304] 0 2024-09-12T01:43:08.777 INFO:tasks.workunit.client.0.smithi066.stdout:7/262: dread - d2/d20/d25/f48 zero size 2024-09-12T01:43:08.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.777+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f554410eec0 con 0x7f5534038a70 2024-09-12T01:43:08.778 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:08 smithi066 ceph-mon[27875]: Checking for cert/key for grafana.smithi066 2024-09-12T01:43:08.778 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:08 smithi066 ceph-mon[27875]: Migrating grafana.smithi066 cert to cert store 2024-09-12T01:43:08.778 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:08 smithi066 ceph-mon[27875]: Migrating grafana.smithi066 key to cert store 2024-09-12T01:43:08.779 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:08 smithi066 ceph-mon[27875]: mgrmap e22: smithi153.jpnqza(active, since 1.02603s) 2024-09-12T01:43:08.781 INFO:tasks.workunit.client.0.smithi066.stdout:4/292: dwrite d4/d6/d27/d2f/f54 [0,4194304] 0 2024-09-12T01:43:08.782 INFO:tasks.workunit.client.1.smithi153.stdout:0/771: dwrite f6 [0,4194304] 0 2024-09-12T01:43:08.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.783+0000 7f55417fa640 1 -- 172.21.15.66:0/2918401960 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f554410eec0 con 0x7f5534038a70 2024-09-12T01:43:08.783 INFO:tasks.workunit.client.1.smithi153.stdout:6/719: symlink d1/d6/d46/d73/le7 0 2024-09-12T01:43:08.785 INFO:tasks.workunit.client.1.smithi153.stdout:7/610: dread d12/d21/d29/d35/d37/f6c [0,4194304] 0 2024-09-12T01:43:08.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f5534038a70 msgr2=0x7f553403af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f5534038a70 0x7f553403af20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f554410ccb0 tx=0x7f553000b040 comp rx=0 tx=0).stop 2024-09-12T01:43:08.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 msgr2=0x7f554410cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.786 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 0x7f554410cf00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f55380048a0 tx=0x7f5538009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.786 INFO:tasks.workunit.client.1.smithi153.stdout:4/581: dread d6/d9/d11/f1c [4194304,4194304] 0 2024-09-12T01:43:08.787 INFO:tasks.workunit.client.1.smithi153.stdout:9/664: symlink d3/d5f/dc4/lcb 0 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 shutdown_connections 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f5534038a70 0x7f553403af20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55440ff4d0 0x7f554410d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 --2- 172.21.15.66:0/2918401960 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5544065af0 0x7f554410cf00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 >> 172.21.15.66:0/2918401960 conn(0x7f55440f6a40 msgr2=0x7f55440f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.786+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 shutdown_connections 2024-09-12T01:43:08.787 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.787+0000 7f55498e4640 1 -- 172.21.15.66:0/2918401960 wait complete. 2024-09-12T01:43:08.790 INFO:tasks.workunit.client.1.smithi153.stdout:1/717: dwrite d2/d9/f1a [0,4194304] 0 2024-09-12T01:43:08.790 INFO:tasks.workunit.client.1.smithi153.stdout:1/718: chown d2/d9/d17/d2f/d56/d71/ca4 55470 1 2024-09-12T01:43:08.796 INFO:tasks.workunit.client.1.smithi153.stdout:4/582: dread d6/d9/dc/d31/f34 [0,4194304] 0 2024-09-12T01:43:08.796 INFO:tasks.workunit.client.1.smithi153.stdout:0/772: write d22/f3c [2041218,43559] 0 2024-09-12T01:43:08.801 INFO:tasks.workunit.client.1.smithi153.stdout:3/717: truncate d1/d1e/f2f 887014 0 2024-09-12T01:43:08.801 INFO:tasks.workunit.client.1.smithi153.stdout:3/718: truncate d1/d1e/f2a 1933966 0 2024-09-12T01:43:08.803 INFO:tasks.workunit.client.1.smithi153.stdout:7/611: dread d12/d21/d29/d35/d37/f91 [0,4194304] 0 2024-09-12T01:43:08.803 INFO:tasks.workunit.client.1.smithi153.stdout:7/612: truncate d12/d21/d29/d35/d37/d58/f63 4835127 0 2024-09-12T01:43:08.807 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:43:08.809 INFO:tasks.workunit.client.1.smithi153.stdout:0/773: dread d22/d30/d4c/d6e/d7f/d98/fd5 [0,4194304] 0 2024-09-12T01:43:08.811 INFO:tasks.workunit.client.1.smithi153.stdout:6/720: link d1/d6/d23/d98/d53/d8d/fa9 d1/d6/d23/d98/d53/da0/fe8 0 2024-09-12T01:43:08.815 INFO:tasks.workunit.client.1.smithi153.stdout:6/721: dread d1/d6/da/f37 [0,4194304] 0 2024-09-12T01:43:08.815 INFO:tasks.workunit.client.1.smithi153.stdout:6/722: stat d1/d6/d46/d73/d8a/d84/d96/fdc 0 2024-09-12T01:43:08.818 INFO:tasks.workunit.client.1.smithi153.stdout:1/719: creat d2/d9/fe5 x:0 0 0 2024-09-12T01:43:08.818 INFO:tasks.workunit.client.1.smithi153.stdout:1/720: creat d2/d9/d17/d2f/d56/fe6 x:0 0 0 2024-09-12T01:43:08.818 INFO:tasks.workunit.client.1.smithi153.stdout:4/583: dwrite d6/d15/db4/fc0 [0,4194304] 0 2024-09-12T01:43:08.819 INFO:tasks.workunit.client.1.smithi153.stdout:7/613: dread d12/d21/d4d/f7d [0,4194304] 0 2024-09-12T01:43:08.820 INFO:tasks.workunit.client.1.smithi153.stdout:7/614: read d12/f26 [3503015,4945] 0 2024-09-12T01:43:08.822 INFO:tasks.workunit.client.1.smithi153.stdout:9/665: dwrite d3/d35/f3f [0,4194304] 0 2024-09-12T01:43:08.823 INFO:tasks.workunit.client.1.smithi153.stdout:9/666: dread - d3/d3a/d42/d72/d98/d9a/da0/fc1 zero size 2024-09-12T01:43:08.823 INFO:tasks.workunit.client.0.smithi066.stdout:5/280: symlink d0/d26/d2d/d33/d55/l56 0 2024-09-12T01:43:08.825 INFO:tasks.workunit.client.1.smithi153.stdout:3/719: mknod d1/d13/d23/ccd 0 2024-09-12T01:43:08.827 INFO:tasks.workunit.client.1.smithi153.stdout:6/723: symlink d1/d6/d46/le9 0 2024-09-12T01:43:08.829 INFO:tasks.workunit.client.0.smithi066.stdout:8/338: mknod d12/d21/d2f/d57/d43/c6e 0 2024-09-12T01:43:08.829 INFO:tasks.workunit.client.0.smithi066.stdout:8/339: dread - d12/d21/d2f/d57/d3c/d49/d50/d56/f59 zero size 2024-09-12T01:43:08.829 INFO:tasks.workunit.client.0.smithi066.stdout:8/340: chown d12/d21/d2f/d53/f6b 1 1 2024-09-12T01:43:08.831 INFO:tasks.workunit.client.0.smithi066.stdout:9/355: rmdir d0/d6/d17/d4f/d12 39 2024-09-12T01:43:08.833 INFO:tasks.workunit.client.0.smithi066.stdout:6/419: creat d2/db/d12/d1d/d6b/f89 x:0 0 0 2024-09-12T01:43:08.833 INFO:tasks.workunit.client.0.smithi066.stdout:6/420: fdatasync d2/db/f2d 0 2024-09-12T01:43:08.835 INFO:tasks.workunit.client.0.smithi066.stdout:7/263: mknod d2/d20/c5a 0 2024-09-12T01:43:08.836 INFO:tasks.workunit.client.1.smithi153.stdout:0/774: dwrite d22/d79/d8e/dae/ffd [0,4194304] 0 2024-09-12T01:43:08.836 INFO:tasks.workunit.client.1.smithi153.stdout:0/775: chown d22/d30/d4c/d6f/ce5 1472217 1 2024-09-12T01:43:08.836 INFO:tasks.workunit.client.1.smithi153.stdout:4/584: truncate d6/d9/dc/d98/f7e 3144603 0 2024-09-12T01:43:08.840 INFO:tasks.workunit.client.1.smithi153.stdout:7/615: rmdir d12/d21/d29 39 2024-09-12T01:43:08.840 INFO:tasks.workunit.client.1.smithi153.stdout:7/616: creat d12/d21/d29/d35/d37/d4c/d5c/fbe x:0 0 0 2024-09-12T01:43:08.840 INFO:tasks.workunit.client.1.smithi153.stdout:7/617: creat d12/d7e/db2/fbf x:0 0 0 2024-09-12T01:43:08.840 INFO:tasks.workunit.client.1.smithi153.stdout:7/618: chown d12/d21/d29/d35/d37/f97 27 1 2024-09-12T01:43:08.840 INFO:tasks.workunit.client.1.smithi153.stdout:7/619: chown d12/d21/f44 725 1 2024-09-12T01:43:08.840 INFO:tasks.workunit.client.1.smithi153.stdout:1/721: dwrite d2/d9/d17/d2c/f85 [0,4194304] 0 2024-09-12T01:43:08.841 INFO:tasks.workunit.client.0.smithi066.stdout:0/336: sync 2024-09-12T01:43:08.842 INFO:tasks.workunit.client.0.smithi066.stdout:5/281: dread d0/dd/fe [0,4194304] 0 2024-09-12T01:43:08.844 INFO:tasks.workunit.client.0.smithi066.stdout:0/337: write d1/d72/de/f3c [87006,53599] 0 2024-09-12T01:43:08.844 INFO:tasks.workunit.client.0.smithi066.stdout:4/293: creat d4/d15/d33/f5d x:0 0 0 2024-09-12T01:43:08.844 INFO:tasks.workunit.client.0.smithi066.stdout:4/294: chown d4/d15/c2a 77727 1 2024-09-12T01:43:08.845 INFO:tasks.workunit.client.0.smithi066.stdout:0/338: write d1/d72/de/d47/d4a/d67/d20/f30 [1362824,37928] 0 2024-09-12T01:43:08.845 INFO:tasks.workunit.client.0.smithi066.stdout:4/295: readlink d4/d6/d8/lf 0 2024-09-12T01:43:08.845 INFO:tasks.workunit.client.0.smithi066.stdout:4/296: chown d4/f46 573906 1 2024-09-12T01:43:08.850 INFO:tasks.workunit.client.1.smithi153.stdout:1/722: dread d2/d9/d17/d2f/f31 [0,4194304] 0 2024-09-12T01:43:08.852 INFO:tasks.workunit.client.1.smithi153.stdout:9/667: rmdir d3 39 2024-09-12T01:43:08.853 INFO:tasks.workunit.client.0.smithi066.stdout:0/339: write d1/d72/de/d46/f58 [181771,116266] 0 2024-09-12T01:43:08.854 INFO:tasks.workunit.client.1.smithi153.stdout:3/720: getdents d1/d13/d25 0 2024-09-12T01:43:08.854 INFO:tasks.workunit.client.0.smithi066.stdout:1/292: rmdir d5 39 2024-09-12T01:43:08.856 INFO:tasks.workunit.client.1.smithi153.stdout:6/724: creat d1/df/fea x:0 0 0 2024-09-12T01:43:08.856 INFO:tasks.workunit.client.1.smithi153.stdout:6/725: chown d1/d6/d46/d73/d8a/d84/d96 16212 1 2024-09-12T01:43:08.856 INFO:tasks.workunit.client.1.smithi153.stdout:6/726: write d1/df/d9d/fe3 [495723,66767] 0 2024-09-12T01:43:08.858 INFO:tasks.workunit.client.0.smithi066.stdout:8/341: mkdir d12/d21/d2f/d57/d3c/d49/d6f 0 2024-09-12T01:43:08.862 INFO:tasks.workunit.client.0.smithi066.stdout:9/356: mkdir d0/d6/d17/d1b/d4c/d4b/d86 0 2024-09-12T01:43:08.862 INFO:tasks.workunit.client.0.smithi066.stdout:9/357: write d0/d6/d17/d4f/d9/fa [2242556,93967] 0 2024-09-12T01:43:08.863 INFO:tasks.workunit.client.0.smithi066.stdout:7/264: creat d2/d5/da/d3f/d52/f5b x:0 0 0 2024-09-12T01:43:08.863 INFO:tasks.workunit.client.0.smithi066.stdout:7/265: chown d2/d5/da/d3f/d52/f5b 0 1 2024-09-12T01:43:08.864 INFO:tasks.workunit.client.0.smithi066.stdout:7/266: read - d2/d5/da/d3f/f57 zero size 2024-09-12T01:43:08.867 INFO:tasks.workunit.client.0.smithi066.stdout:5/282: symlink d0/dd/l57 0 2024-09-12T01:43:08.869 INFO:tasks.workunit.client.1.smithi153.stdout:8/633: sync 2024-09-12T01:43:08.870 INFO:tasks.workunit.client.1.smithi153.stdout:8/634: chown d17/d1d/fbd 50 1 2024-09-12T01:43:08.870 INFO:tasks.workunit.client.0.smithi066.stdout:8/342: dread d12/d21/d2f/d57/f36 [0,4194304] 0 2024-09-12T01:43:08.870 INFO:tasks.workunit.client.1.smithi153.stdout:0/776: link d22/l66 d22/d79/d8e/dc6/dd6/l107 0 2024-09-12T01:43:08.871 INFO:tasks.workunit.client.0.smithi066.stdout:4/297: mkdir d4/d15/d33/d5e 0 2024-09-12T01:43:08.873 INFO:tasks.workunit.client.1.smithi153.stdout:4/585: rename d6/l73 to d6/d9/dc/d98/d3e/lcd 0 2024-09-12T01:43:08.875 INFO:tasks.workunit.client.0.smithi066.stdout:1/293: link d5/c22 d5/d15/d4d/c4e 0 2024-09-12T01:43:08.878 INFO:tasks.workunit.client.0.smithi066.stdout:7/267: unlink d2/d5/da/f19 0 2024-09-12T01:43:08.878 INFO:tasks.workunit.client.0.smithi066.stdout:7/268: write d2/d20/d1d/f3b [1029017,29205] 0 2024-09-12T01:43:08.880 INFO:tasks.workunit.client.0.smithi066.stdout:5/283: creat d0/d26/d2f/f58 x:0 0 0 2024-09-12T01:43:08.882 INFO:tasks.workunit.client.0.smithi066.stdout:9/358: dread d0/d6/d17/f71 [0,4194304] 0 2024-09-12T01:43:08.882 INFO:tasks.workunit.client.0.smithi066.stdout:9/359: stat d0/d6/d17/d1b/f1c 0 2024-09-12T01:43:08.882 INFO:tasks.workunit.client.0.smithi066.stdout:8/343: rename d12/d21/d2f/f54 to d12/f70 0 2024-09-12T01:43:08.885 INFO:tasks.workunit.client.0.smithi066.stdout:4/298: dread d4/f17 [0,4194304] 0 2024-09-12T01:43:08.885 INFO:tasks.workunit.client.0.smithi066.stdout:1/294: unlink d5/dc/d36/f44 0 2024-09-12T01:43:08.885 INFO:tasks.workunit.client.1.smithi153.stdout:3/721: dwrite d1/d1e/f2a [0,4194304] 0 2024-09-12T01:43:08.887 INFO:tasks.workunit.client.0.smithi066.stdout:5/284: symlink d0/d26/l59 0 2024-09-12T01:43:08.887 INFO:tasks.workunit.client.0.smithi066.stdout:5/285: fsync d0/d21/d27/f28 0 2024-09-12T01:43:08.888 INFO:tasks.workunit.client.0.smithi066.stdout:5/286: write d0/f2 [494868,118697] 0 2024-09-12T01:43:08.888 INFO:tasks.workunit.client.1.smithi153.stdout:9/668: dwrite d3/d55/d30/d95/f83 [0,4194304] 0 2024-09-12T01:43:08.888 INFO:tasks.workunit.client.1.smithi153.stdout:0/777: write d22/f83 [3722443,10097] 0 2024-09-12T01:43:08.888 INFO:tasks.workunit.client.1.smithi153.stdout:9/669: write d3/d55/f57 [3921740,28999] 0 2024-09-12T01:43:08.889 INFO:tasks.workunit.client.1.smithi153.stdout:9/670: dread - d3/d5f/f76 zero size 2024-09-12T01:43:08.889 INFO:tasks.workunit.client.0.smithi066.stdout:0/340: dwrite d1/d72/de/d47/f6b [0,4194304] 0 2024-09-12T01:43:08.889 INFO:tasks.workunit.client.0.smithi066.stdout:0/341: chown d1/d72/de/d47/d4a/d67/d1b/d26/d5b 7 1 2024-09-12T01:43:08.889 INFO:tasks.workunit.client.0.smithi066.stdout:0/342: readlink d1/d72/de/d47/d4a/d67/d3e/l3f 0 2024-09-12T01:43:08.890 INFO:tasks.workunit.client.0.smithi066.stdout:9/360: creat d0/d6/d17/d4f/d12/f87 x:0 0 0 2024-09-12T01:43:08.891 INFO:tasks.workunit.client.0.smithi066.stdout:1/295: mkdir d5/dc/d4f 0 2024-09-12T01:43:08.891 INFO:tasks.workunit.client.0.smithi066.stdout:1/296: chown d5/dc/d36/d4b/l13 6 1 2024-09-12T01:43:08.892 INFO:tasks.workunit.client.1.smithi153.stdout:7/620: dwrite d12/d21/d29/d35/fb7 [0,4194304] 0 2024-09-12T01:43:08.892 INFO:tasks.workunit.client.1.smithi153.stdout:1/723: creat d2/d9/d17/fe7 x:0 0 0 2024-09-12T01:43:08.892 INFO:tasks.workunit.client.1.smithi153.stdout:8/635: dread d17/d21/d56/f84 [0,4194304] 0 2024-09-12T01:43:08.893 INFO:tasks.workunit.client.0.smithi066.stdout:4/299: dread d4/d6/d8/f13 [0,4194304] 0 2024-09-12T01:43:08.894 INFO:tasks.workunit.client.0.smithi066.stdout:8/344: dread d12/d21/d2f/d57/d43/d66/f68 [0,4194304] 0 2024-09-12T01:43:08.895 INFO:tasks.workunit.client.0.smithi066.stdout:5/287: creat d0/dd/d18/f5a x:0 0 0 2024-09-12T01:43:08.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:08 smithi153 ceph-mon[34713]: Checking for cert/key for grafana.smithi066 2024-09-12T01:43:08.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:08 smithi153 ceph-mon[34713]: Migrating grafana.smithi066 cert to cert store 2024-09-12T01:43:08.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:08 smithi153 ceph-mon[34713]: Migrating grafana.smithi066 key to cert store 2024-09-12T01:43:08.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:08 smithi153 ceph-mon[34713]: mgrmap e22: smithi153.jpnqza(active, since 1.02603s) 2024-09-12T01:43:08.905 INFO:tasks.workunit.client.0.smithi066.stdout:7/269: dwrite d2/d5/f39 [0,4194304] 0 2024-09-12T01:43:08.906 INFO:tasks.workunit.client.1.smithi153.stdout:6/727: rename d1/d6/d46/f82 to d1/d6/d23/d98/d4f/feb 0 2024-09-12T01:43:08.907 INFO:tasks.workunit.client.0.smithi066.stdout:0/343: creat d1/d72/de/d47/d4a/d65/f76 x:0 0 0 2024-09-12T01:43:08.907 INFO:tasks.workunit.client.0.smithi066.stdout:0/344: dread - d1/d72/de/d47/d4a/d65/f71 zero size 2024-09-12T01:43:08.909 INFO:tasks.workunit.client.1.smithi153.stdout:4/586: mkdir d6/d9/d11/d13/dce 0 2024-09-12T01:43:08.909 INFO:tasks.workunit.client.1.smithi153.stdout:4/587: chown d6/d9/dc/d31 232688 1 2024-09-12T01:43:08.910 INFO:tasks.workunit.client.1.smithi153.stdout:2/644: sync 2024-09-12T01:43:08.910 INFO:tasks.workunit.client.1.smithi153.stdout:5/690: sync 2024-09-12T01:43:08.910 INFO:tasks.workunit.client.1.smithi153.stdout:2/645: fdatasync d7/db/d1d/f35 0 2024-09-12T01:43:08.910 INFO:tasks.workunit.client.1.smithi153.stdout:2/646: stat d7/db/d27/f7d 0 2024-09-12T01:43:08.912 INFO:tasks.workunit.client.1.smithi153.stdout:4/588: write d6/d9/fc9 [562397,74082] 0 2024-09-12T01:43:08.912 INFO:tasks.workunit.client.1.smithi153.stdout:4/589: readlink d6/d9/d11/lb1 0 2024-09-12T01:43:08.912 INFO:tasks.workunit.client.0.smithi066.stdout:9/361: symlink d0/d6/d7f/l88 0 2024-09-12T01:43:08.916 INFO:tasks.workunit.client.0.smithi066.stdout:1/297: link d5/dc/d36/d4b/f48 d5/dc/d36/d4b/f50 0 2024-09-12T01:43:08.919 INFO:tasks.workunit.client.0.smithi066.stdout:4/300: mkdir d4/d5f 0 2024-09-12T01:43:08.921 INFO:tasks.workunit.client.1.smithi153.stdout:3/722: symlink d1/d13/d25/d26/d4b/d97/lce 0 2024-09-12T01:43:08.922 INFO:tasks.workunit.client.0.smithi066.stdout:4/301: dread d4/f37 [0,4194304] 0 2024-09-12T01:43:08.922 INFO:tasks.workunit.client.0.smithi066.stdout:8/345: truncate d12/d21/d2f/d57/d43/f46 3533542 0 2024-09-12T01:43:08.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/346: write d12/d21/d2f/f45 [4533164,96448] 0 2024-09-12T01:43:08.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/347: fdatasync d12/d21/d2f/f34 0 2024-09-12T01:43:08.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/348: chown d12/f47 641 1 2024-09-12T01:43:08.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/349: read - d12/d21/d2f/f63 zero size 2024-09-12T01:43:08.923 INFO:tasks.workunit.client.0.smithi066.stdout:8/350: dread - d12/d21/d2f/f62 zero size 2024-09-12T01:43:08.924 INFO:tasks.workunit.client.1.smithi153.stdout:0/778: truncate d22/d79/d8e/dc6/dd6/ff3 425633 0 2024-09-12T01:43:08.925 INFO:tasks.workunit.client.0.smithi066.stdout:7/270: creat d2/d5/d6/d22/f5c x:0 0 0 2024-09-12T01:43:08.925 INFO:tasks.workunit.client.0.smithi066.stdout:7/271: stat d2/d3c 0 2024-09-12T01:43:08.926 INFO:tasks.workunit.client.0.smithi066.stdout:0/345: rename d1/d72/de/f3a to d1/d72/de/d47/d4a/d67/d1b/d26/f77 0 2024-09-12T01:43:08.927 INFO:tasks.workunit.client.1.smithi153.stdout:7/621: mkdir d12/d21/d4d/dae/dc0 0 2024-09-12T01:43:08.927 INFO:tasks.workunit.client.1.smithi153.stdout:7/622: read d12/d21/f6b [1680575,96481] 0 2024-09-12T01:43:08.928 INFO:tasks.workunit.client.0.smithi066.stdout:9/362: mkdir d0/d6/d37/d85/d89 0 2024-09-12T01:43:08.928 INFO:tasks.workunit.client.0.smithi066.stdout:9/363: write d0/d6/d17/d4f/f81 [977932,57220] 0 2024-09-12T01:43:08.928 INFO:tasks.workunit.client.1.smithi153.stdout:1/724: symlink d2/d9/d17/d2f/d56/d83/le8 0 2024-09-12T01:43:08.929 INFO:tasks.workunit.client.1.smithi153.stdout:1/725: write d2/d9/d17/fe7 [547697,27987] 0 2024-09-12T01:43:08.929 INFO:tasks.workunit.client.1.smithi153.stdout:6/728: write d1/d6/f44 [5013741,85961] 0 2024-09-12T01:43:08.929 INFO:tasks.workunit.client.1.smithi153.stdout:6/729: read - d1/d6/d39/dc4/fe5 zero size 2024-09-12T01:43:08.929 INFO:tasks.workunit.client.0.smithi066.stdout:1/298: symlink d5/dc/l51 0 2024-09-12T01:43:08.929 INFO:tasks.workunit.client.0.smithi066.stdout:1/299: stat c2 0 2024-09-12T01:43:08.929 INFO:tasks.workunit.client.0.smithi066.stdout:1/300: write d5/fa [3546733,70748] 0 2024-09-12T01:43:08.930 INFO:tasks.workunit.client.1.smithi153.stdout:5/691: mkdir d0/d43/d8d/d8e/dd7/ddd 0 2024-09-12T01:43:08.930 INFO:tasks.workunit.client.0.smithi066.stdout:4/302: mknod d4/d6/d8/d4a/c60 0 2024-09-12T01:43:08.933 INFO:tasks.workunit.client.1.smithi153.stdout:4/590: mkdir d6/d9/d11/d90/dcf 0 2024-09-12T01:43:08.933 INFO:tasks.workunit.client.0.smithi066.stdout:8/351: mknod d12/c71 0 2024-09-12T01:43:08.933 INFO:tasks.workunit.client.0.smithi066.stdout:8/352: fdatasync d12/d21/d2f/d57/d3c/f6d 0 2024-09-12T01:43:08.933 INFO:tasks.workunit.client.0.smithi066.stdout:8/353: stat d12/d21/c2d 0 2024-09-12T01:43:08.933 INFO:tasks.workunit.client.0.smithi066.stdout:8/354: fsync d12/f5f 0 2024-09-12T01:43:08.933 INFO:tasks.workunit.client.0.smithi066.stdout:8/355: chown d12/c37 1 1 2024-09-12T01:43:08.935 INFO:tasks.workunit.client.0.smithi066.stdout:5/288: dwrite d0/dd/fe [4194304,4194304] 0 2024-09-12T01:43:08.936 INFO:tasks.workunit.client.0.smithi066.stdout:5/289: write d0/dd/d18/f5a [962970,47166] 0 2024-09-12T01:43:08.936 INFO:tasks.workunit.client.0.smithi066.stdout:5/290: write d0/d26/f2e [1322444,111696] 0 2024-09-12T01:43:08.936 INFO:tasks.workunit.client.1.smithi153.stdout:0/779: unlink d22/c31 0 2024-09-12T01:43:08.936 INFO:tasks.workunit.client.1.smithi153.stdout:0/780: readlink d22/d79/la7 0 2024-09-12T01:43:08.936 INFO:tasks.workunit.client.1.smithi153.stdout:0/781: write d22/d30/d4c/d6e/f8f [857913,130950] 0 2024-09-12T01:43:08.937 INFO:tasks.workunit.client.0.smithi066.stdout:0/346: mknod d1/d72/de/d47/d4a/d67/d6e/c78 0 2024-09-12T01:43:08.938 INFO:tasks.workunit.client.1.smithi153.stdout:8/636: dwrite d17/d21/faf [0,4194304] 0 2024-09-12T01:43:08.938 INFO:tasks.workunit.client.1.smithi153.stdout:9/671: dwrite d3/f13 [4194304,4194304] 0 2024-09-12T01:43:08.939 INFO:tasks.workunit.client.1.smithi153.stdout:7/623: truncate d12/d21/d29/d2d/f55 461934 0 2024-09-12T01:43:08.939 INFO:tasks.workunit.client.0.smithi066.stdout:9/364: unlink d0/d6/d17/d1b/l3b 0 2024-09-12T01:43:08.945 INFO:tasks.workunit.client.0.smithi066.stdout:5/291: dread d0/dd/d18/f3d [0,4194304] 0 2024-09-12T01:43:08.946 INFO:tasks.workunit.client.1.smithi153.stdout:1/726: creat d2/d68/d6b/d9e/dc7/fe9 x:0 0 0 2024-09-12T01:43:08.946 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.945+0000 7fe6b9ffb640 1 -- 172.21.15.66:0/15830552 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b40328f0 con 0x7fe6bc0fc520 2024-09-12T01:43:08.946 INFO:tasks.workunit.client.0.smithi066.stdout:4/303: mkdir d4/d15/d61 0 2024-09-12T01:43:08.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.946+0000 7fe6c1711640 1 -- 172.21.15.66:0/15830552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fc520 msgr2=0x7fe6bc0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.946+0000 7fe6c1711640 1 --2- 172.21.15.66:0/15830552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fc520 0x7fe6bc0fc930 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4009c50 tx=0x7fe6b4004d10 comp rx=0 tx=0).stop 2024-09-12T01:43:08.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.947+0000 7fe6c1711640 1 -- 172.21.15.66:0/15830552 shutdown_connections 2024-09-12T01:43:08.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.947+0000 7fe6c1711640 1 --2- 172.21.15.66:0/15830552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.947+0000 7fe6c1711640 1 --2- 172.21.15.66:0/15830552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fc520 0x7fe6bc0fc930 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.947+0000 7fe6c1711640 1 -- 172.21.15.66:0/15830552 >> 172.21.15.66:0/15830552 conn(0x7fe6bc0f7ce0 msgr2=0x7fe6bc0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:08.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.948+0000 7fe6c1711640 1 -- 172.21.15.66:0/15830552 shutdown_connections 2024-09-12T01:43:08.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.948+0000 7fe6c1711640 1 -- 172.21.15.66:0/15830552 wait complete. 2024-09-12T01:43:08.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/272: write d2/d5/f1a [2544310,84805] 0 2024-09-12T01:43:08.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/273: write d2/d20/d2f/f34 [1479789,93759] 0 2024-09-12T01:43:08.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/274: fdatasync d2/d5/d6/f2a 0 2024-09-12T01:43:08.950 INFO:tasks.workunit.client.1.smithi153.stdout:5/692: rename d0/d15/f6f to d0/d43/dac/fde 0 2024-09-12T01:43:08.950 INFO:tasks.workunit.client.1.smithi153.stdout:5/693: fdatasync d0/d20/f26 0 2024-09-12T01:43:08.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.949+0000 7fe6c1711640 1 Processor -- start 2024-09-12T01:43:08.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.950+0000 7fe6c1711640 1 -- start start 2024-09-12T01:43:08.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.950+0000 7fe6c1711640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6bc0fc520 0x7fe6bc10ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.950+0000 7fe6c1711640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc10b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.950+0000 7fe6c1711640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc10b980 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.950+0000 7fe6c1711640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc10c240 con 0x7fe6bc0fc520 2024-09-12T01:43:08.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.951+0000 7fe6ba7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc10b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.951+0000 7fe6ba7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc10b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58532/0 (socket says 172.21.15.66:58532) 2024-09-12T01:43:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.951+0000 7fe6ba7fc640 1 -- 172.21.15.66:0/3412093628 learned_addr learned my addr 172.21.15.66:0/3412093628 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.951+0000 7fe6ba7fc640 1 -- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6bc0fc520 msgr2=0x7fe6bc10ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:43:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.951+0000 7fe6ba7fc640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6bc0fc520 0x7fe6bc10ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.951+0000 7fe6ba7fc640 1 -- 172.21.15.66:0/3412093628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40098b0 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.952+0000 7fe6ba7fc640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc10b380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000eb70 tx=0x7fe6b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.954 INFO:tasks.workunit.client.0.smithi066.stdout:0/347: write d1/d62/d6c/f74 [2057473,50839] 0 2024-09-12T01:43:08.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.952+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b0007c30 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.952+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6b000f040 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.952+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b0009510 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.953+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc10c4c0 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.955 INFO:tasks.workunit.client.0.smithi066.stdout:1/301: dwrite d5/dc/d36/d4b/f50 [0,4194304] 0 2024-09-12T01:43:08.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.953+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6bc10ca60 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.957 INFO:tasks.workunit.client.1.smithi153.stdout:2/647: dwrite d7/d4d/d7b/f90 [0,4194304] 0 2024-09-12T01:43:08.957 INFO:tasks.workunit.client.1.smithi153.stdout:4/591: creat d6/da4/fd0 x:0 0 0 2024-09-12T01:43:08.957 INFO:tasks.workunit.client.1.smithi153.stdout:4/592: getdents d6/d9/dc/d98/d3e/d66 0 2024-09-12T01:43:08.958 INFO:tasks.workunit.client.1.smithi153.stdout:8/637: dread d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:08.960 INFO:tasks.workunit.client.0.smithi066.stdout:9/365: dread d0/d6/d37/f55 [0,4194304] 0 2024-09-12T01:43:08.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.957+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a8005240 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.957+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 23) v1 ==== 46241+0+0 (secure 0 0 0) 0x7fe6b000cbd0 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.957+0000 7fe6a37fe640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fe6a4038e80 0x7fe6a403b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.958+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fe6b004c800 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.961 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.960+0000 7fe6baffd640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fe6a4038e80 0x7fe6a403b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.963 INFO:tasks.workunit.client.1.smithi153.stdout:3/723: getdents d1/d16 0 2024-09-12T01:43:08.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.963+0000 7fe6baffd640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fe6a4038e80 0x7fe6a403b330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4004a30 tx=0x7fe6b4004d10 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.969 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:08.969+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe6b0012750 con 0x7fe6bc0fd7f0 2024-09-12T01:43:08.976 INFO:tasks.workunit.client.1.smithi153.stdout:9/672: getdents d3/d5f/dc4 0 2024-09-12T01:43:08.978 INFO:tasks.workunit.client.0.smithi066.stdout:4/304: dwrite d4/d6/d8/f32 [0,4194304] 0 2024-09-12T01:43:08.981 INFO:tasks.workunit.client.0.smithi066.stdout:5/292: dwrite d0/dd/d18/f53 [0,4194304] 0 2024-09-12T01:43:08.982 INFO:tasks.workunit.client.0.smithi066.stdout:0/348: write d1/d72/de/d47/d4a/d67/d1b/d26/f77 [1811524,44362] 0 2024-09-12T01:43:08.989 INFO:tasks.workunit.client.1.smithi153.stdout:4/593: dwrite d6/d15/db4/fc0 [0,4194304] 0 2024-09-12T01:43:08.991 INFO:tasks.workunit.client.1.smithi153.stdout:2/648: dwrite d7/d4d/d70/f88 [0,4194304] 0 2024-09-12T01:43:08.992 INFO:tasks.workunit.client.1.smithi153.stdout:2/649: write d7/d19/d40/f82 [715555,75868] 0 2024-09-12T01:43:08.992 INFO:tasks.workunit.client.1.smithi153.stdout:1/727: stat d2/d9/d1d/d82/ce2 0 2024-09-12T01:43:08.992 INFO:tasks.workunit.client.1.smithi153.stdout:5/694: truncate d0/df/d83/f7f 651642 0 2024-09-12T01:43:08.992 INFO:tasks.workunit.client.1.smithi153.stdout:1/728: fsync d2/d9/d58/d74/fbf 0 2024-09-12T01:43:08.997 INFO:tasks.workunit.client.1.smithi153.stdout:5/695: dread d0/d20/fa1 [0,4194304] 0 2024-09-12T01:43:08.997 INFO:tasks.workunit.client.1.smithi153.stdout:5/696: dread - d0/df/d83/d36/fa8 zero size 2024-09-12T01:43:08.998 INFO:tasks.workunit.client.1.smithi153.stdout:8/638: symlink d17/d1f/d4f/d42/d79/ld0 0 2024-09-12T01:43:09.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/302: mkdir d5/d52 0 2024-09-12T01:43:09.004 INFO:tasks.workunit.client.0.smithi066.stdout:1/303: dread d5/dc/f1f [0,4194304] 0 2024-09-12T01:43:09.006 INFO:tasks.workunit.client.0.smithi066.stdout:8/356: rmdir d12/d21 39 2024-09-12T01:43:09.007 INFO:tasks.workunit.client.1.smithi153.stdout:3/724: mknod d1/ccf 0 2024-09-12T01:43:09.007 INFO:tasks.workunit.client.1.smithi153.stdout:3/725: creat d1/d64/db0/fd0 x:0 0 0 2024-09-12T01:43:09.007 INFO:tasks.workunit.client.1.smithi153.stdout:3/726: read - d1/d1e/fbc zero size 2024-09-12T01:43:09.011 INFO:tasks.workunit.client.0.smithi066.stdout:9/366: dwrite d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:09.011 INFO:tasks.workunit.client.0.smithi066.stdout:9/367: readlink d0/d6/d37/l65 0 2024-09-12T01:43:09.012 INFO:tasks.workunit.client.1.smithi153.stdout:0/782: getdents d22 0 2024-09-12T01:43:09.015 INFO:tasks.workunit.client.1.smithi153.stdout:4/594: dwrite d6/d9/d11/f1e [0,4194304] 0 2024-09-12T01:43:09.015 INFO:tasks.workunit.client.1.smithi153.stdout:4/595: fdatasync d6/fe 0 2024-09-12T01:43:09.015 INFO:tasks.workunit.client.1.smithi153.stdout:9/673: symlink d3/d3a/d42/d72/lcc 0 2024-09-12T01:43:09.015 INFO:tasks.workunit.client.1.smithi153.stdout:9/674: truncate d3/d3a/f60 413674 0 2024-09-12T01:43:09.015 INFO:tasks.workunit.client.1.smithi153.stdout:9/675: readlink d3/d3a/d42/l56 0 2024-09-12T01:43:09.015 INFO:tasks.workunit.client.1.smithi153.stdout:9/676: write d3/d3a/d42/fa2 [324682,96768] 0 2024-09-12T01:43:09.019 INFO:tasks.workunit.client.0.smithi066.stdout:4/305: dwrite d4/f17 [0,4194304] 0 2024-09-12T01:43:09.019 INFO:tasks.workunit.client.0.smithi066.stdout:4/306: write d4/f37 [792539,80396] 0 2024-09-12T01:43:09.019 INFO:tasks.workunit.client.1.smithi153.stdout:7/624: rmdir d12/d21/d29/d35/d95 39 2024-09-12T01:43:09.022 INFO:tasks.workunit.client.0.smithi066.stdout:5/293: creat d0/d26/d2d/d33/f5b x:0 0 0 2024-09-12T01:43:09.031 INFO:tasks.workunit.client.0.smithi066.stdout:0/349: link d1/d72/c34 d1/d72/de/d47/d4a/d67/d1b/d61/c79 0 2024-09-12T01:43:09.031 INFO:tasks.workunit.client.0.smithi066.stdout:0/350: fdatasync d1/f4d 0 2024-09-12T01:43:09.032 INFO:tasks.workunit.client.1.smithi153.stdout:2/650: rename d7/d4d/d70/d81 to d7/db/d6c/d76/db8/dcf 0 2024-09-12T01:43:09.032 INFO:tasks.workunit.client.1.smithi153.stdout:2/651: stat d7/d4d/d7b/f90 0 2024-09-12T01:43:09.032 INFO:tasks.workunit.client.0.smithi066.stdout:1/304: rename d5/dc/d36/d4b/d1c to d5/dc/d53 0 2024-09-12T01:43:09.032 INFO:tasks.workunit.client.0.smithi066.stdout:0/351: dread d1/d72/de/d47/d4a/d67/f52 [0,4194304] 0 2024-09-12T01:43:09.037 INFO:tasks.workunit.client.1.smithi153.stdout:8/639: creat d17/d1f/d4f/d42/fd1 x:0 0 0 2024-09-12T01:43:09.037 INFO:tasks.workunit.client.1.smithi153.stdout:8/640: readlink d17/d21/d56/d95/dbc/lcb 0 2024-09-12T01:43:09.037 INFO:tasks.workunit.client.1.smithi153.stdout:8/641: fdatasync d17/f1b 0 2024-09-12T01:43:09.039 INFO:tasks.workunit.client.0.smithi066.stdout:1/305: dread d5/dc/f1f [0,4194304] 0 2024-09-12T01:43:09.039 INFO:tasks.workunit.client.1.smithi153.stdout:4/596: rmdir d6/d9/d20 39 2024-09-12T01:43:09.043 INFO:tasks.workunit.client.1.smithi153.stdout:9/677: unlink d3/d3a/d42/d72/lcc 0 2024-09-12T01:43:09.045 INFO:tasks.workunit.client.1.smithi153.stdout:8/642: stat d17/d21/d56/d96/d6c/c9f 0 2024-09-12T01:43:09.046 INFO:tasks.workunit.client.0.smithi066.stdout:1/306: unlink d5/dc/d53/l41 0 2024-09-12T01:43:09.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/368: truncate d0/d6/d17/d4f/d9/fa 1464244 0 2024-09-12T01:43:09.047 INFO:tasks.workunit.client.0.smithi066.stdout:9/369: chown d0/d6/d17/d1b/d4c/d42/f5d 990352 1 2024-09-12T01:43:09.048 INFO:tasks.workunit.client.1.smithi153.stdout:1/729: dwrite d2/d9/d1d/d25/f35 [0,4194304] 0 2024-09-12T01:43:09.048 INFO:tasks.workunit.client.0.smithi066.stdout:5/294: getdents d0/d26/d2d 0 2024-09-12T01:43:09.049 INFO:tasks.workunit.client.0.smithi066.stdout:1/307: symlink d5/d15/d4d/l54 0 2024-09-12T01:43:09.050 INFO:tasks.workunit.client.0.smithi066.stdout:9/370: mknod d0/d6/d17/d4f/d12/d46/d68/c8a 0 2024-09-12T01:43:09.050 INFO:tasks.workunit.client.0.smithi066.stdout:9/371: chown d0/d6/d17/d1b/d4c/d42/f5e 1887970842 1 2024-09-12T01:43:09.050 INFO:tasks.workunit.client.0.smithi066.stdout:9/372: creat d0/d6/d43/f8b x:0 0 0 2024-09-12T01:43:09.051 INFO:tasks.workunit.client.1.smithi153.stdout:9/678: dread d3/d66/f6f [0,4194304] 0 2024-09-12T01:43:09.052 INFO:tasks.workunit.client.1.smithi153.stdout:1/730: creat d2/d34/d3d/d80/fea x:0 0 0 2024-09-12T01:43:09.053 INFO:tasks.workunit.client.1.smithi153.stdout:2/652: write d7/d4d/d7b/f90 [1272783,121321] 0 2024-09-12T01:43:09.053 INFO:tasks.workunit.client.0.smithi066.stdout:5/295: rename d0/d26/d2d/d33/f5b to d0/dd/d18/d36/f5c 0 2024-09-12T01:43:09.055 INFO:tasks.workunit.client.0.smithi066.stdout:9/373: symlink d0/d6/d17/d1b/d4c/d4b/d7d/l8c 0 2024-09-12T01:43:09.056 INFO:tasks.workunit.client.1.smithi153.stdout:9/679: read d3/f5 [4730324,51920] 0 2024-09-12T01:43:09.057 INFO:tasks.workunit.client.1.smithi153.stdout:1/731: read d2/d68/d6b/d9e/fd6 [351674,111368] 0 2024-09-12T01:43:09.058 INFO:tasks.workunit.client.1.smithi153.stdout:2/653: creat d7/db/fd0 x:0 0 0 2024-09-12T01:43:09.058 INFO:tasks.workunit.client.0.smithi066.stdout:5/296: symlink d0/dd/l5d 0 2024-09-12T01:43:09.059 INFO:tasks.workunit.client.0.smithi066.stdout:9/374: symlink d0/d6/d17/d4f/d12/d84/l8d 0 2024-09-12T01:43:09.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/308: rename d5/dc/d53/l26 to d5/d15/l55 0 2024-09-12T01:43:09.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/309: read d5/dc/f40 [1883610,92816] 0 2024-09-12T01:43:09.060 INFO:tasks.workunit.client.0.smithi066.stdout:5/297: creat d0/d26/d2d/d33/d55/f5e x:0 0 0 2024-09-12T01:43:09.061 INFO:tasks.workunit.client.1.smithi153.stdout:1/732: mknod d2/d9/d17/d2f/d56/d71/db8/ceb 0 2024-09-12T01:43:09.061 INFO:tasks.workunit.client.0.smithi066.stdout:5/298: write d0/d21/d27/f3a [1000514,33633] 0 2024-09-12T01:43:09.063 INFO:tasks.workunit.client.1.smithi153.stdout:2/654: rename d7/cbc to d7/d4d/d70/cd1 0 2024-09-12T01:43:09.063 INFO:tasks.workunit.client.0.smithi066.stdout:5/299: write d0/dd/d18/f3d [68694,72926] 0 2024-09-12T01:43:09.064 INFO:tasks.workunit.client.1.smithi153.stdout:1/733: creat d2/d9/d17/d69/fec x:0 0 0 2024-09-12T01:43:09.064 INFO:tasks.workunit.client.1.smithi153.stdout:1/734: write d2/d9/fe5 [451359,26626] 0 2024-09-12T01:43:09.066 INFO:tasks.workunit.client.0.smithi066.stdout:1/310: rename d5/dc/d36/d4b/f48 to d5/d15/f56 0 2024-09-12T01:43:09.067 INFO:tasks.workunit.client.0.smithi066.stdout:5/300: symlink d0/d21/l5f 0 2024-09-12T01:43:09.067 INFO:tasks.workunit.client.1.smithi153.stdout:2/655: rename d7/db/d6c/d76/db8/dcf/lcd to d7/db/d27/d56/ld2 0 2024-09-12T01:43:09.067 INFO:tasks.workunit.client.1.smithi153.stdout:4/597: write d6/d9/d20/f87 [3456622,24715] 0 2024-09-12T01:43:09.068 INFO:tasks.workunit.client.0.smithi066.stdout:1/311: unlink d5/c22 0 2024-09-12T01:43:09.068 INFO:tasks.workunit.client.0.smithi066.stdout:1/312: stat d5/dc 0 2024-09-12T01:43:09.069 INFO:tasks.workunit.client.0.smithi066.stdout:5/301: mknod d0/c60 0 2024-09-12T01:43:09.069 INFO:tasks.workunit.client.1.smithi153.stdout:4/598: write d6/d9/dc/d98/f88 [235821,47861] 0 2024-09-12T01:43:09.071 INFO:tasks.workunit.client.1.smithi153.stdout:1/735: rename d2/d9/d1d/l8e to d2/d9/d17/d69/led 0 2024-09-12T01:43:09.071 INFO:tasks.workunit.client.0.smithi066.stdout:5/302: stat d0/d26/d2f/d30/l48 0 2024-09-12T01:43:09.073 INFO:tasks.workunit.client.1.smithi153.stdout:2/656: mkdir d7/db/d62/dbb/dd3 0 2024-09-12T01:43:09.074 INFO:tasks.workunit.client.0.smithi066.stdout:9/375: dread d0/d6/d17/d1b/d4c/d42/f5a [0,4194304] 0 2024-09-12T01:43:09.075 INFO:tasks.workunit.client.0.smithi066.stdout:9/376: getdents d0/d6/d17/d1b/d4c/d4b 0 2024-09-12T01:43:09.076 INFO:tasks.workunit.client.0.smithi066.stdout:9/377: creat d0/d6/f8e x:0 0 0 2024-09-12T01:43:09.076 INFO:tasks.workunit.client.0.smithi066.stdout:9/378: fdatasync d0/d6/d17/d1b/d4c/f2b 0 2024-09-12T01:43:09.076 INFO:tasks.workunit.client.1.smithi153.stdout:2/657: dread d7/db/d27/f31 [0,4194304] 0 2024-09-12T01:43:09.079 INFO:tasks.workunit.client.0.smithi066.stdout:8/357: dwrite d12/d21/d2f/f62 [0,4194304] 0 2024-09-12T01:43:09.079 INFO:tasks.workunit.client.1.smithi153.stdout:2/658: rename d7/db/c32 to d7/db/d36/cd4 0 2024-09-12T01:43:09.079 INFO:tasks.workunit.client.1.smithi153.stdout:2/659: stat d7/db/d27/lad 0 2024-09-12T01:43:09.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/680: write d3/d3a/d42/f48 [3951922,89440] 0 2024-09-12T01:43:09.079 INFO:tasks.workunit.client.1.smithi153.stdout:2/660: dread - d7/d19/d40/fac zero size 2024-09-12T01:43:09.080 INFO:tasks.workunit.client.1.smithi153.stdout:5/697: dwrite d0/d15/f25 [0,4194304] 0 2024-09-12T01:43:09.080 INFO:tasks.workunit.client.1.smithi153.stdout:5/698: fdatasync d0/df/db8/d2f/d55/d9c/d7b/fd2 0 2024-09-12T01:43:09.080 INFO:tasks.workunit.client.1.smithi153.stdout:0/783: dwrite d22/f39 [4194304,4194304] 0 2024-09-12T01:43:09.080 INFO:tasks.workunit.client.1.smithi153.stdout:0/784: write d22/d30/d4c/fad [902001,110981] 0 2024-09-12T01:43:09.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/681: truncate d3/d55/f1e 1069617 0 2024-09-12T01:43:09.082 INFO:tasks.workunit.client.1.smithi153.stdout:9/682: dread - d3/d66/fc0 zero size 2024-09-12T01:43:09.083 INFO:tasks.workunit.client.0.smithi066.stdout:4/307: dwrite d4/d6/f30 [0,4194304] 0 2024-09-12T01:43:09.084 INFO:tasks.workunit.client.1.smithi153.stdout:7/625: dwrite d12/d21/f44 [8388608,4194304] 0 2024-09-12T01:43:09.085 INFO:tasks.workunit.client.1.smithi153.stdout:8/643: dwrite d17/d1d/f94 [0,4194304] 0 2024-09-12T01:43:09.087 INFO:tasks.workunit.client.1.smithi153.stdout:5/699: rename d0/d43/d8d/l9e to d0/d43/d8d/d8e/dd7/ldf 0 2024-09-12T01:43:09.089 INFO:tasks.workunit.client.1.smithi153.stdout:3/727: dwrite d1/d13/d23/d47/d71/d8e/fca [0,4194304] 0 2024-09-12T01:43:09.092 INFO:tasks.workunit.client.0.smithi066.stdout:0/352: dwrite d1/d72/de/d47/d4a/d67/d1b/f33 [0,4194304] 0 2024-09-12T01:43:09.094 INFO:tasks.workunit.client.0.smithi066.stdout:1/313: rmdir d5/dc/d53 39 2024-09-12T01:43:09.095 INFO:tasks.workunit.client.0.smithi066.stdout:1/314: chown d5/dc/d53/l3d 66 1 2024-09-12T01:43:09.100 INFO:tasks.workunit.client.0.smithi066.stdout:3/366: sync 2024-09-12T01:43:09.100 INFO:tasks.workunit.client.0.smithi066.stdout:2/313: sync 2024-09-12T01:43:09.100 INFO:tasks.workunit.client.0.smithi066.stdout:2/314: fdatasync de/d13/d28/f56 0 2024-09-12T01:43:09.101 INFO:tasks.workunit.client.1.smithi153.stdout:0/785: write d22/d30/d4c/f55 [867266,16886] 0 2024-09-12T01:43:09.103 INFO:tasks.workunit.client.0.smithi066.stdout:9/379: read d0/d6/f50 [1733783,78692] 0 2024-09-12T01:43:09.103 INFO:tasks.workunit.client.1.smithi153.stdout:7/626: symlink d12/d21/d29/d35/lc1 0 2024-09-12T01:43:09.103 INFO:tasks.workunit.client.1.smithi153.stdout:7/627: write d12/f56 [961585,86846] 0 2024-09-12T01:43:09.109 INFO:tasks.workunit.client.0.smithi066.stdout:8/358: symlink d12/d21/d2f/d57/d3c/l72 0 2024-09-12T01:43:09.109 INFO:tasks.workunit.client.0.smithi066.stdout:4/308: getdents d4/d4f 0 2024-09-12T01:43:09.109 INFO:tasks.workunit.client.0.smithi066.stdout:0/353: mknod d1/d72/de/d47/d64/c7a 0 2024-09-12T01:43:09.110 INFO:tasks.workunit.client.1.smithi153.stdout:8/644: symlink d17/d21/d56/d99/ld2 0 2024-09-12T01:43:09.111 INFO:tasks.workunit.client.0.smithi066.stdout:9/380: mknod d0/d6/d17/d4f/d9/c8f 0 2024-09-12T01:43:09.112 INFO:tasks.workunit.client.0.smithi066.stdout:8/359: symlink d12/d21/d2f/d53/l73 0 2024-09-12T01:43:09.113 INFO:tasks.workunit.client.0.smithi066.stdout:0/354: getdents d1/d72/de/d47/d4a/d67/d20/d3d 0 2024-09-12T01:43:09.114 INFO:tasks.workunit.client.0.smithi066.stdout:0/355: stat d1/d62/d6c 0 2024-09-12T01:43:09.114 INFO:tasks.workunit.client.0.smithi066.stdout:0/356: chown d1/d72/de/d47/d4a/d67/f52 21 1 2024-09-12T01:43:09.115 INFO:tasks.workunit.client.0.smithi066.stdout:2/315: mknod de/c67 0 2024-09-12T01:43:09.115 INFO:tasks.workunit.client.1.smithi153.stdout:3/728: write d1/d64/f86 [1140512,63446] 0 2024-09-12T01:43:09.119 INFO:tasks.workunit.client.0.smithi066.stdout:5/303: dread d0/d21/d27/f3a [0,4194304] 0 2024-09-12T01:43:09.119 INFO:tasks.workunit.client.0.smithi066.stdout:2/316: symlink de/d13/d28/d3d/l68 0 2024-09-12T01:43:09.121 INFO:tasks.workunit.client.0.smithi066.stdout:2/317: creat de/d13/d1e/f69 x:0 0 0 2024-09-12T01:43:09.123 INFO:tasks.workunit.client.0.smithi066.stdout:2/318: truncate fd 444957 0 2024-09-12T01:43:09.126 INFO:tasks.workunit.client.1.smithi153.stdout:0/786: symlink d22/d30/d4c/d6f/dfa/l108 0 2024-09-12T01:43:09.126 INFO:tasks.workunit.client.1.smithi153.stdout:0/787: readlink d22/d79/la7 0 2024-09-12T01:43:09.129 INFO:tasks.workunit.client.1.smithi153.stdout:8/645: mkdir d17/d1f/d4f/d42/d79/dac/dd3 0 2024-09-12T01:43:09.129 INFO:tasks.workunit.client.1.smithi153.stdout:8/646: write d17/d1d/fbd [77164,35834] 0 2024-09-12T01:43:09.129 INFO:tasks.workunit.client.1.smithi153.stdout:3/729: mkdir d1/d13/d23/d47/d71/d8e/d93/dd1 0 2024-09-12T01:43:09.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/357: dread d1/d72/de/d47/d4a/d67/d20/f30 [0,4194304] 0 2024-09-12T01:43:09.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/358: readlink d1/d72/de/d47/d4a/d67/d1b/d26/l37 0 2024-09-12T01:43:09.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/359: dread - d1/d72/de/d47/d4a/d67/d3e/f75 zero size 2024-09-12T01:43:09.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/360: truncate d1/d72/de/d47/d4a/d65/f76 886155 0 2024-09-12T01:43:09.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/361: chown d1/c6 11 1 2024-09-12T01:43:09.130 INFO:tasks.workunit.client.1.smithi153.stdout:8/647: mkdir d17/d1f/d4f/d42/d79/dd4 0 2024-09-12T01:43:09.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/730: truncate d1/d13/d25/da6/f7e 2870335 0 2024-09-12T01:43:09.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/731: fsync d1/d64/db0/fc7 0 2024-09-12T01:43:09.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/732: creat d1/d64/db0/fd2 x:0 0 0 2024-09-12T01:43:09.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/733: stat d1/d16/d1c/f91 0 2024-09-12T01:43:09.133 INFO:tasks.workunit.client.0.smithi066.stdout:0/362: rmdir d1/d72 39 2024-09-12T01:43:09.133 INFO:tasks.workunit.client.0.smithi066.stdout:0/363: write d1/d72/de/d47/d4a/d67/d1b/d26/d5b/f73 [772822,62836] 0 2024-09-12T01:43:09.136 INFO:tasks.workunit.client.0.smithi066.stdout:0/364: creat d1/d72/de/f7b x:0 0 0 2024-09-12T01:43:09.138 INFO:tasks.workunit.client.1.smithi153.stdout:3/734: getdents d1/d13/d25/da6 0 2024-09-12T01:43:09.138 INFO:tasks.workunit.client.1.smithi153.stdout:4/599: dwrite d6/d9/dc/d98/f7e [0,4194304] 0 2024-09-12T01:43:09.139 INFO:tasks.workunit.client.0.smithi066.stdout:0/365: rmdir d1/d72/de/d47/d4a/d67/d3e 39 2024-09-12T01:43:09.139 INFO:tasks.workunit.client.0.smithi066.stdout:0/366: stat d1/d72/de/d47/d4a/d67/c18 0 2024-09-12T01:43:09.141 INFO:tasks.workunit.client.0.smithi066.stdout:0/367: mkdir d1/d72/de/d47/d7c 0 2024-09-12T01:43:09.141 INFO:tasks.workunit.client.1.smithi153.stdout:4/600: symlink d6/d9/dc/ld1 0 2024-09-12T01:43:09.141 INFO:tasks.workunit.client.1.smithi153.stdout:0/788: read d22/f5f [685802,127558] 0 2024-09-12T01:43:09.142 INFO:tasks.workunit.client.1.smithi153.stdout:4/601: mkdir d6/d9/dc/d31/d76/d99/dd2 0 2024-09-12T01:43:09.142 INFO:tasks.workunit.client.1.smithi153.stdout:4/602: creat d6/fd3 x:0 0 0 2024-09-12T01:43:09.142 INFO:tasks.workunit.client.0.smithi066.stdout:9/381: write d0/d6/d17/d4f/d12/f67 [2908702,95818] 0 2024-09-12T01:43:09.142 INFO:tasks.workunit.client.0.smithi066.stdout:9/382: write d0/f2 [1343623,191] 0 2024-09-12T01:43:09.142 INFO:tasks.workunit.client.0.smithi066.stdout:9/383: write d0/d6/d17/d28/f77 [419888,83042] 0 2024-09-12T01:43:09.143 INFO:tasks.workunit.client.0.smithi066.stdout:0/368: creat d1/d72/de/d47/d4a/d67/d1b/f7d x:0 0 0 2024-09-12T01:43:09.143 INFO:tasks.workunit.client.0.smithi066.stdout:3/367: dwrite d5/d6/d1b/d45/d66/f3b [0,4194304] 0 2024-09-12T01:43:09.144 INFO:tasks.workunit.client.1.smithi153.stdout:0/789: creat d22/d79/d8e/dae/db7/f109 x:0 0 0 2024-09-12T01:43:09.144 INFO:tasks.workunit.client.1.smithi153.stdout:0/790: fsync d22/d30/d4c/d6f/d88/fc3 0 2024-09-12T01:43:09.144 INFO:tasks.workunit.client.1.smithi153.stdout:0/791: chown d22/d30/d4c/d6e/d7f 194 1 2024-09-12T01:43:09.147 INFO:tasks.workunit.client.1.smithi153.stdout:4/603: mknod d6/d9/dc/d98/d3e/cd4 0 2024-09-12T01:43:09.147 INFO:tasks.workunit.client.1.smithi153.stdout:4/604: stat d6/d9/dc/d98/d3e/d66/l72 0 2024-09-12T01:43:09.147 INFO:tasks.workunit.client.1.smithi153.stdout:1/736: dwrite d2/d9/d17/d2f/d56/d71/fe4 [0,4194304] 0 2024-09-12T01:43:09.148 INFO:tasks.workunit.client.1.smithi153.stdout:5/700: dwrite d0/d15/f96 [0,4194304] 0 2024-09-12T01:43:09.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/792: rename d22/d79/d8e/dae/db7/de8/f106 to d22/d82/f10a 0 2024-09-12T01:43:09.149 INFO:tasks.workunit.client.0.smithi066.stdout:0/369: dread d1/d62/d6c/f5d [0,4194304] 0 2024-09-12T01:43:09.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/304: dread d0/dd/d18/f5a [0,4194304] 0 2024-09-12T01:43:09.153 INFO:tasks.workunit.client.1.smithi153.stdout:1/737: rename d2/d9/d17/f41 to d2/d9/d17/dab/fee 0 2024-09-12T01:43:09.154 INFO:tasks.workunit.client.0.smithi066.stdout:0/370: dread d1/d72/de/d47/d4a/d67/d20/f30 [0,4194304] 0 2024-09-12T01:43:09.154 INFO:tasks.workunit.client.0.smithi066.stdout:0/371: write d1/d62/d6c/f5d [1116131,28334] 0 2024-09-12T01:43:09.155 INFO:tasks.workunit.client.0.smithi066.stdout:5/305: creat d0/dd/d18/d36/d4c/f61 x:0 0 0 2024-09-12T01:43:09.155 INFO:tasks.workunit.client.0.smithi066.stdout:5/306: stat d0/dd/c4e 0 2024-09-12T01:43:09.157 INFO:tasks.workunit.client.0.smithi066.stdout:0/372: mkdir d1/d72/de/d47/d7e 0 2024-09-12T01:43:09.159 INFO:tasks.workunit.client.0.smithi066.stdout:1/315: dwrite d5/f2a [4194304,4194304] 0 2024-09-12T01:43:09.160 INFO:tasks.workunit.client.1.smithi153.stdout:7/628: dwrite d12/d7e/db2/fbf [0,4194304] 0 2024-09-12T01:43:09.160 INFO:tasks.workunit.client.1.smithi153.stdout:7/629: stat d12/d21/d4d/f5d 0 2024-09-12T01:43:09.160 INFO:tasks.workunit.client.1.smithi153.stdout:7/630: write d12/d21/d29/d35/fb6 [763871,60189] 0 2024-09-12T01:43:09.160 INFO:tasks.workunit.client.0.smithi066.stdout:5/307: mknod d0/dd/c62 0 2024-09-12T01:43:09.161 INFO:tasks.workunit.client.0.smithi066.stdout:5/308: write d0/d26/d2d/d33/d55/f5e [310988,72013] 0 2024-09-12T01:43:09.161 INFO:tasks.workunit.client.1.smithi153.stdout:9/683: dwrite d3/d3a/f5a [0,4194304] 0 2024-09-12T01:43:09.165 INFO:tasks.workunit.client.1.smithi153.stdout:4/605: dread d6/d9/d11/f1e [0,4194304] 0 2024-09-12T01:43:09.166 INFO:tasks.workunit.client.0.smithi066.stdout:2/319: dwrite de/d13/d1e/d25/f32 [0,4194304] 0 2024-09-12T01:43:09.166 INFO:tasks.workunit.client.0.smithi066.stdout:2/320: write de/d13/d28/d3a/f4d [4613890,35480] 0 2024-09-12T01:43:09.168 INFO:tasks.workunit.client.0.smithi066.stdout:1/316: mkdir d5/dc/d36/d57 0 2024-09-12T01:43:09.168 INFO:tasks.workunit.client.0.smithi066.stdout:1/317: getdents d5/dc/d36/d57 0 2024-09-12T01:43:09.168 INFO:tasks.workunit.client.0.smithi066.stdout:1/318: write d5/dc/f40 [2804917,45708] 0 2024-09-12T01:43:09.169 INFO:tasks.workunit.client.1.smithi153.stdout:1/738: write d2/d34/d3d/f59 [4001910,72684] 0 2024-09-12T01:43:09.169 INFO:tasks.workunit.client.1.smithi153.stdout:1/739: creat d2/d9/d17/fef x:0 0 0 2024-09-12T01:43:09.173 INFO:tasks.workunit.client.0.smithi066.stdout:9/384: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:09.173 INFO:tasks.workunit.client.0.smithi066.stdout:9/385: dread - d0/d6/d17/d4f/d12/f6b zero size 2024-09-12T01:43:09.174 INFO:tasks.workunit.client.0.smithi066.stdout:0/373: dread d1/d72/de/d47/d4a/d67/d1b/d26/f2e [0,4194304] 0 2024-09-12T01:43:09.174 INFO:tasks.workunit.client.1.smithi153.stdout:7/631: dread d12/f53 [0,4194304] 0 2024-09-12T01:43:09.176 INFO:tasks.workunit.client.0.smithi066.stdout:3/368: dwrite d5/d6/d1b/d45/d66/d67/f69 [0,4194304] 0 2024-09-12T01:43:09.177 INFO:tasks.workunit.client.1.smithi153.stdout:5/701: read d0/df/db8/d2f/d55/fd5 [266386,126161] 0 2024-09-12T01:43:09.177 INFO:tasks.workunit.client.1.smithi153.stdout:5/702: write d0/df/db8/f2b [139169,69115] 0 2024-09-12T01:43:09.178 INFO:tasks.workunit.client.0.smithi066.stdout:4/309: dwrite d4/f46 [0,4194304] 0 2024-09-12T01:43:09.181 INFO:tasks.workunit.client.1.smithi153.stdout:4/606: unlink d6/d15/l2d 0 2024-09-12T01:43:09.182 INFO:tasks.workunit.client.1.smithi153.stdout:0/793: dwrite d22/d30/d4c/d6f/d88/f89 [0,4194304] 0 2024-09-12T01:43:09.184 INFO:tasks.workunit.client.0.smithi066.stdout:2/321: creat de/d13/f6a x:0 0 0 2024-09-12T01:43:09.189 INFO:tasks.workunit.client.1.smithi153.stdout:1/740: symlink d2/d9/d17/dab/lf0 0 2024-09-12T01:43:09.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/741: write d2/d9/d17/d2f/d56/d71/f84 [46158,62106] 0 2024-09-12T01:43:09.190 INFO:tasks.workunit.client.1.smithi153.stdout:1/742: truncate d2/d9/d17/fef 889101 0 2024-09-12T01:43:09.190 INFO:tasks.workunit.client.0.smithi066.stdout:9/386: mkdir d0/d6/d7f/d90 0 2024-09-12T01:43:09.191 INFO:tasks.workunit.client.0.smithi066.stdout:9/387: fdatasync d0/d6/d17/d4f/d12/f6b 0 2024-09-12T01:43:09.191 INFO:tasks.workunit.client.0.smithi066.stdout:9/388: write d0/d6/d17/d4f/d12/f67 [2215675,39871] 0 2024-09-12T01:43:09.193 INFO:tasks.workunit.client.0.smithi066.stdout:5/309: dwrite d0/dd/d18/d36/d4c/f61 [0,4194304] 0 2024-09-12T01:43:09.193 INFO:tasks.workunit.client.1.smithi153.stdout:7/632: creat d12/d21/d29/d35/d37/d4c/fc2 x:0 0 0 2024-09-12T01:43:09.194 INFO:tasks.workunit.client.0.smithi066.stdout:0/374: creat d1/d72/de/d47/d4a/d67/d1b/d61/f7f x:0 0 0 2024-09-12T01:43:09.201 INFO:tasks.workunit.client.1.smithi153.stdout:4/607: rename d6/d9/dc/c23 to d6/d9/dc/d98/d3e/d66/cd5 0 2024-09-12T01:43:09.204 INFO:tasks.workunit.client.0.smithi066.stdout:1/319: mkdir d5/d15/d58 0 2024-09-12T01:43:09.205 INFO:tasks.workunit.client.1.smithi153.stdout:9/684: dwrite d3/d55/fc2 [0,4194304] 0 2024-09-12T01:43:09.205 INFO:tasks.workunit.client.1.smithi153.stdout:9/685: truncate d3/f49 4387691 0 2024-09-12T01:43:09.205 INFO:tasks.workunit.client.1.smithi153.stdout:9/686: chown d3/f2d 2885318 1 2024-09-12T01:43:09.206 INFO:tasks.workunit.client.0.smithi066.stdout:9/389: creat d0/d6/d17/d1b/d4c/d4b/d86/f91 x:0 0 0 2024-09-12T01:43:09.206 INFO:tasks.workunit.client.0.smithi066.stdout:9/390: readlink d0/d6/d17/d1b/d4c/d4b/d7d/l6c 0 2024-09-12T01:43:09.207 INFO:tasks.workunit.client.1.smithi153.stdout:1/743: symlink d2/d34/d3d/d80/lf1 0 2024-09-12T01:43:09.209 INFO:tasks.workunit.client.0.smithi066.stdout:4/310: dwrite d4/f16 [4194304,4194304] 0 2024-09-12T01:43:09.210 INFO:tasks.workunit.client.1.smithi153.stdout:7/633: symlink d12/d7e/lc3 0 2024-09-12T01:43:09.212 INFO:tasks.workunit.client.1.smithi153.stdout:9/687: dread d3/f4 [0,4194304] 0 2024-09-12T01:43:09.212 INFO:tasks.workunit.client.1.smithi153.stdout:0/794: dwrite d22/d79/dca/fee [0,4194304] 0 2024-09-12T01:43:09.213 INFO:tasks.workunit.client.0.smithi066.stdout:3/369: dwrite d5/d6/d1b/d28/f2b [4194304,4194304] 0 2024-09-12T01:43:09.216 INFO:tasks.workunit.client.0.smithi066.stdout:9/391: write d0/d6/f69 [4002138,18385] 0 2024-09-12T01:43:09.216 INFO:tasks.workunit.client.0.smithi066.stdout:9/392: dread - d0/d6/d43/f8b zero size 2024-09-12T01:43:09.223 INFO:tasks.workunit.client.1.smithi153.stdout:4/608: dwrite d6/d9/dc/d98/d3e/f61 [0,4194304] 0 2024-09-12T01:43:09.232 INFO:tasks.workunit.client.1.smithi153.stdout:6/730: sync 2024-09-12T01:43:09.244 INFO:tasks.workunit.client.0.smithi066.stdout:5/310: rename d0/d26/l59 to d0/dd/d18/d36/l63 0 2024-09-12T01:43:09.246 INFO:tasks.workunit.client.0.smithi066.stdout:2/322: rmdir de/d13/d1e/d22 39 2024-09-12T01:43:09.246 INFO:tasks.workunit.client.0.smithi066.stdout:2/323: readlink l3 0 2024-09-12T01:43:09.247 INFO:tasks.workunit.client.0.smithi066.stdout:1/320: creat d5/d15/d4d/f59 x:0 0 0 2024-09-12T01:43:09.248 INFO:tasks.workunit.client.1.smithi153.stdout:5/703: rmdir d0 39 2024-09-12T01:43:09.251 INFO:tasks.workunit.client.0.smithi066.stdout:4/311: rmdir d4/d4f/d58 39 2024-09-12T01:43:09.252 INFO:tasks.workunit.client.1.smithi153.stdout:3/735: dread d1/d13/d25/da6/f7e [0,4194304] 0 2024-09-12T01:43:09.253 INFO:tasks.workunit.client.1.smithi153.stdout:8/648: write d17/d1f/d4f/d34/f47 [2311062,18974] 0 2024-09-12T01:43:09.256 INFO:tasks.workunit.client.1.smithi153.stdout:1/744: creat d2/d34/d8a/da7/ff2 x:0 0 0 2024-09-12T01:43:09.256 INFO:tasks.workunit.client.0.smithi066.stdout:3/370: creat d5/d6/d1b/d45/d66/d67/d6d/f78 x:0 0 0 2024-09-12T01:43:09.256 INFO:tasks.workunit.client.0.smithi066.stdout:3/371: write d5/d6/d48/f71 [304453,84842] 0 2024-09-12T01:43:09.258 INFO:tasks.workunit.client.1.smithi153.stdout:7/634: unlink d12/d21/d5f/la8 0 2024-09-12T01:43:09.260 INFO:tasks.workunit.client.0.smithi066.stdout:9/393: getdents d0/d6/d17/d4f/d9/de 0 2024-09-12T01:43:09.260 INFO:tasks.workunit.client.0.smithi066.stdout:6/421: sync 2024-09-12T01:43:09.260 INFO:tasks.workunit.client.0.smithi066.stdout:6/422: write d2/f22 [5773717,40156] 0 2024-09-12T01:43:09.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/311: creat d0/dd/d18/f64 x:0 0 0 2024-09-12T01:43:09.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/312: dread - d0/dd/d18/d36/f5c zero size 2024-09-12T01:43:09.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/313: chown d0/l8 15592 1 2024-09-12T01:43:09.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/314: stat d0/l3 0 2024-09-12T01:43:09.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/375: rename d1/d72/de/d46 to d1/d72/de/d47/d4a/d67/d6e/d80 0 2024-09-12T01:43:09.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/376: creat d1/d72/de/d47/d4a/d67/d1b/d61/f81 x:0 0 0 2024-09-12T01:43:09.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/377: creat d1/d72/de/d47/d4a/d65/f82 x:0 0 0 2024-09-12T01:43:09.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/378: getdents d1/d72/de/d47/d4a/d67/d20/d3d 0 2024-09-12T01:43:09.268 INFO:tasks.workunit.client.1.smithi153.stdout:5/704: dwrite d0/df/db8/f86 [0,4194304] 0 2024-09-12T01:43:09.269 INFO:tasks.workunit.client.1.smithi153.stdout:1/745: write d2/d9/d17/d2f/fb6 [983074,107311] 0 2024-09-12T01:43:09.272 INFO:tasks.workunit.client.0.smithi066.stdout:4/312: mkdir d4/d6/d62 0 2024-09-12T01:43:09.272 INFO:tasks.workunit.client.0.smithi066.stdout:2/324: dread de/f15 [0,4194304] 0 2024-09-12T01:43:09.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/325: write de/d13/d1e/d22/f57 [805780,96255] 0 2024-09-12T01:43:09.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/326: readlink de/d13/d28/l5d 0 2024-09-12T01:43:09.276 INFO:tasks.workunit.client.0.smithi066.stdout:6/423: unlink d2/d31/l78 0 2024-09-12T01:43:09.276 INFO:tasks.workunit.client.0.smithi066.stdout:6/424: chown d2/db/d12/l2f 12407229 1 2024-09-12T01:43:09.276 INFO:tasks.workunit.client.0.smithi066.stdout:6/425: creat d2/d31/d5e/f8a x:0 0 0 2024-09-12T01:43:09.279 INFO:tasks.workunit.client.0.smithi066.stdout:1/321: rename d5/dc/d36/f39 to d5/dc/d53/f5a 0 2024-09-12T01:43:09.282 INFO:tasks.workunit.client.0.smithi066.stdout:9/394: dwrite d0/d6/d17/d4f/f81 [0,4194304] 0 2024-09-12T01:43:09.282 INFO:tasks.workunit.client.1.smithi153.stdout:4/609: link d6/d9/dc/d31/d76/d99/f6b d6/d15/db4/dbd/fd6 0 2024-09-12T01:43:09.285 INFO:tasks.workunit.client.0.smithi066.stdout:1/322: dread d5/dc/d53/f5a [0,4194304] 0 2024-09-12T01:43:09.285 INFO:tasks.workunit.client.1.smithi153.stdout:6/731: mknod d1/d6/d23/d98/d53/da4/ddf/cec 0 2024-09-12T01:43:09.289 INFO:tasks.workunit.client.0.smithi066.stdout:6/426: dread d2/db/f1c [0,4194304] 0 2024-09-12T01:43:09.289 INFO:tasks.workunit.client.0.smithi066.stdout:0/379: mkdir d1/d72/de/d47/d4a/d65/d83 0 2024-09-12T01:43:09.291 INFO:tasks.workunit.client.1.smithi153.stdout:3/736: link d1/d13/d25/f42 d1/d13/d23/d47/d71/d8e/fd3 0 2024-09-12T01:43:09.291 INFO:tasks.workunit.client.1.smithi153.stdout:0/795: write d22/d30/f47 [2528379,53790] 0 2024-09-12T01:43:09.292 INFO:tasks.workunit.client.0.smithi066.stdout:4/313: symlink d4/d6/d8/d18/l63 0 2024-09-12T01:43:09.293 INFO:tasks.workunit.client.0.smithi066.stdout:3/372: symlink d5/l79 0 2024-09-12T01:43:09.294 INFO:tasks.workunit.client.0.smithi066.stdout:3/373: creat d5/d6/d1b/d45/d66/d67/d6d/f7a x:0 0 0 2024-09-12T01:43:09.295 INFO:tasks.workunit.client.1.smithi153.stdout:7/635: mkdir d12/d21/d4d/dae/dc0/dc4 0 2024-09-12T01:43:09.300 INFO:tasks.workunit.client.0.smithi066.stdout:5/315: rename d0/d21/d27/f3a to d0/d26/d2f/d30/f65 0 2024-09-12T01:43:09.301 INFO:tasks.workunit.client.1.smithi153.stdout:5/705: rmdir d0 39 2024-09-12T01:43:09.304 INFO:tasks.workunit.client.1.smithi153.stdout:3/737: dread d1/f19 [4194304,4194304] 0 2024-09-12T01:43:09.307 INFO:tasks.workunit.client.1.smithi153.stdout:9/688: getdents d3/d55 0 2024-09-12T01:43:09.307 INFO:tasks.workunit.client.0.smithi066.stdout:9/395: mknod d0/d6/d17/c92 0 2024-09-12T01:43:09.308 INFO:tasks.workunit.client.1.smithi153.stdout:1/746: dwrite d2/d9/d1d/d25/f5f [0,4194304] 0 2024-09-12T01:43:09.308 INFO:tasks.workunit.client.1.smithi153.stdout:1/747: creat d2/d34/d8a/ff3 x:0 0 0 2024-09-12T01:43:09.312 INFO:tasks.workunit.client.0.smithi066.stdout:1/323: rmdir d5/dc/d36/d4b 39 2024-09-12T01:43:09.312 INFO:tasks.workunit.client.0.smithi066.stdout:6/427: truncate d2/d31/f69 3022272 0 2024-09-12T01:43:09.313 INFO:tasks.workunit.client.0.smithi066.stdout:6/428: chown d2/db/d72/d87 0 1 2024-09-12T01:43:09.314 INFO:tasks.workunit.client.0.smithi066.stdout:7/275: sync 2024-09-12T01:43:09.314 INFO:tasks.workunit.client.0.smithi066.stdout:7/276: readlink d2/d5/d6/d22/l29 0 2024-09-12T01:43:09.314 INFO:tasks.workunit.client.0.smithi066.stdout:7/277: fdatasync d2/d20/d1d/f4b 0 2024-09-12T01:43:09.314 INFO:tasks.workunit.client.1.smithi153.stdout:6/732: truncate d1/d6/d23/d98/d4f/feb 6228959 0 2024-09-12T01:43:09.315 INFO:tasks.workunit.client.1.smithi153.stdout:6/733: truncate d1/df/f30 5068556 0 2024-09-12T01:43:09.317 INFO:tasks.workunit.client.1.smithi153.stdout:0/796: link d22/c23 d22/d79/d8e/dc6/dd6/c10b 0 2024-09-12T01:43:09.320 INFO:tasks.workunit.client.1.smithi153.stdout:8/649: mknod d17/d1f/d4f/d34/cd5 0 2024-09-12T01:43:09.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/327: getdents de/d13/d1e 0 2024-09-12T01:43:09.323 INFO:tasks.workunit.client.0.smithi066.stdout:3/374: write d5/f17 [19779,113842] 0 2024-09-12T01:43:09.323 INFO:tasks.workunit.client.1.smithi153.stdout:5/706: truncate d0/d43/f6b 264024 0 2024-09-12T01:43:09.325 INFO:tasks.workunit.client.0.smithi066.stdout:9/396: unlink d0/d6/d37/l78 0 2024-09-12T01:43:09.325 INFO:tasks.workunit.client.0.smithi066.stdout:9/397: dread - d0/d6/d17/d1b/d4c/d42/f5e zero size 2024-09-12T01:43:09.325 INFO:tasks.workunit.client.0.smithi066.stdout:9/398: stat d0/d6/d17/d28/d79 0 2024-09-12T01:43:09.327 INFO:tasks.workunit.client.1.smithi153.stdout:3/738: creat d1/d13/d23/d47/fd4 x:0 0 0 2024-09-12T01:43:09.327 INFO:tasks.workunit.client.1.smithi153.stdout:3/739: creat d1/d16/d17/d82/d92/fd5 x:0 0 0 2024-09-12T01:43:09.328 INFO:tasks.workunit.client.0.smithi066.stdout:1/324: getdents d5/dc 0 2024-09-12T01:43:09.330 INFO:tasks.workunit.client.1.smithi153.stdout:9/689: rmdir d3/d3a/d42/d72/d98/d9a 39 2024-09-12T01:43:09.334 INFO:tasks.workunit.client.0.smithi066.stdout:4/314: dwrite d4/f46 [0,4194304] 0 2024-09-12T01:43:09.334 INFO:tasks.workunit.client.0.smithi066.stdout:6/429: mknod d2/db/d72/c8b 0 2024-09-12T01:43:09.334 INFO:tasks.workunit.client.1.smithi153.stdout:1/748: dwrite d2/d9/d17/d2f/d56/f79 [0,4194304] 0 2024-09-12T01:43:09.334 INFO:tasks.workunit.client.1.smithi153.stdout:7/636: dwrite d12/d21/d29/d35/d37/d58/f98 [0,4194304] 0 2024-09-12T01:43:09.335 INFO:tasks.workunit.client.0.smithi066.stdout:0/380: dread d1/d72/de/d47/d4a/d67/f1a [0,4194304] 0 2024-09-12T01:43:09.336 INFO:tasks.workunit.client.0.smithi066.stdout:6/430: dread d2/db/f58 [0,4194304] 0 2024-09-12T01:43:09.337 INFO:tasks.workunit.client.0.smithi066.stdout:5/316: dwrite d0/f4 [4194304,4194304] 0 2024-09-12T01:43:09.337 INFO:tasks.workunit.client.0.smithi066.stdout:5/317: fsync d0/f4 0 2024-09-12T01:43:09.337 INFO:tasks.workunit.client.0.smithi066.stdout:5/318: stat d0/dd/d18/d36/d4c/f61 0 2024-09-12T01:43:09.338 INFO:tasks.workunit.client.0.smithi066.stdout:7/278: symlink d2/d5/d6/l5d 0 2024-09-12T01:43:09.341 INFO:tasks.workunit.client.0.smithi066.stdout:2/328: write de/d13/f1f [3697666,35548] 0 2024-09-12T01:43:09.341 INFO:tasks.workunit.client.0.smithi066.stdout:2/329: fdatasync de/f21 0 2024-09-12T01:43:09.342 INFO:tasks.workunit.client.0.smithi066.stdout:3/375: mknod d5/d6/d1b/d45/d66/c7b 0 2024-09-12T01:43:09.342 INFO:tasks.workunit.client.0.smithi066.stdout:3/376: fdatasync d5/d6/d1b/d28/d4f/f51 0 2024-09-12T01:43:09.347 INFO:tasks.workunit.client.1.smithi153.stdout:7/637: dread d12/f26 [0,4194304] 0 2024-09-12T01:43:09.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/279: write d2/f2b [907471,94196] 0 2024-09-12T01:43:09.348 INFO:tasks.workunit.client.0.smithi066.stdout:3/377: dread d5/d6/d48/f71 [0,4194304] 0 2024-09-12T01:43:09.348 INFO:tasks.workunit.client.1.smithi153.stdout:6/734: creat d1/d6/d46/d73/d8a/d84/fed x:0 0 0 2024-09-12T01:43:09.349 INFO:tasks.workunit.client.1.smithi153.stdout:2/661: sync 2024-09-12T01:43:09.350 INFO:tasks.workunit.client.0.smithi066.stdout:1/325: creat d5/dc/f5b x:0 0 0 2024-09-12T01:43:09.351 INFO:tasks.workunit.client.1.smithi153.stdout:6/735: dread d1/d6/d39/f63 [0,4194304] 0 2024-09-12T01:43:09.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.352+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6a8000bf0 con 0x7fe6a4038e80 2024-09-12T01:43:09.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/797: link d22/d30/d4c/l5c d22/d30/d4c/d6e/d7f/l10c 0 2024-09-12T01:43:09.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/798: chown d22/d82/f10a 92 1 2024-09-12T01:43:09.356 INFO:tasks.workunit.client.1.smithi153.stdout:0/799: readlink d22/d30/d4c/l5c 0 2024-09-12T01:43:09.358 INFO:tasks.workunit.client.1.smithi153.stdout:8/650: unlink d17/d21/d56/d96/l5e 0 2024-09-12T01:43:09.362 INFO:tasks.workunit.client.1.smithi153.stdout:5/707: creat d0/df/db8/d88/fe0 x:0 0 0 2024-09-12T01:43:09.367 INFO:tasks.workunit.client.0.smithi066.stdout:4/315: dwrite d4/f46 [0,4194304] 0 2024-09-12T01:43:09.367 INFO:tasks.workunit.client.0.smithi066.stdout:4/316: write d4/f12 [3693169,128624] 0 2024-09-12T01:43:09.367 INFO:tasks.workunit.client.0.smithi066.stdout:3/378: dread d5/d6/d1b/f62 [0,4194304] 0 2024-09-12T01:43:09.368 INFO:tasks.workunit.client.1.smithi153.stdout:9/690: symlink d3/d55/d30/d95/d84/d8b/lcd 0 2024-09-12T01:43:09.368 INFO:tasks.workunit.client.1.smithi153.stdout:9/691: chown d3/d55/d30/d95 12409950 1 2024-09-12T01:43:09.369 INFO:tasks.workunit.client.0.smithi066.stdout:0/381: symlink d1/d72/de/d47/d4a/d67/d20/d3d/l84 0 2024-09-12T01:43:09.369 INFO:tasks.workunit.client.0.smithi066.stdout:0/382: creat d1/d72/de/d47/d4a/d65/f85 x:0 0 0 2024-09-12T01:43:09.371 INFO:tasks.workunit.client.0.smithi066.stdout:6/431: truncate d2/db/d12/f53 1798967 0 2024-09-12T01:43:09.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.373+0000 7fe6a37fe640 1 -- 172.21.15.66:0/3412093628 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe6a8000bf0 con 0x7fe6a4038e80 2024-09-12T01:43:09.377 INFO:tasks.workunit.client.0.smithi066.stdout:5/319: creat d0/d26/d2f/d30/f66 x:0 0 0 2024-09-12T01:43:09.378 INFO:tasks.workunit.client.0.smithi066.stdout:7/280: dwrite d2/d5/d56/f58 [0,4194304] 0 2024-09-12T01:43:09.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fe6a4038e80 msgr2=0x7fe6a403b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fe6a4038e80 0x7fe6a403b330 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe6b4004a30 tx=0x7fe6b4004d10 comp rx=0 tx=0).stop 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 msgr2=0x7fe6bc10b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc10b380 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000eb70 tx=0x7fe6b000b040 comp rx=0 tx=0).stop 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 shutdown_connections 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fe6a4038e80 0x7fe6a403b330 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0fd7f0 0x7fe6bc10b380 secure :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000eb70 tx=0x7fe6b000b040 comp rx=0 tx=0).stop 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 --2- 172.21.15.66:0/3412093628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6bc0fc520 0x7fe6bc10ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.378+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 >> 172.21.15.66:0/3412093628 conn(0x7fe6bc0f7ce0 msgr2=0x7fe6bc0f88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/326: dwrite d5/fa [0,4194304] 0 2024-09-12T01:43:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.380+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 shutdown_connections 2024-09-12T01:43:09.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.380+0000 7fe6c1711640 1 -- 172.21.15.66:0/3412093628 wait complete. 2024-09-12T01:43:09.380 INFO:tasks.workunit.client.1.smithi153.stdout:1/749: creat d2/d9/d17/d2f/ff4 x:0 0 0 2024-09-12T01:43:09.381 INFO:tasks.workunit.client.1.smithi153.stdout:1/750: dread d2/d9/d28/f9d [0,4194304] 0 2024-09-12T01:43:09.385 INFO:tasks.workunit.client.0.smithi066.stdout:2/330: write de/f12 [2108463,40842] 0 2024-09-12T01:43:09.387 INFO:tasks.workunit.client.1.smithi153.stdout:4/610: rename d6/d9/d26 to d6/d9/d11/d13/dce/dd7 0 2024-09-12T01:43:09.387 INFO:tasks.workunit.client.1.smithi153.stdout:4/611: dread - d6/d9/dc/d31/d7d/d94/f9e zero size 2024-09-12T01:43:09.388 INFO:tasks.workunit.client.0.smithi066.stdout:0/383: dwrite d1/d72/f14 [0,4194304] 0 2024-09-12T01:43:09.389 INFO:tasks.workunit.client.0.smithi066.stdout:9/399: getdents d0/d6/d17/d4f 0 2024-09-12T01:43:09.392 INFO:tasks.workunit.client.0.smithi066.stdout:5/320: write d0/d26/f34 [302864,130180] 0 2024-09-12T01:43:09.395 INFO:tasks.workunit.client.0.smithi066.stdout:4/317: mknod d4/d6/c64 0 2024-09-12T01:43:09.398 INFO:tasks.workunit.client.0.smithi066.stdout:3/379: creat d5/d6/d1b/d77/f7c x:0 0 0 2024-09-12T01:43:09.398 INFO:tasks.workunit.client.0.smithi066.stdout:3/380: read - d5/d6/d1b/d45/d66/f6c zero size 2024-09-12T01:43:09.400 INFO:tasks.workunit.client.1.smithi153.stdout:7/638: mknod d12/d4e/cc5 0 2024-09-12T01:43:09.400 INFO:tasks.workunit.client.1.smithi153.stdout:7/639: chown d12/d21/d5f/lb8 608502 1 2024-09-12T01:43:09.400 INFO:tasks.workunit.client.1.smithi153.stdout:7/640: write d12/d7e/f82 [3630,109078] 0 2024-09-12T01:43:09.402 INFO:tasks.workunit.client.1.smithi153.stdout:2/662: truncate d7/db/d27/f29 3877575 0 2024-09-12T01:43:09.402 INFO:tasks.workunit.client.1.smithi153.stdout:2/663: creat d7/db/d62/fd5 x:0 0 0 2024-09-12T01:43:09.403 INFO:tasks.workunit.client.0.smithi066.stdout:6/432: symlink d2/db/d7b/l8c 0 2024-09-12T01:43:09.403 INFO:tasks.workunit.client.0.smithi066.stdout:6/433: readlink d2/db/d7b/l8c 0 2024-09-12T01:43:09.405 INFO:tasks.workunit.client.1.smithi153.stdout:6/736: creat d1/d6/d23/fee x:0 0 0 2024-09-12T01:43:09.408 INFO:tasks.workunit.client.1.smithi153.stdout:0/800: link d22/f26 d22/d79/dca/f10d 0 2024-09-12T01:43:09.408 INFO:tasks.workunit.client.1.smithi153.stdout:0/801: getdents d22/d79/d8e/dc6/dd6/d100 0 2024-09-12T01:43:09.409 INFO:tasks.workunit.client.0.smithi066.stdout:9/400: dwrite d0/d6/d17/d4f/d9/fa [0,4194304] 0 2024-09-12T01:43:09.411 INFO:tasks.workunit.client.0.smithi066.stdout:7/281: mkdir d2/d5/da/d3f/d5e 0 2024-09-12T01:43:09.411 INFO:tasks.workunit.client.0.smithi066.stdout:7/282: write d2/d20/d25/f48 [139824,30481] 0 2024-09-12T01:43:09.413 INFO:tasks.workunit.client.0.smithi066.stdout:8/360: sync 2024-09-12T01:43:09.413 INFO:tasks.workunit.client.0.smithi066.stdout:8/361: fsync d12/f70 0 2024-09-12T01:43:09.413 INFO:tasks.workunit.client.0.smithi066.stdout:8/362: creat d12/f74 x:0 0 0 2024-09-12T01:43:09.414 INFO:tasks.workunit.client.1.smithi153.stdout:5/708: getdents d0/d43/d8d/d8e/dd7 0 2024-09-12T01:43:09.416 INFO:tasks.workunit.client.0.smithi066.stdout:1/327: symlink d5/d15/d58/l5c 0 2024-09-12T01:43:09.416 INFO:tasks.workunit.client.0.smithi066.stdout:1/328: fdatasync d5/dc/f5b 0 2024-09-12T01:43:09.419 INFO:tasks.workunit.client.1.smithi153.stdout:9/692: mkdir d3/d3a/d42/d72/dce 0 2024-09-12T01:43:09.420 INFO:tasks.workunit.client.1.smithi153.stdout:1/751: mkdir d2/d34/df5 0 2024-09-12T01:43:09.422 INFO:tasks.workunit.client.0.smithi066.stdout:0/384: creat d1/d72/de/d47/d4a/d67/d1b/d3b/f86 x:0 0 0 2024-09-12T01:43:09.422 INFO:tasks.workunit.client.0.smithi066.stdout:0/385: dread - d1/f27 zero size 2024-09-12T01:43:09.422 INFO:tasks.workunit.client.0.smithi066.stdout:0/386: fsync d1/d72/f6f 0 2024-09-12T01:43:09.425 INFO:tasks.workunit.client.1.smithi153.stdout:9/693: write d3/d55/f77 [298100,100251] 0 2024-09-12T01:43:09.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/737: dwrite d1/f5e [0,4194304] 0 2024-09-12T01:43:09.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/738: fdatasync d1/d6/da/d19/fab 0 2024-09-12T01:43:09.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/739: chown d1/d6/d23/c3d 2358 1 2024-09-12T01:43:09.427 INFO:tasks.workunit.client.1.smithi153.stdout:6/740: write d1/df/fa7 [4956895,56321] 0 2024-09-12T01:43:09.427 INFO:tasks.workunit.client.1.smithi153.stdout:4/612: mkdir d6/d15/db4/d7b/dd8 0 2024-09-12T01:43:09.428 INFO:tasks.workunit.client.1.smithi153.stdout:4/613: write d6/d9/d20/f87 [2221205,99] 0 2024-09-12T01:43:09.429 INFO:tasks.workunit.client.0.smithi066.stdout:5/321: creat d0/dd/d18/d36/f67 x:0 0 0 2024-09-12T01:43:09.431 INFO:tasks.workunit.client.0.smithi066.stdout:4/318: creat d4/d6/d62/f65 x:0 0 0 2024-09-12T01:43:09.434 INFO:tasks.workunit.client.0.smithi066.stdout:3/381: link d5/d6/f29 d5/d6/d1b/d28/d4f/d5e/f7d 0 2024-09-12T01:43:09.434 INFO:tasks.workunit.client.0.smithi066.stdout:3/382: write d5/d6/dd/f1a [1598111,74698] 0 2024-09-12T01:43:09.436 INFO:tasks.workunit.client.1.smithi153.stdout:7/641: symlink d12/d21/d29/d35/d37/lc6 0 2024-09-12T01:43:09.437 INFO:tasks.workunit.client.0.smithi066.stdout:6/434: link d2/db/c10 d2/db/c8d 0 2024-09-12T01:43:09.439 INFO:tasks.workunit.client.1.smithi153.stdout:8/651: dwrite d17/d1f/d4f/d34/f40 [0,4194304] 0 2024-09-12T01:43:09.442 INFO:tasks.workunit.client.1.smithi153.stdout:2/664: link d7/d19/d40/c94 d7/db/d6c/d9f/cd6 0 2024-09-12T01:43:09.444 INFO:tasks.workunit.client.0.smithi066.stdout:7/283: mkdir d2/d5/d56/d5f 0 2024-09-12T01:43:09.444 INFO:tasks.workunit.client.0.smithi066.stdout:7/284: creat d2/d20/d25/d4d/f60 x:0 0 0 2024-09-12T01:43:09.445 INFO:tasks.workunit.client.0.smithi066.stdout:9/401: dwrite d0/d6/d17/d1b/d4c/d42/f5a [0,4194304] 0 2024-09-12T01:43:09.445 INFO:tasks.workunit.client.0.smithi066.stdout:9/402: getdents d0/d6/d37/d85/d89 0 2024-09-12T01:43:09.446 INFO:tasks.workunit.client.1.smithi153.stdout:0/802: rmdir d22/d30/d4c 39 2024-09-12T01:43:09.452 INFO:tasks.workunit.client.0.smithi066.stdout:8/363: rename d12/d21/d2f/d57/d43/f52 to d12/d21/d2f/d57/d3c/d49/d50/d56/f75 0 2024-09-12T01:43:09.452 INFO:tasks.workunit.client.0.smithi066.stdout:8/364: stat d12/d21/d2f/d57/d3c/f6c 0 2024-09-12T01:43:09.452 INFO:tasks.workunit.client.0.smithi066.stdout:6/435: dread d2/d21/f52 [4194304,4194304] 0 2024-09-12T01:43:09.455 INFO:tasks.workunit.client.0.smithi066.stdout:1/329: write d5/dc/d53/f5a [112704,18961] 0 2024-09-12T01:43:09.457 INFO:tasks.workunit.client.0.smithi066.stdout:0/387: mknod d1/d72/de/d47/d7c/c87 0 2024-09-12T01:43:09.459 INFO:tasks.workunit.client.0.smithi066.stdout:5/322: getdents d0/d21 0 2024-09-12T01:43:09.459 INFO:tasks.workunit.client.0.smithi066.stdout:8/365: dread d12/f23 [0,4194304] 0 2024-09-12T01:43:09.462 INFO:tasks.workunit.client.0.smithi066.stdout:2/331: dwrite de/f1d [0,4194304] 0 2024-09-12T01:43:09.463 INFO:tasks.workunit.client.1.smithi153.stdout:8/652: dwrite d17/d1f/d4f/f78 [4194304,4194304] 0 2024-09-12T01:43:09.466 INFO:tasks.workunit.client.0.smithi066.stdout:3/383: creat d5/d6/d1b/d65/f7e x:0 0 0 2024-09-12T01:43:09.466 INFO:tasks.workunit.client.0.smithi066.stdout:3/384: write d5/d6/d1b/d45/d66/d67/d6d/f55 [67609,71485] 0 2024-09-12T01:43:09.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/741: getdents d1 0 2024-09-12T01:43:09.469 INFO:tasks.workunit.client.1.smithi153.stdout:6/742: write d1/d6/d23/d98/d53/d8d/fa9 [946490,97325] 0 2024-09-12T01:43:09.471 INFO:tasks.workunit.client.1.smithi153.stdout:3/740: sync 2024-09-12T01:43:09.471 INFO:tasks.workunit.client.1.smithi153.stdout:3/741: chown d1/d13/d23/d47/d71/d8e/d93/d79/ccc 1 1 2024-09-12T01:43:09.471 INFO:tasks.workunit.client.0.smithi066.stdout:0/388: fsync d1/d72/de/d47/d4a/d67/d1b/d3b/f86 0 2024-09-12T01:43:09.471 INFO:tasks.workunit.client.0.smithi066.stdout:7/285: truncate d2/d20/d2f/f34 778467 0 2024-09-12T01:43:09.472 INFO:tasks.workunit.client.0.smithi066.stdout:7/286: chown d2/d5/d6/c3a 130 1 2024-09-12T01:43:09.472 INFO:tasks.workunit.client.0.smithi066.stdout:7/287: creat d2/d20/d1d/f61 x:0 0 0 2024-09-12T01:43:09.476 INFO:tasks.workunit.client.0.smithi066.stdout:3/385: dread d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:09.476 INFO:tasks.workunit.client.1.smithi153.stdout:4/614: unlink d6/d9/d20/f87 0 2024-09-12T01:43:09.476 INFO:tasks.workunit.client.1.smithi153.stdout:4/615: creat d6/d15/fd9 x:0 0 0 2024-09-12T01:43:09.476 INFO:tasks.workunit.client.1.smithi153.stdout:4/616: dread - d6/d9/dc/d31/d7d/d94/f9e zero size 2024-09-12T01:43:09.478 INFO:tasks.workunit.client.1.smithi153.stdout:7/642: mkdir d12/d21/d29/d35/dc7 0 2024-09-12T01:43:09.482 INFO:tasks.workunit.client.0.smithi066.stdout:4/319: rename d4/d4f to d4/d6/d27/d66 0 2024-09-12T01:43:09.484 INFO:tasks.workunit.client.0.smithi066.stdout:2/332: dwrite de/d13/d28/f52 [0,4194304] 0 2024-09-12T01:43:09.484 INFO:tasks.workunit.client.0.smithi066.stdout:2/333: write de/d13/d1e/f36 [982950,94267] 0 2024-09-12T01:43:09.485 INFO:tasks.workunit.client.1.smithi153.stdout:2/665: creat d7/d19/d40/fd7 x:0 0 0 2024-09-12T01:43:09.487 INFO:tasks.workunit.client.0.smithi066.stdout:6/436: unlink d2/f7 0 2024-09-12T01:43:09.488 INFO:tasks.workunit.client.1.smithi153.stdout:0/803: mkdir d22/d82/d10e 0 2024-09-12T01:43:09.488 INFO:tasks.workunit.client.1.smithi153.stdout:0/804: dread - d22/d30/d4c/d6e/d7f/f93 zero size 2024-09-12T01:43:09.489 INFO:tasks.workunit.client.1.smithi153.stdout:0/805: stat d22/d30/d4c/d6e/d7f/d98/cce 0 2024-09-12T01:43:09.490 INFO:tasks.workunit.client.0.smithi066.stdout:1/330: read d5/dc/f1f [1009245,50620] 0 2024-09-12T01:43:09.490 INFO:tasks.workunit.client.1.smithi153.stdout:0/806: write d22/d79/fb8 [176917,99943] 0 2024-09-12T01:43:09.493 INFO:tasks.workunit.client.1.smithi153.stdout:5/709: link d0/df/d83/f4c d0/df/db8/d2f/d55/d9c/d75/d58/d71/fe1 0 2024-09-12T01:43:09.495 INFO:tasks.workunit.client.0.smithi066.stdout:8/366: dwrite d12/d21/d2f/d57/d3c/d49/f60 [0,4194304] 0 2024-09-12T01:43:09.495 INFO:tasks.workunit.client.0.smithi066.stdout:0/389: dwrite d1/d72/de/d47/d4a/d65/f76 [0,4194304] 0 2024-09-12T01:43:09.499 INFO:tasks.workunit.client.1.smithi153.stdout:1/752: rename d2/d9/d17/d2f/d56/d71/f9c to d2/d9/ff6 0 2024-09-12T01:43:09.501 INFO:tasks.workunit.client.0.smithi066.stdout:5/323: symlink d0/d26/l68 0 2024-09-12T01:43:09.501 INFO:tasks.workunit.client.0.smithi066.stdout:5/324: creat d0/d26/d2d/d33/f69 x:0 0 0 2024-09-12T01:43:09.501 INFO:tasks.workunit.client.0.smithi066.stdout:5/325: fsync d0/dd/d18/d36/f67 0 2024-09-12T01:43:09.503 INFO:tasks.workunit.client.1.smithi153.stdout:9/694: getdents d3/d66 0 2024-09-12T01:43:09.509 INFO:tasks.workunit.client.1.smithi153.stdout:8/653: unlink d17/d1f/d4f/d42/f48 0 2024-09-12T01:43:09.509 INFO:tasks.workunit.client.1.smithi153.stdout:5/710: dread d0/d43/dac/fde [0,4194304] 0 2024-09-12T01:43:09.512 INFO:tasks.workunit.client.1.smithi153.stdout:6/743: unlink d1/d6/da/f37 0 2024-09-12T01:43:09.514 INFO:tasks.workunit.client.0.smithi066.stdout:7/288: link d2/d5/d6/f2a d2/d5/d56/f62 0 2024-09-12T01:43:09.516 INFO:tasks.workunit.client.1.smithi153.stdout:3/742: unlink d1/d13/d23/d47/fd4 0 2024-09-12T01:43:09.517 INFO:tasks.workunit.client.1.smithi153.stdout:3/743: chown d1/d16/faf 306773 1 2024-09-12T01:43:09.517 INFO:tasks.workunit.client.1.smithi153.stdout:3/744: creat d1/d59/fd6 x:0 0 0 2024-09-12T01:43:09.517 INFO:tasks.workunit.client.1.smithi153.stdout:3/745: creat d1/d64/db0/fd7 x:0 0 0 2024-09-12T01:43:09.517 INFO:tasks.workunit.client.1.smithi153.stdout:3/746: chown d1/d13/d23/d47/d71/d8e/fd3 35409525 1 2024-09-12T01:43:09.517 INFO:tasks.workunit.client.1.smithi153.stdout:3/747: creat d1/d1e/d9a/fd8 x:0 0 0 2024-09-12T01:43:09.517 INFO:tasks.workunit.client.0.smithi066.stdout:3/386: mkdir d5/d6/d1b/d45/d66/d67/d7f 0 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.518+0000 7f24a2ed7640 1 -- 172.21.15.66:0/3271150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 msgr2=0x7f249c0fcfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/3271150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fcfc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f24900048d0 tx=0x7f2490009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 -- 172.21.15.66:0/3271150672 shutdown_connections 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/3271150672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 0x7f249c103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/3271150672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fcfc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.520 INFO:tasks.workunit.client.1.smithi153.stdout:9/695: dread d3/d55/fc2 [0,4194304] 0 2024-09-12T01:43:09.520 INFO:tasks.workunit.client.1.smithi153.stdout:9/696: stat d3/d3a/l43 0 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 -- 172.21.15.66:0/3271150672 >> 172.21.15.66:0/3271150672 conn(0x7f249c0f63a0 msgr2=0x7f249c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 -- 172.21.15.66:0/3271150672 shutdown_connections 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.519+0000 7f24a2ed7640 1 -- 172.21.15.66:0/3271150672 wait complete. 2024-09-12T01:43:09.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.520+0000 7f24a2ed7640 1 Processor -- start 2024-09-12T01:43:09.521 INFO:tasks.workunit.client.0.smithi066.stdout:9/403: getdents d0 0 2024-09-12T01:43:09.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a2ed7640 1 -- start start 2024-09-12T01:43:09.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a2ed7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a2ed7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 0x7f249c0fe320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a2ed7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0fe920 con 0x7f249c0fcbb0 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a2ed7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0ff1e0 con 0x7f249c0fd500 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a0c73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a0c73640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58550/0 (socket says 172.21.15.66:58550) 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f24a0c73640 1 -- 172.21.15.66:0/1952076034 learned_addr learned my addr 172.21.15.66:0/1952076034 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.521+0000 7f249bfff640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 0x7f249c0fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f249bfff640 1 -- 172.21.15.66:0/1952076034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 msgr2=0x7f249c0fdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f249bfff640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f249bfff640 1 -- 172.21.15.66:0/1952076034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490005040 con 0x7f249c0fd500 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f249bfff640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 0x7f249c0fe320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f248800c7e0 tx=0x7f2488007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248800a7a0 con 0x7f249c0fd500 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c0ff4c0 con 0x7f249c0fd500 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f248800ada0 con 0x7f249c0fd500 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.522+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24880113a0 con 0x7f249c0fd500 2024-09-12T01:43:09.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.523+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c0ff9e0 con 0x7f249c0fd500 2024-09-12T01:43:09.524 INFO:tasks.workunit.client.1.smithi153.stdout:7/643: mkdir d12/d21/d29/d2d/da6/dc8 0 2024-09-12T01:43:09.525 INFO:tasks.workunit.client.0.smithi066.stdout:4/320: symlink d4/d15/d33/d5e/l67 0 2024-09-12T01:43:09.525 INFO:tasks.workunit.client.0.smithi066.stdout:6/437: dwrite d2/d31/f85 [0,4194304] 0 2024-09-12T01:43:09.525 INFO:tasks.workunit.client.0.smithi066.stdout:6/438: fsync d2/fe 0 2024-09-12T01:43:09.525 INFO:tasks.workunit.client.0.smithi066.stdout:6/439: creat d2/db/f8e x:0 0 0 2024-09-12T01:43:09.525 INFO:tasks.workunit.client.0.smithi066.stdout:6/440: chown d2/db/d12/d1d/d6b/f86 30 1 2024-09-12T01:43:09.525 INFO:tasks.workunit.client.0.smithi066.stdout:6/441: write d2/db/d12/d1d/f26 [4962546,62473] 0 2024-09-12T01:43:09.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.524+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c0fa040 con 0x7f249c0fd500 2024-09-12T01:43:09.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.524+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 23) v1 ==== 46241+0+0 (secure 0 0 0) 0x7f2488011500 con 0x7f249c0fd500 2024-09-12T01:43:09.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.525+0000 7f24997fa640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f248c038e40 0x7f248c03b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.525+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f248804cd20 con 0x7f249c0fd500 2024-09-12T01:43:09.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.525+0000 7f24a0c73640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f248c038e40 0x7f248c03b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.526+0000 7f24a0c73640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f248c038e40 0x7f248c03b2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f249000b020 tx=0x7f2490035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/807: link d22/f74 d22/d30/d4c/d6f/dfa/f10f 0 2024-09-12T01:43:09.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/808: dread d22/f9e [0,4194304] 0 2024-09-12T01:43:09.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/809: chown d22/d79/d8e/dae/db7/fc7 37 1 2024-09-12T01:43:09.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/810: dread - d22/d30/fcb zero size 2024-09-12T01:43:09.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/811: fdatasync d22/fde 0 2024-09-12T01:43:09.527 INFO:tasks.workunit.client.1.smithi153.stdout:0/812: write d22/f3e [7137102,6610] 0 2024-09-12T01:43:09.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/813: write d22/d30/d4c/fd4 [2045355,11762] 0 2024-09-12T01:43:09.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/814: creat d22/d79/d8e/dae/db7/f110 x:0 0 0 2024-09-12T01:43:09.528 INFO:tasks.workunit.client.1.smithi153.stdout:2/666: dwrite d7/d4d/d70/f88 [4194304,4194304] 0 2024-09-12T01:43:09.529 INFO:tasks.workunit.client.0.smithi066.stdout:2/334: link f8 de/d13/d28/d3a/f6b 0 2024-09-12T01:43:09.529 INFO:tasks.workunit.client.0.smithi066.stdout:2/335: fdatasync de/d13/d28/f38 0 2024-09-12T01:43:09.529 INFO:tasks.workunit.client.0.smithi066.stdout:7/289: write d2/d5/d6/f2a [1750738,127425] 0 2024-09-12T01:43:09.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/367: dwrite d12/d21/d2f/d57/d3c/f6c [8388608,4194304] 0 2024-09-12T01:43:09.530 INFO:tasks.workunit.client.1.smithi153.stdout:8/654: dwrite d17/d21/d56/d96/fc3 [0,4194304] 0 2024-09-12T01:43:09.531 INFO:tasks.workunit.client.0.smithi066.stdout:1/331: mkdir d5/d52/d5d 0 2024-09-12T01:43:09.531 INFO:tasks.workunit.client.0.smithi066.stdout:1/332: fsync d5/fa 0 2024-09-12T01:43:09.533 INFO:tasks.workunit.client.1.smithi153.stdout:7/644: write d12/d21/f44 [1206353,55904] 0 2024-09-12T01:43:09.534 INFO:tasks.workunit.client.1.smithi153.stdout:7/645: dread - d12/d7e/f8f zero size 2024-09-12T01:43:09.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.534+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f248801b400 con 0x7f249c0fd500 2024-09-12T01:43:09.536 INFO:tasks.workunit.client.1.smithi153.stdout:4/617: rename d6/d15/db4/fbb to d6/d9/d11/d90/fda 0 2024-09-12T01:43:09.536 INFO:tasks.workunit.client.0.smithi066.stdout:7/290: read d2/d5/da/f36 [2088587,55685] 0 2024-09-12T01:43:09.536 INFO:tasks.workunit.client.0.smithi066.stdout:7/291: truncate d2/d5/d6/d22/f5c 764184 0 2024-09-12T01:43:09.536 INFO:tasks.workunit.client.0.smithi066.stdout:7/292: read - d2/d20/d25/d4d/f4f zero size 2024-09-12T01:43:09.536 INFO:tasks.workunit.client.0.smithi066.stdout:7/293: chown d2/d20/d25/f49 29086 1 2024-09-12T01:43:09.540 INFO:tasks.workunit.client.1.smithi153.stdout:1/753: symlink d2/d9/d28/lf7 0 2024-09-12T01:43:09.540 INFO:tasks.workunit.client.1.smithi153.stdout:1/754: write d2/d9/d1d/d25/f5f [4953783,106925] 0 2024-09-12T01:43:09.540 INFO:tasks.workunit.client.1.smithi153.stdout:1/755: chown d2/d34 4733 1 2024-09-12T01:43:09.545 INFO:tasks.workunit.client.1.smithi153.stdout:5/711: link d0/df/db8/l3c d0/df/db8/d2f/d55/d9c/d7b/le2 0 2024-09-12T01:43:09.545 INFO:tasks.workunit.client.1.smithi153.stdout:5/712: stat d0/df/d83/d36/d39/f72 0 2024-09-12T01:43:09.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/390: symlink d1/d72/de/d47/d4a/d67/d20/d3d/l88 0 2024-09-12T01:43:09.547 INFO:tasks.workunit.client.0.smithi066.stdout:0/391: chown d1/d62/d6c/f74 466637 1 2024-09-12T01:43:09.548 INFO:tasks.workunit.client.1.smithi153.stdout:6/744: truncate d1/df/f50 4385153 0 2024-09-12T01:43:09.548 INFO:tasks.workunit.client.1.smithi153.stdout:6/745: chown d1/d6/da/d19/f87 26452 1 2024-09-12T01:43:09.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/326: creat d0/d26/d2d/d31/f6a x:0 0 0 2024-09-12T01:43:09.555 INFO:tasks.workunit.client.0.smithi066.stdout:3/387: truncate d5/d6/d1b/d45/f49 2245759 0 2024-09-12T01:43:09.556 INFO:tasks.workunit.client.1.smithi153.stdout:6/746: dread d1/d80/fae [0,4194304] 0 2024-09-12T01:43:09.556 INFO:tasks.workunit.client.1.smithi153.stdout:6/747: truncate d1/d6/d23/d98/f68 730962 0 2024-09-12T01:43:09.556 INFO:tasks.workunit.client.1.smithi153.stdout:6/748: write d1/d80/fae [486319,8430] 0 2024-09-12T01:43:09.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/404: truncate d0/d6/d17/d1b/f1c 188820 0 2024-09-12T01:43:09.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/405: truncate d0/d6/d17/d28/f77 1248670 0 2024-09-12T01:43:09.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/406: fsync d0/d6/d17/f4d 0 2024-09-12T01:43:09.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/407: stat d0/d6/d43/c47 0 2024-09-12T01:43:09.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/408: chown d0/d6/d17/d4f/d12/f6b 13320862 1 2024-09-12T01:43:09.559 INFO:tasks.workunit.client.1.smithi153.stdout:3/748: creat d1/d16/d1c/fd9 x:0 0 0 2024-09-12T01:43:09.561 INFO:tasks.workunit.client.0.smithi066.stdout:4/321: mknod d4/d6/d48/d5a/c68 0 2024-09-12T01:43:09.561 INFO:tasks.workunit.client.0.smithi066.stdout:4/322: fdatasync d4/d15/d33/f5d 0 2024-09-12T01:43:09.561 INFO:tasks.workunit.client.0.smithi066.stdout:4/323: stat d4/d6/d8/d18/c44 0 2024-09-12T01:43:09.561 INFO:tasks.workunit.client.0.smithi066.stdout:4/324: chown d4/d6/d8/d18/d4d 831420 1 2024-09-12T01:43:09.561 INFO:tasks.workunit.client.1.smithi153.stdout:9/697: unlink d3/d35/cb0 0 2024-09-12T01:43:09.562 INFO:tasks.workunit.client.0.smithi066.stdout:5/327: read d0/dd/d18/f53 [884069,94466] 0 2024-09-12T01:43:09.563 INFO:tasks.workunit.client.0.smithi066.stdout:5/328: write d0/d26/f35 [449320,121984] 0 2024-09-12T01:43:09.564 INFO:tasks.workunit.client.1.smithi153.stdout:1/756: dwrite d2/d34/f50 [0,4194304] 0 2024-09-12T01:43:09.566 INFO:tasks.workunit.client.0.smithi066.stdout:6/442: rename d2/db/l48 to d2/db/d12/l8f 0 2024-09-12T01:43:09.572 INFO:tasks.workunit.client.1.smithi153.stdout:0/815: creat d22/d79/d8e/dc6/f111 x:0 0 0 2024-09-12T01:43:09.577 INFO:tasks.workunit.client.0.smithi066.stdout:8/368: creat d12/d21/d2f/d57/d3c/f76 x:0 0 0 2024-09-12T01:43:09.577 INFO:tasks.workunit.client.0.smithi066.stdout:8/369: chown d12/d21/d2f/d53/l73 8201 1 2024-09-12T01:43:09.578 INFO:tasks.workunit.client.1.smithi153.stdout:2/667: mknod d7/db/cd8 0 2024-09-12T01:43:09.579 INFO:tasks.workunit.client.0.smithi066.stdout:1/333: creat d5/d52/d5d/f5e x:0 0 0 2024-09-12T01:43:09.582 INFO:tasks.workunit.client.0.smithi066.stdout:7/294: mkdir d2/d5/d6/d40/d63 0 2024-09-12T01:43:09.582 INFO:tasks.workunit.client.0.smithi066.stdout:7/295: fdatasync d2/d5/f31 0 2024-09-12T01:43:09.585 INFO:tasks.workunit.client.0.smithi066.stdout:3/388: mkdir d5/d6/d1b/d77/d80 0 2024-09-12T01:43:09.585 INFO:tasks.workunit.client.1.smithi153.stdout:2/668: dread d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:09.587 INFO:tasks.workunit.client.0.smithi066.stdout:9/409: symlink d0/d6/d7f/d90/l93 0 2024-09-12T01:43:09.589 INFO:tasks.workunit.client.1.smithi153.stdout:7/646: creat d12/d21/d29/d2d/da6/dc8/fc9 x:0 0 0 2024-09-12T01:43:09.590 INFO:tasks.workunit.client.0.smithi066.stdout:4/325: creat d4/d6/d8/d18/f69 x:0 0 0 2024-09-12T01:43:09.590 INFO:tasks.workunit.client.0.smithi066.stdout:4/326: chown d4/d6/d8/d18/f69 19090 1 2024-09-12T01:43:09.592 INFO:tasks.workunit.client.1.smithi153.stdout:4/618: symlink d6/ldb 0 2024-09-12T01:43:09.594 INFO:tasks.workunit.client.0.smithi066.stdout:3/389: dread d5/d6/dd/f14 [0,4194304] 0 2024-09-12T01:43:09.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/329: mkdir d0/d26/d2f/d3b/d6b 0 2024-09-12T01:43:09.595 INFO:tasks.workunit.client.0.smithi066.stdout:9/410: dread d0/d6/d37/f55 [0,4194304] 0 2024-09-12T01:43:09.598 INFO:tasks.workunit.client.0.smithi066.stdout:6/443: unlink d2/db/d72/c8b 0 2024-09-12T01:43:09.600 INFO:tasks.workunit.client.1.smithi153.stdout:5/713: rmdir d0/d43/d68/db2 39 2024-09-12T01:43:09.601 INFO:tasks.workunit.client.1.smithi153.stdout:2/669: dwrite d7/db/d27/d56/f5b [0,4194304] 0 2024-09-12T01:43:09.604 INFO:tasks.workunit.client.1.smithi153.stdout:6/749: link d1/d6/d23/d98/d4f/cde d1/d6/d23/d98/d53/d69/d7c/d7f/cef 0 2024-09-12T01:43:09.604 INFO:tasks.workunit.client.1.smithi153.stdout:6/750: chown d1/d6/d23/d98/d53/da0/fad 1 1 2024-09-12T01:43:09.604 INFO:tasks.workunit.client.1.smithi153.stdout:6/751: dread - d1/d6/d46/d73/d8a/d84/fed zero size 2024-09-12T01:43:09.604 INFO:tasks.workunit.client.1.smithi153.stdout:6/752: chown d1/d6/d23/d98 0 1 2024-09-12T01:43:09.605 INFO:tasks.workunit.client.0.smithi066.stdout:2/336: link de/l1a de/d13/d5c/l6c 0 2024-09-12T01:43:09.607 INFO:tasks.workunit.client.1.smithi153.stdout:3/749: creat d1/d13/d25/d26/fda x:0 0 0 2024-09-12T01:43:09.607 INFO:tasks.workunit.client.1.smithi153.stdout:3/750: fdatasync d1/d16/f53 0 2024-09-12T01:43:09.608 INFO:tasks.workunit.client.0.smithi066.stdout:8/370: rmdir d12/d21 39 2024-09-12T01:43:09.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/371: write d12/f3d [1458956,67985] 0 2024-09-12T01:43:09.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/372: truncate d12/f3d 2309449 0 2024-09-12T01:43:09.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/373: write d12/d21/d2f/d53/f6b [829815,66874] 0 2024-09-12T01:43:09.613 INFO:tasks.workunit.client.0.smithi066.stdout:1/334: stat d5/dc/d36/d4b/f50 0 2024-09-12T01:43:09.613 INFO:tasks.workunit.client.0.smithi066.stdout:1/335: write d5/dc/f5b [919316,98872] 0 2024-09-12T01:43:09.614 INFO:tasks.workunit.client.0.smithi066.stdout:1/336: dread - d5/d52/d5d/f5e zero size 2024-09-12T01:43:09.617 INFO:tasks.workunit.client.1.smithi153.stdout:9/698: rename d3/d35/f37 to d3/d55/d30/d95/d84/d8b/fcf 0 2024-09-12T01:43:09.617 INFO:tasks.workunit.client.0.smithi066.stdout:7/296: rmdir d2/d46 0 2024-09-12T01:43:09.619 INFO:tasks.workunit.client.1.smithi153.stdout:1/757: mknod d2/d9/d17/cf8 0 2024-09-12T01:43:09.620 INFO:tasks.workunit.client.0.smithi066.stdout:4/327: symlink d4/d6/d27/d66/d58/l6a 0 2024-09-12T01:43:09.623 INFO:tasks.workunit.client.1.smithi153.stdout:1/758: dread d2/d9/d17/f2d [0,4194304] 0 2024-09-12T01:43:09.623 INFO:tasks.workunit.client.1.smithi153.stdout:1/759: creat d2/d9/d17/ff9 x:0 0 0 2024-09-12T01:43:09.623 INFO:tasks.workunit.client.1.smithi153.stdout:5/714: dread d0/d20/f37 [0,4194304] 0 2024-09-12T01:43:09.625 INFO:tasks.workunit.client.1.smithi153.stdout:7/647: creat d12/d21/d4d/dae/dc0/dc4/fca x:0 0 0 2024-09-12T01:43:09.625 INFO:tasks.workunit.client.1.smithi153.stdout:7/648: dread - d12/d7e/f8f zero size 2024-09-12T01:43:09.626 INFO:tasks.workunit.client.0.smithi066.stdout:9/411: creat d0/d6/d17/d1b/d4c/d4b/f94 x:0 0 0 2024-09-12T01:43:09.626 INFO:tasks.workunit.client.0.smithi066.stdout:9/412: chown d0/d6/d17/d4f/d12 6995762 1 2024-09-12T01:43:09.626 INFO:tasks.workunit.client.1.smithi153.stdout:6/753: dread d1/d6/d23/d98/d53/d8d/f93 [0,4194304] 0 2024-09-12T01:43:09.626 INFO:tasks.workunit.client.1.smithi153.stdout:8/655: write f10 [1964949,21552] 0 2024-09-12T01:43:09.628 INFO:tasks.workunit.client.1.smithi153.stdout:2/670: dwrite d7/db/d1d/f28 [0,4194304] 0 2024-09-12T01:43:09.628 INFO:tasks.workunit.client.1.smithi153.stdout:2/671: stat d7/db/d62/d87/c89 0 2024-09-12T01:43:09.630 INFO:tasks.workunit.client.1.smithi153.stdout:4/619: symlink d6/d6a/d9c/ldc 0 2024-09-12T01:43:09.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/444: creat d2/db/d12/f90 x:0 0 0 2024-09-12T01:43:09.633 INFO:tasks.workunit.client.1.smithi153.stdout:7/649: dread d12/d21/d29/d2d/f55 [0,4194304] 0 2024-09-12T01:43:09.638 INFO:tasks.workunit.client.0.smithi066.stdout:3/390: dwrite d5/d6/d1b/f62 [0,4194304] 0 2024-09-12T01:43:09.638 INFO:tasks.workunit.client.1.smithi153.stdout:3/751: mkdir d1/d13/ddb 0 2024-09-12T01:43:09.638 INFO:tasks.workunit.client.1.smithi153.stdout:3/752: creat d1/d64/db0/fdc x:0 0 0 2024-09-12T01:43:09.638 INFO:tasks.workunit.client.1.smithi153.stdout:3/753: fdatasync d1/d1e/f80 0 2024-09-12T01:43:09.641 INFO:tasks.workunit.client.0.smithi066.stdout:2/337: truncate de/d13/d1e/f23 2945184 0 2024-09-12T01:43:09.641 INFO:tasks.workunit.client.0.smithi066.stdout:2/338: fsync f8 0 2024-09-12T01:43:09.647 INFO:tasks.workunit.client.1.smithi153.stdout:0/816: rename d22/d30/d4c/d8a/cb3 to d22/d30/d4c/d6f/d88/c112 0 2024-09-12T01:43:09.648 INFO:tasks.workunit.client.1.smithi153.stdout:0/817: creat d22/d79/d8e/dc6/f113 x:0 0 0 2024-09-12T01:43:09.649 INFO:tasks.workunit.client.0.smithi066.stdout:8/374: getdents d12/d21/d2f 0 2024-09-12T01:43:09.649 INFO:tasks.workunit.client.0.smithi066.stdout:8/375: chown d12/c6a 6 1 2024-09-12T01:43:09.652 INFO:tasks.workunit.client.0.smithi066.stdout:1/337: link d5/d15/f43 d5/dc/d36/d4b/f5f 0 2024-09-12T01:43:09.653 INFO:tasks.workunit.client.1.smithi153.stdout:9/699: truncate d3/d3a/d42/d72/dc3/fc7 1246901 0 2024-09-12T01:43:09.653 INFO:tasks.workunit.client.1.smithi153.stdout:9/700: dread - d3/d55/d30/d7b/d8f/f9c zero size 2024-09-12T01:43:09.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/330: rmdir d0/d26/d2d/d33/d55 39 2024-09-12T01:43:09.656 INFO:tasks.workunit.client.0.smithi066.stdout:9/413: link d0/d6/d17/d1b/d4c/c3f d0/d6/d17/d1b/d4c/d4b/c95 0 2024-09-12T01:43:09.657 INFO:tasks.workunit.client.1.smithi153.stdout:1/760: creat d2/d34/d3d/ffa x:0 0 0 2024-09-12T01:43:09.660 INFO:tasks.workunit.client.1.smithi153.stdout:5/715: symlink d0/df/db8/d2f/d55/d9c/d75/d58/d70/dbe/le3 0 2024-09-12T01:43:09.663 INFO:tasks.workunit.client.0.smithi066.stdout:0/392: rename d1/d72/de/d47/d4a/d65 to d1/d62/d89 0 2024-09-12T01:43:09.665 INFO:tasks.workunit.client.1.smithi153.stdout:6/754: mkdir d1/d6/d23/d98/d53/d69/d7c/d7f/df0 0 2024-09-12T01:43:09.669 INFO:tasks.workunit.client.1.smithi153.stdout:3/754: mkdir d1/d13/d23/d47/d6c/ddd 0 2024-09-12T01:43:09.669 INFO:tasks.workunit.client.1.smithi153.stdout:3/755: read - d1/d16/d17/f67 zero size 2024-09-12T01:43:09.670 INFO:tasks.workunit.client.0.smithi066.stdout:8/376: mknod d12/d21/d2f/d57/d3c/d49/d50/d56/d69/c77 0 2024-09-12T01:43:09.670 INFO:tasks.workunit.client.0.smithi066.stdout:8/377: creat d12/d21/d2f/d57/d3c/f78 x:0 0 0 2024-09-12T01:43:09.673 INFO:tasks.workunit.client.0.smithi066.stdout:1/338: mkdir d5/d52/d60 0 2024-09-12T01:43:09.677 INFO:tasks.workunit.client.0.smithi066.stdout:7/297: dwrite d2/d5/d6/d22/f59 [0,4194304] 0 2024-09-12T01:43:09.679 INFO:tasks.workunit.client.0.smithi066.stdout:5/331: link d0/d26/d2f/l45 d0/d26/d2d/d42/l6c 0 2024-09-12T01:43:09.679 INFO:tasks.workunit.client.0.smithi066.stdout:5/332: truncate d0/dd/d18/d36/f5c 790113 0 2024-09-12T01:43:09.679 INFO:tasks.workunit.client.0.smithi066.stdout:5/333: fsync d0/f4 0 2024-09-12T01:43:09.679 INFO:tasks.workunit.client.0.smithi066.stdout:5/334: dread - d0/d26/d2f/f58 zero size 2024-09-12T01:43:09.680 INFO:tasks.workunit.client.0.smithi066.stdout:4/328: dwrite d4/d6/d8/f4e [0,4194304] 0 2024-09-12T01:43:09.680 INFO:tasks.workunit.client.0.smithi066.stdout:4/329: truncate d4/d6/d62/f65 191368 0 2024-09-12T01:43:09.680 INFO:tasks.workunit.client.0.smithi066.stdout:4/330: stat d4/d6/d8/d18/d4d 0 2024-09-12T01:43:09.680 INFO:tasks.workunit.client.0.smithi066.stdout:9/414: link d0/d6/d43/c52 d0/d6/d17/d4f/d12/d46/d68/c96 0 2024-09-12T01:43:09.681 INFO:tasks.workunit.client.1.smithi153.stdout:2/672: dwrite f1 [4194304,4194304] 0 2024-09-12T01:43:09.682 INFO:tasks.workunit.client.0.smithi066.stdout:6/445: dwrite d2/db/d12/f53 [0,4194304] 0 2024-09-12T01:43:09.690 INFO:tasks.workunit.client.0.smithi066.stdout:3/391: rename d5/f44 to d5/d6/dd/f81 0 2024-09-12T01:43:09.693 INFO:tasks.workunit.client.0.smithi066.stdout:0/393: symlink d1/d72/de/d47/d4a/d67/d1b/d26/d5b/l8a 0 2024-09-12T01:43:09.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/335: write d0/dd/d18/f23 [1121165,107751] 0 2024-09-12T01:43:09.696 INFO:tasks.workunit.client.1.smithi153.stdout:4/620: rename d6/d9/d11/f3c to d6/d15/db4/d7b/fdd 0 2024-09-12T01:43:09.698 INFO:tasks.workunit.client.0.smithi066.stdout:8/378: getdents d12/d21/d2f/d57/d43/d66 0 2024-09-12T01:43:09.703 INFO:tasks.workunit.client.1.smithi153.stdout:6/755: creat d1/d6/d23/d98/ff1 x:0 0 0 2024-09-12T01:43:09.704 INFO:tasks.workunit.client.0.smithi066.stdout:8/379: dread d12/d21/d2f/f34 [0,4194304] 0 2024-09-12T01:43:09.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/415: creat d0/d6/d17/d4f/f97 x:0 0 0 2024-09-12T01:43:09.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/416: stat d0/d6/d17/d1b/d4c/d4b 0 2024-09-12T01:43:09.705 INFO:tasks.workunit.client.0.smithi066.stdout:9/417: chown d0/d6/d43/c4e 2910217 1 2024-09-12T01:43:09.705 INFO:tasks.workunit.client.0.smithi066.stdout:9/418: chown d0/d6/d17/d1b/d4c 14782128 1 2024-09-12T01:43:09.705 INFO:tasks.workunit.client.0.smithi066.stdout:6/446: rename d2/d21/f4a to d2/db/d12/d1d/f91 0 2024-09-12T01:43:09.707 INFO:tasks.workunit.client.0.smithi066.stdout:0/394: mkdir d1/d62/d89/d83/d8b 0 2024-09-12T01:43:09.708 INFO:tasks.workunit.client.0.smithi066.stdout:1/339: link d5/dc/f40 d5/d52/d60/f61 0 2024-09-12T01:43:09.708 INFO:tasks.workunit.client.0.smithi066.stdout:1/340: write d5/dc/f40 [3911382,13095] 0 2024-09-12T01:43:09.709 INFO:tasks.workunit.client.0.smithi066.stdout:8/380: link d12/d21/d2f/d53/c55 d12/d21/d2f/d53/c79 0 2024-09-12T01:43:09.713 INFO:tasks.workunit.client.1.smithi153.stdout:2/673: creat d7/d17/da4/fd9 x:0 0 0 2024-09-12T01:43:09.713 INFO:tasks.workunit.client.1.smithi153.stdout:2/674: chown d7/d17/f8c 827609 1 2024-09-12T01:43:09.714 INFO:tasks.workunit.client.1.smithi153.stdout:0/818: dwrite d22/f2a [0,4194304] 0 2024-09-12T01:43:09.714 INFO:tasks.workunit.client.1.smithi153.stdout:4/621: unlink d6/d9/dc/d31/d7d/d94/f9e 0 2024-09-12T01:43:09.715 INFO:tasks.workunit.client.1.smithi153.stdout:6/756: mknod d1/d80/cf2 0 2024-09-12T01:43:09.715 INFO:tasks.workunit.client.1.smithi153.stdout:6/757: creat d1/d6/d23/d98/d53/d8d/ff3 x:0 0 0 2024-09-12T01:43:09.716 INFO:tasks.workunit.client.0.smithi066.stdout:6/447: mkdir d2/d21/d92 0 2024-09-12T01:43:09.716 INFO:tasks.workunit.client.0.smithi066.stdout:6/448: creat d2/d31/f93 x:0 0 0 2024-09-12T01:43:09.717 INFO:tasks.workunit.client.1.smithi153.stdout:0/819: symlink d22/d79/d8e/l114 0 2024-09-12T01:43:09.717 INFO:tasks.workunit.client.1.smithi153.stdout:0/820: chown d22/d79/dca/ded/df8/c104 9237068 1 2024-09-12T01:43:09.717 INFO:tasks.workunit.client.1.smithi153.stdout:0/821: chown d22/d30/d4c/d6f/f70 1015805685 1 2024-09-12T01:43:09.717 INFO:tasks.workunit.client.1.smithi153.stdout:0/822: write f3 [1034779,31699] 0 2024-09-12T01:43:09.717 INFO:tasks.workunit.client.1.smithi153.stdout:0/823: chown d22/d30/d4c/d6f/fe1 2454463 1 2024-09-12T01:43:09.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/824: chown d22/d30/d4c/d6e/d7f/dbd/fc8 2502313 1 2024-09-12T01:43:09.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/825: creat d22/d79/d8e/dae/f115 x:0 0 0 2024-09-12T01:43:09.718 INFO:tasks.workunit.client.1.smithi153.stdout:4/622: getdents d6/d9/d11/d13/dce 0 2024-09-12T01:43:09.718 INFO:tasks.workunit.client.0.smithi066.stdout:2/339: dwrite f9 [0,4194304] 0 2024-09-12T01:43:09.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/341: unlink d5/f2a 0 2024-09-12T01:43:09.719 INFO:tasks.workunit.client.0.smithi066.stdout:8/381: mkdir d12/d21/d2f/d57/d43/d7a 0 2024-09-12T01:43:09.720 INFO:tasks.workunit.client.1.smithi153.stdout:6/758: unlink d1/cd1 0 2024-09-12T01:43:09.724 INFO:tasks.workunit.client.0.smithi066.stdout:0/395: dread d1/f9 [0,4194304] 0 2024-09-12T01:43:09.724 INFO:tasks.workunit.client.0.smithi066.stdout:3/392: rename d5/d6/c57 to d5/c82 0 2024-09-12T01:43:09.724 INFO:tasks.workunit.client.0.smithi066.stdout:6/449: symlink d2/d31/d57/l94 0 2024-09-12T01:43:09.725 INFO:tasks.workunit.client.1.smithi153.stdout:0/826: creat d22/d30/d4c/d6f/dfa/f116 x:0 0 0 2024-09-12T01:43:09.725 INFO:tasks.workunit.client.1.smithi153.stdout:4/623: getdents d6/d6a/d9c 0 2024-09-12T01:43:09.725 INFO:tasks.workunit.client.1.smithi153.stdout:4/624: creat d6/d9/dc/d31/d7d/d94/fde x:0 0 0 2024-09-12T01:43:09.725 INFO:tasks.workunit.client.1.smithi153.stdout:4/625: creat d6/d9/dc/d98/d3e/fdf x:0 0 0 2024-09-12T01:43:09.727 INFO:tasks.workunit.client.1.smithi153.stdout:6/759: link d1/d6/da/d19/d3a/f9f d1/d6/d23/d98/d53/d8d/ff4 0 2024-09-12T01:43:09.727 INFO:tasks.workunit.client.0.smithi066.stdout:8/382: rmdir d12/d21/d2f 39 2024-09-12T01:43:09.727 INFO:tasks.workunit.client.0.smithi066.stdout:8/383: creat d12/d21/d2f/d57/d3c/f7b x:0 0 0 2024-09-12T01:43:09.729 INFO:tasks.workunit.client.0.smithi066.stdout:0/396: creat d1/d72/de/d47/d4a/d67/d20/d5e/f8c x:0 0 0 2024-09-12T01:43:09.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/760: rename d1/d6/da/d19/d3a/db0/fba to d1/d6/d23/d98/d4f/ff5 0 2024-09-12T01:43:09.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/761: fdatasync d1/d6/d23/f6e 0 2024-09-12T01:43:09.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/762: creat d1/d80/ff6 x:0 0 0 2024-09-12T01:43:09.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/763: truncate d1/df/f6f 2935125 0 2024-09-12T01:43:09.733 INFO:tasks.workunit.client.1.smithi153.stdout:6/764: chown d1/d6/d46/d73/d8a/d84/d96/cc3 13234835 1 2024-09-12T01:43:09.734 INFO:tasks.workunit.client.0.smithi066.stdout:3/393: unlink d5/d6/f29 0 2024-09-12T01:43:09.734 INFO:tasks.workunit.client.0.smithi066.stdout:0/397: mknod d1/d72/de/d47/d4a/d67/d20/d5e/c8d 0 2024-09-12T01:43:09.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/394: stat d5/d6/d1b/l76 0 2024-09-12T01:43:09.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/395: creat d5/d6/d1b/f83 x:0 0 0 2024-09-12T01:43:09.736 INFO:tasks.workunit.client.1.smithi153.stdout:1/761: dwrite d2/d9/d17/d2f/d56/fe6 [0,4194304] 0 2024-09-12T01:43:09.736 INFO:tasks.workunit.client.1.smithi153.stdout:1/762: chown d2/d9/d58/d74/c98 416951 1 2024-09-12T01:43:09.737 INFO:tasks.workunit.client.0.smithi066.stdout:0/398: creat d1/d62/f8e x:0 0 0 2024-09-12T01:43:09.738 INFO:tasks.workunit.client.1.smithi153.stdout:6/765: mkdir d1/d6/d23/d98/d53/d8d/df7 0 2024-09-12T01:43:09.740 INFO:tasks.workunit.client.0.smithi066.stdout:0/399: rmdir d1/d72/de/d47/d4a/d67/d6e 39 2024-09-12T01:43:09.742 INFO:tasks.workunit.client.1.smithi153.stdout:7/650: dwrite d12/d21/d29/d2d/f30 [0,4194304] 0 2024-09-12T01:43:09.742 INFO:tasks.workunit.client.1.smithi153.stdout:7/651: fdatasync d12/d21/d29/f3b 0 2024-09-12T01:43:09.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/701: dwrite d3/d3a/d42/f47 [0,4194304] 0 2024-09-12T01:43:09.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/702: chown d3/d3a/d42/d72/lba 46808 1 2024-09-12T01:43:09.746 INFO:tasks.workunit.client.0.smithi066.stdout:4/331: dwrite d4/d6/d8/f32 [0,4194304] 0 2024-09-12T01:43:09.746 INFO:tasks.workunit.client.0.smithi066.stdout:4/332: chown d4/d6/d27/c36 30 1 2024-09-12T01:43:09.746 INFO:tasks.workunit.client.1.smithi153.stdout:3/756: dwrite d1/d64/db0/fd7 [0,4194304] 0 2024-09-12T01:43:09.749 INFO:tasks.workunit.client.1.smithi153.stdout:1/763: creat d2/d9/d17/d2f/d56/d71/d9a/ffb x:0 0 0 2024-09-12T01:43:09.749 INFO:tasks.workunit.client.1.smithi153.stdout:4/626: dwrite d6/da4/fd0 [0,4194304] 0 2024-09-12T01:43:09.749 INFO:tasks.workunit.client.1.smithi153.stdout:6/766: creat d1/ff8 x:0 0 0 2024-09-12T01:43:09.749 INFO:tasks.workunit.client.1.smithi153.stdout:4/627: readlink d6/d9/lae 0 2024-09-12T01:43:09.751 INFO:tasks.workunit.client.0.smithi066.stdout:1/342: fdatasync d5/dc/f5b 0 2024-09-12T01:43:09.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/384: dread d12/d21/f5d [0,4194304] 0 2024-09-12T01:43:09.752 INFO:tasks.workunit.client.0.smithi066.stdout:8/385: rename d12/d21/d2f/d57/d43/d7a to d12/d21/d2f/d57/d43/d7a/d7c 22 2024-09-12T01:43:09.752 INFO:tasks.workunit.client.0.smithi066.stdout:0/400: creat d1/d72/de/d47/d64/f8f x:0 0 0 2024-09-12T01:43:09.753 INFO:tasks.workunit.client.1.smithi153.stdout:9/703: truncate d3/d55/d30/d90/fa5 4059972 0 2024-09-12T01:43:09.755 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:09 smithi153 ceph-mon[34713]: pgmap v3: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail 2024-09-12T01:43:09.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:09 smithi153 ceph-mon[34713]: Deploying cephadm binary to smithi066 2024-09-12T01:43:09.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:09 smithi153 ceph-mon[34713]: Deploying cephadm binary to smithi153 2024-09-12T01:43:09.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:09 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:09.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:09 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:09.756 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:09 smithi153 ceph-mon[34713]: mgrmap e23: smithi153.jpnqza(active, since 2s) 2024-09-12T01:43:09.757 INFO:tasks.workunit.client.0.smithi066.stdout:7/298: dwrite d2/d20/d25/d4d/f60 [0,4194304] 0 2024-09-12T01:43:09.759 INFO:tasks.workunit.client.0.smithi066.stdout:2/340: dread de/d13/d1e/f36 [0,4194304] 0 2024-09-12T01:43:09.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/716: dwrite d0/df/db8/d2f/d55/d9c/d75/d58/d71/fe1 [4194304,4194304] 0 2024-09-12T01:43:09.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/717: fsync d0/d15/dae/fc5 0 2024-09-12T01:43:09.764 INFO:tasks.workunit.client.0.smithi066.stdout:3/396: dwrite d5/d6/d1b/d45/d66/f3b [0,4194304] 0 2024-09-12T01:43:09.764 INFO:tasks.workunit.client.0.smithi066.stdout:3/397: chown d5/d6/d1b/d28/d4f/c63 2097 1 2024-09-12T01:43:09.765 INFO:tasks.workunit.client.1.smithi153.stdout:3/757: write d1/d13/d23/d47/d71/d8e/fca [1584216,31838] 0 2024-09-12T01:43:09.765 INFO:tasks.workunit.client.1.smithi153.stdout:2/675: dwrite d7/db/d27/d56/f9e [0,4194304] 0 2024-09-12T01:43:09.766 INFO:tasks.workunit.client.1.smithi153.stdout:3/758: write d1/d16/d17/d82/d92/fac [87171,50531] 0 2024-09-12T01:43:09.772 INFO:tasks.workunit.client.1.smithi153.stdout:1/764: rename d2/c1e to d2/d9/d17/d2f/d56/d91/cfc 0 2024-09-12T01:43:09.773 INFO:tasks.workunit.client.0.smithi066.stdout:8/386: dread d12/d21/d2f/d57/f2e [0,4194304] 0 2024-09-12T01:43:09.773 INFO:tasks.workunit.client.0.smithi066.stdout:8/387: truncate d12/f31 9109284 0 2024-09-12T01:43:09.773 INFO:tasks.workunit.client.0.smithi066.stdout:8/388: write d12/d21/d2f/d57/d3c/d49/d50/d56/f59 [812753,67869] 0 2024-09-12T01:43:09.773 INFO:tasks.workunit.client.0.smithi066.stdout:0/401: readlink d1/d72/de/d47/d4a/d67/l2f 0 2024-09-12T01:43:09.774 INFO:tasks.workunit.client.1.smithi153.stdout:7/652: dwrite d12/d21/d29/d35/fb6 [0,4194304] 0 2024-09-12T01:43:09.775 INFO:tasks.workunit.client.0.smithi066.stdout:4/333: dwrite d4/d6/d8/f4e [0,4194304] 0 2024-09-12T01:43:09.778 INFO:tasks.workunit.client.0.smithi066.stdout:1/343: dwrite d5/d15/f3a [0,4194304] 0 2024-09-12T01:43:09.778 INFO:tasks.workunit.client.0.smithi066.stdout:1/344: dread - d5/f3b zero size 2024-09-12T01:43:09.778 INFO:tasks.workunit.client.1.smithi153.stdout:6/767: mknod d1/d6/da/d19/d3a/cf9 0 2024-09-12T01:43:09.778 INFO:tasks.workunit.client.1.smithi153.stdout:6/768: dread - d1/d6/da/d19/d3a/fe2 zero size 2024-09-12T01:43:09.787 INFO:tasks.workunit.client.1.smithi153.stdout:5/718: creat d0/d43/d68/dcc/fe4 x:0 0 0 2024-09-12T01:43:09.791 INFO:tasks.workunit.client.1.smithi153.stdout:5/719: write d0/df/db8/d2f/d55/d9c/d75/d58/d71/fbd [795611,78208] 0 2024-09-12T01:43:09.792 INFO:tasks.workunit.client.0.smithi066.stdout:7/299: symlink d2/d20/d2f/l64 0 2024-09-12T01:43:09.794 INFO:tasks.workunit.client.0.smithi066.stdout:2/341: fsync de/f42 0 2024-09-12T01:43:09.794 INFO:tasks.workunit.client.0.smithi066.stdout:2/342: fdatasync de/f12 0 2024-09-12T01:43:09.794 INFO:tasks.workunit.client.0.smithi066.stdout:2/343: chown de/d13/d28/d3d/f5f 131709017 1 2024-09-12T01:43:09.800 INFO:tasks.workunit.client.0.smithi066.stdout:4/334: dwrite d4/f17 [0,4194304] 0 2024-09-12T01:43:09.800 INFO:tasks.workunit.client.0.smithi066.stdout:4/335: chown d4/d6/d8/f13 12620891 1 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/759: stat d1/d16/d1c/lc5 0 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/760: chown d1/d13/d23/d47/d6c/d9c/cb2 11036708 1 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/761: dread - d1/d16/d1c/fd9 zero size 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/762: truncate d1/d1e/d9a/fc9 77769 0 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/763: stat d1/f5 0 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/764: creat d1/d45/fde x:0 0 0 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/765: creat d1/d45/fdf x:0 0 0 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/766: read - d1/d64/db0/fd2 zero size 2024-09-12T01:43:09.802 INFO:tasks.workunit.client.1.smithi153.stdout:3/767: chown d1/d13/d25/d26/d4b 0 1 2024-09-12T01:43:09.803 INFO:tasks.workunit.client.0.smithi066.stdout:3/398: mkdir d5/d6/d1b/d45/d66/d67/d7f/d84 0 2024-09-12T01:43:09.804 INFO:tasks.workunit.client.1.smithi153.stdout:4/628: getdents d6/d9/dc/d31/d76/d99 0 2024-09-12T01:43:09.804 INFO:tasks.workunit.client.1.smithi153.stdout:4/629: chown d6/d9/dc/ld1 0 1 2024-09-12T01:43:09.804 INFO:tasks.workunit.client.0.smithi066.stdout:1/345: dwrite d5/dc/d53/f5a [0,4194304] 0 2024-09-12T01:43:09.805 INFO:tasks.workunit.client.0.smithi066.stdout:8/389: mkdir d12/d21/d2f/d57/d3c/d49/d50/d56/d69/d7d 0 2024-09-12T01:43:09.807 INFO:tasks.workunit.client.0.smithi066.stdout:0/402: mknod d1/c90 0 2024-09-12T01:43:09.807 INFO:tasks.workunit.client.0.smithi066.stdout:0/403: readlink d1/l11 0 2024-09-12T01:43:09.810 INFO:tasks.workunit.client.1.smithi153.stdout:7/653: unlink d12/d21/d29/d35/d37/fbb 0 2024-09-12T01:43:09.812 INFO:tasks.workunit.client.1.smithi153.stdout:6/769: unlink d1/d6/d23/f8c 0 2024-09-12T01:43:09.812 INFO:tasks.workunit.client.1.smithi153.stdout:5/720: dwrite d0/f32 [0,4194304] 0 2024-09-12T01:43:09.813 INFO:tasks.workunit.client.1.smithi153.stdout:6/770: write d1/d6/da/d19/fab [140105,130298] 0 2024-09-12T01:43:09.814 INFO:tasks.workunit.client.0.smithi066.stdout:7/300: unlink d2/d5/f1a 0 2024-09-12T01:43:09.815 INFO:tasks.workunit.client.1.smithi153.stdout:2/676: symlink d7/lda 0 2024-09-12T01:43:09.816 INFO:tasks.workunit.client.1.smithi153.stdout:2/677: chown d7/db/d6c/d9f 0 1 2024-09-12T01:43:09.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/344: symlink de/d13/d1e/d41/d58/l6d 0 2024-09-12T01:43:09.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/345: fdatasync f8 0 2024-09-12T01:43:09.820 INFO:tasks.workunit.client.1.smithi153.stdout:3/768: dwrite d1/d13/f37 [0,4194304] 0 2024-09-12T01:43:09.820 INFO:tasks.workunit.client.1.smithi153.stdout:3/769: creat d1/d13/d23/d47/d6c/fe0 x:0 0 0 2024-09-12T01:43:09.822 INFO:tasks.workunit.client.0.smithi066.stdout:9/419: truncate d0/d6/d17/d28/f77 139415 0 2024-09-12T01:43:09.827 INFO:tasks.workunit.client.0.smithi066.stdout:4/336: rename d4/d15/f28 to d4/d6/d48/d5a/f6b 0 2024-09-12T01:43:09.830 INFO:tasks.workunit.client.0.smithi066.stdout:3/399: mkdir d5/d6/d1b/d45/d85 0 2024-09-12T01:43:09.831 INFO:tasks.workunit.client.1.smithi153.stdout:4/630: rename d6/d15/db4/c5b to d6/d6a/ce0 0 2024-09-12T01:43:09.833 INFO:tasks.workunit.client.0.smithi066.stdout:1/346: rmdir d5/d52/d60 39 2024-09-12T01:43:09.835 INFO:tasks.workunit.client.1.smithi153.stdout:7/654: mkdir d12/d21/d29/d35/dcb 0 2024-09-12T01:43:09.835 INFO:tasks.workunit.client.1.smithi153.stdout:7/655: stat d12/d21/d29/d35/d37/d4c/d8e/fa1 0 2024-09-12T01:43:09.837 INFO:tasks.workunit.client.0.smithi066.stdout:8/390: creat d12/d21/d2f/d57/d3c/d49/f7e x:0 0 0 2024-09-12T01:43:09.837 INFO:tasks.workunit.client.0.smithi066.stdout:8/391: write ff [1113520,100243] 0 2024-09-12T01:43:09.838 INFO:tasks.workunit.client.0.smithi066.stdout:4/337: read d4/d6/d8/f3b [3580561,14013] 0 2024-09-12T01:43:09.838 INFO:tasks.workunit.client.0.smithi066.stdout:4/338: fsync d4/d6/f34 0 2024-09-12T01:43:09.838 INFO:tasks.workunit.client.0.smithi066.stdout:0/404: creat d1/d72/de/d47/d4a/d67/f91 x:0 0 0 2024-09-12T01:43:09.839 INFO:tasks.workunit.client.0.smithi066.stdout:8/392: dread d12/d21/d2f/f34 [0,4194304] 0 2024-09-12T01:43:09.839 INFO:tasks.workunit.client.0.smithi066.stdout:8/393: read - d12/f74 zero size 2024-09-12T01:43:09.839 INFO:tasks.workunit.client.0.smithi066.stdout:8/394: truncate d12/f70 61810 0 2024-09-12T01:43:09.839 INFO:tasks.workunit.client.1.smithi153.stdout:6/771: truncate d1/d6/d23/f48 545139 0 2024-09-12T01:43:09.843 INFO:tasks.workunit.client.0.smithi066.stdout:7/301: dwrite d2/d5/da/d3f/f57 [0,4194304] 0 2024-09-12T01:43:09.844 INFO:tasks.workunit.client.1.smithi153.stdout:2/678: dwrite d7/db/d27/f4c [0,4194304] 0 2024-09-12T01:43:09.845 INFO:tasks.workunit.client.1.smithi153.stdout:6/772: dread d1/df/f50 [0,4194304] 0 2024-09-12T01:43:09.846 INFO:tasks.workunit.client.0.smithi066.stdout:2/346: rename de/d3c/l63 to de/d13/d28/d3d/l6e 0 2024-09-12T01:43:09.846 INFO:tasks.workunit.client.0.smithi066.stdout:7/302: rename d2/d5/d6/d40 to d2/d5/d6/d40/d65 22 2024-09-12T01:43:09.846 INFO:tasks.workunit.client.0.smithi066.stdout:7/303: creat d2/d5/d56/f66 x:0 0 0 2024-09-12T01:43:09.846 INFO:tasks.workunit.client.0.smithi066.stdout:7/304: chown d2/d5/d6/d40/d51 39 1 2024-09-12T01:43:09.846 INFO:tasks.workunit.client.0.smithi066.stdout:7/305: creat d2/d20/d25/f67 x:0 0 0 2024-09-12T01:43:09.849 INFO:tasks.workunit.client.0.smithi066.stdout:3/400: mkdir d5/d6/d1b/d28/d86 0 2024-09-12T01:43:09.850 INFO:tasks.workunit.client.1.smithi153.stdout:5/721: mknod d0/df/d83/ce5 0 2024-09-12T01:43:09.851 INFO:tasks.workunit.client.1.smithi153.stdout:7/656: write d12/d21/d29/d35/fb7 [3874165,16268] 0 2024-09-12T01:43:09.851 INFO:tasks.workunit.client.1.smithi153.stdout:7/657: write d12/d21/d29/d35/d37/d4c/f62 [426400,35730] 0 2024-09-12T01:43:09.856 INFO:tasks.workunit.client.0.smithi066.stdout:4/339: mkdir d4/d6/d27/d66/d6c 0 2024-09-12T01:43:09.859 INFO:tasks.workunit.client.0.smithi066.stdout:3/401: write d5/d6/d1b/d45/d66/d67/f69 [1483666,48526] 0 2024-09-12T01:43:09.860 INFO:tasks.workunit.client.0.smithi066.stdout:8/395: symlink d12/d21/d2f/d57/d3c/d49/d50/d56/d69/l7f 0 2024-09-12T01:43:09.860 INFO:tasks.workunit.client.0.smithi066.stdout:8/396: fsync d12/f5b 0 2024-09-12T01:43:09.861 INFO:tasks.workunit.client.1.smithi153.stdout:2/679: mknod d7/db/d62/dbb/dd3/cdb 0 2024-09-12T01:43:09.865 INFO:tasks.workunit.client.0.smithi066.stdout:7/306: dwrite d2/d5/d6/d22/f4e [0,4194304] 0 2024-09-12T01:43:09.865 INFO:tasks.workunit.client.0.smithi066.stdout:7/307: write d2/d5/da/d3f/d52/f5b [411401,99033] 0 2024-09-12T01:43:09.865 INFO:tasks.workunit.client.0.smithi066.stdout:9/420: rmdir d0/d6/d17/d1b/d4c/d4b 39 2024-09-12T01:43:09.865 INFO:tasks.workunit.client.0.smithi066.stdout:9/421: readlink d0/d6/l3a 0 2024-09-12T01:43:09.866 INFO:tasks.workunit.client.0.smithi066.stdout:9/422: creat d0/d6/d17/f98 x:0 0 0 2024-09-12T01:43:09.866 INFO:tasks.workunit.client.0.smithi066.stdout:9/423: chown d0/d6/d17/d4f/l30 16190 1 2024-09-12T01:43:09.871 INFO:tasks.workunit.client.1.smithi153.stdout:6/773: mkdir d1/d80/dfa 0 2024-09-12T01:43:09.871 INFO:tasks.workunit.client.0.smithi066.stdout:2/347: dwrite de/d13/d1e/d25/f29 [0,4194304] 0 2024-09-12T01:43:09.874 INFO:tasks.workunit.client.1.smithi153.stdout:3/770: symlink d1/d13/d23/d47/le1 0 2024-09-12T01:43:09.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.874+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f249c0ffd20 con 0x7f248c038e40 2024-09-12T01:43:09.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/658: mknod d12/d21/d4d/ccc 0 2024-09-12T01:43:09.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/659: stat d12/d21/d5f/f8c 0 2024-09-12T01:43:09.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/660: chown d12/d21/d29/f8d 349866910 1 2024-09-12T01:43:09.879 INFO:tasks.workunit.client.1.smithi153.stdout:6/774: unlink d1/d6/da/d19/d3a/db0/ce4 0 2024-09-12T01:43:09.882 INFO:tasks.workunit.client.0.smithi066.stdout:1/347: symlink d5/d15/l62 0 2024-09-12T01:43:09.883 INFO:tasks.workunit.client.1.smithi153.stdout:2/680: dwrite d7/db/d6c/d76/db8/dcf/f8e [0,4194304] 0 2024-09-12T01:43:09.883 INFO:tasks.workunit.client.1.smithi153.stdout:2/681: chown d7/d17/f8c 13159948 1 2024-09-12T01:43:09.884 INFO:tasks.workunit.client.1.smithi153.stdout:2/682: chown d7/db/l24 237 1 2024-09-12T01:43:09.884 INFO:tasks.workunit.client.1.smithi153.stdout:2/683: dread - d7/db/f50 zero size 2024-09-12T01:43:09.884 INFO:tasks.workunit.client.1.smithi153.stdout:7/661: rename d12/f53 to d12/d21/d29/d35/d95/fcd 0 2024-09-12T01:43:09.884 INFO:tasks.workunit.client.1.smithi153.stdout:7/662: readlink d12/d21/d29/d35/lc1 0 2024-09-12T01:43:09.885 INFO:tasks.workunit.client.0.smithi066.stdout:4/340: symlink d4/d6/d27/d66/d6c/l6d 0 2024-09-12T01:43:09.885 INFO:tasks.workunit.client.1.smithi153.stdout:6/775: dread d1/d6/d23/d98/d53/d8d/fa9 [0,4194304] 0 2024-09-12T01:43:09.886 INFO:tasks.workunit.client.1.smithi153.stdout:6/776: dread - d1/d6/d39/d76/f9a zero size 2024-09-12T01:43:09.886 INFO:tasks.workunit.client.1.smithi153.stdout:6/777: write d1/d6/d23/d98/f68 [848786,57954] 0 2024-09-12T01:43:09.886 INFO:tasks.workunit.client.1.smithi153.stdout:6/778: stat d1/d6/da/d19/d3a/lb1 0 2024-09-12T01:43:09.892 INFO:tasks.workunit.client.1.smithi153.stdout:2/684: read d7/db/d62/f7f [2465003,66642] 0 2024-09-12T01:43:09.892 INFO:tasks.workunit.client.1.smithi153.stdout:2/685: creat d7/db/d36/fdc x:0 0 0 2024-09-12T01:43:09.894 INFO:tasks.workunit.client.0.smithi066.stdout:4/341: read d4/d6/d27/d2f/f54 [269023,85716] 0 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:6/779: dread d1/d6/d23/d98/d53/f6a [0,4194304] 0 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:3/771: rmdir d1/d16/d17/d82/d92 39 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:6/780: stat d1/d6/d46/d73/d8a 0 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:6/781: fsync d1/d6/d39/d76/f9a 0 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:3/772: readlink d1/d13/d25/l57 0 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:3/773: chown d1/d13/d25/f42 8107 1 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:6/782: creat d1/d6/d23/d98/d4f/ffb x:0 0 0 2024-09-12T01:43:09.897 INFO:tasks.workunit.client.1.smithi153.stdout:6/783: fsync d1/d6/d23/d98/d53/d69/d7c/d7f/f95 0 2024-09-12T01:43:09.898 INFO:tasks.workunit.client.1.smithi153.stdout:3/774: write d1/d13/d25/f42 [126109,97716] 0 2024-09-12T01:43:09.900 INFO:tasks.workunit.client.1.smithi153.stdout:7/663: creat d12/d21/d29/d35/d37/fce x:0 0 0 2024-09-12T01:43:09.900 INFO:tasks.workunit.client.1.smithi153.stdout:7/664: fsync d12/d21/d29/f2c 0 2024-09-12T01:43:09.902 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.902+0000 7f24997fa640 1 -- 172.21.15.66:0/1952076034 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f249c0ffd20 con 0x7f248c038e40 2024-09-12T01:43:09.902 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:43:09.902 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (6m) 118s ago 7m 25.3M - 0.25.0 c8568f914cd2 b2c0b1b4f381 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (7m) 118s ago 7m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (6m) 12s ago 6m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (6m) 118s ago 7m 82.9M - 9.4.7 954c08fa6188 a6ff5cae127b 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (2m) 118s ago 2m 10.9M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (2m) 118s ago 2m 16.2M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (2m) 12s ago 2m 14.5M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (2m) 12s ago 2m 14.5M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:9283,8765,8443 running (9m) 118s ago 9m 450M - 17.2.7-1609-g554ba93e d4c538e492e4 d4facfef752d 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (19s) 12s ago 6m 69.1M - 19.1.1-298-gb53b6d3e 54467abc55f8 514739a269bf 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (9m) 118s ago 9m 49.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (6m) 12s ago 6m 37.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (7m) 118s ago 7m 16.1M - 1.5.0 0da6a335fe13 ebe17b848675 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (6m) 12s ago 6m 16.8M - 1.5.0 0da6a335fe13 6391262c1a15 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (6m) 118s ago 6m 45.9M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:43:09.903 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (5m) 118s ago 5m 44.5M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:43:09.904 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (5m) 118s ago 5m 42.8M 4288M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:43:09.904 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (4m) 12s ago 4m 120M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:43:09.904 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (4m) 12s ago 4m 123M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:43:09.904 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (3m) 12s ago 3m 110M 5312M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:43:09.904 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (6m) 118s ago 7m 53.3M - 2.43.0 a07b618ecd1d 25c9c1516174 2024-09-12T01:43:09.904 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:09 smithi066 ceph-mon[27875]: pgmap v3: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail 2024-09-12T01:43:09.904 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:09 smithi066 ceph-mon[27875]: Deploying cephadm binary to smithi066 2024-09-12T01:43:09.904 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:09 smithi066 ceph-mon[27875]: Deploying cephadm binary to smithi153 2024-09-12T01:43:09.904 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:09 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:09.904 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:09 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:09.905 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:09 smithi066 ceph-mon[27875]: mgrmap e23: smithi153.jpnqza(active, since 2s) 2024-09-12T01:43:09.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f248c038e40 msgr2=0x7f248c03b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f248c038e40 0x7f248c03b2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f249000b020 tx=0x7f2490035040 comp rx=0 tx=0).stop 2024-09-12T01:43:09.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 msgr2=0x7f249c0fe320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 0x7f249c0fe320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f248800c7e0 tx=0x7f2488007f20 comp rx=0 tx=0).stop 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 shutdown_connections 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f248c038e40 0x7f248c03b2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c0fd500 0x7f249c0fe320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 --2- 172.21.15.66:0/1952076034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c0fcbb0 0x7f249c0fdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 >> 172.21.15.66:0/1952076034 conn(0x7f249c0f63a0 msgr2=0x7f249c0f67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 shutdown_connections 2024-09-12T01:43:09.906 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:09.905+0000 7f24a2ed7640 1 -- 172.21.15.66:0/1952076034 wait complete. 2024-09-12T01:43:09.911 INFO:tasks.workunit.client.1.smithi153.stdout:3/775: dwrite d1/d16/d17/d82/fa3 [0,4194304] 0 2024-09-12T01:43:09.946 INFO:tasks.workunit.client.0.smithi066.stdout:8/397: mknod d12/d21/d2f/d57/d3c/d49/d50/d56/d69/c80 0 2024-09-12T01:43:09.950 INFO:tasks.workunit.client.0.smithi066.stdout:7/308: getdents d2 0 2024-09-12T01:43:09.952 INFO:tasks.workunit.client.0.smithi066.stdout:7/309: dread d2/d20/d2f/f34 [0,4194304] 0 2024-09-12T01:43:09.952 INFO:tasks.workunit.client.1.smithi153.stdout:8/656: sync 2024-09-12T01:43:09.961 INFO:tasks.workunit.client.0.smithi066.stdout:4/342: symlink d4/d6/d27/d66/d58/l6e 0 2024-09-12T01:43:09.962 INFO:tasks.workunit.client.1.smithi153.stdout:2/686: truncate d7/db/f30 1407035 0 2024-09-12T01:43:09.962 INFO:tasks.workunit.client.0.smithi066.stdout:1/348: dread d5/dc/f33 [0,4194304] 0 2024-09-12T01:43:09.964 INFO:tasks.workunit.client.0.smithi066.stdout:4/343: dread d4/f37 [0,4194304] 0 2024-09-12T01:43:09.964 INFO:tasks.workunit.client.0.smithi066.stdout:4/344: fdatasync d4/f37 0 2024-09-12T01:43:09.964 INFO:tasks.workunit.client.0.smithi066.stdout:4/345: truncate d4/d6/d8/f1a 1002267 0 2024-09-12T01:43:09.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/346: chown d4/d6/d8/d18/f69 7 1 2024-09-12T01:43:09.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/347: chown d4/d6/d27/l50 7539 1 2024-09-12T01:43:09.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/348: write d4/d15/d33/f5d [851143,49326] 0 2024-09-12T01:43:09.965 INFO:tasks.workunit.client.0.smithi066.stdout:4/349: chown d4/d6/d8/d18/l26 318348 1 2024-09-12T01:43:09.965 INFO:tasks.workunit.client.1.smithi153.stdout:6/784: symlink d1/d6/da/d19/d34/lfc 0 2024-09-12T01:43:09.967 INFO:tasks.workunit.client.1.smithi153.stdout:7/665: creat d12/d21/d29/d2d/da6/fcf x:0 0 0 2024-09-12T01:43:09.973 INFO:tasks.workunit.client.1.smithi153.stdout:3/776: rename d1/d45/f61 to d1/d45/dc2/fe2 0 2024-09-12T01:43:09.982 INFO:tasks.workunit.client.1.smithi153.stdout:6/785: dwrite d1/d6/da/d19/d34/f20 [0,4194304] 0 2024-09-12T01:43:09.982 INFO:tasks.workunit.client.1.smithi153.stdout:6/786: chown d1/d6/da/d19/c67 17010332 1 2024-09-12T01:43:09.984 INFO:tasks.workunit.client.1.smithi153.stdout:8/657: mkdir d17/d21/d56/d95/dd6 0 2024-09-12T01:43:09.985 INFO:tasks.workunit.client.1.smithi153.stdout:8/658: dread - d17/d1f/d4f/d34/db4/fa8 zero size 2024-09-12T01:43:09.987 INFO:tasks.workunit.client.0.smithi066.stdout:7/310: mknod d2/d5/d6/c68 0 2024-09-12T01:43:09.988 INFO:tasks.workunit.client.1.smithi153.stdout:2/687: getdents d7/db/d6c 0 2024-09-12T01:43:09.988 INFO:tasks.workunit.client.1.smithi153.stdout:2/688: readlink d7/db/d27/l3b 0 2024-09-12T01:43:09.988 INFO:tasks.workunit.client.1.smithi153.stdout:2/689: fdatasync d7/db/f39 0 2024-09-12T01:43:09.989 INFO:tasks.workunit.client.0.smithi066.stdout:1/349: mknod d5/d52/c63 0 2024-09-12T01:43:09.991 INFO:tasks.workunit.client.1.smithi153.stdout:7/666: mknod d12/d21/d29/d2d/da6/dc8/cd0 0 2024-09-12T01:43:09.993 INFO:tasks.workunit.client.0.smithi066.stdout:3/402: symlink d5/d6/d1b/d28/d4f/d5e/l87 0 2024-09-12T01:43:09.993 INFO:tasks.workunit.client.0.smithi066.stdout:3/403: chown d5/d6/d1b/d45/d66/f6c 426589 1 2024-09-12T01:43:09.996 INFO:tasks.workunit.client.0.smithi066.stdout:4/350: creat d4/d15/d33/d5e/f6f x:0 0 0 2024-09-12T01:43:09.996 INFO:tasks.workunit.client.0.smithi066.stdout:4/351: write d4/f12 [310891,24959] 0 2024-09-12T01:43:09.997 INFO:tasks.workunit.client.1.smithi153.stdout:7/667: dread d12/d21/d29/d35/d37/d58/f63 [0,4194304] 0 2024-09-12T01:43:10.004 INFO:tasks.workunit.client.0.smithi066.stdout:1/350: truncate d5/d15/f3a 797201 0 2024-09-12T01:43:10.008 INFO:tasks.workunit.client.0.smithi066.stdout:0/405: truncate d1/d72/f14 1528881 0 2024-09-12T01:43:10.009 INFO:tasks.workunit.client.1.smithi153.stdout:8/659: symlink d17/d1d/d27/ld7 0 2024-09-12T01:43:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.011+0000 7fa87c96d640 1 -- 172.21.15.66:0/293741863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 msgr2=0x7fa8780fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.011+0000 7fa87c96d640 1 --2- 172.21.15.66:0/293741863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa8780fdc70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0048d0 tx=0x7fa86c009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.013 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.012+0000 7fa87c96d640 1 -- 172.21.15.66:0/293741863 shutdown_connections 2024-09-12T01:43:10.013 INFO:tasks.workunit.client.0.smithi066.stdout:1/351: symlink d5/dc/d53/l64 0 2024-09-12T01:43:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.012+0000 7fa87c96d640 1 --2- 172.21.15.66:0/293741863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa8780fdc70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.013+0000 7fa87c96d640 1 --2- 172.21.15.66:0/293741863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8780fc530 0x7fa8780fc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.013+0000 7fa87c96d640 1 -- 172.21.15.66:0/293741863 >> 172.21.15.66:0/293741863 conn(0x7fa8780f7d10 msgr2=0x7fa8780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.014 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.014+0000 7fa87c96d640 1 -- 172.21.15.66:0/293741863 shutdown_connections 2024-09-12T01:43:10.014 INFO:tasks.workunit.client.0.smithi066.stdout:7/311: dwrite d2/d5/d56/f66 [0,4194304] 0 2024-09-12T01:43:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.014+0000 7fa87c96d640 1 -- 172.21.15.66:0/293741863 wait complete. 2024-09-12T01:43:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.014+0000 7fa87c96d640 1 Processor -- start 2024-09-12T01:43:10.015 INFO:tasks.workunit.client.0.smithi066.stdout:7/312: write d2/d20/d1d/f4c [450272,41589] 0 2024-09-12T01:43:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa87c96d640 1 -- start start 2024-09-12T01:43:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa87c96d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8780fc530 0x7fa878071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa87c96d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa87806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa87c96d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa878070080 con 0x7fa8780fd800 2024-09-12T01:43:10.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa87c96d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8780701c0 con 0x7fa8780fc530 2024-09-12T01:43:10.016 INFO:tasks.workunit.client.0.smithi066.stdout:4/352: dwrite d4/d6/f30 [4194304,4194304] 0 2024-09-12T01:43:10.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa875d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa87806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.016 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa875d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa87806fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58570/0 (socket says 172.21.15.66:58570) 2024-09-12T01:43:10.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.015+0000 7fa875d9b640 1 -- 172.21.15.66:0/3222626441 learned_addr learned my addr 172.21.15.66:0/3222626441 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:10.017 INFO:tasks.workunit.client.0.smithi066.stdout:3/404: getdents d5/d35 0 2024-09-12T01:43:10.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.016+0000 7fa875d9b640 1 -- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8780fc530 msgr2=0x7fa878071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.016+0000 7fa875d9b640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8780fc530 0x7fa878071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.017 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.016+0000 7fa875d9b640 1 -- 172.21.15.66:0/3222626441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c005040 con 0x7fa8780fd800 2024-09-12T01:43:10.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.016+0000 7fa875d9b640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa87806fa60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa86c003080 tx=0x7fa86c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.017+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86c038070 con 0x7fa8780fd800 2024-09-12T01:43:10.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.017+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa878070440 con 0x7fa8780fd800 2024-09-12T01:43:10.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.017+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa878115120 con 0x7fa8780fd800 2024-09-12T01:43:10.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.017+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa86c02abd0 con 0x7fa8780fd800 2024-09-12T01:43:10.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.017+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa86c03e670 con 0x7fa8780fd800 2024-09-12T01:43:10.019 INFO:tasks.workunit.client.1.smithi153.stdout:2/690: mkdir d7/db/d62/d87/ddd 0 2024-09-12T01:43:10.019 INFO:tasks.workunit.client.1.smithi153.stdout:2/691: dread d7/db/d1d/d1e/f26 [0,4194304] 0 2024-09-12T01:43:10.019 INFO:tasks.workunit.client.1.smithi153.stdout:2/692: dread d7/d19/d83/fa7 [0,4194304] 0 2024-09-12T01:43:10.020 INFO:tasks.workunit.client.1.smithi153.stdout:7/668: creat d12/d21/d29/d2d/d8b/fd1 x:0 0 0 2024-09-12T01:43:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.019+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 23) v1 ==== 46241+0+0 (secure 0 0 0) 0x7fa86c030020 con 0x7fa8780fd800 2024-09-12T01:43:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.019+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa858005240 con 0x7fa8780fd800 2024-09-12T01:43:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.020+0000 7fa866ffd640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fa860038df0 0x7fa86003b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.020 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.020+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa86c06c3e0 con 0x7fa8780fd800 2024-09-12T01:43:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.021+0000 7fa87659c640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fa860038df0 0x7fa86003b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.021 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.021+0000 7fa87659c640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fa860038df0 0x7fa86003b2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa878071320 tx=0x7fa868006d20 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.025 INFO:tasks.workunit.client.1.smithi153.stdout:3/777: rmdir d1/d13/d23/d47/d71/d8e 39 2024-09-12T01:43:10.025 INFO:tasks.workunit.client.1.smithi153.stdout:3/778: chown d1/d16/d17/d82/d92/fd5 8589947 1 2024-09-12T01:43:10.025 INFO:tasks.workunit.client.1.smithi153.stdout:7/669: write d12/d21/d4d/f7d [2097070,107920] 0 2024-09-12T01:43:10.026 INFO:tasks.workunit.client.0.smithi066.stdout:7/313: mknod d2/d5/da/d3f/d5e/c69 0 2024-09-12T01:43:10.026 INFO:tasks.workunit.client.0.smithi066.stdout:7/314: read d2/f2b [2114379,8576] 0 2024-09-12T01:43:10.027 INFO:tasks.workunit.client.1.smithi153.stdout:8/660: symlink d17/d1d/ld8 0 2024-09-12T01:43:10.030 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.030+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa86c03cbc0 con 0x7fa8780fd800 2024-09-12T01:43:10.030 INFO:tasks.workunit.client.1.smithi153.stdout:2/693: unlink d7/db/d6c/d7e/f63 0 2024-09-12T01:43:10.030 INFO:tasks.workunit.client.1.smithi153.stdout:2/694: write d7/db/d27/f73 [1111851,47479] 0 2024-09-12T01:43:10.031 INFO:tasks.workunit.client.0.smithi066.stdout:3/405: truncate d5/d6/dd/f1c 1522806 0 2024-09-12T01:43:10.031 INFO:tasks.workunit.client.1.smithi153.stdout:0/827: sync 2024-09-12T01:43:10.034 INFO:tasks.workunit.client.0.smithi066.stdout:1/352: symlink d5/d15/l65 0 2024-09-12T01:43:10.034 INFO:tasks.workunit.client.0.smithi066.stdout:1/353: write d5/dc/d36/d4b/f11 [4208976,108986] 0 2024-09-12T01:43:10.037 INFO:tasks.workunit.client.0.smithi066.stdout:0/406: dwrite d1/d72/de/d47/d4a/d67/f52 [0,4194304] 0 2024-09-12T01:43:10.039 INFO:tasks.workunit.client.0.smithi066.stdout:7/315: symlink d2/d20/d25/l6a 0 2024-09-12T01:43:10.039 INFO:tasks.workunit.client.1.smithi153.stdout:8/661: mkdir d17/d1d/d93/dd9 0 2024-09-12T01:43:10.039 INFO:tasks.workunit.client.1.smithi153.stdout:8/662: stat d17/d1d/d27/l33 0 2024-09-12T01:43:10.041 INFO:tasks.workunit.client.0.smithi066.stdout:3/406: write d5/d6/d1b/d45/d66/d67/f69 [5023730,1356] 0 2024-09-12T01:43:10.041 INFO:tasks.workunit.client.0.smithi066.stdout:3/407: creat d5/d6/d1b/f88 x:0 0 0 2024-09-12T01:43:10.042 INFO:tasks.workunit.client.0.smithi066.stdout:4/353: dwrite d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:10.043 INFO:tasks.workunit.client.1.smithi153.stdout:0/828: mkdir d22/d30/d4c/d8a/d117 0 2024-09-12T01:43:10.045 INFO:tasks.workunit.client.0.smithi066.stdout:7/316: link d2/d5/da/l38 d2/d41/d53/l6b 0 2024-09-12T01:43:10.047 INFO:tasks.workunit.client.0.smithi066.stdout:8/398: truncate d12/d21/d2f/d57/d43/d66/f68 1531967 0 2024-09-12T01:43:10.048 INFO:tasks.workunit.client.0.smithi066.stdout:8/399: chown d12/d21/d2f/c4c 58047 1 2024-09-12T01:43:10.048 INFO:tasks.workunit.client.0.smithi066.stdout:1/354: write d5/dc/d53/f5a [1403852,39779] 0 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:0/829: dread d22/d30/f42 [4194304,4194304] 0 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:0/830: creat d22/d82/f118 x:0 0 0 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:8/663: mkdir d17/d1f/d4f/d34/db4/dda 0 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:0/831: creat d22/d30/d4c/d6f/dfa/f119 x:0 0 0 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:5/722: sync 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:9/704: sync 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/631: sync 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:1/765: sync 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/632: write d6/d15/db4/dbd/fd6 [236781,74512] 0 2024-09-12T01:43:10.054 INFO:tasks.workunit.client.1.smithi153.stdout:4/633: chown d6/d9/d11/c5c 5 1 2024-09-12T01:43:10.056 INFO:tasks.workunit.client.1.smithi153.stdout:7/670: dwrite d12/d21/d29/d2d/da6/fcf [0,4194304] 0 2024-09-12T01:43:10.056 INFO:tasks.workunit.client.1.smithi153.stdout:7/671: creat d12/d21/d4d/fd2 x:0 0 0 2024-09-12T01:43:10.056 INFO:tasks.workunit.client.0.smithi066.stdout:3/408: unlink d5/l1d 0 2024-09-12T01:43:10.062 INFO:tasks.workunit.client.0.smithi066.stdout:4/354: link d4/d15/d33/c3e d4/d6/d27/d66/c70 0 2024-09-12T01:43:10.064 INFO:tasks.workunit.client.1.smithi153.stdout:8/664: mkdir d17/d21/d56/d95/dd6/ddb 0 2024-09-12T01:43:10.064 INFO:tasks.workunit.client.1.smithi153.stdout:4/634: dread d6/d9/dc/f64 [0,4194304] 0 2024-09-12T01:43:10.064 INFO:tasks.workunit.client.1.smithi153.stdout:4/635: write d6/d9/dc/d31/fa9 [649884,8387] 0 2024-09-12T01:43:10.064 INFO:tasks.workunit.client.1.smithi153.stdout:4/636: fsync d6/f8b 0 2024-09-12T01:43:10.068 INFO:tasks.workunit.client.1.smithi153.stdout:0/832: mknod d22/d79/d8e/c11a 0 2024-09-12T01:43:10.068 INFO:tasks.workunit.client.1.smithi153.stdout:7/672: dread d12/d21/d29/d35/d37/d58/f81 [0,4194304] 0 2024-09-12T01:43:10.071 INFO:tasks.workunit.client.0.smithi066.stdout:3/409: dread d5/fa [0,4194304] 0 2024-09-12T01:43:10.071 INFO:tasks.workunit.client.0.smithi066.stdout:3/410: readlink d5/d6/d1b/d45/d66/l5f 0 2024-09-12T01:43:10.072 INFO:tasks.workunit.client.0.smithi066.stdout:7/317: mkdir d2/d20/d1d/d6c 0 2024-09-12T01:43:10.073 INFO:tasks.workunit.client.1.smithi153.stdout:5/723: mknod d0/ce6 0 2024-09-12T01:43:10.073 INFO:tasks.workunit.client.1.smithi153.stdout:5/724: fdatasync d0/df/d83/d36/d39/da4/fba 0 2024-09-12T01:43:10.077 INFO:tasks.workunit.client.1.smithi153.stdout:8/665: dread d17/d21/d56/f63 [0,4194304] 0 2024-09-12T01:43:10.077 INFO:tasks.workunit.client.1.smithi153.stdout:2/695: dwrite d7/db/d62/d87/fb9 [0,4194304] 0 2024-09-12T01:43:10.079 INFO:tasks.workunit.client.0.smithi066.stdout:8/400: unlink d12/d21/d2f/d57/f27 0 2024-09-12T01:43:10.079 INFO:tasks.workunit.client.1.smithi153.stdout:9/705: symlink d3/d55/d30/d7b/d8f/ld0 0 2024-09-12T01:43:10.081 INFO:tasks.workunit.client.1.smithi153.stdout:1/766: mkdir d2/d9/d17/d2f/d56/d97/dfd 0 2024-09-12T01:43:10.081 INFO:tasks.workunit.client.1.smithi153.stdout:1/767: creat d2/d9/d17/d69/d95/ffe x:0 0 0 2024-09-12T01:43:10.082 INFO:tasks.workunit.client.0.smithi066.stdout:1/355: creat d5/d52/f66 x:0 0 0 2024-09-12T01:43:10.082 INFO:tasks.workunit.client.0.smithi066.stdout:1/356: write d5/d15/f43 [873003,39032] 0 2024-09-12T01:43:10.086 INFO:tasks.workunit.client.0.smithi066.stdout:4/355: dwrite d4/d6/d8/d18/f69 [0,4194304] 0 2024-09-12T01:43:10.087 INFO:tasks.workunit.client.0.smithi066.stdout:4/356: creat d4/f71 x:0 0 0 2024-09-12T01:43:10.087 INFO:tasks.workunit.client.0.smithi066.stdout:4/357: dread - d4/d6/d8/d18/d45/f57 zero size 2024-09-12T01:43:10.089 INFO:tasks.workunit.client.1.smithi153.stdout:4/637: symlink d6/d6a/d9c/le1 0 2024-09-12T01:43:10.090 INFO:tasks.workunit.client.0.smithi066.stdout:7/318: mknod d2/d3c/c6d 0 2024-09-12T01:43:10.090 INFO:tasks.workunit.client.0.smithi066.stdout:7/319: write d2/d20/d1d/f4c [780318,113148] 0 2024-09-12T01:43:10.090 INFO:tasks.workunit.client.0.smithi066.stdout:7/320: fsync d2/d5/f31 0 2024-09-12T01:43:10.090 INFO:tasks.workunit.client.0.smithi066.stdout:7/321: dread - d2/d5/f31 zero size 2024-09-12T01:43:10.090 INFO:tasks.workunit.client.0.smithi066.stdout:7/322: chown d2/d5/d6/c3a 29833 1 2024-09-12T01:43:10.091 INFO:tasks.workunit.client.1.smithi153.stdout:7/673: link d12/d21/d29/d35/d37/f6c d12/d21/d29/d35/d37/d4c/d8e/fd3 0 2024-09-12T01:43:10.093 INFO:tasks.workunit.client.0.smithi066.stdout:8/401: symlink d12/d21/d2f/d57/d3c/d49/d6f/l81 0 2024-09-12T01:43:10.093 INFO:tasks.workunit.client.0.smithi066.stdout:8/402: write d12/f47 [109898,2519] 0 2024-09-12T01:43:10.093 INFO:tasks.workunit.client.0.smithi066.stdout:8/403: chown d12/d21/d2f/d57/d3c/c4f 317524 1 2024-09-12T01:43:10.094 INFO:tasks.workunit.client.1.smithi153.stdout:3/779: write d1/d13/d25/f4c [59417,9066] 0 2024-09-12T01:43:10.094 INFO:tasks.workunit.client.1.smithi153.stdout:3/780: readlink d1/l15 0 2024-09-12T01:43:10.095 INFO:tasks.workunit.client.0.smithi066.stdout:7/323: dread d2/d20/d1d/f4c [0,4194304] 0 2024-09-12T01:43:10.099 INFO:tasks.workunit.client.1.smithi153.stdout:5/725: creat d0/df/db8/d2f/d55/fe7 x:0 0 0 2024-09-12T01:43:10.099 INFO:tasks.workunit.client.1.smithi153.stdout:5/726: chown d0/fd 1408 1 2024-09-12T01:43:10.109 INFO:tasks.workunit.client.1.smithi153.stdout:8/666: unlink d17/d21/d56/d96/f8a 0 2024-09-12T01:43:10.111 INFO:tasks.workunit.client.0.smithi066.stdout:8/404: unlink d12/d21/l3a 0 2024-09-12T01:43:10.111 INFO:tasks.workunit.client.0.smithi066.stdout:8/405: chown d12/f1b 11 1 2024-09-12T01:43:10.113 INFO:tasks.workunit.client.0.smithi066.stdout:7/324: getdents d2/d20/d2f 0 2024-09-12T01:43:10.113 INFO:tasks.workunit.client.0.smithi066.stdout:7/325: fsync d2/d20/d25/f48 0 2024-09-12T01:43:10.113 INFO:tasks.workunit.client.0.smithi066.stdout:7/326: chown d2/d5/da/d3f/d5e/c69 14 1 2024-09-12T01:43:10.113 INFO:tasks.workunit.client.0.smithi066.stdout:7/327: chown d2/d5/d6/d22 24404864 1 2024-09-12T01:43:10.116 INFO:tasks.workunit.client.0.smithi066.stdout:3/411: rename d5/d6/dd to d5/d6/d1b/d65/d89 0 2024-09-12T01:43:10.117 INFO:tasks.workunit.client.1.smithi153.stdout:2/696: symlink d7/db/d62/dbb/dd3/lde 0 2024-09-12T01:43:10.118 INFO:tasks.workunit.client.0.smithi066.stdout:8/406: mkdir d12/d21/d2f/d57/d43/d82 0 2024-09-12T01:43:10.119 INFO:tasks.workunit.client.0.smithi066.stdout:8/407: dread d12/f5b [0,4194304] 0 2024-09-12T01:43:10.120 INFO:tasks.workunit.client.1.smithi153.stdout:9/706: link d3/d55/l69 d3/d55/d30/d88/dc6/ld1 0 2024-09-12T01:43:10.121 INFO:tasks.workunit.client.0.smithi066.stdout:7/328: unlink d2/d5/c32 0 2024-09-12T01:43:10.123 INFO:tasks.workunit.client.1.smithi153.stdout:9/707: dread d3/d55/f77 [0,4194304] 0 2024-09-12T01:43:10.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/768: mknod d2/d9/d17/dab/cff 0 2024-09-12T01:43:10.130 INFO:tasks.workunit.client.0.smithi066.stdout:4/358: rename d4/d15/d61 to d4/d6/d27/d2f/d72 0 2024-09-12T01:43:10.131 INFO:tasks.workunit.client.1.smithi153.stdout:4/638: unlink d6/d9/d20/la7 0 2024-09-12T01:43:10.131 INFO:tasks.workunit.client.1.smithi153.stdout:4/639: fdatasync d6/d6a/d9c/fbc 0 2024-09-12T01:43:10.131 INFO:tasks.workunit.client.1.smithi153.stdout:4/640: write d6/d9/d11/d90/f95 [2016915,81909] 0 2024-09-12T01:43:10.133 INFO:tasks.workunit.client.0.smithi066.stdout:3/412: creat d5/f8a x:0 0 0 2024-09-12T01:43:10.133 INFO:tasks.workunit.client.0.smithi066.stdout:3/413: chown d5/c21 17009023 1 2024-09-12T01:43:10.136 INFO:tasks.workunit.client.1.smithi153.stdout:7/674: mknod d12/d21/d4d/dae/dc0/cd4 0 2024-09-12T01:43:10.136 INFO:tasks.workunit.client.1.smithi153.stdout:7/675: fsync d12/d21/d29/d35/d95/fa9 0 2024-09-12T01:43:10.138 INFO:tasks.workunit.client.0.smithi066.stdout:8/408: mknod d12/d21/d2f/d57/d3c/d49/d50/d56/c83 0 2024-09-12T01:43:10.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/781: symlink d1/d13/d23/d47/d71/d8e/d93/d79/db5/le3 0 2024-09-12T01:43:10.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/782: readlink d1/d13/d23/d47/le1 0 2024-09-12T01:43:10.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/783: chown d1/d1e/c31 5085 1 2024-09-12T01:43:10.141 INFO:tasks.workunit.client.1.smithi153.stdout:3/784: chown d1 711 1 2024-09-12T01:43:10.142 INFO:tasks.workunit.client.0.smithi066.stdout:7/329: mknod d2/d5/d6/d40/d51/c6e 0 2024-09-12T01:43:10.142 INFO:tasks.workunit.client.0.smithi066.stdout:7/330: chown d2/d20/d2f/l64 2 1 2024-09-12T01:43:10.143 INFO:tasks.workunit.client.1.smithi153.stdout:5/727: fsync d0/df/d83/f42 0 2024-09-12T01:43:10.144 INFO:tasks.workunit.client.1.smithi153.stdout:7/676: dread d12/d21/d29/d35/d37/d4c/d8e/fb5 [0,4194304] 0 2024-09-12T01:43:10.145 INFO:tasks.workunit.client.0.smithi066.stdout:7/331: dread d2/d20/d2f/f34 [0,4194304] 0 2024-09-12T01:43:10.145 INFO:tasks.workunit.client.0.smithi066.stdout:7/332: getdents d2/d20/d1d/d6c 0 2024-09-12T01:43:10.146 INFO:tasks.workunit.client.1.smithi153.stdout:9/708: dwrite d3/d66/fc0 [0,4194304] 0 2024-09-12T01:43:10.146 INFO:tasks.workunit.client.1.smithi153.stdout:9/709: dread - d3/d3a/fb2 zero size 2024-09-12T01:43:10.148 INFO:tasks.workunit.client.1.smithi153.stdout:2/697: creat d7/db/d62/d87/dc9/fdf x:0 0 0 2024-09-12T01:43:10.149 INFO:tasks.workunit.client.0.smithi066.stdout:7/333: symlink d2/d5/d6/l6f 0 2024-09-12T01:43:10.151 INFO:tasks.workunit.client.1.smithi153.stdout:1/769: mkdir d2/d9/d17/d100 0 2024-09-12T01:43:10.151 INFO:tasks.workunit.client.1.smithi153.stdout:1/770: dread - d2/d9/fb5 zero size 2024-09-12T01:43:10.151 INFO:tasks.workunit.client.1.smithi153.stdout:1/771: write d2/d9/d17/d69/fec [967693,28364] 0 2024-09-12T01:43:10.151 INFO:tasks.workunit.client.1.smithi153.stdout:3/785: dread d1/d16/d17/d82/fa3 [0,4194304] 0 2024-09-12T01:43:10.154 INFO:tasks.workunit.client.1.smithi153.stdout:5/728: truncate d0/df/f5d 96152 0 2024-09-12T01:43:10.156 INFO:tasks.workunit.client.1.smithi153.stdout:7/677: link d12/d21/d29/d35/d37/d4c/f71 d12/d21/d4d/dae/dc0/dc4/fd5 0 2024-09-12T01:43:10.157 INFO:tasks.workunit.client.0.smithi066.stdout:7/334: mkdir d2/d20/d1d/d70 0 2024-09-12T01:43:10.158 INFO:tasks.workunit.client.1.smithi153.stdout:7/678: dread d12/d21/d29/d35/f7c [0,4194304] 0 2024-09-12T01:43:10.158 INFO:tasks.workunit.client.1.smithi153.stdout:7/679: chown d12/d21/d29/d35/d37/d4c/d5c/f7a 56 1 2024-09-12T01:43:10.160 INFO:tasks.workunit.client.0.smithi066.stdout:7/335: rmdir d2/d20/d2f 39 2024-09-12T01:43:10.161 INFO:tasks.workunit.client.1.smithi153.stdout:9/710: creat d3/d66/fd2 x:0 0 0 2024-09-12T01:43:10.162 INFO:tasks.workunit.client.1.smithi153.stdout:3/786: mkdir d1/d59/de4 0 2024-09-12T01:43:10.164 INFO:tasks.workunit.client.1.smithi153.stdout:4/641: dwrite d6/d6a/d9c/fbc [0,4194304] 0 2024-09-12T01:43:10.164 INFO:tasks.workunit.client.1.smithi153.stdout:4/642: write d6/d9/dc/d98/d3e/f50 [2631903,9135] 0 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.0.smithi066.stdout:7/336: mkdir d2/d71 0 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.0.smithi066.stdout:3/414: dwrite d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.0.smithi066.stdout:3/415: stat d5/d6/d1b/d65/d89/l18 0 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.0.smithi066.stdout:3/416: write d5/d6/d1b/f3f [3271649,33184] 0 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.0.smithi066.stdout:3/417: chown d5/d6/d1b/f2e 8300 1 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.0.smithi066.stdout:3/418: fsync d5/d6/d1b/d45/d66/d67/d6d/f55 0 2024-09-12T01:43:10.165 INFO:tasks.workunit.client.1.smithi153.stdout:5/729: rmdir d0 39 2024-09-12T01:43:10.166 INFO:tasks.workunit.client.1.smithi153.stdout:6/787: sync 2024-09-12T01:43:10.167 INFO:tasks.workunit.client.1.smithi153.stdout:2/698: read d7/d19/d40/f37 [1907178,10896] 0 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.1.smithi153.stdout:5/730: dread d0/d20/fa1 [0,4194304] 0 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.1.smithi153.stdout:5/731: write d0/df/db8/d2f/d55/d9c/d75/f95 [181360,85954] 0 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.1.smithi153.stdout:5/732: read - d0/d43/dac/db0/fd9 zero size 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.1.smithi153.stdout:5/733: chown d0/fd 4734 1 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.0.smithi066.stdout:7/337: creat d2/d5/d6/d40/d51/f72 x:0 0 0 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.0.smithi066.stdout:7/338: truncate d2/d5/d6/d40/d51/f72 773146 0 2024-09-12T01:43:10.168 INFO:tasks.workunit.client.0.smithi066.stdout:7/339: fsync d2/d5/d6/d22/f5c 0 2024-09-12T01:43:10.169 INFO:tasks.workunit.client.1.smithi153.stdout:1/772: write d2/d34/f39 [2131947,20114] 0 2024-09-12T01:43:10.169 INFO:tasks.workunit.client.1.smithi153.stdout:1/773: dread - d2/d9/d17/d69/d95/ffe zero size 2024-09-12T01:43:10.169 INFO:tasks.workunit.client.1.smithi153.stdout:1/774: chown d2/d9/f32 2810 1 2024-09-12T01:43:10.170 INFO:tasks.workunit.client.1.smithi153.stdout:7/680: mknod d12/d4e/cd6 0 2024-09-12T01:43:10.170 INFO:tasks.workunit.client.1.smithi153.stdout:7/681: dread - d12/d7e/f8f zero size 2024-09-12T01:43:10.171 INFO:tasks.workunit.client.0.smithi066.stdout:7/340: dread d2/d20/d1d/f3b [0,4194304] 0 2024-09-12T01:43:10.171 INFO:tasks.workunit.client.0.smithi066.stdout:3/419: mkdir d5/d6/d1b/d77/d8b 0 2024-09-12T01:43:10.172 INFO:tasks.workunit.client.0.smithi066.stdout:3/420: readlink d5/d6/d1b/l34 0 2024-09-12T01:43:10.175 INFO:tasks.workunit.client.1.smithi153.stdout:3/787: rename d1/f9d to d1/d13/d23/d47/d71/d8e/fe5 0 2024-09-12T01:43:10.179 INFO:tasks.workunit.client.1.smithi153.stdout:9/711: dwrite d3/d3a/d42/f68 [0,4194304] 0 2024-09-12T01:43:10.180 INFO:tasks.workunit.client.0.smithi066.stdout:3/421: dread d5/d6/d1b/d28/d4f/d5e/f4e [0,4194304] 0 2024-09-12T01:43:10.183 INFO:tasks.workunit.client.0.smithi066.stdout:7/341: getdents d2/d5/da/d3f/d52 0 2024-09-12T01:43:10.183 INFO:tasks.workunit.client.0.smithi066.stdout:7/342: write d2/d5/d6/d22/f4e [5214004,121627] 0 2024-09-12T01:43:10.185 INFO:tasks.workunit.client.0.smithi066.stdout:3/422: mknod d5/d6/d1b/d28/d86/c8c 0 2024-09-12T01:43:10.194 INFO:tasks.workunit.client.1.smithi153.stdout:4/643: rmdir d6/d15/db4/d7b/dd8 0 2024-09-12T01:43:10.194 INFO:tasks.workunit.client.1.smithi153.stdout:4/644: write d6/d6a/fc5 [466834,130542] 0 2024-09-12T01:43:10.195 INFO:tasks.workunit.client.0.smithi066.stdout:8/409: rename d12/d21/d2f/d57/d3c/d49 to d12/d21/d2f/d57/d84 0 2024-09-12T01:43:10.195 INFO:tasks.workunit.client.0.smithi066.stdout:7/343: rename d2/d5/d6 to d2/d5/d6/d40/d63/d73 22 2024-09-12T01:43:10.196 INFO:tasks.workunit.client.0.smithi066.stdout:3/423: write d5/d6/d1b/d65/d89/f81 [3245656,9193] 0 2024-09-12T01:43:10.197 INFO:tasks.workunit.client.1.smithi153.stdout:6/788: link d1/d6/da/fcd d1/d6/d23/d98/d53/d8d/ffd 0 2024-09-12T01:43:10.197 INFO:tasks.workunit.client.1.smithi153.stdout:6/789: dread - d1/d6/d46/d73/d8a/d84/d96/fdc zero size 2024-09-12T01:43:10.199 INFO:tasks.workunit.client.0.smithi066.stdout:7/344: link d2/d20/d25/l35 d2/d3c/l74 0 2024-09-12T01:43:10.199 INFO:tasks.workunit.client.0.smithi066.stdout:7/345: stat d2/d5/d56 0 2024-09-12T01:43:10.203 INFO:tasks.workunit.client.1.smithi153.stdout:5/734: symlink d0/d43/d68/le8 0 2024-09-12T01:43:10.210 INFO:tasks.workunit.client.0.smithi066.stdout:3/424: rename d5/d6/d1b/d65/d89/c32 to d5/d6/d1b/d45/d85/c8d 0 2024-09-12T01:43:10.210 INFO:tasks.workunit.client.0.smithi066.stdout:3/425: stat d5/d6/d1b/l76 0 2024-09-12T01:43:10.210 INFO:tasks.workunit.client.0.smithi066.stdout:3/426: truncate d5/d6/d48/f71 453399 0 2024-09-12T01:43:10.211 INFO:tasks.workunit.client.1.smithi153.stdout:1/775: mkdir d2/d9/d17/d2c/d101 0 2024-09-12T01:43:10.211 INFO:tasks.workunit.client.1.smithi153.stdout:1/776: fdatasync d2/d9/d28/d73/d76/fb0 0 2024-09-12T01:43:10.212 INFO:tasks.workunit.client.0.smithi066.stdout:8/410: getdents d12 0 2024-09-12T01:43:10.213 INFO:tasks.workunit.client.0.smithi066.stdout:8/411: truncate d12/d21/d2f/d57/d43/f46 3886691 0 2024-09-12T01:43:10.214 INFO:tasks.workunit.client.1.smithi153.stdout:7/682: mknod d12/d21/d29/d35/d37/d58/cd7 0 2024-09-12T01:43:10.215 INFO:tasks.workunit.client.1.smithi153.stdout:6/790: dwrite d1/d6/d23/d98/d4f/feb [0,4194304] 0 2024-09-12T01:43:10.219 INFO:tasks.workunit.client.1.smithi153.stdout:3/788: mkdir d1/d13/d23/d47/d71/d8e/de6 0 2024-09-12T01:43:10.219 INFO:tasks.workunit.client.1.smithi153.stdout:3/789: write d1/d13/d25/da6/f43 [216621,83987] 0 2024-09-12T01:43:10.219 INFO:tasks.workunit.client.1.smithi153.stdout:3/790: read - d1/d13/d23/d47/d6c/fa8 zero size 2024-09-12T01:43:10.220 INFO:tasks.workunit.client.1.smithi153.stdout:3/791: dread - d1/d13/d25/d26/fda zero size 2024-09-12T01:43:10.221 INFO:tasks.workunit.client.0.smithi066.stdout:3/427: mkdir d5/d6/d1b/d45/d66/d67/d75/d8e 0 2024-09-12T01:43:10.221 INFO:tasks.workunit.client.0.smithi066.stdout:3/428: truncate d5/d6/d1b/d45/f49 2721500 0 2024-09-12T01:43:10.221 INFO:tasks.workunit.client.0.smithi066.stdout:3/429: chown d5/d6/d1b/d45/d66/d67/d6d/f7a 0 1 2024-09-12T01:43:10.221 INFO:tasks.workunit.client.0.smithi066.stdout:3/430: fsync d5/d6/d1b/d28/f46 0 2024-09-12T01:43:10.227 INFO:tasks.workunit.client.1.smithi153.stdout:0/833: sync 2024-09-12T01:43:10.227 INFO:tasks.workunit.client.1.smithi153.stdout:0/834: truncate d22/f68 4881656 0 2024-09-12T01:43:10.229 INFO:tasks.workunit.client.1.smithi153.stdout:0/835: dread d22/d30/d4c/d6e/f8f [0,4194304] 0 2024-09-12T01:43:10.237 INFO:tasks.workunit.client.1.smithi153.stdout:9/712: rename d3/d5f/d62/fa4 to d3/d55/d30/d90/fd3 0 2024-09-12T01:43:10.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/431: dwrite d5/d35/f4d [0,4194304] 0 2024-09-12T01:43:10.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/432: truncate d5/d6/d1b/f88 572574 0 2024-09-12T01:43:10.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/433: read - d5/d6/d1b/d65/f7e zero size 2024-09-12T01:43:10.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/434: dread - d5/f8a zero size 2024-09-12T01:43:10.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/435: write d5/d6/d1b/d65/f7e [482144,90280] 0 2024-09-12T01:43:10.240 INFO:tasks.workunit.client.1.smithi153.stdout:4/645: truncate d6/d15/db4/fc0 346501 0 2024-09-12T01:43:10.245 INFO:tasks.workunit.client.1.smithi153.stdout:2/699: link d7/db/d27/d56/da3/fb3 d7/fe0 0 2024-09-12T01:43:10.246 INFO:tasks.workunit.client.1.smithi153.stdout:2/700: write d7/d19/d40/f82 [159781,55453] 0 2024-09-12T01:43:10.248 INFO:tasks.workunit.client.0.smithi066.stdout:7/346: rename d2/d20 to d2/d5/d6/d22/d75 0 2024-09-12T01:43:10.253 INFO:tasks.workunit.client.1.smithi153.stdout:1/777: creat d2/d9/d58/d74/f102 x:0 0 0 2024-09-12T01:43:10.255 INFO:tasks.workunit.client.0.smithi066.stdout:8/412: rename d12/d21/d2f/d57/d84/d50/d56/d69/l7f to d12/d21/d2f/d57/d84/l85 0 2024-09-12T01:43:10.255 INFO:tasks.workunit.client.0.smithi066.stdout:8/413: stat d12/d21/d2f/d57/d3c/f7b 0 2024-09-12T01:43:10.257 INFO:tasks.workunit.client.1.smithi153.stdout:7/683: symlink d12/d21/d29/ld8 0 2024-09-12T01:43:10.257 INFO:tasks.workunit.client.1.smithi153.stdout:7/684: rename d12 to d12/d21/d4d/dd9 22 2024-09-12T01:43:10.257 INFO:tasks.workunit.client.1.smithi153.stdout:7/685: chown d12/d21/d4d/dae 0 1 2024-09-12T01:43:10.262 INFO:tasks.workunit.client.0.smithi066.stdout:8/414: rmdir d12/d21/d2f/d57/d84/d50/d56 39 2024-09-12T01:43:10.264 INFO:tasks.workunit.client.1.smithi153.stdout:6/791: symlink d1/d80/lfe 0 2024-09-12T01:43:10.265 INFO:tasks.workunit.client.0.smithi066.stdout:8/415: read d12/d21/d2f/d53/f6b [373645,29398] 0 2024-09-12T01:43:10.265 INFO:tasks.workunit.client.0.smithi066.stdout:8/416: stat d12/d21/d2f/f34 0 2024-09-12T01:43:10.266 INFO:tasks.workunit.client.1.smithi153.stdout:3/792: mknod d1/d59/ce7 0 2024-09-12T01:43:10.268 INFO:tasks.workunit.client.0.smithi066.stdout:3/436: dwrite d5/ff [4194304,4194304] 0 2024-09-12T01:43:10.268 INFO:tasks.workunit.client.0.smithi066.stdout:3/437: dread - d5/d6/d1b/d65/d89/f72 zero size 2024-09-12T01:43:10.268 INFO:tasks.workunit.client.0.smithi066.stdout:8/417: mknod d12/d21/d2f/c86 0 2024-09-12T01:43:10.269 INFO:tasks.workunit.client.0.smithi066.stdout:8/418: truncate d12/d21/d2f/d57/d43/d66/f68 2413190 0 2024-09-12T01:43:10.275 INFO:tasks.workunit.client.1.smithi153.stdout:4/646: symlink d6/d6a/dcb/le2 0 2024-09-12T01:43:10.275 INFO:tasks.workunit.client.1.smithi153.stdout:4/647: creat d6/fe3 x:0 0 0 2024-09-12T01:43:10.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/701: dwrite d7/d17/f8d [0,4194304] 0 2024-09-12T01:43:10.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/702: chown d7/d17/da4/lc7 10945329 1 2024-09-12T01:43:10.277 INFO:tasks.workunit.client.1.smithi153.stdout:2/703: chown d7/d19/d40/l38 54 1 2024-09-12T01:43:10.277 INFO:tasks.workunit.client.1.smithi153.stdout:1/778: dwrite d2/d9/d17/d2f/d56/fe3 [0,4194304] 0 2024-09-12T01:43:10.279 INFO:tasks.workunit.client.0.smithi066.stdout:8/419: rename d12/d21/d2f/c86 to d12/d21/d2f/d57/d84/d50/c87 0 2024-09-12T01:43:10.281 INFO:tasks.workunit.client.1.smithi153.stdout:5/735: mkdir d0/df/db8/d2f/d55/d9c/d75/d58/d71/de9 0 2024-09-12T01:43:10.283 INFO:tasks.workunit.client.0.smithi066.stdout:3/438: dread d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:10.283 INFO:tasks.workunit.client.0.smithi066.stdout:3/439: dread - d5/d6/d1b/d45/d66/d67/d6d/f7a zero size 2024-09-12T01:43:10.283 INFO:tasks.workunit.client.1.smithi153.stdout:8/667: sync 2024-09-12T01:43:10.285 INFO:tasks.workunit.client.1.smithi153.stdout:7/686: creat d12/d21/d4d/dae/fda x:0 0 0 2024-09-12T01:43:10.285 INFO:tasks.workunit.client.1.smithi153.stdout:7/687: write d12/d21/d29/d2d/f77 [1940507,106813] 0 2024-09-12T01:43:10.285 INFO:tasks.workunit.client.1.smithi153.stdout:7/688: dread - d12/d4e/f74 zero size 2024-09-12T01:43:10.289 INFO:tasks.workunit.client.0.smithi066.stdout:8/420: link d12/d21/d2f/d57/d84/d6f/l81 d12/d21/d2f/d57/d84/d50/d56/d69/d7d/l88 0 2024-09-12T01:43:10.289 INFO:tasks.workunit.client.0.smithi066.stdout:8/421: chown d12/d21/d2f/d57/d84/d50/d56/d69/c80 121 1 2024-09-12T01:43:10.291 INFO:tasks.workunit.client.1.smithi153.stdout:6/792: unlink d1/d6/d23/d98/f36 0 2024-09-12T01:43:10.293 INFO:tasks.workunit.client.1.smithi153.stdout:3/793: symlink d1/d16/d1c/le8 0 2024-09-12T01:43:10.296 INFO:tasks.workunit.client.0.smithi066.stdout:8/422: mkdir d12/d21/d2f/d57/d84/d89 0 2024-09-12T01:43:10.306 INFO:tasks.workunit.client.1.smithi153.stdout:5/736: write d0/df/d83/d36/da5/fa6 [1753227,47053] 0 2024-09-12T01:43:10.310 INFO:tasks.workunit.client.1.smithi153.stdout:4/648: mknod d6/d9/dc/d98/d3e/ce4 0 2024-09-12T01:43:10.310 INFO:tasks.workunit.client.1.smithi153.stdout:7/689: dread d12/d21/d29/d35/d37/d4c/f73 [0,4194304] 0 2024-09-12T01:43:10.310 INFO:tasks.workunit.client.1.smithi153.stdout:7/690: dread - d12/d21/d4d/dae/fda zero size 2024-09-12T01:43:10.314 INFO:tasks.workunit.client.1.smithi153.stdout:2/704: mkdir d7/db/d6c/d76/db8/de1 0 2024-09-12T01:43:10.314 INFO:tasks.workunit.client.1.smithi153.stdout:2/705: stat d7/db/d6c/d9f 0 2024-09-12T01:43:10.315 INFO:tasks.workunit.client.0.smithi066.stdout:3/440: dwrite f4 [0,4194304] 0 2024-09-12T01:43:10.325 INFO:tasks.workunit.client.1.smithi153.stdout:1/779: rename d2/d9/d1d/d82 to d2/d9/d58/d74/d103 0 2024-09-12T01:43:10.326 INFO:tasks.workunit.client.1.smithi153.stdout:8/668: rmdir d17/d1f 39 2024-09-12T01:43:10.326 INFO:tasks.workunit.client.1.smithi153.stdout:8/669: dread - d17/d1f/d4f/d42/fd1 zero size 2024-09-12T01:43:10.326 INFO:tasks.workunit.client.0.smithi066.stdout:3/441: creat d5/d35/f8f x:0 0 0 2024-09-12T01:43:10.328 INFO:tasks.workunit.client.1.smithi153.stdout:3/794: dwrite d1/d1e/d9a/fc9 [0,4194304] 0 2024-09-12T01:43:10.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/780: rename d2/d34/d3d/ffa to d2/d9/d17/d69/f104 0 2024-09-12T01:43:10.332 INFO:tasks.workunit.client.1.smithi153.stdout:1/781: chown d2/d68/d6b/d9e/lc8 267583122 1 2024-09-12T01:43:10.332 INFO:tasks.workunit.client.1.smithi153.stdout:6/793: dwrite d1/d6/d46/d73/d8a/f89 [0,4194304] 0 2024-09-12T01:43:10.332 INFO:tasks.workunit.client.1.smithi153.stdout:6/794: fsync d1/d80/ff6 0 2024-09-12T01:43:10.332 INFO:tasks.workunit.client.1.smithi153.stdout:6/795: chown d1/d6/d39/fa5 3 1 2024-09-12T01:43:10.332 INFO:tasks.workunit.client.1.smithi153.stdout:6/796: fdatasync d1/f38 0 2024-09-12T01:43:10.333 INFO:tasks.workunit.client.0.smithi066.stdout:8/423: dwrite d12/d21/d2f/d57/d3c/f6c [12582912,4194304] 0 2024-09-12T01:43:10.340 INFO:tasks.workunit.client.1.smithi153.stdout:3/795: creat d1/d13/d23/d47/d71/d8e/d93/d79/db5/fe9 x:0 0 0 2024-09-12T01:43:10.342 INFO:tasks.workunit.client.1.smithi153.stdout:5/737: rmdir d0/d43/d68/dcc 39 2024-09-12T01:43:10.343 INFO:tasks.workunit.client.1.smithi153.stdout:4/649: rmdir d6/d15/db4 39 2024-09-12T01:43:10.346 INFO:tasks.workunit.client.1.smithi153.stdout:7/691: getdents d12 0 2024-09-12T01:43:10.346 INFO:tasks.workunit.client.1.smithi153.stdout:7/692: write d12/d21/d29/d35/d37/d4c/d5c/fbe [872698,102434] 0 2024-09-12T01:43:10.351 INFO:tasks.workunit.client.0.smithi066.stdout:8/424: readlink l8 0 2024-09-12T01:43:10.351 INFO:tasks.workunit.client.0.smithi066.stdout:8/425: dread - d12/d21/d2f/d57/d84/d50/d56/f75 zero size 2024-09-12T01:43:10.354 INFO:tasks.workunit.client.1.smithi153.stdout:3/796: creat d1/d13/d23/d47/d71/d8e/d93/d79/fea x:0 0 0 2024-09-12T01:43:10.356 INFO:tasks.workunit.client.1.smithi153.stdout:5/738: mkdir d0/d20/dc0/dea 0 2024-09-12T01:43:10.356 INFO:tasks.workunit.client.1.smithi153.stdout:7/693: mknod d12/d21/d29/d2d/d8b/cdb 0 2024-09-12T01:43:10.356 INFO:tasks.workunit.client.1.smithi153.stdout:5/739: chown d0/d15/l61 15321120 1 2024-09-12T01:43:10.357 INFO:tasks.workunit.client.1.smithi153.stdout:5/740: fsync d0/df/db8/d6e/fd4 0 2024-09-12T01:43:10.357 INFO:tasks.workunit.client.1.smithi153.stdout:8/670: dwrite d17/fc4 [0,4194304] 0 2024-09-12T01:43:10.357 INFO:tasks.workunit.client.1.smithi153.stdout:8/671: readlink d17/d1f/d4f/d42/l76 0 2024-09-12T01:43:10.359 INFO:tasks.workunit.client.0.smithi066.stdout:8/426: rmdir d12/d21/d2f/d57/d43/d7a 0 2024-09-12T01:43:10.360 INFO:tasks.workunit.client.1.smithi153.stdout:1/782: rmdir d2/d9/d17/d2f/d56/d97 39 2024-09-12T01:43:10.360 INFO:tasks.workunit.client.1.smithi153.stdout:6/797: getdents d1/d6/da/d19/d3a/db0 0 2024-09-12T01:43:10.360 INFO:tasks.workunit.client.1.smithi153.stdout:3/797: rmdir d1/d16/d17/d82/d92 39 2024-09-12T01:43:10.360 INFO:tasks.workunit.client.1.smithi153.stdout:1/783: fsync d2/f6 0 2024-09-12T01:43:10.361 INFO:tasks.workunit.client.1.smithi153.stdout:1/784: write d2/d9/d58/d74/fbf [65763,54139] 0 2024-09-12T01:43:10.361 INFO:tasks.workunit.client.1.smithi153.stdout:6/798: creat d1/fff x:0 0 0 2024-09-12T01:43:10.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/706: dwrite d7/db/d6c/d76/fa8 [0,4194304] 0 2024-09-12T01:43:10.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/707: write d7/db/d1d/d1e/f26 [1166823,14286] 0 2024-09-12T01:43:10.361 INFO:tasks.workunit.client.1.smithi153.stdout:7/694: mkdir d12/d21/d4d/ddc 0 2024-09-12T01:43:10.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/741: link d0/d20/f65 d0/d43/dac/db0/feb 0 2024-09-12T01:43:10.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/742: dread - d0/df/d1c/fc4 zero size 2024-09-12T01:43:10.363 INFO:tasks.workunit.client.0.smithi066.stdout:3/442: dwrite d5/d35/f64 [0,4194304] 0 2024-09-12T01:43:10.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/443: fsync d5/d35/f73 0 2024-09-12T01:43:10.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/444: write d5/d6/d48/f68 [4771352,20602] 0 2024-09-12T01:43:10.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/445: stat d5/d6/d1b/d45/d66/d67/d6d/f55 0 2024-09-12T01:43:10.364 INFO:tasks.workunit.client.1.smithi153.stdout:3/798: dread d1/d1e/f80 [0,4194304] 0 2024-09-12T01:43:10.365 INFO:tasks.workunit.client.1.smithi153.stdout:3/799: chown d1/d13/d25/d26/c84 2622 1 2024-09-12T01:43:10.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/427: creat d12/d21/d2f/d57/d43/d66/f8a x:0 0 0 2024-09-12T01:43:10.365 INFO:tasks.workunit.client.0.smithi066.stdout:8/428: write d12/d21/d2f/d53/f6b [343485,55506] 0 2024-09-12T01:43:10.371 INFO:tasks.workunit.client.1.smithi153.stdout:6/799: dread d1/d6/d23/fb5 [0,4194304] 0 2024-09-12T01:43:10.376 INFO:tasks.workunit.client.1.smithi153.stdout:8/672: rmdir d17/d1f/dc6 0 2024-09-12T01:43:10.377 INFO:tasks.workunit.client.0.smithi066.stdout:3/446: creat d5/d6/d1b/d28/f90 x:0 0 0 2024-09-12T01:43:10.381 INFO:tasks.workunit.client.0.smithi066.stdout:8/429: creat d12/d21/d2f/d57/d84/d6f/f8b x:0 0 0 2024-09-12T01:43:10.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/800: dwrite d1/d13/d25/d26/d4b/f8c [0,4194304] 0 2024-09-12T01:43:10.381 INFO:tasks.workunit.client.1.smithi153.stdout:3/801: chown d1/d13/d23/d47/d71/d8e/d93/d79/lc3 111539 1 2024-09-12T01:43:10.382 INFO:tasks.workunit.client.1.smithi153.stdout:3/802: chown d1/d59/f98 146086486 1 2024-09-12T01:43:10.384 INFO:tasks.workunit.client.0.smithi066.stdout:3/447: chown d5/l10 179598 1 2024-09-12T01:43:10.384 INFO:tasks.workunit.client.0.smithi066.stdout:3/448: write d5/d6/d1b/d65/d89/f72 [501495,57703] 0 2024-09-12T01:43:10.386 INFO:tasks.workunit.client.1.smithi153.stdout:1/785: truncate d2/d9/d58/d74/d103/d89/fbe 1716330 0 2024-09-12T01:43:10.389 INFO:tasks.workunit.client.0.smithi066.stdout:3/449: write d5/fa [1021334,63300] 0 2024-09-12T01:43:10.389 INFO:tasks.workunit.client.0.smithi066.stdout:3/450: fsync f3 0 2024-09-12T01:43:10.391 INFO:tasks.workunit.client.1.smithi153.stdout:0/836: sync 2024-09-12T01:43:10.391 INFO:tasks.workunit.client.1.smithi153.stdout:0/837: chown d22/d30/f59 25 1 2024-09-12T01:43:10.391 INFO:tasks.workunit.client.1.smithi153.stdout:0/838: dread - d22/d79/d8e/fac zero size 2024-09-12T01:43:10.396 INFO:tasks.workunit.client.0.smithi066.stdout:3/451: mknod d5/d6/d1b/d28/d4f/c91 0 2024-09-12T01:43:10.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/708: mknod d7/d4d/d70/ce2 0 2024-09-12T01:43:10.398 INFO:tasks.workunit.client.1.smithi153.stdout:2/709: truncate f1 9016865 0 2024-09-12T01:43:10.398 INFO:tasks.workunit.client.0.smithi066.stdout:8/430: dwrite d12/f47 [0,4194304] 0 2024-09-12T01:43:10.398 INFO:tasks.workunit.client.0.smithi066.stdout:8/431: read d12/d21/d2f/d57/d84/d50/d56/f59 [854396,58320] 0 2024-09-12T01:43:10.398 INFO:tasks.workunit.client.0.smithi066.stdout:8/432: truncate d12/d21/d2f/f34 1127234 0 2024-09-12T01:43:10.399 INFO:tasks.workunit.client.0.smithi066.stdout:3/452: creat d5/f92 x:0 0 0 2024-09-12T01:43:10.399 INFO:tasks.workunit.client.0.smithi066.stdout:3/453: chown d5/d6/d1b/d65/d89 1 1 2024-09-12T01:43:10.401 INFO:tasks.workunit.client.1.smithi153.stdout:7/695: unlink d12/d21/d29/f3b 0 2024-09-12T01:43:10.403 INFO:tasks.workunit.client.1.smithi153.stdout:5/743: rmdir d0/df/db8/d2f 39 2024-09-12T01:43:10.404 INFO:tasks.workunit.client.1.smithi153.stdout:5/744: fsync d0/df/d83/d36/fa8 0 2024-09-12T01:43:10.404 INFO:tasks.workunit.client.0.smithi066.stdout:6/450: sync 2024-09-12T01:43:10.404 INFO:tasks.workunit.client.0.smithi066.stdout:6/451: chown d2/d31/d5e/l61 398232 1 2024-09-12T01:43:10.404 INFO:tasks.workunit.client.0.smithi066.stdout:2/348: sync 2024-09-12T01:43:10.405 INFO:tasks.workunit.client.0.smithi066.stdout:0/407: sync 2024-09-12T01:43:10.405 INFO:tasks.workunit.client.0.smithi066.stdout:0/408: dread - d1/d62/d89/f82 zero size 2024-09-12T01:43:10.405 INFO:tasks.workunit.client.0.smithi066.stdout:9/424: sync 2024-09-12T01:43:10.405 INFO:tasks.workunit.client.0.smithi066.stdout:5/336: sync 2024-09-12T01:43:10.407 INFO:tasks.workunit.client.1.smithi153.stdout:6/800: rmdir d1/d80/dfa 0 2024-09-12T01:43:10.408 INFO:tasks.workunit.client.0.smithi066.stdout:8/433: creat d12/d21/d2f/d57/f8c x:0 0 0 2024-09-12T01:43:10.408 INFO:tasks.workunit.client.1.smithi153.stdout:2/710: write d7/db/f39 [4400514,27462] 0 2024-09-12T01:43:10.411 INFO:tasks.workunit.client.0.smithi066.stdout:3/454: symlink d5/d6/d1b/d65/d89/l93 0 2024-09-12T01:43:10.417 INFO:tasks.workunit.client.1.smithi153.stdout:6/801: write d1/d6/d23/d98/d4f/feb [3182979,63756] 0 2024-09-12T01:43:10.417 INFO:tasks.workunit.client.1.smithi153.stdout:6/802: creat d1/d6/d23/d98/d53/da0/f100 x:0 0 0 2024-09-12T01:43:10.418 INFO:tasks.workunit.client.0.smithi066.stdout:6/452: rename d2/db/c10 to d2/db/d12/c95 0 2024-09-12T01:43:10.418 INFO:tasks.workunit.client.0.smithi066.stdout:2/349: mknod de/d13/d1e/c6f 0 2024-09-12T01:43:10.419 INFO:tasks.workunit.client.1.smithi153.stdout:6/803: read d1/d6/d39/d76/f79 [956030,63548] 0 2024-09-12T01:43:10.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/713: sync 2024-09-12T01:43:10.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/714: chown d3/d3a/d42/fa2 4458594 1 2024-09-12T01:43:10.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/715: chown d3/d66/fd2 257760835 1 2024-09-12T01:43:10.421 INFO:tasks.workunit.client.1.smithi153.stdout:9/716: write d3/d66/d80/faa [963329,100852] 0 2024-09-12T01:43:10.422 INFO:tasks.workunit.client.0.smithi066.stdout:0/409: mkdir d1/d72/de/d47/d92 0 2024-09-12T01:43:10.422 INFO:tasks.workunit.client.0.smithi066.stdout:0/410: fdatasync d1/d72/f5c 0 2024-09-12T01:43:10.424 INFO:tasks.workunit.client.0.smithi066.stdout:9/425: rmdir d0/d6/d37/d85 39 2024-09-12T01:43:10.427 INFO:tasks.workunit.client.1.smithi153.stdout:0/839: truncate d22/f5f 903143 0 2024-09-12T01:43:10.427 INFO:tasks.workunit.client.1.smithi153.stdout:0/840: stat f3 0 2024-09-12T01:43:10.429 INFO:tasks.workunit.client.0.smithi066.stdout:3/455: link d5/d6/d1b/d45/d66/d67/d6d/c6b d5/d6/c94 0 2024-09-12T01:43:10.434 INFO:tasks.workunit.client.1.smithi153.stdout:7/696: mknod d12/d21/d29/d2d/da6/cdd 0 2024-09-12T01:43:10.435 INFO:tasks.workunit.client.0.smithi066.stdout:0/411: symlink d1/d72/de/d47/d7c/l93 0 2024-09-12T01:43:10.441 INFO:tasks.workunit.client.1.smithi153.stdout:8/673: write f15 [231764,80147] 0 2024-09-12T01:43:10.441 INFO:tasks.workunit.client.1.smithi153.stdout:8/674: write d17/d21/d56/d96/fc3 [4648909,44852] 0 2024-09-12T01:43:10.441 INFO:tasks.workunit.client.0.smithi066.stdout:3/456: truncate d5/d6/d1b/d45/d66/d67/d6d/f55 902336 0 2024-09-12T01:43:10.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/804: unlink d1/d6/da/d19/d3a/lb1 0 2024-09-12T01:43:10.446 INFO:tasks.workunit.client.1.smithi153.stdout:6/805: chown d1/d6/da/d19 10427 1 2024-09-12T01:43:10.447 INFO:tasks.workunit.client.1.smithi153.stdout:9/717: creat d3/d55/d30/d88/fd4 x:0 0 0 2024-09-12T01:43:10.447 INFO:tasks.workunit.client.0.smithi066.stdout:2/350: write de/d13/d28/f35 [3533896,114773] 0 2024-09-12T01:43:10.448 INFO:tasks.workunit.client.1.smithi153.stdout:1/786: rmdir d2/d34/d8a 39 2024-09-12T01:43:10.449 INFO:tasks.workunit.client.1.smithi153.stdout:0/841: symlink d22/d79/d8e/dc6/l11b 0 2024-09-12T01:43:10.450 INFO:tasks.workunit.client.0.smithi066.stdout:0/412: dread d1/f4d [0,4194304] 0 2024-09-12T01:43:10.450 INFO:tasks.workunit.client.0.smithi066.stdout:0/413: creat d1/d62/f94 x:0 0 0 2024-09-12T01:43:10.450 INFO:tasks.workunit.client.0.smithi066.stdout:2/351: write fa [4431509,760] 0 2024-09-12T01:43:10.451 INFO:tasks.workunit.client.0.smithi066.stdout:2/352: write de/d13/d1e/f69 [570570,66562] 0 2024-09-12T01:43:10.452 INFO:tasks.workunit.client.1.smithi153.stdout:2/711: dwrite d7/db/d6c/d7e/f66 [0,4194304] 0 2024-09-12T01:43:10.452 INFO:tasks.workunit.client.1.smithi153.stdout:7/697: creat d12/d21/fde x:0 0 0 2024-09-12T01:43:10.452 INFO:tasks.workunit.client.0.smithi066.stdout:5/337: dwrite d0/d26/f35 [0,4194304] 0 2024-09-12T01:43:10.452 INFO:tasks.workunit.client.0.smithi066.stdout:5/338: fdatasync d0/dd/d18/d36/d4c/f61 0 2024-09-12T01:43:10.453 INFO:tasks.workunit.client.0.smithi066.stdout:5/339: chown d0/d26/d2d/d31 1 1 2024-09-12T01:43:10.453 INFO:tasks.workunit.client.1.smithi153.stdout:0/842: dread d22/d30/d4c/d6f/dfa/f10f [0,4194304] 0 2024-09-12T01:43:10.456 INFO:tasks.workunit.client.1.smithi153.stdout:5/745: dwrite d0/fe [4194304,4194304] 0 2024-09-12T01:43:10.458 INFO:tasks.workunit.client.0.smithi066.stdout:8/434: dwrite d12/d21/d2f/f63 [0,4194304] 0 2024-09-12T01:43:10.459 INFO:tasks.workunit.client.0.smithi066.stdout:8/435: truncate d12/d21/d2f/d57/d84/d50/d56/f75 500 0 2024-09-12T01:43:10.461 INFO:tasks.workunit.client.0.smithi066.stdout:8/436: dread d12/f23 [0,4194304] 0 2024-09-12T01:43:10.462 INFO:tasks.workunit.client.0.smithi066.stdout:8/437: truncate d12/d21/d2f/f45 5547458 0 2024-09-12T01:43:10.462 INFO:tasks.workunit.client.0.smithi066.stdout:8/438: readlink d12/d21/d2f/d57/l4a 0 2024-09-12T01:43:10.462 INFO:tasks.workunit.client.0.smithi066.stdout:8/439: chown d12/c3f 16744 1 2024-09-12T01:43:10.464 INFO:tasks.workunit.client.1.smithi153.stdout:8/675: mkdir d17/d1f/d4f/d42/d79/dac/dce/ddc 0 2024-09-12T01:43:10.465 INFO:tasks.workunit.client.0.smithi066.stdout:9/426: dwrite d0/d6/d17/f18 [4194304,4194304] 0 2024-09-12T01:43:10.467 INFO:tasks.workunit.client.0.smithi066.stdout:0/414: mkdir d1/d72/de/d47/d92/d95 0 2024-09-12T01:43:10.467 INFO:tasks.workunit.client.0.smithi066.stdout:0/415: readlink d1/d72/de/d47/d4a/d67/l2f 0 2024-09-12T01:43:10.468 INFO:tasks.workunit.client.0.smithi066.stdout:6/453: dwrite d2/d21/f52 [4194304,4194304] 0 2024-09-12T01:43:10.468 INFO:tasks.workunit.client.0.smithi066.stdout:6/454: read - d2/d31/d5e/f8a zero size 2024-09-12T01:43:10.468 INFO:tasks.workunit.client.1.smithi153.stdout:6/806: getdents d1/d6/d23/d98/d53/da4 0 2024-09-12T01:43:10.471 INFO:tasks.workunit.client.1.smithi153.stdout:9/718: creat d3/d5f/dc4/fd5 x:0 0 0 2024-09-12T01:43:10.471 INFO:tasks.workunit.client.1.smithi153.stdout:9/719: write d3/d55/d30/f31 [13968,124404] 0 2024-09-12T01:43:10.472 INFO:tasks.workunit.client.0.smithi066.stdout:2/353: mkdir de/d13/d1e/d25/d5e/d70 0 2024-09-12T01:43:10.474 INFO:tasks.workunit.client.1.smithi153.stdout:1/787: mknod d2/d68/d6b/d9e/dc7/c105 0 2024-09-12T01:43:10.483 INFO:tasks.workunit.client.1.smithi153.stdout:5/746: truncate d0/df/db8/d2f/d55/d9c/d75/d58/f85 1437053 0 2024-09-12T01:43:10.483 INFO:tasks.workunit.client.0.smithi066.stdout:8/440: symlink d12/d21/d2f/d57/d84/d6f/l8d 0 2024-09-12T01:43:10.483 INFO:tasks.workunit.client.0.smithi066.stdout:8/441: chown d12/d21/f61 28 1 2024-09-12T01:43:10.483 INFO:tasks.workunit.client.0.smithi066.stdout:2/354: write de/d13/d1e/d25/f32 [2883810,2044] 0 2024-09-12T01:43:10.490 INFO:tasks.workunit.client.1.smithi153.stdout:9/720: creat d3/d5f/fd6 x:0 0 0 2024-09-12T01:43:10.494 INFO:tasks.workunit.client.1.smithi153.stdout:1/788: mkdir d2/d34/d3d/d106 0 2024-09-12T01:43:10.496 INFO:tasks.workunit.client.1.smithi153.stdout:6/807: rmdir d1/d6/d23/d98/d4f 39 2024-09-12T01:43:10.496 INFO:tasks.workunit.client.1.smithi153.stdout:6/808: write d1/d6/d46/d73/d8a/f89 [5022117,36001] 0 2024-09-12T01:43:10.496 INFO:tasks.workunit.client.1.smithi153.stdout:6/809: readlink d1/lbd 0 2024-09-12T01:43:10.500 INFO:tasks.workunit.client.1.smithi153.stdout:6/810: unlink d1/d6/d23/d98/d4f/ff5 0 2024-09-12T01:43:10.502 INFO:tasks.workunit.client.0.smithi066.stdout:6/455: rename d2/db/d12/f53 to d2/db/d12/d1d/f96 0 2024-09-12T01:43:10.503 INFO:tasks.workunit.client.0.smithi066.stdout:6/456: write d2/d31/f39 [1347242,33921] 0 2024-09-12T01:43:10.503 INFO:tasks.workunit.client.0.smithi066.stdout:6/457: fdatasync d2/db/f6a 0 2024-09-12T01:43:10.504 INFO:tasks.workunit.client.1.smithi153.stdout:5/747: dwrite d0/d43/dac/db0/fd9 [0,4194304] 0 2024-09-12T01:43:10.504 INFO:tasks.workunit.client.1.smithi153.stdout:6/811: creat d1/d6/d23/d98/d53/de0/f101 x:0 0 0 2024-09-12T01:43:10.505 INFO:tasks.workunit.client.0.smithi066.stdout:2/355: mknod de/d13/d1e/c71 0 2024-09-12T01:43:10.505 INFO:tasks.workunit.client.0.smithi066.stdout:2/356: truncate de/d13/d28/d3d/f3f 952253 0 2024-09-12T01:43:10.505 INFO:tasks.workunit.client.0.smithi066.stdout:2/357: write de/d13/d28/d3d/f3f [1579726,128236] 0 2024-09-12T01:43:10.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/427: mknod d0/d6/c99 0 2024-09-12T01:43:10.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/428: stat d0/f3c 0 2024-09-12T01:43:10.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/429: stat d0/d6/d17/d4f/d12/d46/d68/f70 0 2024-09-12T01:43:10.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.508+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa8580057c0 con 0x7fa8780fd800 2024-09-12T01:43:10.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.509+0000 7fa866ffd640 1 -- 172.21.15.66:0/3222626441 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fa86c03cbc0 con 0x7fa8780fd800 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:43:10.509 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 12, 2024-09-12T01:43:10.510 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:43:10.510 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:43:10.510 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:43:10.510 INFO:tasks.workunit.client.0.smithi066.stdout:8/442: rename d12/d21/d2f/d57/l4a to d12/d21/d2f/d57/d43/d82/l8e 0 2024-09-12T01:43:10.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fa860038df0 msgr2=0x7fa86003b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fa860038df0 0x7fa86003b2a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa878071320 tx=0x7fa868006d20 comp rx=0 tx=0).stop 2024-09-12T01:43:10.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 msgr2=0x7fa87806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa87806fa60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa86c003080 tx=0x7fa86c009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 shutdown_connections 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fa860038df0 0x7fa86003b2a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8780fd800 0x7fa87806fa60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 --2- 172.21.15.66:0/3222626441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8780fc530 0x7fa878071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 >> 172.21.15.66:0/3222626441 conn(0x7fa8780f7d10 msgr2=0x7fa8780f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 shutdown_connections 2024-09-12T01:43:10.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.511+0000 7fa87c96d640 1 -- 172.21.15.66:0/3222626441 wait complete. 2024-09-12T01:43:10.512 INFO:tasks.workunit.client.1.smithi153.stdout:5/748: creat d0/df/db8/d2f/d55/d9c/d7b/fec x:0 0 0 2024-09-12T01:43:10.513 INFO:tasks.workunit.client.0.smithi066.stdout:2/358: rmdir de/d13/d1e/d22/d4f 39 2024-09-12T01:43:10.513 INFO:tasks.workunit.client.0.smithi066.stdout:2/359: chown f2 4 1 2024-09-12T01:43:10.514 INFO:tasks.workunit.client.1.smithi153.stdout:6/812: unlink d1/d6/f4c 0 2024-09-12T01:43:10.515 INFO:tasks.workunit.client.0.smithi066.stdout:9/430: rmdir d0/d6/d17/d1b/d4c/d4b 39 2024-09-12T01:43:10.515 INFO:tasks.workunit.client.0.smithi066.stdout:9/431: write d0/d6/d17/d1b/f1c [1098672,59310] 0 2024-09-12T01:43:10.515 INFO:tasks.workunit.client.0.smithi066.stdout:9/432: dread - d0/d6/d17/d28/f6f zero size 2024-09-12T01:43:10.516 INFO:tasks.workunit.client.1.smithi153.stdout:5/749: symlink d0/df/db8/d2f/d55/d9c/d75/led 0 2024-09-12T01:43:10.516 INFO:tasks.workunit.client.1.smithi153.stdout:5/750: chown d0/df/f35 3714 1 2024-09-12T01:43:10.518 INFO:tasks.workunit.client.1.smithi153.stdout:6/813: creat d1/d6/d23/d98/d53/f102 x:0 0 0 2024-09-12T01:43:10.519 INFO:tasks.workunit.client.0.smithi066.stdout:8/443: creat d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f8f x:0 0 0 2024-09-12T01:43:10.522 INFO:tasks.workunit.client.1.smithi153.stdout:5/751: rename d0/fb9 to d0/d43/d8d/fee 0 2024-09-12T01:43:10.522 INFO:tasks.workunit.client.1.smithi153.stdout:5/752: chown d0/df/d83/d36/d39/f74 276265 1 2024-09-12T01:43:10.523 INFO:tasks.workunit.client.0.smithi066.stdout:2/360: rename de/f65 to de/d13/d1e/d25/d5e/d70/f72 0 2024-09-12T01:43:10.525 INFO:tasks.workunit.client.1.smithi153.stdout:6/814: mkdir d1/d80/db6/d103 0 2024-09-12T01:43:10.526 INFO:tasks.workunit.client.0.smithi066.stdout:9/433: mkdir d0/d6/d7f/d90/d9a 0 2024-09-12T01:43:10.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/444: creat d12/d21/d2f/d57/d84/d50/d56/d69/f90 x:0 0 0 2024-09-12T01:43:10.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/445: fsync d12/d21/d2f/d57/d3c/f76 0 2024-09-12T01:43:10.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/446: chown d12/l5c 1449118 1 2024-09-12T01:43:10.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/447: dread - d12/d21/d2f/d57/d84/d50/d56/d69/f90 zero size 2024-09-12T01:43:10.531 INFO:tasks.workunit.client.1.smithi153.stdout:6/815: rename d1/d6/d23/d98/d53/de0/f101 to d1/d6/d23/d98/d53/f104 0 2024-09-12T01:43:10.533 INFO:tasks.workunit.client.0.smithi066.stdout:2/361: link f5 de/d13/d1e/d41/d58/f73 0 2024-09-12T01:43:10.536 INFO:tasks.workunit.client.0.smithi066.stdout:9/434: mknod d0/d6/d37/c9b 0 2024-09-12T01:43:10.540 INFO:tasks.workunit.client.0.smithi066.stdout:8/448: dread d12/d21/d2f/f45 [0,4194304] 0 2024-09-12T01:43:10.555 INFO:tasks.workunit.client.0.smithi066.stdout:2/362: dwrite f9 [0,4194304] 0 2024-09-12T01:43:10.556 INFO:tasks.workunit.client.0.smithi066.stdout:2/363: creat de/d13/d1e/d22/f74 x:0 0 0 2024-09-12T01:43:10.557 INFO:tasks.workunit.client.0.smithi066.stdout:2/364: getdents de/d13/d1e/d22/d4f 0 2024-09-12T01:43:10.560 INFO:tasks.workunit.client.0.smithi066.stdout:2/365: getdents de/d13/d1e/d25 0 2024-09-12T01:43:10.560 INFO:tasks.workunit.client.0.smithi066.stdout:2/366: chown f1 2427160 1 2024-09-12T01:43:10.564 INFO:tasks.workunit.client.0.smithi066.stdout:2/367: write de/d13/d28/d3d/f3f [1461317,3021] 0 2024-09-12T01:43:10.568 INFO:tasks.workunit.client.0.smithi066.stdout:2/368: symlink de/d13/d1e/d41/l75 0 2024-09-12T01:43:10.571 INFO:tasks.workunit.client.0.smithi066.stdout:2/369: unlink fa 0 2024-09-12T01:43:10.571 INFO:tasks.workunit.client.0.smithi066.stdout:2/370: write de/d13/d1e/d25/d5e/d70/f72 [1031900,42228] 0 2024-09-12T01:43:10.571 INFO:tasks.workunit.client.0.smithi066.stdout:2/371: chown de/d13/d28/d3d/f3f 248 1 2024-09-12T01:43:10.571 INFO:tasks.workunit.client.0.smithi066.stdout:2/372: readlink de/d13/d28/d3d/l6e 0 2024-09-12T01:43:10.572 INFO:tasks.workunit.client.1.smithi153.stdout:0/843: dwrite d22/d82/f118 [0,4194304] 0 2024-09-12T01:43:10.582 INFO:tasks.workunit.client.1.smithi153.stdout:2/712: dwrite d7/f99 [0,4194304] 0 2024-09-12T01:43:10.582 INFO:tasks.workunit.client.1.smithi153.stdout:2/713: truncate d7/fe 1011494 0 2024-09-12T01:43:10.583 INFO:tasks.workunit.client.1.smithi153.stdout:2/714: creat d7/d19/d40/fe3 x:0 0 0 2024-09-12T01:43:10.583 INFO:tasks.workunit.client.0.smithi066.stdout:2/373: symlink de/l76 0 2024-09-12T01:43:10.583 INFO:tasks.workunit.client.0.smithi066.stdout:2/374: creat de/d13/d28/f77 x:0 0 0 2024-09-12T01:43:10.583 INFO:tasks.workunit.client.0.smithi066.stdout:2/375: read - de/d13/d1e/d41/d58/f60 zero size 2024-09-12T01:43:10.592 INFO:tasks.workunit.client.1.smithi153.stdout:9/721: dwrite d3/f5 [0,4194304] 0 2024-09-12T01:43:10.592 INFO:tasks.workunit.client.1.smithi153.stdout:9/722: write d3/d5f/d62/f64 [479352,114684] 0 2024-09-12T01:43:10.598 INFO:tasks.workunit.client.1.smithi153.stdout:1/789: dwrite d2/d34/d3d/d80/fea [0,4194304] 0 2024-09-12T01:43:10.601 INFO:tasks.workunit.client.1.smithi153.stdout:2/715: dwrite d7/db/f25 [4194304,4194304] 0 2024-09-12T01:43:10.602 INFO:tasks.workunit.client.0.smithi066.stdout:2/376: rename de/f66 to de/d13/d5c/f78 0 2024-09-12T01:43:10.618 INFO:tasks.workunit.client.0.smithi066.stdout:2/377: mknod de/d13/d1e/d25/d5e/d70/c79 0 2024-09-12T01:43:10.620 INFO:tasks.workunit.client.1.smithi153.stdout:9/723: read - d3/d3a/d42/d72/d98/d9a/da0/fc1 zero size 2024-09-12T01:43:10.621 INFO:tasks.workunit.client.1.smithi153.stdout:2/716: dwrite d7/db/d6c/d76/f96 [0,4194304] 0 2024-09-12T01:43:10.622 INFO:tasks.workunit.client.1.smithi153.stdout:2/717: readlink d7/d19/d40/l61 0 2024-09-12T01:43:10.622 INFO:tasks.workunit.client.0.smithi066.stdout:2/378: symlink de/d13/d28/l7a 0 2024-09-12T01:43:10.622 INFO:tasks.workunit.client.0.smithi066.stdout:2/379: dread - de/d13/d1e/d25/f33 zero size 2024-09-12T01:43:10.627 INFO:tasks.workunit.client.0.smithi066.stdout:2/380: rename de/d13/d1e/d22/d4f/l50 to de/d3c/l7b 0 2024-09-12T01:43:10.627 INFO:tasks.workunit.client.0.smithi066.stdout:2/381: read - de/d13/d1e/d41/d58/f61 zero size 2024-09-12T01:43:10.631 INFO:tasks.workunit.client.1.smithi153.stdout:9/724: write d3/d3a/d42/f48 [6708344,6651] 0 2024-09-12T01:43:10.631 INFO:tasks.workunit.client.1.smithi153.stdout:9/725: fsync d3/d66/fd2 0 2024-09-12T01:43:10.635 INFO:tasks.workunit.client.1.smithi153.stdout:1/790: mkdir d2/d9/d17/d69/d107 0 2024-09-12T01:43:10.637 INFO:tasks.workunit.client.1.smithi153.stdout:2/718: truncate d7/db/d1d/f5d 1221007 0 2024-09-12T01:43:10.637 INFO:tasks.workunit.client.1.smithi153.stdout:2/719: write d7/db/d27/f7d [811503,51651] 0 2024-09-12T01:43:10.638 INFO:tasks.workunit.client.0.smithi066.stdout:4/359: sync 2024-09-12T01:43:10.638 INFO:tasks.workunit.client.0.smithi066.stdout:1/357: sync 2024-09-12T01:43:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.640+0000 7fc8e9c50640 1 -- 172.21.15.66:0/2397058230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e40fd4d0 msgr2=0x7fc8e40ff950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.642 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.640+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/2397058230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e40fd4d0 0x7fc8e40ff950 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4004950 tx=0x7fc8d4009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.640+0000 7fc8e9c50640 1 -- 172.21.15.66:0/2397058230 shutdown_connections 2024-09-12T01:43:10.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.640+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/2397058230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e40fd4d0 0x7fc8e40ff950 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.640+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/2397058230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e4066690 0x7fc8e40fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.643 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.640+0000 7fc8e9c50640 1 -- 172.21.15.66:0/2397058230 >> 172.21.15.66:0/2397058230 conn(0x7fc8e40f6c30 msgr2=0x7fc8e40f9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.645+0000 7fc8e9c50640 1 -- 172.21.15.66:0/2397058230 shutdown_connections 2024-09-12T01:43:10.645 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.645+0000 7fc8e9c50640 1 -- 172.21.15.66:0/2397058230 wait complete. 2024-09-12T01:43:10.646 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.645+0000 7fc8e9c50640 1 Processor -- start 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.646+0000 7fc8e9c50640 1 -- start start 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.646+0000 7fc8e9c50640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4066690 0x7fc8e410adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.646+0000 7fc8e9c50640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 0x7fc8e410c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.646+0000 7fc8e9c50640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e410b770 con 0x7fc8e4066690 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.646+0000 7fc8e9c50640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e410b8e0 con 0x7fc8e410b300 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.646+0000 7fc8e37fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4066690 0x7fc8e410adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.647+0000 7fc8e2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 0x7fc8e410c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.647+0000 7fc8e2ffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 0x7fc8e410c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:43822/0 (socket says 172.21.15.66:43822) 2024-09-12T01:43:10.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.647+0000 7fc8e2ffd640 1 -- 172.21.15.66:0/1333440363 learned_addr learned my addr 172.21.15.66:0/1333440363 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:10.648 INFO:tasks.workunit.client.1.smithi153.stdout:9/726: creat d3/d55/d30/d7b/d8f/fd7 x:0 0 0 2024-09-12T01:43:10.648 INFO:tasks.workunit.client.1.smithi153.stdout:1/791: mkdir d2/d9/d1d/d25/d108 0 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.647+0000 7fc8e2ffd640 1 -- 172.21.15.66:0/1333440363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4066690 msgr2=0x7fc8e410adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.647+0000 7fc8e2ffd640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4066690 0x7fc8e410adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.647+0000 7fc8e2ffd640 1 -- 172.21.15.66:0/1333440363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d4005040 con 0x7fc8e410b300 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.648+0000 7fc8e2ffd640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 0x7fc8e410c090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40435e0 tx=0x7fc8d4009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.651+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d4049070 con 0x7fc8e410b300 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.651+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc8d4004290 con 0x7fc8e410b300 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.651+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e410c690 con 0x7fc8e410b300 2024-09-12T01:43:10.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.651+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e410cbd0 con 0x7fc8e410b300 2024-09-12T01:43:10.652 INFO:tasks.workunit.client.1.smithi153.stdout:5/753: rmdir d0/df/db8/d2f/d55/d9c/d7b 39 2024-09-12T01:43:10.652 INFO:tasks.workunit.client.1.smithi153.stdout:5/754: stat d0/df/db8/d6e/fd4 0 2024-09-12T01:43:10.652 INFO:tasks.workunit.client.1.smithi153.stdout:5/755: dread - d0/df/db8/d2f/d55/d9c/d7b/fd2 zero size 2024-09-12T01:43:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.652+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8d4009680 con 0x7fc8e410b300 2024-09-12T01:43:10.653 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.653+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 24) v1 ==== 46297+0+0 (secure 0 0 0) 0x7fc8d4041020 con 0x7fc8e410b300 2024-09-12T01:43:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.653+0000 7fc8cbfff640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fc8cc038fe0 0x7fc8cc03b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.653+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc8d4043830 con 0x7fc8e410b300 2024-09-12T01:43:10.654 INFO:tasks.workunit.client.0.smithi066.stdout:2/382: dwrite de/d13/d28/d3a/f6b [0,4194304] 0 2024-09-12T01:43:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.654+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d0005240 con 0x7fc8e410b300 2024-09-12T01:43:10.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.654+0000 7fc8e37fe640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fc8cc038fe0 0x7fc8cc03b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.655 INFO:tasks.workunit.client.0.smithi066.stdout:1/358: symlink d5/d52/d5d/l67 0 2024-09-12T01:43:10.655 INFO:tasks.workunit.client.0.smithi066.stdout:1/359: read d5/dc/d53/f45 [2472958,29484] 0 2024-09-12T01:43:10.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.655+0000 7fc8e37fe640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fc8cc038fe0 0x7fc8cc03b490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc8e410ab50 tx=0x7fc8d800b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.660 INFO:tasks.workunit.client.0.smithi066.stdout:2/383: readlink de/l2e 0 2024-09-12T01:43:10.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:10.660+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc8d4052070 con 0x7fc8e410b300 2024-09-12T01:43:10.661 INFO:tasks.workunit.client.0.smithi066.stdout:4/360: dwrite d4/f2b [0,4194304] 0 2024-09-12T01:43:10.661 INFO:tasks.workunit.client.1.smithi153.stdout:6/816: rmdir d1/d6 39 2024-09-12T01:43:10.661 INFO:tasks.workunit.client.1.smithi153.stdout:6/817: write d1/f4 [4973546,8706] 0 2024-09-12T01:43:10.665 INFO:tasks.workunit.client.0.smithi066.stdout:1/360: creat d5/d15/f68 x:0 0 0 2024-09-12T01:43:10.667 INFO:tasks.workunit.client.1.smithi153.stdout:9/727: rename d3/d5f/d62/l8d to d3/d55/d30/d95/d84/ld8 0 2024-09-12T01:43:10.669 INFO:tasks.workunit.client.0.smithi066.stdout:2/384: symlink de/d13/d1e/d22/d4f/l7c 0 2024-09-12T01:43:10.669 INFO:tasks.workunit.client.0.smithi066.stdout:2/385: truncate de/d13/f1f 4429181 0 2024-09-12T01:43:10.669 INFO:tasks.workunit.client.0.smithi066.stdout:2/386: chown de/d13/d1e/f36 55 1 2024-09-12T01:43:10.675 INFO:tasks.workunit.client.1.smithi153.stdout:1/792: rmdir d2/d9/d17/d2c/d101 0 2024-09-12T01:43:10.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/756: mknod d0/d43/d8d/cef 0 2024-09-12T01:43:10.680 INFO:tasks.workunit.client.1.smithi153.stdout:5/757: write d0/df/db8/d2f/d55/d9c/d7b/fd2 [55226,87262] 0 2024-09-12T01:43:10.683 INFO:tasks.workunit.client.0.smithi066.stdout:4/361: link d4/d6/l53 d4/d6/d27/d66/d58/l73 0 2024-09-12T01:43:10.688 INFO:tasks.workunit.client.1.smithi153.stdout:5/758: dread d0/d15/f1a [0,4194304] 0 2024-09-12T01:43:10.694 INFO:tasks.workunit.client.1.smithi153.stdout:1/793: dread d2/d9/d28/d73/d76/fb0 [0,4194304] 0 2024-09-12T01:43:10.698 INFO:tasks.workunit.client.1.smithi153.stdout:6/818: dwrite d1/fcf [0,4194304] 0 2024-09-12T01:43:10.698 INFO:tasks.workunit.client.1.smithi153.stdout:6/819: stat d1/d6/da/d19/d3a 0 2024-09-12T01:43:10.703 INFO:tasks.workunit.client.0.smithi066.stdout:7/347: sync 2024-09-12T01:43:10.704 INFO:tasks.workunit.client.0.smithi066.stdout:4/362: dwrite d4/f46 [4194304,4194304] 0 2024-09-12T01:43:10.705 INFO:tasks.workunit.client.0.smithi066.stdout:4/363: creat d4/d6/d8/d18/f74 x:0 0 0 2024-09-12T01:43:10.705 INFO:tasks.workunit.client.0.smithi066.stdout:4/364: fdatasync d4/d6/d8/f43 0 2024-09-12T01:43:10.705 INFO:tasks.workunit.client.1.smithi153.stdout:9/728: dwrite d3/d5f/dbb/fbe [0,4194304] 0 2024-09-12T01:43:10.706 INFO:tasks.workunit.client.1.smithi153.stdout:5/759: creat d0/df/db8/d2f/ff0 x:0 0 0 2024-09-12T01:43:10.707 INFO:tasks.workunit.client.1.smithi153.stdout:5/760: write d0/d15/f1a [4326253,86256] 0 2024-09-12T01:43:10.709 INFO:tasks.workunit.client.0.smithi066.stdout:1/361: creat d5/dc/d4f/f69 x:0 0 0 2024-09-12T01:43:10.709 INFO:tasks.workunit.client.0.smithi066.stdout:1/362: chown d5/dc/d53/c4c 20 1 2024-09-12T01:43:10.710 INFO:tasks.workunit.client.1.smithi153.stdout:4/650: sync 2024-09-12T01:43:10.712 INFO:tasks.workunit.client.1.smithi153.stdout:1/794: creat d2/d9/d17/d2f/d56/da0/f109 x:0 0 0 2024-09-12T01:43:10.716 INFO:tasks.workunit.client.0.smithi066.stdout:2/387: link de/l17 de/d13/d1e/d25/l7d 0 2024-09-12T01:43:10.723 INFO:tasks.workunit.client.0.smithi066.stdout:2/388: dread de/d13/d28/f35 [0,4194304] 0 2024-09-12T01:43:10.724 INFO:tasks.workunit.client.0.smithi066.stdout:7/348: creat d2/d5/d6/d22/d75/d25/d4d/f76 x:0 0 0 2024-09-12T01:43:10.728 INFO:tasks.workunit.client.1.smithi153.stdout:6/820: creat d1/d80/db6/f105 x:0 0 0 2024-09-12T01:43:10.729 INFO:tasks.workunit.client.0.smithi066.stdout:4/365: mkdir d4/d6/d27/d66/d6c/d75 0 2024-09-12T01:43:10.730 INFO:tasks.workunit.client.0.smithi066.stdout:4/366: write d4/d6/d27/d2f/f54 [3031414,36554] 0 2024-09-12T01:43:10.730 INFO:tasks.workunit.client.0.smithi066.stdout:4/367: chown d4/f52 717032 1 2024-09-12T01:43:10.732 INFO:tasks.workunit.client.0.smithi066.stdout:1/363: dwrite d5/d52/d60/f61 [0,4194304] 0 2024-09-12T01:43:10.733 INFO:tasks.workunit.client.0.smithi066.stdout:7/349: mknod d2/d5/d6/c77 0 2024-09-12T01:43:10.733 INFO:tasks.workunit.client.0.smithi066.stdout:2/389: dread de/d13/d1e/f23 [0,4194304] 0 2024-09-12T01:43:10.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/368: dread d4/d6/d8/f13 [0,4194304] 0 2024-09-12T01:43:10.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/369: readlink d4/d6/d27/d66/d58/l73 0 2024-09-12T01:43:10.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/370: readlink d4/d15/d33/l40 0 2024-09-12T01:43:10.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/371: creat d4/d6/d8/d18/f76 x:0 0 0 2024-09-12T01:43:10.745 INFO:tasks.workunit.client.0.smithi066.stdout:7/350: creat d2/d5/d6/d22/d75/d25/f78 x:0 0 0 2024-09-12T01:43:10.745 INFO:tasks.workunit.client.0.smithi066.stdout:7/351: chown d2/d5/da/d3f/d5e 57013316 1 2024-09-12T01:43:10.745 INFO:tasks.workunit.client.0.smithi066.stdout:7/352: stat d2/d5/d6/c68 0 2024-09-12T01:43:10.747 INFO:tasks.workunit.client.0.smithi066.stdout:2/390: symlink de/d3c/l7e 0 2024-09-12T01:43:10.747 INFO:tasks.workunit.client.0.smithi066.stdout:2/391: read - de/d13/d1e/d41/d58/f61 zero size 2024-09-12T01:43:10.751 INFO:tasks.workunit.client.0.smithi066.stdout:4/372: creat d4/d6/d27/d66/d58/f77 x:0 0 0 2024-09-12T01:43:10.751 INFO:tasks.workunit.client.0.smithi066.stdout:4/373: creat d4/d6/d27/d66/d58/f78 x:0 0 0 2024-09-12T01:43:10.751 INFO:tasks.workunit.client.0.smithi066.stdout:4/374: fdatasync d4/f46 0 2024-09-12T01:43:10.752 INFO:tasks.workunit.client.1.smithi153.stdout:9/729: mkdir d3/d3a/d42/d72/dc3/dd9 0 2024-09-12T01:43:10.757 INFO:tasks.workunit.client.0.smithi066.stdout:1/364: symlink d5/d15/d4d/l6a 0 2024-09-12T01:43:10.757 INFO:tasks.workunit.client.0.smithi066.stdout:1/365: stat d5/d15/l65 0 2024-09-12T01:43:10.758 INFO:tasks.workunit.client.1.smithi153.stdout:5/761: mkdir d0/d43/d68/db2/df1 0 2024-09-12T01:43:10.760 INFO:tasks.workunit.client.1.smithi153.stdout:3/803: sync 2024-09-12T01:43:10.760 INFO:tasks.workunit.client.1.smithi153.stdout:0/844: sync 2024-09-12T01:43:10.760 INFO:tasks.workunit.client.1.smithi153.stdout:8/676: sync 2024-09-12T01:43:10.760 INFO:tasks.workunit.client.1.smithi153.stdout:7/698: sync 2024-09-12T01:43:10.760 INFO:tasks.workunit.client.1.smithi153.stdout:7/699: chown d12/c3e 19904041 1 2024-09-12T01:43:10.761 INFO:tasks.workunit.client.1.smithi153.stdout:0/845: write d22/d30/d4c/d6f/fb0 [566491,63903] 0 2024-09-12T01:43:10.761 INFO:tasks.workunit.client.0.smithi066.stdout:2/392: rename de/d13/d1e/d25/d5e/d70 to de/d13/d7f 0 2024-09-12T01:43:10.765 INFO:tasks.workunit.client.0.smithi066.stdout:4/375: creat d4/d15/f79 x:0 0 0 2024-09-12T01:43:10.768 INFO:tasks.workunit.client.1.smithi153.stdout:8/677: dread d17/d1f/d4f/d42/d79/f98 [0,4194304] 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.1.smithi153.stdout:4/651: rename d6/d9/d11/d13/f18 to d6/d9/dc/d31/d7d/d94/fe5 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.1.smithi153.stdout:1/795: mknod d2/d9/d58/d74/c10a 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/393: link de/d13/d1e/d25/f33 de/d13/f80 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/394: readlink de/d3c/l7e 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/366: write d5/dc/d36/d4b/f11 [129384,3621] 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/367: fsync d5/dc/d36/d4b/f31 0 2024-09-12T01:43:10.771 INFO:tasks.workunit.client.0.smithi066.stdout:1/368: fsync d5/dc/d53/f45 0 2024-09-12T01:43:10.775 INFO:tasks.workunit.client.1.smithi153.stdout:4/652: mknod d6/d9/d11/d90/ce6 0 2024-09-12T01:43:10.775 INFO:tasks.workunit.client.1.smithi153.stdout:4/653: chown d6/d9/cb 238253 1 2024-09-12T01:43:10.775 INFO:tasks.workunit.client.1.smithi153.stdout:4/654: chown f0 1151640199 1 2024-09-12T01:43:10.775 INFO:tasks.workunit.client.1.smithi153.stdout:1/796: truncate d2/d9/d17/f2d 203339 0 2024-09-12T01:43:10.775 INFO:tasks.workunit.client.0.smithi066.stdout:2/395: mkdir de/d13/d1e/d41/d81 0 2024-09-12T01:43:10.776 INFO:tasks.workunit.client.0.smithi066.stdout:2/396: read - de/d13/d1e/d22/f3b zero size 2024-09-12T01:43:10.776 INFO:tasks.workunit.client.0.smithi066.stdout:2/397: chown de/d13/d1e/d41/d58/f73 346095 1 2024-09-12T01:43:10.778 INFO:tasks.workunit.client.0.smithi066.stdout:7/353: dwrite d2/d5/d6/d22/d75/d1d/f4b [0,4194304] 0 2024-09-12T01:43:10.778 INFO:tasks.workunit.client.0.smithi066.stdout:7/354: read - d2/d5/d6/d22/d75/d1d/f61 zero size 2024-09-12T01:43:10.778 INFO:tasks.workunit.client.0.smithi066.stdout:1/369: unlink d5/c2c 0 2024-09-12T01:43:10.779 INFO:tasks.workunit.client.1.smithi153.stdout:3/804: dread d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:10.779 INFO:tasks.workunit.client.1.smithi153.stdout:3/805: creat d1/d45/feb x:0 0 0 2024-09-12T01:43:10.779 INFO:tasks.workunit.client.1.smithi153.stdout:3/806: chown d1/d13/d23/d47/d71/d8e/d93/d79/db5/le3 719664 1 2024-09-12T01:43:10.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/846: dread d22/f84 [0,4194304] 0 2024-09-12T01:43:10.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/847: dread - d22/d30/d4c/d6f/d88/f9a zero size 2024-09-12T01:43:10.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/848: chown d22/f3e 6 1 2024-09-12T01:43:10.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/849: truncate d22/d30/d4c/f86 258621 0 2024-09-12T01:43:10.783 INFO:tasks.workunit.client.1.smithi153.stdout:6/821: read d1/d6/d23/d98/d53/f97 [1225706,76972] 0 2024-09-12T01:43:10.784 INFO:tasks.workunit.client.1.smithi153.stdout:9/730: dwrite d3/f1f [4194304,4194304] 0 2024-09-12T01:43:10.786 INFO:tasks.workunit.client.1.smithi153.stdout:9/731: creat d3/d5f/dbb/fda x:0 0 0 2024-09-12T01:43:10.803 INFO:tasks.workunit.client.0.smithi066.stdout:7/355: rename d2/d5/f31 to d2/f79 0 2024-09-12T01:43:10.803 INFO:tasks.workunit.client.1.smithi153.stdout:3/807: mknod d1/d45/dc2/cec 0 2024-09-12T01:43:10.803 INFO:tasks.workunit.client.1.smithi153.stdout:3/808: getdents d1/d13/d25 0 2024-09-12T01:43:10.803 INFO:tasks.workunit.client.0.smithi066.stdout:1/370: symlink d5/d52/d5d/l6b 0 2024-09-12T01:43:10.805 INFO:tasks.workunit.client.1.smithi153.stdout:0/850: unlink d22/d30/d4c/lcc 0 2024-09-12T01:43:10.809 INFO:tasks.workunit.client.1.smithi153.stdout:4/655: getdents d6/d9 0 2024-09-12T01:43:10.810 INFO:tasks.workunit.client.0.smithi066.stdout:2/398: symlink de/l82 0 2024-09-12T01:43:10.810 INFO:tasks.workunit.client.0.smithi066.stdout:4/376: dwrite d4/d6/d48/d5a/f6b [0,4194304] 0 2024-09-12T01:43:10.810 INFO:tasks.workunit.client.0.smithi066.stdout:7/356: unlink d2/d5/d6/l6f 0 2024-09-12T01:43:10.811 INFO:tasks.workunit.client.0.smithi066.stdout:7/357: creat d2/d5/da/f7a x:0 0 0 2024-09-12T01:43:10.811 INFO:tasks.workunit.client.0.smithi066.stdout:7/358: dread - d2/d5/da/f7a zero size 2024-09-12T01:43:10.817 INFO:tasks.workunit.client.0.smithi066.stdout:4/377: creat d4/d6/d48/d5a/f7a x:0 0 0 2024-09-12T01:43:10.822 INFO:tasks.workunit.client.0.smithi066.stdout:1/371: unlink d5/dc/l51 0 2024-09-12T01:43:10.824 INFO:tasks.workunit.client.0.smithi066.stdout:1/372: mknod d5/d15/d58/c6c 0 2024-09-12T01:43:10.824 INFO:tasks.workunit.client.1.smithi153.stdout:7/700: dwrite d12/d21/d29/d35/d37/d4c/d5c/f7f [0,4194304] 0 2024-09-12T01:43:10.826 INFO:tasks.workunit.client.0.smithi066.stdout:1/373: rename d5/dc/d36/d4b/f50 to d5/f6d 0 2024-09-12T01:43:10.828 INFO:tasks.workunit.client.0.smithi066.stdout:1/374: rmdir d5/d15/d4d 39 2024-09-12T01:43:10.830 INFO:tasks.workunit.client.0.smithi066.stdout:1/375: unlink d5/d52/d5d/f5e 0 2024-09-12T01:43:10.850 INFO:tasks.workunit.client.1.smithi153.stdout:2/720: sync 2024-09-12T01:43:10.851 INFO:tasks.workunit.client.1.smithi153.stdout:2/721: write d7/db/d62/f7f [4698026,2593] 0 2024-09-12T01:43:10.852 INFO:tasks.workunit.client.1.smithi153.stdout:6/822: dwrite d1/d6/da/d19/d3a/f7e [0,4194304] 0 2024-09-12T01:43:10.856 INFO:tasks.workunit.client.0.smithi066.stdout:1/376: write d5/dc/d36/d4b/f5f [694498,127351] 0 2024-09-12T01:43:10.856 INFO:tasks.workunit.client.0.smithi066.stdout:1/377: fdatasync d5/d52/d60/f61 0 2024-09-12T01:43:10.859 INFO:tasks.workunit.client.1.smithi153.stdout:5/762: dwrite d0/d15/f1a [4194304,4194304] 0 2024-09-12T01:43:10.859 INFO:tasks.workunit.client.1.smithi153.stdout:5/763: fsync d0/df/db8/d2f/d55/d9c/d75/f6a 0 2024-09-12T01:43:10.859 INFO:tasks.workunit.client.1.smithi153.stdout:1/797: dwrite d2/d9/d58/d74/fbf [0,4194304] 0 2024-09-12T01:43:10.859 INFO:tasks.workunit.client.1.smithi153.stdout:1/798: getdents d2/d34/d3d/d106 0 2024-09-12T01:43:10.860 INFO:tasks.workunit.client.0.smithi066.stdout:1/378: rmdir d5/dc 39 2024-09-12T01:43:10.860 INFO:tasks.workunit.client.0.smithi066.stdout:1/379: write d5/dc/d4f/f69 [451051,22110] 0 2024-09-12T01:43:10.860 INFO:tasks.workunit.client.0.smithi066.stdout:1/380: readlink d5/d15/d4d/l6a 0 2024-09-12T01:43:10.860 INFO:tasks.workunit.client.1.smithi153.stdout:2/722: dread d7/d17/f3c [0,4194304] 0 2024-09-12T01:43:10.861 INFO:tasks.workunit.client.1.smithi153.stdout:2/723: write d7/d19/f4b [4267735,65294] 0 2024-09-12T01:43:10.861 INFO:tasks.workunit.client.1.smithi153.stdout:8/678: dwrite d17/d1f/d4f/d34/d6f/f70 [0,4194304] 0 2024-09-12T01:43:10.865 INFO:tasks.workunit.client.1.smithi153.stdout:5/764: creat d0/d43/d8d/d8e/dbb/ff2 x:0 0 0 2024-09-12T01:43:10.869 INFO:tasks.workunit.client.0.smithi066.stdout:1/381: creat d5/d15/f6e x:0 0 0 2024-09-12T01:43:10.872 INFO:tasks.workunit.client.0.smithi066.stdout:1/382: mknod d5/dc/d36/d4b/c6f 0 2024-09-12T01:43:10.872 INFO:tasks.workunit.client.0.smithi066.stdout:1/383: chown d5/dc/d53 28114 1 2024-09-12T01:43:10.872 INFO:tasks.workunit.client.1.smithi153.stdout:2/724: write d7/db/d6c/d76/fa8 [14057,114414] 0 2024-09-12T01:43:10.873 INFO:tasks.workunit.client.1.smithi153.stdout:1/799: mknod d2/d9/c10b 0 2024-09-12T01:43:10.874 INFO:tasks.workunit.client.1.smithi153.stdout:9/732: dwrite d3/d3a/d42/fa2 [0,4194304] 0 2024-09-12T01:43:10.874 INFO:tasks.workunit.client.0.smithi066.stdout:1/384: chown d5/d15/d4d/l54 16040562 1 2024-09-12T01:43:10.874 INFO:tasks.workunit.client.0.smithi066.stdout:1/385: rename d5/d15 to d5/d15/d58/d70 22 2024-09-12T01:43:10.879 INFO:tasks.workunit.client.0.smithi066.stdout:1/386: rename d5/d15/l55 to d5/dc/d36/d57/l71 0 2024-09-12T01:43:10.884 INFO:tasks.workunit.client.1.smithi153.stdout:9/733: creat d3/d3a/da6/fdb x:0 0 0 2024-09-12T01:43:10.886 INFO:tasks.workunit.client.1.smithi153.stdout:1/800: getdents d2/d68 0 2024-09-12T01:43:10.886 INFO:tasks.workunit.client.1.smithi153.stdout:1/801: write d2/d68/fae [1434101,17639] 0 2024-09-12T01:43:10.888 INFO:tasks.workunit.client.1.smithi153.stdout:9/734: mkdir d3/d66/ddc 0 2024-09-12T01:43:10.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:10 smithi066 ceph-mon[27875]: pgmap v4: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail 2024-09-12T01:43:10.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:10 smithi066 ceph-mon[27875]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:10.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:10 smithi066 ceph-mon[27875]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:10.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:10 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3222626441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:43:10.890 INFO:tasks.workunit.client.1.smithi153.stdout:9/735: mknod d3/d3a/cdd 0 2024-09-12T01:43:10.890 INFO:tasks.workunit.client.1.smithi153.stdout:9/736: dread - d3/f1d zero size 2024-09-12T01:43:10.891 INFO:tasks.workunit.client.1.smithi153.stdout:6/823: dread d1/d6/d23/f29 [0,4194304] 0 2024-09-12T01:43:10.891 INFO:tasks.workunit.client.1.smithi153.stdout:6/824: write d1/d6/d39/d76/f9a [810141,67949] 0 2024-09-12T01:43:10.892 INFO:tasks.workunit.client.1.smithi153.stdout:6/825: stat d1/d6/da/d19/d34/lbb 0 2024-09-12T01:43:10.892 INFO:tasks.workunit.client.1.smithi153.stdout:9/737: truncate d3/d3a/d42/f47 2309594 0 2024-09-12T01:43:10.893 INFO:tasks.workunit.client.1.smithi153.stdout:9/738: chown d3/d55/d30/d90/fd3 1420 1 2024-09-12T01:43:10.893 INFO:tasks.workunit.client.1.smithi153.stdout:4/656: dwrite d6/d15/f22 [4194304,4194304] 0 2024-09-12T01:43:10.894 INFO:tasks.workunit.client.0.smithi066.stdout:2/399: dwrite de/d13/d1e/d41/d58/f73 [0,4194304] 0 2024-09-12T01:43:10.894 INFO:tasks.workunit.client.0.smithi066.stdout:2/400: write de/d13/d1e/d25/f5b [852494,24705] 0 2024-09-12T01:43:10.894 INFO:tasks.workunit.client.0.smithi066.stdout:1/387: dread d5/dc/f33 [0,4194304] 0 2024-09-12T01:43:10.896 INFO:tasks.workunit.client.1.smithi153.stdout:9/739: mknod d3/d3a/da6/cde 0 2024-09-12T01:43:10.898 INFO:tasks.workunit.client.0.smithi066.stdout:1/388: creat d5/d52/d60/f72 x:0 0 0 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/679: dread d17/d1d/d27/f6b [0,4194304] 0 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/809: dwrite d1/d13/d25/d26/fda [0,4194304] 0 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/680: chown d17/d21/d56/d96/fc3 25167 1 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/681: creat d17/d1f/d4f/d42/fdd x:0 0 0 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/810: creat d1/d13/d25/d26/fed x:0 0 0 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/811: fsync d1/d45/fde 0 2024-09-12T01:43:10.901 INFO:tasks.workunit.client.1.smithi153.stdout:3/812: fsync d1/d1e/d9a/fd8 0 2024-09-12T01:43:10.902 INFO:tasks.workunit.client.1.smithi153.stdout:3/813: creat d1/d13/d23/d47/d71/fee x:0 0 0 2024-09-12T01:43:10.902 INFO:tasks.workunit.client.0.smithi066.stdout:4/378: dwrite d4/d6/d8/d18/d4d/f51 [0,4194304] 0 2024-09-12T01:43:10.902 INFO:tasks.workunit.client.1.smithi153.stdout:7/701: dwrite d12/d21/d29/d35/d95/f9c [0,4194304] 0 2024-09-12T01:43:10.902 INFO:tasks.workunit.client.1.smithi153.stdout:5/765: write d0/d43/d8d/fee [2106332,122909] 0 2024-09-12T01:43:10.903 INFO:tasks.workunit.client.1.smithi153.stdout:7/702: chown d12/d4e/lbc 2875 1 2024-09-12T01:43:10.907 INFO:tasks.workunit.client.0.smithi066.stdout:1/389: creat d5/f73 x:0 0 0 2024-09-12T01:43:10.907 INFO:tasks.workunit.client.0.smithi066.stdout:2/401: dread de/d13/d28/f30 [0,4194304] 0 2024-09-12T01:43:10.907 INFO:tasks.workunit.client.0.smithi066.stdout:2/402: fsync f2 0 2024-09-12T01:43:10.918 INFO:tasks.workunit.client.0.smithi066.stdout:2/403: fdatasync de/d13/d28/d3a/f4d 0 2024-09-12T01:43:10.922 INFO:tasks.workunit.client.1.smithi153.stdout:3/814: creat d1/d1e/fef x:0 0 0 2024-09-12T01:43:10.922 INFO:tasks.workunit.client.1.smithi153.stdout:7/703: symlink d12/d21/d29/d35/d37/d4c/d5c/ldf 0 2024-09-12T01:43:10.927 INFO:tasks.workunit.client.1.smithi153.stdout:2/725: dwrite d7/fe [0,4194304] 0 2024-09-12T01:43:10.931 INFO:tasks.workunit.client.1.smithi153.stdout:2/726: link d7/db/d6c/d76/f96 d7/db/d7c/fe4 0 2024-09-12T01:43:10.931 INFO:tasks.workunit.client.1.smithi153.stdout:2/727: fdatasync d7/db/d1d/f35 0 2024-09-12T01:43:10.935 INFO:tasks.workunit.client.1.smithi153.stdout:8/682: write d17/d1f/d4f/d34/d6f/f70 [4181103,19059] 0 2024-09-12T01:43:10.937 INFO:tasks.workunit.client.1.smithi153.stdout:8/683: creat d17/d1f/d4f/d42/d79/dac/dce/ddc/fde x:0 0 0 2024-09-12T01:43:10.939 INFO:tasks.workunit.client.1.smithi153.stdout:8/684: mkdir d17/d21/d56/ddf 0 2024-09-12T01:43:10.940 INFO:tasks.workunit.client.1.smithi153.stdout:8/685: mknod d17/d21/d56/ce0 0 2024-09-12T01:43:10.940 INFO:tasks.workunit.client.1.smithi153.stdout:8/686: stat d17/d1d/f73 0 2024-09-12T01:43:10.940 INFO:tasks.workunit.client.1.smithi153.stdout:7/704: dread d12/d21/d29/d35/d37/d4c/d5c/f7a [4194304,4194304] 0 2024-09-12T01:43:10.941 INFO:tasks.workunit.client.1.smithi153.stdout:7/705: chown d12/c1f 12173385 1 2024-09-12T01:43:10.941 INFO:tasks.workunit.client.1.smithi153.stdout:7/706: truncate d12/d21/d29/d35/d37/d4c/d8e/fd3 3689926 0 2024-09-12T01:43:10.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/707: symlink d12/d4e/le0 0 2024-09-12T01:43:10.948 INFO:tasks.workunit.client.1.smithi153.stdout:1/802: dwrite d2/d9/d17/d2f/fb6 [4194304,4194304] 0 2024-09-12T01:43:10.950 INFO:tasks.workunit.client.1.smithi153.stdout:1/803: getdents d2/d9/d28/d73/d76 0 2024-09-12T01:43:10.952 INFO:tasks.workunit.client.1.smithi153.stdout:4/657: dwrite d6/d9/d11/d13/dce/dd7/f74 [0,4194304] 0 2024-09-12T01:43:10.954 INFO:tasks.workunit.client.1.smithi153.stdout:9/740: dwrite d3/d55/d30/d5b/f7d [0,4194304] 0 2024-09-12T01:43:10.955 INFO:tasks.workunit.client.0.smithi066.stdout:4/379: dwrite d4/d6/f30 [4194304,4194304] 0 2024-09-12T01:43:10.958 INFO:tasks.workunit.client.1.smithi153.stdout:1/804: rename d2/d9/d58/c81 to d2/d9/d17/d2f/d56/da0/c10c 0 2024-09-12T01:43:10.958 INFO:tasks.workunit.client.1.smithi153.stdout:1/805: fdatasync d2/d9/d17/f4e 0 2024-09-12T01:43:10.962 INFO:tasks.workunit.client.1.smithi153.stdout:1/806: rmdir d2/d68/d6b/d9e/dc7 39 2024-09-12T01:43:10.965 INFO:tasks.workunit.client.1.smithi153.stdout:4/658: dread d6/d9/dc/d98/d3e/d66/fb9 [0,4194304] 0 2024-09-12T01:43:10.965 INFO:tasks.workunit.client.1.smithi153.stdout:4/659: stat d6/d9/dc/d98/d3e/f50 0 2024-09-12T01:43:10.965 INFO:tasks.workunit.client.0.smithi066.stdout:1/390: dwrite d5/dc/d36/d4b/f31 [0,4194304] 0 2024-09-12T01:43:10.970 INFO:tasks.workunit.client.0.smithi066.stdout:4/380: dread d4/d6/d8/f4e [0,4194304] 0 2024-09-12T01:43:10.971 INFO:tasks.workunit.client.1.smithi153.stdout:5/766: dread d0/d43/d8d/fee [0,4194304] 0 2024-09-12T01:43:10.972 INFO:tasks.workunit.client.1.smithi153.stdout:5/767: truncate d0/df/db8/d6e/fcb 989775 0 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:4/660: rename d6/l7f to d6/d9/dc/d31/le7 0 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:4/661: dread - d6/f8b zero size 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:4/662: fdatasync d6/d15/db4/fc0 0 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:4/663: getdents d6/d9/dc/d31/d76/d99 0 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:3/815: dwrite d1/f5 [4194304,4194304] 0 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:2/728: dwrite d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:10.973 INFO:tasks.workunit.client.1.smithi153.stdout:3/816: creat d1/d13/d25/d26/ff0 x:0 0 0 2024-09-12T01:43:10.974 INFO:tasks.workunit.client.0.smithi066.stdout:2/404: dwrite de/d13/d28/f77 [0,4194304] 0 2024-09-12T01:43:10.976 INFO:tasks.workunit.client.1.smithi153.stdout:4/664: rename d6/l46 to d6/d9/dc/d31/d76/d99/dd2/le8 0 2024-09-12T01:43:10.976 INFO:tasks.workunit.client.1.smithi153.stdout:9/741: write d3/d55/d30/f86 [3354721,81232] 0 2024-09-12T01:43:10.981 INFO:tasks.workunit.client.0.smithi066.stdout:1/391: symlink d5/dc/d53/l74 0 2024-09-12T01:43:10.981 INFO:tasks.workunit.client.1.smithi153.stdout:3/817: rmdir d1/d13/d23/d47/d6c/ddd 0 2024-09-12T01:43:10.982 INFO:tasks.workunit.client.1.smithi153.stdout:3/818: readlink d1/d16/l38 0 2024-09-12T01:43:10.983 INFO:tasks.workunit.client.1.smithi153.stdout:2/729: mknod d7/d17/da9/ce5 0 2024-09-12T01:43:10.985 INFO:tasks.workunit.client.0.smithi066.stdout:2/405: dread de/d13/d28/f52 [0,4194304] 0 2024-09-12T01:43:10.985 INFO:tasks.workunit.client.1.smithi153.stdout:4/665: creat d6/d9/d11/d13/dce/dd7/fe9 x:0 0 0 2024-09-12T01:43:10.986 INFO:tasks.workunit.client.1.smithi153.stdout:5/768: write d0/df/db8/d2f/d55/d9c/d75/d58/f94 [3489965,77641] 0 2024-09-12T01:43:10.987 INFO:tasks.workunit.client.1.smithi153.stdout:5/769: stat d0/df/db8/d2f/d55/fe7 0 2024-09-12T01:43:10.987 INFO:tasks.workunit.client.1.smithi153.stdout:8/687: dwrite d17/d21/d56/d96/d6c/d89/f8e [0,4194304] 0 2024-09-12T01:43:10.987 INFO:tasks.workunit.client.1.smithi153.stdout:8/688: readlink d17/d21/d56/d96/l49 0 2024-09-12T01:43:10.988 INFO:tasks.workunit.client.1.smithi153.stdout:7/708: dwrite d12/d21/d29/d2d/f30 [0,4194304] 0 2024-09-12T01:43:10.988 INFO:tasks.workunit.client.1.smithi153.stdout:7/709: fdatasync d12/d7e/db2/fbf 0 2024-09-12T01:43:10.989 INFO:tasks.workunit.client.0.smithi066.stdout:1/392: link d5/dc/d53/l46 d5/d15/l75 0 2024-09-12T01:43:10.992 INFO:tasks.workunit.client.0.smithi066.stdout:2/406: creat de/d13/d28/d3a/f83 x:0 0 0 2024-09-12T01:43:10.993 INFO:tasks.workunit.client.1.smithi153.stdout:9/742: rmdir d3/d55/d30/d90 39 2024-09-12T01:43:10.993 INFO:tasks.workunit.client.1.smithi153.stdout:9/743: stat d3/d55/d30/d7b/d8f 0 2024-09-12T01:43:10.995 INFO:tasks.workunit.client.1.smithi153.stdout:1/807: dwrite d2/d9/fb5 [0,4194304] 0 2024-09-12T01:43:10.995 INFO:tasks.workunit.client.0.smithi066.stdout:1/393: symlink d5/d52/d60/l76 0 2024-09-12T01:43:10.995 INFO:tasks.workunit.client.0.smithi066.stdout:4/381: dwrite d4/f17 [4194304,4194304] 0 2024-09-12T01:43:10.996 INFO:tasks.workunit.client.1.smithi153.stdout:9/744: dread d3/d55/f59 [0,4194304] 0 2024-09-12T01:43:10.999 INFO:tasks.workunit.client.1.smithi153.stdout:3/819: creat d1/d59/de4/ff1 x:0 0 0 2024-09-12T01:43:11.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/394: symlink d5/d52/l77 0 2024-09-12T01:43:11.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/395: read d5/dc/d36/d4b/f11 [2971694,67429] 0 2024-09-12T01:43:11.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/396: chown d5/dc/d53/l64 17475 1 2024-09-12T01:43:11.001 INFO:tasks.workunit.client.0.smithi066.stdout:1/397: chown d5/dc/d36 448 1 2024-09-12T01:43:11.001 INFO:tasks.workunit.client.0.smithi066.stdout:1/398: truncate d5/dc/d4f/f69 530710 0 2024-09-12T01:43:11.001 INFO:tasks.workunit.client.0.smithi066.stdout:1/399: fsync d5/d15/f43 0 2024-09-12T01:43:11.001 INFO:tasks.workunit.client.1.smithi153.stdout:2/730: rmdir d7/db/d6c 39 2024-09-12T01:43:11.002 INFO:tasks.workunit.client.0.smithi066.stdout:2/407: dread de/d13/d1e/d25/f2b [0,4194304] 0 2024-09-12T01:43:11.003 INFO:tasks.workunit.client.1.smithi153.stdout:4/666: creat d6/d15/db4/fea x:0 0 0 2024-09-12T01:43:11.003 INFO:tasks.workunit.client.1.smithi153.stdout:4/667: chown d6/d6a/dcb/le2 360064402 1 2024-09-12T01:43:11.003 INFO:tasks.workunit.client.1.smithi153.stdout:4/668: fsync d6/d6a/d9c/fbc 0 2024-09-12T01:43:11.004 INFO:tasks.workunit.client.0.smithi066.stdout:4/382: mknod d4/d6/d27/d2f/c7b 0 2024-09-12T01:43:11.004 INFO:tasks.workunit.client.0.smithi066.stdout:5/340: sync 2024-09-12T01:43:11.004 INFO:tasks.workunit.client.0.smithi066.stdout:3/457: sync 2024-09-12T01:43:11.004 INFO:tasks.workunit.client.0.smithi066.stdout:8/449: sync 2024-09-12T01:43:11.004 INFO:tasks.workunit.client.0.smithi066.stdout:0/416: sync 2024-09-12T01:43:11.005 INFO:tasks.workunit.client.0.smithi066.stdout:6/458: sync 2024-09-12T01:43:11.007 INFO:tasks.workunit.client.0.smithi066.stdout:9/435: sync 2024-09-12T01:43:11.007 INFO:tasks.workunit.client.0.smithi066.stdout:5/341: write d0/dd/d18/f5a [117883,70348] 0 2024-09-12T01:43:11.007 INFO:tasks.workunit.client.0.smithi066.stdout:5/342: chown d0/d26/d2d/d33/d55/f5e 74234 1 2024-09-12T01:43:11.011 INFO:tasks.workunit.client.1.smithi153.stdout:8/689: mknod d17/d1d/ce1 0 2024-09-12T01:43:11.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/408: mkdir de/d13/d1e/d84 0 2024-09-12T01:43:11.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/409: write fd [487486,61298] 0 2024-09-12T01:43:11.012 INFO:tasks.workunit.client.0.smithi066.stdout:3/458: symlink d5/d6/d1b/d65/d89/d50/l95 0 2024-09-12T01:43:11.013 INFO:tasks.workunit.client.1.smithi153.stdout:4/669: dread d6/d9/dc/d98/f7e [0,4194304] 0 2024-09-12T01:43:11.016 INFO:tasks.workunit.client.1.smithi153.stdout:5/770: dwrite d0/d15/f53 [4194304,4194304] 0 2024-09-12T01:43:11.016 INFO:tasks.workunit.client.1.smithi153.stdout:5/771: write d0/d43/d68/db2/fcf [712527,119049] 0 2024-09-12T01:43:11.016 INFO:tasks.workunit.client.1.smithi153.stdout:5/772: stat d0/df/db8/d2f/d55/d9c/lb1 0 2024-09-12T01:43:11.018 INFO:tasks.workunit.client.0.smithi066.stdout:0/417: symlink d1/d72/de/d47/d7c/l96 0 2024-09-12T01:43:11.018 INFO:tasks.workunit.client.0.smithi066.stdout:8/450: write d12/d21/d2f/d57/d43/f46 [3392401,57907] 0 2024-09-12T01:43:11.018 INFO:tasks.workunit.client.1.smithi153.stdout:1/808: dread d2/d9/d17/d2f/d56/f5c [0,4194304] 0 2024-09-12T01:43:11.018 INFO:tasks.workunit.client.1.smithi153.stdout:1/809: dread - d2/d9/d17/d2f/d56/d71/d9a/ffb zero size 2024-09-12T01:43:11.023 INFO:tasks.workunit.client.1.smithi153.stdout:7/710: mknod d12/d21/d4d/ce1 0 2024-09-12T01:43:11.027 INFO:tasks.workunit.client.0.smithi066.stdout:1/400: rename d5/d15/d4d/l6a to d5/dc/l78 0 2024-09-12T01:43:11.027 INFO:tasks.workunit.client.0.smithi066.stdout:1/401: creat d5/d52/d60/f79 x:0 0 0 2024-09-12T01:43:11.030 INFO:tasks.workunit.client.0.smithi066.stdout:8/451: dread d12/d21/d2f/d57/d43/d66/f68 [0,4194304] 0 2024-09-12T01:43:11.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.032+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8d0000bf0 con 0x7fc8cc038fe0 2024-09-12T01:43:11.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.034+0000 7fc8cbfff640 1 -- 172.21.15.66:0/1333440363 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc8d0000bf0 con 0x7fc8cc038fe0 2024-09-12T01:43:11.034 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:43:11.034 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [], 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "1/2 daemons upgraded", 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "", 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:43:11.035 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:43:11.035 INFO:tasks.workunit.client.0.smithi066.stdout:2/410: link de/d13/d1e/d22/f3b de/d13/d1e/d25/d5e/f85 0 2024-09-12T01:43:11.036 INFO:tasks.workunit.client.0.smithi066.stdout:2/411: readlink de/d3c/l64 0 2024-09-12T01:43:11.036 INFO:tasks.workunit.client.0.smithi066.stdout:2/412: read de/d13/d1e/d25/f32 [3533412,97663] 0 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.036+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fc8cc038fe0 msgr2=0x7fc8cc03b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.036+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fc8cc038fe0 0x7fc8cc03b490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc8e410ab50 tx=0x7fc8d800b040 comp rx=0 tx=0).stop 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.036+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 msgr2=0x7fc8e410c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 0x7fc8e410c090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8d40435e0 tx=0x7fc8d4009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 shutdown_connections 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fc8cc038fe0 0x7fc8cc03b490 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8e410b300 0x7fc8e410c090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.037 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 --2- 172.21.15.66:0/1333440363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e4066690 0x7fc8e410adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 >> 172.21.15.66:0/1333440363 conn(0x7fc8e40f6c30 msgr2=0x7fc8e40fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 shutdown_connections 2024-09-12T01:43:11.038 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:11.037+0000 7fc8e9c50640 1 -- 172.21.15.66:0/1333440363 wait complete. 2024-09-12T01:43:11.038 INFO:tasks.workunit.client.1.smithi153.stdout:9/745: link d3/d55/d30/d7b/c91 d3/d55/d30/d95/d84/d8b/cdf 0 2024-09-12T01:43:11.040 INFO:tasks.workunit.client.1.smithi153.stdout:3/820: creat d1/d13/d23/d47/d71/d8e/d93/dd1/ff2 x:0 0 0 2024-09-12T01:43:11.040 INFO:tasks.workunit.client.1.smithi153.stdout:3/821: creat d1/d1e/ff3 x:0 0 0 2024-09-12T01:43:11.040 INFO:tasks.workunit.client.1.smithi153.stdout:3/822: chown d1/d59/caa 8943538 1 2024-09-12T01:43:11.042 INFO:tasks.workunit.client.1.smithi153.stdout:2/731: unlink d7/db/ff 0 2024-09-12T01:43:11.043 INFO:tasks.workunit.client.0.smithi066.stdout:8/452: unlink d12/d21/d2f/d57/d3c/c4e 0 2024-09-12T01:43:11.046 INFO:tasks.workunit.client.1.smithi153.stdout:8/690: rename d17/d21/d56/d95/db7/fbb to d17/d1f/d4f/d34/d6f/fe2 0 2024-09-12T01:43:11.053 INFO:tasks.workunit.client.0.smithi066.stdout:2/413: rename de/d13/d1e/d22/c43 to de/d13/d5c/c86 0 2024-09-12T01:43:11.053 INFO:tasks.workunit.client.0.smithi066.stdout:2/414: creat de/d13/f87 x:0 0 0 2024-09-12T01:43:11.056 INFO:tasks.workunit.client.1.smithi153.stdout:5/773: mknod d0/df/db8/d6e/cf3 0 2024-09-12T01:43:11.058 INFO:tasks.workunit.client.1.smithi153.stdout:7/711: link d12/d4e/cd6 d12/d21/ce2 0 2024-09-12T01:43:11.058 INFO:tasks.workunit.client.1.smithi153.stdout:7/712: write d12/d21/d29/f5a [5466706,21070] 0 2024-09-12T01:43:11.059 INFO:tasks.workunit.client.1.smithi153.stdout:9/746: creat d3/d35/fe0 x:0 0 0 2024-09-12T01:43:11.059 INFO:tasks.workunit.client.1.smithi153.stdout:9/747: read d3/d35/f5d [1027055,80158] 0 2024-09-12T01:43:11.062 INFO:tasks.workunit.client.1.smithi153.stdout:3/823: rename d1/d13/d25/d26/d4b/f4f to d1/d16/ff4 0 2024-09-12T01:43:11.062 INFO:tasks.workunit.client.1.smithi153.stdout:3/824: creat d1/d1e/d9a/ff5 x:0 0 0 2024-09-12T01:43:11.062 INFO:tasks.workunit.client.1.smithi153.stdout:3/825: creat d1/d13/d25/d26/ff6 x:0 0 0 2024-09-12T01:43:11.063 INFO:tasks.workunit.client.1.smithi153.stdout:7/713: truncate d12/d21/d29/d35/d37/d4c/f71 2618243 0 2024-09-12T01:43:11.064 INFO:tasks.workunit.client.1.smithi153.stdout:9/748: truncate d3/f29 1192252 0 2024-09-12T01:43:11.064 INFO:tasks.workunit.client.1.smithi153.stdout:9/749: write d3/d5f/dbb/fda [1020392,53819] 0 2024-09-12T01:43:11.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/691: rename d17/d1d/d93 to d17/d21/d56/ddf/de3 0 2024-09-12T01:43:11.066 INFO:tasks.workunit.client.1.smithi153.stdout:8/692: readlink d17/d1d/ld8 0 2024-09-12T01:43:11.066 INFO:tasks.workunit.client.1.smithi153.stdout:8/693: truncate d17/d1f/d4f/d34/f47 4687950 0 2024-09-12T01:43:11.068 INFO:tasks.workunit.client.1.smithi153.stdout:8/694: creat d17/d1f/dcf/fe4 x:0 0 0 2024-09-12T01:43:11.068 INFO:tasks.workunit.client.1.smithi153.stdout:8/695: dread - d17/d1f/d4f/d42/fd1 zero size 2024-09-12T01:43:11.069 INFO:tasks.workunit.client.1.smithi153.stdout:8/696: mkdir d17/d1f/d4f/d42/d79/dd4/de5 0 2024-09-12T01:43:11.069 INFO:tasks.workunit.client.1.smithi153.stdout:8/697: getdents d17/d21/d56/d95/dbc 0 2024-09-12T01:43:11.074 INFO:tasks.workunit.client.1.smithi153.stdout:6/826: sync 2024-09-12T01:43:11.074 INFO:tasks.workunit.client.1.smithi153.stdout:0/851: sync 2024-09-12T01:43:11.074 INFO:tasks.workunit.client.1.smithi153.stdout:6/827: dread - d1/d6/d39/dc4/fe5 zero size 2024-09-12T01:43:11.074 INFO:tasks.workunit.client.1.smithi153.stdout:0/852: write d22/d30/d4c/fd4 [866566,62685] 0 2024-09-12T01:43:11.075 INFO:tasks.workunit.client.1.smithi153.stdout:6/828: link d1/d6/d23/d98/d4f/cde d1/d6/d46/d73/c106 0 2024-09-12T01:43:11.075 INFO:tasks.workunit.client.1.smithi153.stdout:6/829: readlink d1/df/ldd 0 2024-09-12T01:43:11.075 INFO:tasks.workunit.client.1.smithi153.stdout:0/853: truncate d22/d30/d4c/d6f/f70 13159 0 2024-09-12T01:43:11.079 INFO:tasks.workunit.client.1.smithi153.stdout:6/830: dread d1/df/f6f [0,4194304] 0 2024-09-12T01:43:11.079 INFO:tasks.workunit.client.1.smithi153.stdout:6/831: dread - d1/d6/d46/d73/d8a/d84/d96/fdc zero size 2024-09-12T01:43:11.079 INFO:tasks.workunit.client.1.smithi153.stdout:0/854: dread d22/fde [0,4194304] 0 2024-09-12T01:43:11.080 INFO:tasks.workunit.client.1.smithi153.stdout:6/832: creat d1/d6/d23/d98/d4f/f107 x:0 0 0 2024-09-12T01:43:11.081 INFO:tasks.workunit.client.1.smithi153.stdout:0/855: getdents d22/d79/dca/ded 0 2024-09-12T01:43:11.082 INFO:tasks.workunit.client.1.smithi153.stdout:0/856: write d22/d79/d8e/dae/db7/fc9 [696613,26566] 0 2024-09-12T01:43:11.082 INFO:tasks.workunit.client.1.smithi153.stdout:0/857: chown d22/d30/d4c/d6f/ca9 166662209 1 2024-09-12T01:43:11.083 INFO:tasks.workunit.client.1.smithi153.stdout:0/858: creat d22/d79/d8e/dc6/dd6/f11c x:0 0 0 2024-09-12T01:43:11.084 INFO:tasks.workunit.client.1.smithi153.stdout:0/859: getdents d22/d79/d8e/dae 0 2024-09-12T01:43:11.086 INFO:tasks.workunit.client.1.smithi153.stdout:0/860: mknod d22/d79/d8e/dc6/c11d 0 2024-09-12T01:43:11.089 INFO:tasks.workunit.client.1.smithi153.stdout:0/861: rename d22/d30/d4c/d6f/dfa to d22/d79/d8e/dae/dff/d11e 0 2024-09-12T01:43:11.090 INFO:tasks.workunit.client.1.smithi153.stdout:0/862: rename d22/d30/d4c/d6e/c85 to d22/d30/d4c/d8a/d117/c11f 0 2024-09-12T01:43:11.104 INFO:tasks.workunit.client.0.smithi066.stdout:2/415: write de/d13/d1e/f36 [534820,95843] 0 2024-09-12T01:43:11.105 INFO:tasks.workunit.client.0.smithi066.stdout:2/416: chown de/d13/d1e/l20 495392 1 2024-09-12T01:43:11.105 INFO:tasks.workunit.client.0.smithi066.stdout:2/417: fsync de/d13/d1e/d22/f74 0 2024-09-12T01:43:11.105 INFO:tasks.workunit.client.0.smithi066.stdout:4/383: dwrite d4/f71 [0,4194304] 0 2024-09-12T01:43:11.107 INFO:tasks.workunit.client.0.smithi066.stdout:3/459: dwrite d5/d35/f4d [0,4194304] 0 2024-09-12T01:43:11.108 INFO:tasks.workunit.client.0.smithi066.stdout:4/384: unlink d4/d6/d27/d66/f56 0 2024-09-12T01:43:11.108 INFO:tasks.workunit.client.0.smithi066.stdout:4/385: write d4/d6/d27/d66/d58/f77 [434714,115304] 0 2024-09-12T01:43:11.109 INFO:tasks.workunit.client.0.smithi066.stdout:4/386: read d4/d6/d8/f3b [1016970,66500] 0 2024-09-12T01:43:11.119 INFO:tasks.workunit.client.1.smithi153.stdout:7/714: write d12/d21/d29/d35/d37/d58/f98 [541277,31416] 0 2024-09-12T01:43:11.119 INFO:tasks.workunit.client.1.smithi153.stdout:7/715: write d12/d21/d29/d35/d37/fa0 [914693,11296] 0 2024-09-12T01:43:11.120 INFO:tasks.workunit.client.0.smithi066.stdout:3/460: write d5/d6/d1b/d28/d4f/d5e/f7d [357013,89367] 0 2024-09-12T01:43:11.120 INFO:tasks.workunit.client.0.smithi066.stdout:3/461: truncate d5/f5b 435426 0 2024-09-12T01:43:11.120 INFO:tasks.workunit.client.0.smithi066.stdout:3/462: readlink d5/d6/d1b/d65/d89/l18 0 2024-09-12T01:43:11.120 INFO:tasks.workunit.client.0.smithi066.stdout:3/463: creat d5/d6/f96 x:0 0 0 2024-09-12T01:43:11.122 INFO:tasks.workunit.client.0.smithi066.stdout:3/464: mknod d5/d6/d1b/d45/d66/c97 0 2024-09-12T01:43:11.122 INFO:tasks.workunit.client.0.smithi066.stdout:3/465: fsync d5/d6/d1b/f88 0 2024-09-12T01:43:11.127 INFO:tasks.workunit.client.0.smithi066.stdout:3/466: write d5/d6/d1b/d65/d89/f72 [79414,61043] 0 2024-09-12T01:43:11.142 INFO:tasks.workunit.client.0.smithi066.stdout:6/459: dwrite d2/d21/f30 [0,4194304] 0 2024-09-12T01:43:11.143 INFO:tasks.workunit.client.0.smithi066.stdout:6/460: dread d2/db/f60 [4194304,4194304] 0 2024-09-12T01:43:11.152 INFO:tasks.workunit.client.1.smithi153.stdout:2/732: dwrite d7/fe [0,4194304] 0 2024-09-12T01:43:11.153 INFO:tasks.workunit.client.1.smithi153.stdout:2/733: creat d7/db/d1d/d1e/d6d/fe6 x:0 0 0 2024-09-12T01:43:11.154 INFO:tasks.workunit.client.0.smithi066.stdout:0/418: dwrite d1/d72/de/d47/d4a/d67/d1b/d26/f2e [4194304,4194304] 0 2024-09-12T01:43:11.154 INFO:tasks.workunit.client.0.smithi066.stdout:0/419: readlink d1/d72/de/d47/d4a/d67/d1b/d26/l37 0 2024-09-12T01:43:11.154 INFO:tasks.workunit.client.0.smithi066.stdout:8/453: dwrite d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f8f [0,4194304] 0 2024-09-12T01:43:11.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:10 smithi153 ceph-mon[34713]: pgmap v4: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail 2024-09-12T01:43:11.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:10 smithi153 ceph-mon[34713]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:11.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:10 smithi153 ceph-mon[34713]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:11.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:10 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3222626441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:43:11.155 INFO:tasks.workunit.client.1.smithi153.stdout:2/734: creat d7/db/d1d/d1e/fe7 x:0 0 0 2024-09-12T01:43:11.157 INFO:tasks.workunit.client.0.smithi066.stdout:8/454: link d12/d21/f33 d12/d21/d2f/d57/d43/f91 0 2024-09-12T01:43:11.159 INFO:tasks.workunit.client.0.smithi066.stdout:8/455: mkdir d12/d21/d2f/d57/d84/d89/d92 0 2024-09-12T01:43:11.165 INFO:tasks.workunit.client.1.smithi153.stdout:7/716: dread d12/d21/f49 [0,4194304] 0 2024-09-12T01:43:11.165 INFO:tasks.workunit.client.1.smithi153.stdout:7/717: dread - d12/d21/d29/d2d/fac zero size 2024-09-12T01:43:11.167 INFO:tasks.workunit.client.1.smithi153.stdout:7/718: getdents d12/d21/d29/d35/d37/d4c/d8e 0 2024-09-12T01:43:11.172 INFO:tasks.workunit.client.1.smithi153.stdout:0/863: dwrite d22/d79/d8e/dae/dff/d11e/f119 [0,4194304] 0 2024-09-12T01:43:11.174 INFO:tasks.workunit.client.1.smithi153.stdout:2/735: dread d7/db/d27/f31 [0,4194304] 0 2024-09-12T01:43:11.175 INFO:tasks.workunit.client.0.smithi066.stdout:0/420: dread d1/d72/de/f3c [0,4194304] 0 2024-09-12T01:43:11.176 INFO:tasks.workunit.client.1.smithi153.stdout:2/736: creat d7/db/d62/dbb/dd3/fe8 x:0 0 0 2024-09-12T01:43:11.176 INFO:tasks.workunit.client.0.smithi066.stdout:0/421: mknod d1/d62/c97 0 2024-09-12T01:43:11.179 INFO:tasks.workunit.client.1.smithi153.stdout:3/826: dwrite d1/d1e/fbc [0,4194304] 0 2024-09-12T01:43:11.179 INFO:tasks.workunit.client.0.smithi066.stdout:0/422: link d1/d72/de/d47/d4a/d67/d20/d3d/l84 d1/d72/de/d47/d4a/d67/d3e/l98 0 2024-09-12T01:43:11.179 INFO:tasks.workunit.client.0.smithi066.stdout:0/423: write d1/d72/de/d47/d4a/d67/d6e/d80/f58 [2917258,71531] 0 2024-09-12T01:43:11.179 INFO:tasks.workunit.client.0.smithi066.stdout:0/424: write d1/d72/de/d47/d4a/d67/d1b/d26/f2e [9382109,1163] 0 2024-09-12T01:43:11.180 INFO:tasks.workunit.client.0.smithi066.stdout:0/425: chown d1/d72/de/d47/d4a/d67/d1b/d26/l37 460 1 2024-09-12T01:43:11.181 INFO:tasks.workunit.client.0.smithi066.stdout:0/426: creat d1/d62/d89/d83/f99 x:0 0 0 2024-09-12T01:43:11.182 INFO:tasks.workunit.client.1.smithi153.stdout:8/698: dwrite d17/d21/d56/f84 [0,4194304] 0 2024-09-12T01:43:11.184 INFO:tasks.workunit.client.0.smithi066.stdout:0/427: symlink d1/d62/d89/d83/l9a 0 2024-09-12T01:43:11.188 INFO:tasks.workunit.client.0.smithi066.stdout:0/428: creat d1/d62/d89/f9b x:0 0 0 2024-09-12T01:43:11.188 INFO:tasks.workunit.client.0.smithi066.stdout:0/429: write d1/d72/de/d47/d4a/d67/d20/f30 [2504830,56920] 0 2024-09-12T01:43:11.188 INFO:tasks.workunit.client.1.smithi153.stdout:0/864: dread d22/d30/d4c/d6e/d7f/dbd/fc8 [0,4194304] 0 2024-09-12T01:43:11.188 INFO:tasks.workunit.client.1.smithi153.stdout:0/865: truncate d22/d79/d8e/dae/db7/f110 671164 0 2024-09-12T01:43:11.189 INFO:tasks.workunit.client.1.smithi153.stdout:0/866: dread - d22/d30/d4c/d6e/d7f/f93 zero size 2024-09-12T01:43:11.189 INFO:tasks.workunit.client.0.smithi066.stdout:0/430: mkdir d1/d72/de/d47/d4a/d67/d1b/d26/d9c 0 2024-09-12T01:43:11.189 INFO:tasks.workunit.client.0.smithi066.stdout:0/431: chown d1/d72/f6f 76295549 1 2024-09-12T01:43:11.189 INFO:tasks.workunit.client.0.smithi066.stdout:0/432: write d1/d72/de/d47/d4a/d67/f91 [1036423,84895] 0 2024-09-12T01:43:11.191 INFO:tasks.workunit.client.0.smithi066.stdout:0/433: mknod d1/d72/de/d47/d4a/d67/d20/c9d 0 2024-09-12T01:43:11.195 INFO:tasks.workunit.client.1.smithi153.stdout:6/833: dwrite d1/d6/d46/d73/f91 [0,4194304] 0 2024-09-12T01:43:11.196 INFO:tasks.workunit.client.0.smithi066.stdout:0/434: creat d1/d72/de/d47/d7c/f9e x:0 0 0 2024-09-12T01:43:11.198 INFO:tasks.workunit.client.1.smithi153.stdout:6/834: dread d1/df/f6f [0,4194304] 0 2024-09-12T01:43:11.201 INFO:tasks.workunit.client.1.smithi153.stdout:6/835: creat d1/d6/d39/dc4/f108 x:0 0 0 2024-09-12T01:43:11.201 INFO:tasks.workunit.client.1.smithi153.stdout:6/836: write d1/d6/d23/d98/d53/da0/fad [141409,128551] 0 2024-09-12T01:43:11.202 INFO:tasks.workunit.client.1.smithi153.stdout:6/837: creat d1/d80/db6/d103/f109 x:0 0 0 2024-09-12T01:43:11.203 INFO:tasks.workunit.client.1.smithi153.stdout:0/867: dread d22/d30/d4c/f55 [0,4194304] 0 2024-09-12T01:43:11.203 INFO:tasks.workunit.client.1.smithi153.stdout:6/838: mknod d1/d6/d23/d98/d53/d69/d7c/d7f/df0/c10a 0 2024-09-12T01:43:11.204 INFO:tasks.workunit.client.1.smithi153.stdout:0/868: truncate d22/d30/f67 569738 0 2024-09-12T01:43:11.206 INFO:tasks.workunit.client.1.smithi153.stdout:0/869: mkdir d22/d82/d10e/d120 0 2024-09-12T01:43:11.206 INFO:tasks.workunit.client.1.smithi153.stdout:9/750: dwrite d3/d55/f22 [0,4194304] 0 2024-09-12T01:43:11.206 INFO:tasks.workunit.client.1.smithi153.stdout:9/751: creat d3/d55/d30/d7b/d8f/fe1 x:0 0 0 2024-09-12T01:43:11.206 INFO:tasks.workunit.client.1.smithi153.stdout:6/839: dread d1/d6/d23/d98/d53/da0/fe8 [0,4194304] 0 2024-09-12T01:43:11.206 INFO:tasks.workunit.client.1.smithi153.stdout:0/870: read f3 [1030614,23568] 0 2024-09-12T01:43:11.207 INFO:tasks.workunit.client.0.smithi066.stdout:2/418: dwrite de/f1d [0,4194304] 0 2024-09-12T01:43:11.207 INFO:tasks.workunit.client.0.smithi066.stdout:3/467: dwrite d5/d35/f73 [0,4194304] 0 2024-09-12T01:43:11.208 INFO:tasks.workunit.client.0.smithi066.stdout:3/468: fdatasync d5/d6/d1b/d65/f7e 0 2024-09-12T01:43:11.208 INFO:tasks.workunit.client.0.smithi066.stdout:4/387: dwrite d4/d6/f34 [0,4194304] 0 2024-09-12T01:43:11.208 INFO:tasks.workunit.client.0.smithi066.stdout:4/388: chown d4/d6/d8/d4a/c60 869 1 2024-09-12T01:43:11.208 INFO:tasks.workunit.client.0.smithi066.stdout:4/389: fdatasync d4/d6/d8/d18/f76 0 2024-09-12T01:43:11.208 INFO:tasks.workunit.client.0.smithi066.stdout:4/390: getdents d4/d6/d27/d2f/d72 0 2024-09-12T01:43:11.208 INFO:tasks.workunit.client.0.smithi066.stdout:4/391: write d4/d15/f79 [144935,125683] 0 2024-09-12T01:43:11.211 INFO:tasks.workunit.client.0.smithi066.stdout:0/435: rename d1/d72/de/d47 to d1/d62/d9f 0 2024-09-12T01:43:11.215 INFO:tasks.workunit.client.0.smithi066.stdout:2/419: symlink de/d13/d1e/l88 0 2024-09-12T01:43:11.219 INFO:tasks.workunit.client.0.smithi066.stdout:0/436: creat d1/d62/d9f/d4a/d67/d1b/d26/fa0 x:0 0 0 2024-09-12T01:43:11.222 INFO:tasks.workunit.client.0.smithi066.stdout:3/469: rename d5/d35/l43 to d5/d6/d1b/d45/d85/l98 0 2024-09-12T01:43:11.223 INFO:tasks.workunit.client.0.smithi066.stdout:0/437: creat d1/d62/d9f/d4a/d67/d6e/fa1 x:0 0 0 2024-09-12T01:43:11.225 INFO:tasks.workunit.client.0.smithi066.stdout:0/438: creat d1/d62/d9f/d7c/fa2 x:0 0 0 2024-09-12T01:43:11.227 INFO:tasks.workunit.client.0.smithi066.stdout:3/470: link d5/d6/d1b/d28/d4f/d5e/l54 d5/d6/d1b/d45/d66/d67/d7f/d84/l99 0 2024-09-12T01:43:11.227 INFO:tasks.workunit.client.0.smithi066.stdout:0/439: getdents d1/d62/d9f/d4a/d67/d20 0 2024-09-12T01:43:11.228 INFO:tasks.workunit.client.1.smithi153.stdout:6/840: rmdir d1 39 2024-09-12T01:43:11.229 INFO:tasks.workunit.client.0.smithi066.stdout:0/440: truncate d1/d62/d9f/f6b 630115 0 2024-09-12T01:43:11.229 INFO:tasks.workunit.client.1.smithi153.stdout:6/841: link d1/d80/db6/f105 d1/d6/d39/dc4/f10b 0 2024-09-12T01:43:11.230 INFO:tasks.workunit.client.1.smithi153.stdout:6/842: symlink d1/d6/d23/d98/d53/da4/l10c 0 2024-09-12T01:43:11.231 INFO:tasks.workunit.client.1.smithi153.stdout:6/843: chown d1/d6/d46/cd5 27357 1 2024-09-12T01:43:11.233 INFO:tasks.workunit.client.0.smithi066.stdout:6/461: dwrite d2/d21/f51 [0,4194304] 0 2024-09-12T01:43:11.233 INFO:tasks.workunit.client.0.smithi066.stdout:8/456: dwrite d12/d21/f33 [0,4194304] 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/719: dwrite d12/d21/d4d/dae/dc0/dc4/fd5 [0,4194304] 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/720: creat d12/d7e/fe3 x:0 0 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/721: readlink d12/d21/d29/d2d/l42 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/722: chown d12/d21/d29/d35/d37 117 1 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/723: write d12/f56 [902456,90676] 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/724: write d12/d21/d29/d35/d37/f76 [4658637,44421] 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/725: fsync d12/d7e/f72 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/726: stat d12/d21/d29/d2d/d8b/fd1 0 2024-09-12T01:43:11.235 INFO:tasks.workunit.client.1.smithi153.stdout:7/727: read - d12/d21/d29/d35/d37/fce zero size 2024-09-12T01:43:11.238 INFO:tasks.workunit.client.0.smithi066.stdout:6/462: creat d2/f97 x:0 0 0 2024-09-12T01:43:11.239 INFO:tasks.workunit.client.0.smithi066.stdout:0/441: rmdir d1/d62/d9f 39 2024-09-12T01:43:11.239 INFO:tasks.workunit.client.0.smithi066.stdout:0/442: chown l0 484174 1 2024-09-12T01:43:11.241 INFO:tasks.workunit.client.0.smithi066.stdout:3/471: write d5/d35/f4d [3126865,12514] 0 2024-09-12T01:43:11.247 INFO:tasks.workunit.client.1.smithi153.stdout:2/737: dwrite d7/db/d36/f84 [0,4194304] 0 2024-09-12T01:43:11.248 INFO:tasks.workunit.client.1.smithi153.stdout:8/699: dwrite d17/d21/d56/d96/d6c/d89/d9c/fa9 [0,4194304] 0 2024-09-12T01:43:11.248 INFO:tasks.workunit.client.1.smithi153.stdout:3/827: dwrite d1/d59/f66 [4194304,4194304] 0 2024-09-12T01:43:11.248 INFO:tasks.workunit.client.1.smithi153.stdout:8/700: getdents d17/d1f/d4f/d42/d79/dac/dd3 0 2024-09-12T01:43:11.251 INFO:tasks.workunit.client.1.smithi153.stdout:0/871: dwrite d22/d79/dca/fd9 [0,4194304] 0 2024-09-12T01:43:11.251 INFO:tasks.workunit.client.0.smithi066.stdout:4/392: dwrite d4/f71 [4194304,4194304] 0 2024-09-12T01:43:11.253 INFO:tasks.workunit.client.0.smithi066.stdout:6/463: write d2/db/f1c [589432,81371] 0 2024-09-12T01:43:11.253 INFO:tasks.workunit.client.0.smithi066.stdout:6/464: read - d2/d31/f81 zero size 2024-09-12T01:43:11.253 INFO:tasks.workunit.client.0.smithi066.stdout:2/420: dwrite de/d13/d28/d3d/f3f [0,4194304] 0 2024-09-12T01:43:11.254 INFO:tasks.workunit.client.0.smithi066.stdout:8/457: dwrite d12/d21/d2f/f62 [0,4194304] 0 2024-09-12T01:43:11.255 INFO:tasks.workunit.client.1.smithi153.stdout:6/844: dread d1/f4 [0,4194304] 0 2024-09-12T01:43:11.255 INFO:tasks.workunit.client.1.smithi153.stdout:6/845: write d1/d6/d23/d98/d53/d69/d7c/d7f/f9c [916350,67994] 0 2024-09-12T01:43:11.258 INFO:tasks.workunit.client.0.smithi066.stdout:0/443: getdents d1/d62/d9f/d4a/d67/d20/d5e 0 2024-09-12T01:43:11.260 INFO:tasks.workunit.client.0.smithi066.stdout:0/444: write d1/d62/d6c/f5d [302836,50274] 0 2024-09-12T01:43:11.262 INFO:tasks.workunit.client.0.smithi066.stdout:3/472: rmdir d5/d6/d1b/d77/d80 0 2024-09-12T01:43:11.262 INFO:tasks.workunit.client.0.smithi066.stdout:3/473: read d5/d6/d48/f68 [3865869,64188] 0 2024-09-12T01:43:11.263 INFO:tasks.workunit.client.1.smithi153.stdout:8/701: dread d17/f85 [0,4194304] 0 2024-09-12T01:43:11.266 INFO:tasks.workunit.client.0.smithi066.stdout:4/393: symlink d4/d15/d33/l7c 0 2024-09-12T01:43:11.268 INFO:tasks.workunit.client.0.smithi066.stdout:8/458: dread d12/d21/d2f/d57/f2e [0,4194304] 0 2024-09-12T01:43:11.269 INFO:tasks.workunit.client.0.smithi066.stdout:8/459: read d12/f5b [695895,11668] 0 2024-09-12T01:43:11.269 INFO:tasks.workunit.client.0.smithi066.stdout:8/460: dread - d12/d21/d2f/d57/d3c/f78 zero size 2024-09-12T01:43:11.281 INFO:tasks.workunit.client.0.smithi066.stdout:2/421: rename de/d13/d28/f30 to de/d13/d1e/d22/f89 0 2024-09-12T01:43:11.285 INFO:tasks.workunit.client.0.smithi066.stdout:8/461: dread d12/d21/d2f/d53/f6b [0,4194304] 0 2024-09-12T01:43:11.285 INFO:tasks.workunit.client.0.smithi066.stdout:8/462: chown d12/f47 924 1 2024-09-12T01:43:11.288 INFO:tasks.workunit.client.1.smithi153.stdout:0/872: creat d22/d79/dca/ded/df8/f121 x:0 0 0 2024-09-12T01:43:11.289 INFO:tasks.workunit.client.0.smithi066.stdout:0/445: mkdir d1/d62/d89/da3 0 2024-09-12T01:43:11.289 INFO:tasks.workunit.client.1.smithi153.stdout:8/702: chown d17/d1f/d4f/d34/l52 141993 1 2024-09-12T01:43:11.290 INFO:tasks.workunit.client.0.smithi066.stdout:3/474: getdents d5/d6/d1b/d28/d4f/d5e 0 2024-09-12T01:43:11.291 INFO:tasks.workunit.client.1.smithi153.stdout:7/728: link d12/d21/d29/d2d/da6/dc8/cd0 d12/d21/d29/d35/ce4 0 2024-09-12T01:43:11.292 INFO:tasks.workunit.client.1.smithi153.stdout:7/729: dread - d12/d21/d29/d2d/fac zero size 2024-09-12T01:43:11.292 INFO:tasks.workunit.client.1.smithi153.stdout:7/730: read d12/d21/d29/d2d/f55 [358589,97492] 0 2024-09-12T01:43:11.292 INFO:tasks.workunit.client.0.smithi066.stdout:2/422: link de/d13/d1e/d22/f3b de/d13/d1e/d84/f8a 0 2024-09-12T01:43:11.292 INFO:tasks.workunit.client.0.smithi066.stdout:2/423: chown de/d3c/l7e 3728857 1 2024-09-12T01:43:11.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/424: chown de/d13/d1e/d22/l24 3 1 2024-09-12T01:43:11.293 INFO:tasks.workunit.client.1.smithi153.stdout:2/738: getdents d7/db/d6c/d7e 0 2024-09-12T01:43:11.294 INFO:tasks.workunit.client.0.smithi066.stdout:8/463: symlink d12/d21/d2f/l93 0 2024-09-12T01:43:11.294 INFO:tasks.workunit.client.0.smithi066.stdout:8/464: fdatasync d12/d21/d2f/d57/f8c 0 2024-09-12T01:43:11.296 INFO:tasks.workunit.client.1.smithi153.stdout:0/873: rename d22/f84 to d22/d79/d8e/dae/f122 0 2024-09-12T01:43:11.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/446: rmdir d1/d62/d9f/d4a/d67/d1b/d3b 39 2024-09-12T01:43:11.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/447: truncate d1/d72/f6f 980938 0 2024-09-12T01:43:11.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/448: chown d1/d62/d9f 19 1 2024-09-12T01:43:11.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/449: creat d1/d62/fa4 x:0 0 0 2024-09-12T01:43:11.297 INFO:tasks.workunit.client.0.smithi066.stdout:0/450: truncate d1/d62/d9f/d64/f8f 659020 0 2024-09-12T01:43:11.298 INFO:tasks.workunit.client.0.smithi066.stdout:0/451: fdatasync d1/d62/d6c/f74 0 2024-09-12T01:43:11.298 INFO:tasks.workunit.client.0.smithi066.stdout:7/359: sync 2024-09-12T01:43:11.301 INFO:tasks.workunit.client.1.smithi153.stdout:8/703: unlink d17/f72 0 2024-09-12T01:43:11.301 INFO:tasks.workunit.client.1.smithi153.stdout:8/704: creat d17/d75/fe6 x:0 0 0 2024-09-12T01:43:11.302 INFO:tasks.workunit.client.1.smithi153.stdout:3/828: dwrite d1/d13/d25/f4c [0,4194304] 0 2024-09-12T01:43:11.304 INFO:tasks.workunit.client.0.smithi066.stdout:3/475: creat d5/d6/d1b/d28/d86/f9a x:0 0 0 2024-09-12T01:43:11.304 INFO:tasks.workunit.client.0.smithi066.stdout:3/476: chown d5/d6/d1b/f3f 99 1 2024-09-12T01:43:11.305 INFO:tasks.workunit.client.0.smithi066.stdout:6/465: dwrite d2/f77 [0,4194304] 0 2024-09-12T01:43:11.305 INFO:tasks.workunit.client.0.smithi066.stdout:9/436: sync 2024-09-12T01:43:11.307 INFO:tasks.workunit.client.1.smithi153.stdout:6/846: dwrite d1/d6/d46/d73/f8b [0,4194304] 0 2024-09-12T01:43:11.308 INFO:tasks.workunit.client.0.smithi066.stdout:2/425: creat de/d13/d1e/d22/d4f/f8b x:0 0 0 2024-09-12T01:43:11.308 INFO:tasks.workunit.client.0.smithi066.stdout:2/426: creat de/d13/d1e/d22/f8c x:0 0 0 2024-09-12T01:43:11.308 INFO:tasks.workunit.client.0.smithi066.stdout:2/427: fsync de/f12 0 2024-09-12T01:43:11.310 INFO:tasks.workunit.client.0.smithi066.stdout:4/394: dwrite d4/d6/d8/d18/f69 [0,4194304] 0 2024-09-12T01:43:11.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/452: rename d1/d62/d9f/f4e to d1/d62/d89/d83/d8b/fa5 0 2024-09-12T01:43:11.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/453: fsync d1/d62/d89/d83/f99 0 2024-09-12T01:43:11.315 INFO:tasks.workunit.client.1.smithi153.stdout:8/705: rename d17/d1f/d4f/d34/fbe to d17/d75/fe7 0 2024-09-12T01:43:11.316 INFO:tasks.workunit.client.0.smithi066.stdout:6/466: mknod d2/db/d12/d1d/d6b/c98 0 2024-09-12T01:43:11.320 INFO:tasks.workunit.client.1.smithi153.stdout:3/829: symlink d1/d13/d25/da6/lf7 0 2024-09-12T01:43:11.322 INFO:tasks.workunit.client.1.smithi153.stdout:0/874: link d22/d30/c38 d22/d79/d8e/dae/db7/de8/c123 0 2024-09-12T01:43:11.322 INFO:tasks.workunit.client.1.smithi153.stdout:0/875: stat d22/d30/d4c/d6e/l45 0 2024-09-12T01:43:11.327 INFO:tasks.workunit.client.1.smithi153.stdout:3/830: unlink d1/d1e/f2a 0 2024-09-12T01:43:11.328 INFO:tasks.workunit.client.1.smithi153.stdout:3/831: fdatasync d1/d13/d23/d47/d71/d8e/d93/d79/fea 0 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:3/832: mkdir d1/d13/d23/d47/d71/d8e/d93/d79/db5/df8 0 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:3/833: chown d1/d13/d23/cc6 0 1 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:8/706: dread d17/d1f/d4f/f78 [4194304,4194304] 0 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/876: symlink d22/d30/l124 0 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/877: creat d22/d79/d8e/f125 x:0 0 0 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/878: dread - d22/d79/d8e/dc6/f113 zero size 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/879: write d22/f83 [1220333,77609] 0 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:0/880: chown d22/d79/l94 26 1 2024-09-12T01:43:11.331 INFO:tasks.workunit.client.1.smithi153.stdout:3/834: dread d1/d1e/f80 [0,4194304] 0 2024-09-12T01:43:11.332 INFO:tasks.workunit.client.1.smithi153.stdout:0/881: truncate d22/d30/d4c/d6f/d88/fc3 4178561 0 2024-09-12T01:43:11.333 INFO:tasks.workunit.client.1.smithi153.stdout:8/707: rename d17/d1f/d4f/d42/f97 to d17/d1f/d4f/d34/fe8 0 2024-09-12T01:43:11.334 INFO:tasks.workunit.client.1.smithi153.stdout:3/835: unlink d1/d16/d17/d82/l96 0 2024-09-12T01:43:11.334 INFO:tasks.workunit.client.1.smithi153.stdout:0/882: mknod d22/d79/dca/dec/c126 0 2024-09-12T01:43:11.335 INFO:tasks.workunit.client.1.smithi153.stdout:3/836: mknod d1/d13/d25/d26/d4b/cf9 0 2024-09-12T01:43:11.335 INFO:tasks.workunit.client.1.smithi153.stdout:3/837: truncate d1/d13/f83 270921 0 2024-09-12T01:43:11.335 INFO:tasks.workunit.client.1.smithi153.stdout:0/883: mknod d22/d79/dca/c127 0 2024-09-12T01:43:11.337 INFO:tasks.workunit.client.1.smithi153.stdout:7/731: dwrite d12/d21/d29/d35/d37/d4c/f62 [0,4194304] 0 2024-09-12T01:43:11.337 INFO:tasks.workunit.client.1.smithi153.stdout:0/884: mknod d22/d79/dca/dec/c128 0 2024-09-12T01:43:11.337 INFO:tasks.workunit.client.1.smithi153.stdout:0/885: stat d22/d79/dca/dec/lfc 0 2024-09-12T01:43:11.337 INFO:tasks.workunit.client.1.smithi153.stdout:0/886: readlink d22/d30/d4c/d6e/l69 0 2024-09-12T01:43:11.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/838: dread d1/d13/d23/d47/d71/d8e/fd3 [0,4194304] 0 2024-09-12T01:43:11.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/839: stat d1/c74 0 2024-09-12T01:43:11.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/840: read - d1/d13/d23/d47/d71/d8e/d93/f75 zero size 2024-09-12T01:43:11.343 INFO:tasks.workunit.client.1.smithi153.stdout:7/732: getdents d12/d21/d5f 0 2024-09-12T01:43:11.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/841: unlink d1/d13/d25/da6/c35 0 2024-09-12T01:43:11.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/842: fdatasync d1/d13/f37 0 2024-09-12T01:43:11.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/843: write d1/f12 [367144,128879] 0 2024-09-12T01:43:11.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/844: chown d1/d45/f58 84148 1 2024-09-12T01:43:11.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/845: creat d1/d13/d23/d47/d6c/ffa x:0 0 0 2024-09-12T01:43:11.347 INFO:tasks.workunit.client.1.smithi153.stdout:7/733: mknod d12/d21/d29/d35/d37/d4c/ce5 0 2024-09-12T01:43:11.347 INFO:tasks.workunit.client.0.smithi066.stdout:3/477: dwrite d5/f8a [0,4194304] 0 2024-09-12T01:43:11.348 INFO:tasks.workunit.client.0.smithi066.stdout:3/478: truncate d5/f56 4619004 0 2024-09-12T01:43:11.348 INFO:tasks.workunit.client.0.smithi066.stdout:8/465: dwrite d12/f47 [0,4194304] 0 2024-09-12T01:43:11.348 INFO:tasks.workunit.client.0.smithi066.stdout:8/466: write d12/d21/d2f/d57/d43/d66/f68 [2814774,118328] 0 2024-09-12T01:43:11.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/360: dwrite d2/d5/d56/f58 [4194304,4194304] 0 2024-09-12T01:43:11.348 INFO:tasks.workunit.client.0.smithi066.stdout:4/395: dwrite d4/f52 [0,4194304] 0 2024-09-12T01:43:11.350 INFO:tasks.workunit.client.1.smithi153.stdout:8/708: write d17/d1d/d27/f7e [1034791,84038] 0 2024-09-12T01:43:11.357 INFO:tasks.workunit.client.0.smithi066.stdout:8/467: symlink d12/d21/d2f/d57/d84/d50/l94 0 2024-09-12T01:43:11.358 INFO:tasks.workunit.client.1.smithi153.stdout:7/734: rename d12/d21/d29/d2d/d8b/fd1 to d12/d21/d4d/ddc/fe6 0 2024-09-12T01:43:11.363 INFO:tasks.workunit.client.0.smithi066.stdout:8/468: dread d12/d21/d2f/d57/d43/f91 [0,4194304] 0 2024-09-12T01:43:11.364 INFO:tasks.workunit.client.0.smithi066.stdout:7/361: link d2/d5/d6/d40/d51/c6e d2/d71/c7b 0 2024-09-12T01:43:11.368 INFO:tasks.workunit.client.1.smithi153.stdout:8/709: getdents d17 0 2024-09-12T01:43:11.375 INFO:tasks.workunit.client.0.smithi066.stdout:7/362: dread d2/d5/d6/d22/f30 [4194304,4194304] 0 2024-09-12T01:43:11.376 INFO:tasks.workunit.client.0.smithi066.stdout:3/479: dwrite d5/d6/f96 [0,4194304] 0 2024-09-12T01:43:11.376 INFO:tasks.workunit.client.0.smithi066.stdout:3/480: chown d5/d6/f96 24310 1 2024-09-12T01:43:11.377 INFO:tasks.workunit.client.1.smithi153.stdout:3/846: dwrite d1/d1e/fbc [0,4194304] 0 2024-09-12T01:43:11.378 INFO:tasks.workunit.client.0.smithi066.stdout:4/396: link d4/f16 d4/d15/f7d 0 2024-09-12T01:43:11.378 INFO:tasks.workunit.client.0.smithi066.stdout:4/397: readlink d4/d6/d14/l22 0 2024-09-12T01:43:11.380 INFO:tasks.workunit.client.0.smithi066.stdout:6/467: rename d2/db to d2/d99 0 2024-09-12T01:43:11.383 INFO:tasks.workunit.client.1.smithi153.stdout:1/810: sync 2024-09-12T01:43:11.383 INFO:tasks.workunit.client.1.smithi153.stdout:5/774: sync 2024-09-12T01:43:11.383 INFO:tasks.workunit.client.1.smithi153.stdout:4/670: sync 2024-09-12T01:43:11.383 INFO:tasks.workunit.client.1.smithi153.stdout:4/671: creat d6/d9/dc/d31/feb x:0 0 0 2024-09-12T01:43:11.383 INFO:tasks.workunit.client.1.smithi153.stdout:4/672: stat d6/d9/d11/d13/dce/dd7/f47 0 2024-09-12T01:43:11.384 INFO:tasks.workunit.client.0.smithi066.stdout:8/469: rename d12/d21/d2f/d57/d84/d50/d56/d69/f90 to d12/d21/d2f/f95 0 2024-09-12T01:43:11.385 INFO:tasks.workunit.client.0.smithi066.stdout:8/470: write d12/d21/d2f/d57/d84/f7e [857906,2842] 0 2024-09-12T01:43:11.385 INFO:tasks.workunit.client.0.smithi066.stdout:8/471: chown d12/c37 21607 1 2024-09-12T01:43:11.387 INFO:tasks.workunit.client.0.smithi066.stdout:7/363: mkdir d2/d5/d56/d7c 0 2024-09-12T01:43:11.393 INFO:tasks.workunit.client.0.smithi066.stdout:6/468: mkdir d2/d99/d12/d1d/d6b/d9a 0 2024-09-12T01:43:11.393 INFO:tasks.workunit.client.0.smithi066.stdout:6/469: dread - d2/d31/f81 zero size 2024-09-12T01:43:11.393 INFO:tasks.workunit.client.0.smithi066.stdout:6/470: fsync d2/d99/d12/d1d/f2b 0 2024-09-12T01:43:11.394 INFO:tasks.workunit.client.0.smithi066.stdout:8/472: creat d12/d21/d2f/d57/d84/d89/f96 x:0 0 0 2024-09-12T01:43:11.396 INFO:tasks.workunit.client.0.smithi066.stdout:7/364: symlink d2/d5/d56/d5f/l7d 0 2024-09-12T01:43:11.400 INFO:tasks.workunit.client.0.smithi066.stdout:3/481: dwrite d5/d6/d1b/d45/d66/d67/d6d/f7a [0,4194304] 0 2024-09-12T01:43:11.400 INFO:tasks.workunit.client.0.smithi066.stdout:3/482: fsync d5/d6/d1b/d28/d4f/d5e/f4e 0 2024-09-12T01:43:11.400 INFO:tasks.workunit.client.0.smithi066.stdout:6/471: rename d2/d31/d5e/l7d to d2/d99/l9b 0 2024-09-12T01:43:11.400 INFO:tasks.workunit.client.0.smithi066.stdout:6/472: readlink d2/d31/d57/l65 0 2024-09-12T01:43:11.401 INFO:tasks.workunit.client.0.smithi066.stdout:8/473: fdatasync d12/d21/d2f/d57/d84/f7e 0 2024-09-12T01:43:11.402 INFO:tasks.workunit.client.0.smithi066.stdout:7/365: creat d2/d5/d6/d22/d75/d1d/f7e x:0 0 0 2024-09-12T01:43:11.402 INFO:tasks.workunit.client.0.smithi066.stdout:7/366: fdatasync d2/d5/d6/d22/d75/d25/f48 0 2024-09-12T01:43:11.407 INFO:tasks.workunit.client.0.smithi066.stdout:3/483: mkdir d5/d6/d1b/d28/d4f/d9b 0 2024-09-12T01:43:11.407 INFO:tasks.workunit.client.0.smithi066.stdout:7/367: symlink d2/d5/d56/l7f 0 2024-09-12T01:43:11.410 INFO:tasks.workunit.client.1.smithi153.stdout:9/752: sync 2024-09-12T01:43:11.410 INFO:tasks.workunit.client.1.smithi153.stdout:2/739: sync 2024-09-12T01:43:11.411 INFO:tasks.workunit.client.1.smithi153.stdout:9/753: mkdir d3/d55/d30/d95/d84/d8b/de2 0 2024-09-12T01:43:11.412 INFO:tasks.workunit.client.1.smithi153.stdout:9/754: write d3/d3a/fb2 [247912,41997] 0 2024-09-12T01:43:11.412 INFO:tasks.workunit.client.0.smithi066.stdout:7/368: read d2/d5/d6/d22/d75/d1d/f3b [952891,94149] 0 2024-09-12T01:43:11.414 INFO:tasks.workunit.client.1.smithi153.stdout:4/673: dwrite d6/f8b [0,4194304] 0 2024-09-12T01:43:11.414 INFO:tasks.workunit.client.1.smithi153.stdout:5/775: dwrite d0/d15/f96 [4194304,4194304] 0 2024-09-12T01:43:11.415 INFO:tasks.workunit.client.0.smithi066.stdout:5/343: sync 2024-09-12T01:43:11.415 INFO:tasks.workunit.client.0.smithi066.stdout:5/344: dread - d0/d26/d2f/f58 zero size 2024-09-12T01:43:11.415 INFO:tasks.workunit.client.0.smithi066.stdout:5/345: chown d0/dd/l5d 351455491 1 2024-09-12T01:43:11.415 INFO:tasks.workunit.client.0.smithi066.stdout:1/402: sync 2024-09-12T01:43:11.417 INFO:tasks.workunit.client.0.smithi066.stdout:3/484: dread d5/d6/d1b/d45/f49 [0,4194304] 0 2024-09-12T01:43:11.417 INFO:tasks.workunit.client.0.smithi066.stdout:8/474: write d12/d21/d2f/f48 [2724797,48136] 0 2024-09-12T01:43:11.417 INFO:tasks.workunit.client.0.smithi066.stdout:8/475: chown d12/f74 512971 1 2024-09-12T01:43:11.417 INFO:tasks.workunit.client.0.smithi066.stdout:3/485: mkdir d5/d6/d48/d9c 0 2024-09-12T01:43:11.419 INFO:tasks.workunit.client.0.smithi066.stdout:8/476: creat d12/d21/d2f/d57/d84/d50/d56/f97 x:0 0 0 2024-09-12T01:43:11.419 INFO:tasks.workunit.client.0.smithi066.stdout:8/477: truncate d12/d21/f61 948417 0 2024-09-12T01:43:11.419 INFO:tasks.workunit.client.0.smithi066.stdout:8/478: fsync d12/d21/d2f/f95 0 2024-09-12T01:43:11.423 INFO:tasks.workunit.client.0.smithi066.stdout:3/486: truncate d5/d35/f64 1751607 0 2024-09-12T01:43:11.425 INFO:tasks.workunit.client.1.smithi153.stdout:9/755: write d3/f6a [1357780,35516] 0 2024-09-12T01:43:11.426 INFO:tasks.workunit.client.0.smithi066.stdout:8/479: rmdir d12/d21/d2f/d57/d84/d50/d56/d69/d7d 39 2024-09-12T01:43:11.427 INFO:tasks.workunit.client.0.smithi066.stdout:8/480: truncate d12/d21/d2f/f95 560034 0 2024-09-12T01:43:11.427 INFO:tasks.workunit.client.0.smithi066.stdout:3/487: rmdir d5/d6/d1b/d45/d85 39 2024-09-12T01:43:11.429 INFO:tasks.workunit.client.1.smithi153.stdout:4/674: dread d6/d9/dc/d98/fa0 [0,4194304] 0 2024-09-12T01:43:11.429 INFO:tasks.workunit.client.1.smithi153.stdout:1/811: dwrite d2/d9/d17/d2f/fb6 [4194304,4194304] 0 2024-09-12T01:43:11.430 INFO:tasks.workunit.client.0.smithi066.stdout:6/473: dwrite d2/d99/d12/f90 [0,4194304] 0 2024-09-12T01:43:11.431 INFO:tasks.workunit.client.1.smithi153.stdout:5/776: dread d0/d20/f26 [0,4194304] 0 2024-09-12T01:43:11.432 INFO:tasks.workunit.client.0.smithi066.stdout:8/481: rmdir d12/d21/d2f/d57/d84 39 2024-09-12T01:43:11.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/488: getdents d5/d6/d1b/d45/d66/d67/d75 0 2024-09-12T01:43:11.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/489: truncate d5/d6/d1b/d45/d66/d67/d6d/f78 401383 0 2024-09-12T01:43:11.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/490: creat d5/d35/f9d x:0 0 0 2024-09-12T01:43:11.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/491: truncate d5/f92 1005514 0 2024-09-12T01:43:11.433 INFO:tasks.workunit.client.1.smithi153.stdout:1/812: read d2/d9/f32 [134505,107713] 0 2024-09-12T01:43:11.433 INFO:tasks.workunit.client.1.smithi153.stdout:9/756: rmdir d3/d35 39 2024-09-12T01:43:11.433 INFO:tasks.workunit.client.1.smithi153.stdout:9/757: chown d3/d3a/d42/d72/d98/d9a 1061339293 1 2024-09-12T01:43:11.434 INFO:tasks.workunit.client.1.smithi153.stdout:9/758: readlink d3/d55/lae 0 2024-09-12T01:43:11.445 INFO:tasks.workunit.client.0.smithi066.stdout:3/492: creat d5/d6/d1b/d45/d85/f9e x:0 0 0 2024-09-12T01:43:11.445 INFO:tasks.workunit.client.0.smithi066.stdout:3/493: write d5/d6/d1b/d28/d4f/d5e/f4e [882681,67894] 0 2024-09-12T01:43:11.445 INFO:tasks.workunit.client.0.smithi066.stdout:3/494: mknod d5/d6/d1b/d65/d89/d50/c9f 0 2024-09-12T01:43:11.447 INFO:tasks.workunit.client.1.smithi153.stdout:1/813: read d2/d9/d58/d74/d103/d89/fbe [563611,101105] 0 2024-09-12T01:43:11.447 INFO:tasks.workunit.client.1.smithi153.stdout:1/814: write d2/d9/f64 [600867,77540] 0 2024-09-12T01:43:11.447 INFO:tasks.workunit.client.1.smithi153.stdout:1/815: chown d2/d9/d1d/l21 14 1 2024-09-12T01:43:11.447 INFO:tasks.workunit.client.1.smithi153.stdout:1/816: truncate d2/d9/d1d/f30 2853611 0 2024-09-12T01:43:11.450 INFO:tasks.workunit.client.0.smithi066.stdout:6/474: write d2/d31/d57/f67 [1631267,4808] 0 2024-09-12T01:43:11.450 INFO:tasks.workunit.client.0.smithi066.stdout:6/475: write d2/f97 [447708,12984] 0 2024-09-12T01:43:11.451 INFO:tasks.workunit.client.0.smithi066.stdout:3/495: dread d5/d6/d1b/f2e [0,4194304] 0 2024-09-12T01:43:11.452 INFO:tasks.workunit.client.0.smithi066.stdout:3/496: symlink d5/d6/d1b/d45/d66/d67/d7f/la0 0 2024-09-12T01:43:11.452 INFO:tasks.workunit.client.0.smithi066.stdout:3/497: creat d5/d6/d1b/d45/d66/d67/d6d/fa1 x:0 0 0 2024-09-12T01:43:11.452 INFO:tasks.workunit.client.0.smithi066.stdout:3/498: truncate d5/d6/d1b/d28/d86/f9a 1012478 0 2024-09-12T01:43:11.452 INFO:tasks.workunit.client.1.smithi153.stdout:5/777: dread d0/d20/f41 [0,4194304] 0 2024-09-12T01:43:11.453 INFO:tasks.workunit.client.0.smithi066.stdout:3/499: mknod d5/d6/d1b/d45/d85/ca2 0 2024-09-12T01:43:11.453 INFO:tasks.workunit.client.0.smithi066.stdout:3/500: getdents d5/d6/d1b/d45/d66/d67/d75 0 2024-09-12T01:43:11.453 INFO:tasks.workunit.client.0.smithi066.stdout:3/501: fsync d5/f92 0 2024-09-12T01:43:11.455 INFO:tasks.workunit.client.1.smithi153.stdout:5/778: mkdir d0/df/d99/df4 0 2024-09-12T01:43:11.456 INFO:tasks.workunit.client.1.smithi153.stdout:5/779: creat d0/df/db8/d6e/ff5 x:0 0 0 2024-09-12T01:43:11.458 INFO:tasks.workunit.client.1.smithi153.stdout:5/780: mkdir d0/d43/d8d/d8e/dd7/df6 0 2024-09-12T01:43:11.458 INFO:tasks.workunit.client.1.smithi153.stdout:5/781: creat d0/df/db8/d2f/ff7 x:0 0 0 2024-09-12T01:43:11.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/782: mknod d0/df/db8/d88/cf8 0 2024-09-12T01:43:11.460 INFO:tasks.workunit.client.1.smithi153.stdout:5/783: chown d0/fd 0 1 2024-09-12T01:43:11.463 INFO:tasks.workunit.client.0.smithi066.stdout:1/403: dwrite d5/f7 [0,4194304] 0 2024-09-12T01:43:11.463 INFO:tasks.workunit.client.0.smithi066.stdout:1/404: write d5/dc/d36/d4b/f5f [1267682,79649] 0 2024-09-12T01:43:11.464 INFO:tasks.workunit.client.0.smithi066.stdout:1/405: mkdir d5/dc/d53/d7a 0 2024-09-12T01:43:11.466 INFO:tasks.workunit.client.0.smithi066.stdout:1/406: mknod d5/d52/d5d/c7b 0 2024-09-12T01:43:11.466 INFO:tasks.workunit.client.0.smithi066.stdout:1/407: dread - d5/d52/d60/f79 zero size 2024-09-12T01:43:11.466 INFO:tasks.workunit.client.0.smithi066.stdout:1/408: chown d5/dc/d36/d4b/f5f 1 1 2024-09-12T01:43:11.467 INFO:tasks.workunit.client.0.smithi066.stdout:8/482: dwrite d12/d21/d2f/d57/d3c/f6c [16777216,4194304] 0 2024-09-12T01:43:11.468 INFO:tasks.workunit.client.0.smithi066.stdout:8/483: unlink d12/d21/l28 0 2024-09-12T01:43:11.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/484: getdents d12/d21/d2f/d57/d3c 0 2024-09-12T01:43:11.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/485: chown d12/d21/d2f/d57/d84/d50/d56/d69/c80 1 1 2024-09-12T01:43:11.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/486: fdatasync d12/d21/d2f/d57/d84/d50/d56/f75 0 2024-09-12T01:43:11.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/487: chown c1 2942407 1 2024-09-12T01:43:11.471 INFO:tasks.workunit.client.0.smithi066.stdout:8/488: dread - d12/f74 zero size 2024-09-12T01:43:11.472 INFO:tasks.workunit.client.1.smithi153.stdout:9/759: dwrite d3/d3a/d42/f58 [4194304,4194304] 0 2024-09-12T01:43:11.472 INFO:tasks.workunit.client.1.smithi153.stdout:9/760: write d3/d66/d80/faa [1600492,112544] 0 2024-09-12T01:43:11.474 INFO:tasks.workunit.client.0.smithi066.stdout:8/489: write d12/d21/f33 [784273,2789] 0 2024-09-12T01:43:11.475 INFO:tasks.workunit.client.0.smithi066.stdout:3/502: dwrite d5/d6/d1b/d45/d66/d67/d6d/fa1 [0,4194304] 0 2024-09-12T01:43:11.476 INFO:tasks.workunit.client.1.smithi153.stdout:4/675: dwrite d6/d9/dc/d31/d7d/fc7 [0,4194304] 0 2024-09-12T01:43:11.476 INFO:tasks.workunit.client.1.smithi153.stdout:9/761: mkdir d3/d55/de3 0 2024-09-12T01:43:11.476 INFO:tasks.workunit.client.0.smithi066.stdout:5/346: dwrite d0/d26/d2d/d33/f69 [0,4194304] 0 2024-09-12T01:43:11.477 INFO:tasks.workunit.client.0.smithi066.stdout:1/409: write d5/f6d [2354773,58311] 0 2024-09-12T01:43:11.477 INFO:tasks.workunit.client.0.smithi066.stdout:1/410: chown d5/f7 752434307 1 2024-09-12T01:43:11.477 INFO:tasks.workunit.client.0.smithi066.stdout:8/490: mkdir d12/d21/d2f/d57/d43/d66/d98 0 2024-09-12T01:43:11.478 INFO:tasks.workunit.client.1.smithi153.stdout:1/817: dread d2/d9/f64 [0,4194304] 0 2024-09-12T01:43:11.482 INFO:tasks.workunit.client.0.smithi066.stdout:3/503: symlink d5/d6/la3 0 2024-09-12T01:43:11.485 INFO:tasks.workunit.client.1.smithi153.stdout:4/676: unlink d6/da4/fa5 0 2024-09-12T01:43:11.487 INFO:tasks.workunit.client.0.smithi066.stdout:1/411: write d5/fa [1820331,92655] 0 2024-09-12T01:43:11.487 INFO:tasks.workunit.client.0.smithi066.stdout:1/412: truncate d5/f47 57833 0 2024-09-12T01:43:11.491 INFO:tasks.workunit.client.0.smithi066.stdout:5/347: creat d0/dd/f6d x:0 0 0 2024-09-12T01:43:11.491 INFO:tasks.workunit.client.0.smithi066.stdout:5/348: fsync d0/d26/d2d/f49 0 2024-09-12T01:43:11.491 INFO:tasks.workunit.client.0.smithi066.stdout:5/349: write d0/dd/f6d [313953,103380] 0 2024-09-12T01:43:11.493 INFO:tasks.workunit.client.1.smithi153.stdout:9/762: dwrite d3/d55/d30/d88/fd4 [0,4194304] 0 2024-09-12T01:43:11.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/369: rename d2/d5/d56 to d2/d5/d6/d22/d75/d1d/d6c/d80 0 2024-09-12T01:43:11.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/370: chown d2/d5/d6/d22/f30 25274 1 2024-09-12T01:43:11.494 INFO:tasks.workunit.client.0.smithi066.stdout:7/371: read - d2/d5/da/f7a zero size 2024-09-12T01:43:11.496 INFO:tasks.workunit.client.1.smithi153.stdout:5/784: getdents d0/d43/d8d/d8e/dd7 0 2024-09-12T01:43:11.499 INFO:tasks.workunit.client.1.smithi153.stdout:4/677: rmdir d6/d9/d11/d90/dcf 0 2024-09-12T01:43:11.509 INFO:tasks.workunit.client.1.smithi153.stdout:9/763: mkdir d3/d55/d30/d7b/de4 0 2024-09-12T01:43:11.510 INFO:tasks.workunit.client.1.smithi153.stdout:4/678: rename d6/d15/db4/d7b to d6/d15/db4/dbd/dec 0 2024-09-12T01:43:11.513 INFO:tasks.workunit.client.0.smithi066.stdout:8/491: creat d12/d21/d2f/d57/d3c/f99 x:0 0 0 2024-09-12T01:43:11.513 INFO:tasks.workunit.client.0.smithi066.stdout:8/492: write d12/f5f [104180,119481] 0 2024-09-12T01:43:11.515 INFO:tasks.workunit.client.1.smithi153.stdout:4/679: rename d6/d9/dc/d31/d76/d99/c81 to d6/da4/ced 0 2024-09-12T01:43:11.516 INFO:tasks.workunit.client.0.smithi066.stdout:3/504: creat d5/d6/d1b/d65/d89/d50/fa4 x:0 0 0 2024-09-12T01:43:11.516 INFO:tasks.workunit.client.0.smithi066.stdout:3/505: fdatasync d5/d6/d1b/f2e 0 2024-09-12T01:43:11.518 INFO:tasks.workunit.client.0.smithi066.stdout:1/413: symlink d5/dc/d4f/l7c 0 2024-09-12T01:43:11.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/680: link d6/d15/f4c d6/d9/dc/d98/fee 0 2024-09-12T01:43:11.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/681: stat d6/d9/d11/f1c 0 2024-09-12T01:43:11.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/682: chown d6/d9/d11/d13/lbf 39743596 1 2024-09-12T01:43:11.520 INFO:tasks.workunit.client.1.smithi153.stdout:4/683: truncate d6/d15/fd9 609336 0 2024-09-12T01:43:11.523 INFO:tasks.workunit.client.0.smithi066.stdout:6/476: rename d2/d99/d12/c19 to d2/d99/d12/d1d/c9c 0 2024-09-12T01:43:11.523 INFO:tasks.workunit.client.0.smithi066.stdout:6/477: fsync d2/d21/f7c 0 2024-09-12T01:43:11.527 INFO:tasks.workunit.client.1.smithi153.stdout:5/785: dwrite d0/df/db8/fce [0,4194304] 0 2024-09-12T01:43:11.527 INFO:tasks.workunit.client.0.smithi066.stdout:5/350: dwrite d0/dd/f6d [0,4194304] 0 2024-09-12T01:43:11.527 INFO:tasks.workunit.client.0.smithi066.stdout:8/493: write d12/d21/d2f/d57/d84/f60 [3984431,121453] 0 2024-09-12T01:43:11.528 INFO:tasks.workunit.client.0.smithi066.stdout:7/372: mkdir d2/d5/d6/d81 0 2024-09-12T01:43:11.528 INFO:tasks.workunit.client.0.smithi066.stdout:7/373: read d2/d5/da/f11 [604732,92334] 0 2024-09-12T01:43:11.530 INFO:tasks.workunit.client.1.smithi153.stdout:4/684: mknod d6/d9/dc/d31/d76/d99/dd2/cef 0 2024-09-12T01:43:11.530 INFO:tasks.workunit.client.1.smithi153.stdout:4/685: fdatasync d6/d9/dc/d31/d7d/fc7 0 2024-09-12T01:43:11.532 INFO:tasks.workunit.client.1.smithi153.stdout:9/764: dwrite d3/d3a/d42/d72/f94 [0,4194304] 0 2024-09-12T01:43:11.538 INFO:tasks.workunit.client.1.smithi153.stdout:5/786: rename d0/d79 to d0/df/db8/d88/df9 0 2024-09-12T01:43:11.542 INFO:tasks.workunit.client.0.smithi066.stdout:5/351: rename d0/dd/d18/d36/f38 to d0/d26/d2d/d33/d55/f6e 0 2024-09-12T01:43:11.542 INFO:tasks.workunit.client.0.smithi066.stdout:1/414: dwrite d5/dc/f1f [0,4194304] 0 2024-09-12T01:43:11.542 INFO:tasks.workunit.client.0.smithi066.stdout:1/415: chown d5/dc/d36/d4b/l13 454442 1 2024-09-12T01:43:11.544 INFO:tasks.workunit.client.0.smithi066.stdout:8/494: creat d12/d21/d2f/f9a x:0 0 0 2024-09-12T01:43:11.546 INFO:tasks.workunit.client.0.smithi066.stdout:7/374: dwrite d2/d5/d6/d22/d75/d25/d4d/f76 [0,4194304] 0 2024-09-12T01:43:11.546 INFO:tasks.workunit.client.0.smithi066.stdout:7/375: write d2/d5/d6/d22/d75/d1d/f4b [5215107,23111] 0 2024-09-12T01:43:11.546 INFO:tasks.workunit.client.0.smithi066.stdout:3/506: dwrite d5/d6/d1b/d28/f90 [0,4194304] 0 2024-09-12T01:43:11.546 INFO:tasks.workunit.client.0.smithi066.stdout:3/507: creat d5/d6/d1b/d45/d66/d67/d6d/fa5 x:0 0 0 2024-09-12T01:43:11.547 INFO:tasks.workunit.client.0.smithi066.stdout:1/416: dread d5/dc/f33 [0,4194304] 0 2024-09-12T01:43:11.547 INFO:tasks.workunit.client.0.smithi066.stdout:3/508: truncate d5/d6/d1b/f83 204306 0 2024-09-12T01:43:11.547 INFO:tasks.workunit.client.0.smithi066.stdout:5/352: dread d0/f20 [0,4194304] 0 2024-09-12T01:43:11.547 INFO:tasks.workunit.client.0.smithi066.stdout:5/353: chown d0/d26/f2e 120941306 1 2024-09-12T01:43:11.548 INFO:tasks.workunit.client.0.smithi066.stdout:5/354: dread - d0/dd/d18/f64 zero size 2024-09-12T01:43:11.548 INFO:tasks.workunit.client.0.smithi066.stdout:6/478: truncate d2/f5 5550760 0 2024-09-12T01:43:11.556 INFO:tasks.workunit.client.0.smithi066.stdout:8/495: dread d12/f47 [0,4194304] 0 2024-09-12T01:43:11.561 INFO:tasks.workunit.client.0.smithi066.stdout:7/376: write d2/d5/d6/d22/f59 [3225799,108426] 0 2024-09-12T01:43:11.561 INFO:tasks.workunit.client.1.smithi153.stdout:9/765: mkdir d3/d55/de5 0 2024-09-12T01:43:11.565 INFO:tasks.workunit.client.1.smithi153.stdout:6/847: sync 2024-09-12T01:43:11.565 INFO:tasks.workunit.client.1.smithi153.stdout:0/887: sync 2024-09-12T01:43:11.565 INFO:tasks.workunit.client.1.smithi153.stdout:4/686: rename d6/f63 to d6/d15/db4/ff0 0 2024-09-12T01:43:11.567 INFO:tasks.workunit.client.1.smithi153.stdout:5/787: link d0/df/db8/d2f/d55/d9c/d75/d58/d70/f5a d0/df/db8/ffa 0 2024-09-12T01:43:11.567 INFO:tasks.workunit.client.1.smithi153.stdout:5/788: dread - d0/df/db8/d2f/ff7 zero size 2024-09-12T01:43:11.567 INFO:tasks.workunit.client.1.smithi153.stdout:5/789: write d0/df/db8/d2f/d55/d9c/d75/d58/f94 [702200,106292] 0 2024-09-12T01:43:11.568 INFO:tasks.workunit.client.0.smithi066.stdout:3/509: creat d5/d6/d1b/d45/fa6 x:0 0 0 2024-09-12T01:43:11.568 INFO:tasks.workunit.client.0.smithi066.stdout:3/510: chown d5/d35/f4d 2 1 2024-09-12T01:43:11.570 INFO:tasks.workunit.client.1.smithi153.stdout:9/766: creat d3/d55/d30/fe6 x:0 0 0 2024-09-12T01:43:11.571 INFO:tasks.workunit.client.0.smithi066.stdout:1/417: symlink d5/dc/d36/d4b/l7d 0 2024-09-12T01:43:11.573 INFO:tasks.workunit.client.0.smithi066.stdout:8/496: dwrite d12/d21/d2f/d57/d3c/f6c [0,4194304] 0 2024-09-12T01:43:11.574 INFO:tasks.workunit.client.0.smithi066.stdout:5/355: creat d0/d26/f6f x:0 0 0 2024-09-12T01:43:11.575 INFO:tasks.workunit.client.1.smithi153.stdout:6/848: mknod d1/d80/db6/d103/c10d 0 2024-09-12T01:43:11.577 INFO:tasks.workunit.client.0.smithi066.stdout:6/479: symlink d2/d99/l9d 0 2024-09-12T01:43:11.577 INFO:tasks.workunit.client.1.smithi153.stdout:0/888: creat d22/d79/d8e/dae/dff/f129 x:0 0 0 2024-09-12T01:43:11.579 INFO:tasks.workunit.client.0.smithi066.stdout:6/480: write d2/f5f [488154,106776] 0 2024-09-12T01:43:11.579 INFO:tasks.workunit.client.1.smithi153.stdout:2/740: sync 2024-09-12T01:43:11.579 INFO:tasks.workunit.client.1.smithi153.stdout:3/847: sync 2024-09-12T01:43:11.580 INFO:tasks.workunit.client.1.smithi153.stdout:2/741: stat d7/d4d/d70/ce2 0 2024-09-12T01:43:11.580 INFO:tasks.workunit.client.1.smithi153.stdout:7/735: sync 2024-09-12T01:43:11.580 INFO:tasks.workunit.client.1.smithi153.stdout:8/710: sync 2024-09-12T01:43:11.580 INFO:tasks.workunit.client.1.smithi153.stdout:8/711: truncate d17/d1f/dcf/fe4 95730 0 2024-09-12T01:43:11.580 INFO:tasks.workunit.client.0.smithi066.stdout:7/377: rename d2/d5/d6/d22/d75/c54 to d2/d5/d6/d40/d63/c82 0 2024-09-12T01:43:11.580 INFO:tasks.workunit.client.0.smithi066.stdout:7/378: fsync d2/d5/d6/d22/d75/d25/f49 0 2024-09-12T01:43:11.582 INFO:tasks.workunit.client.1.smithi153.stdout:5/790: dread d0/df/db8/d2f/d55/d9c/d75/d58/d71/fe1 [4194304,4194304] 0 2024-09-12T01:43:11.584 INFO:tasks.workunit.client.1.smithi153.stdout:9/767: mknod d3/d3a/ce7 0 2024-09-12T01:43:11.585 INFO:tasks.workunit.client.1.smithi153.stdout:4/687: dwrite d6/d9/d11/d13/dce/dd7/f62 [0,4194304] 0 2024-09-12T01:43:11.587 INFO:tasks.workunit.client.1.smithi153.stdout:6/849: mkdir d1/d6/da/d19/d34/d10e 0 2024-09-12T01:43:11.587 INFO:tasks.workunit.client.1.smithi153.stdout:6/850: write d1/d6/d23/d98/ff1 [757674,99907] 0 2024-09-12T01:43:11.589 INFO:tasks.workunit.client.1.smithi153.stdout:1/818: sync 2024-09-12T01:43:11.590 INFO:tasks.workunit.client.1.smithi153.stdout:7/736: creat d12/d21/d29/d35/d37/d4c/d8e/fe7 x:0 0 0 2024-09-12T01:43:11.590 INFO:tasks.workunit.client.1.smithi153.stdout:7/737: chown d12/d21/d29 193443 1 2024-09-12T01:43:11.590 INFO:tasks.workunit.client.1.smithi153.stdout:7/738: write d12/d21/d29/d2d/da6/fcf [4392264,38487] 0 2024-09-12T01:43:11.591 INFO:tasks.workunit.client.1.smithi153.stdout:2/742: dread d7/db/d6c/d76/db8/dcf/f8a [0,4194304] 0 2024-09-12T01:43:11.591 INFO:tasks.workunit.client.1.smithi153.stdout:0/889: dread d22/d30/f42 [0,4194304] 0 2024-09-12T01:43:11.592 INFO:tasks.workunit.client.1.smithi153.stdout:8/712: creat d17/d1f/d4f/d42/d79/dac/fe9 x:0 0 0 2024-09-12T01:43:11.596 INFO:tasks.workunit.client.1.smithi153.stdout:8/713: write d17/d1d/d27/f6b [3293173,32008] 0 2024-09-12T01:43:11.596 INFO:tasks.workunit.client.1.smithi153.stdout:8/714: write fd [3823784,60499] 0 2024-09-12T01:43:11.597 INFO:tasks.workunit.client.1.smithi153.stdout:5/791: rename d0/d20/dc0/dea to d0/d15/dae/dfb 0 2024-09-12T01:43:11.601 INFO:tasks.workunit.client.1.smithi153.stdout:4/688: creat d6/d9/dc/ff1 x:0 0 0 2024-09-12T01:43:11.603 INFO:tasks.workunit.client.1.smithi153.stdout:6/851: mkdir d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/d10f 0 2024-09-12T01:43:11.605 INFO:tasks.workunit.client.0.smithi066.stdout:3/511: creat d5/d6/d1b/d28/d4f/d9b/fa7 x:0 0 0 2024-09-12T01:43:11.606 INFO:tasks.workunit.client.1.smithi153.stdout:1/819: dread d2/d9/d17/d2f/d56/d71/d9a/fa3 [0,4194304] 0 2024-09-12T01:43:11.607 INFO:tasks.workunit.client.1.smithi153.stdout:1/820: fsync d2/d9/d28/f9d 0 2024-09-12T01:43:11.607 INFO:tasks.workunit.client.0.smithi066.stdout:1/418: truncate d5/d15/f3a 391353 0 2024-09-12T01:43:11.607 INFO:tasks.workunit.client.0.smithi066.stdout:1/419: chown d5/d15/f6e 62906 1 2024-09-12T01:43:11.608 INFO:tasks.workunit.client.1.smithi153.stdout:7/739: unlink l11 0 2024-09-12T01:43:11.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/497: mknod d12/d21/d2f/d57/d84/c9b 0 2024-09-12T01:43:11.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/498: chown d12/d21/f5d 193658427 1 2024-09-12T01:43:11.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/499: creat d12/d21/d2f/f9c x:0 0 0 2024-09-12T01:43:11.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/500: creat d12/d21/d2f/d57/d84/d50/d56/f9d x:0 0 0 2024-09-12T01:43:11.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/501: fsync d12/d21/d2f/d57/d84/d50/d56/f59 0 2024-09-12T01:43:11.610 INFO:tasks.workunit.client.0.smithi066.stdout:8/502: creat d12/d21/d2f/d57/d84/d89/f9e x:0 0 0 2024-09-12T01:43:11.612 INFO:tasks.workunit.client.1.smithi153.stdout:2/743: creat d7/db/d6c/d76/db8/de1/fe9 x:0 0 0 2024-09-12T01:43:11.613 INFO:tasks.workunit.client.1.smithi153.stdout:2/744: fdatasync d7/d4d/fbe 0 2024-09-12T01:43:11.613 INFO:tasks.workunit.client.0.smithi066.stdout:6/481: mkdir d2/d99/d12/d49/d9e 0 2024-09-12T01:43:11.614 INFO:tasks.workunit.client.0.smithi066.stdout:5/356: dwrite d0/d26/f6f [0,4194304] 0 2024-09-12T01:43:11.616 INFO:tasks.workunit.client.0.smithi066.stdout:7/379: mknod d2/d41/c83 0 2024-09-12T01:43:11.617 INFO:tasks.workunit.client.1.smithi153.stdout:9/768: dwrite d3/d3a/d42/fa2 [0,4194304] 0 2024-09-12T01:43:11.617 INFO:tasks.workunit.client.1.smithi153.stdout:9/769: write d3/d3a/d42/d72/f96 [576075,94261] 0 2024-09-12T01:43:11.617 INFO:tasks.workunit.client.0.smithi066.stdout:3/512: truncate d5/ff 3830211 0 2024-09-12T01:43:11.617 INFO:tasks.workunit.client.0.smithi066.stdout:3/513: fsync d5/d6/d1b/f2e 0 2024-09-12T01:43:11.618 INFO:tasks.workunit.client.1.smithi153.stdout:5/792: dwrite d0/d43/dac/fde [4194304,4194304] 0 2024-09-12T01:43:11.618 INFO:tasks.workunit.client.1.smithi153.stdout:9/770: dread d3/d3a/f60 [0,4194304] 0 2024-09-12T01:43:11.618 INFO:tasks.workunit.client.1.smithi153.stdout:9/771: chown d3/d55/d30/d88/fd4 8031846 1 2024-09-12T01:43:11.618 INFO:tasks.workunit.client.1.smithi153.stdout:9/772: truncate d3/d55/f2a 2975417 0 2024-09-12T01:43:11.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/420: rename d5/dc/d36/d4b/f23 to d5/d52/f7e 0 2024-09-12T01:43:11.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/421: getdents d5/dc/d53/d7a 0 2024-09-12T01:43:11.620 INFO:tasks.workunit.client.1.smithi153.stdout:9/773: dread d3/d55/f59 [0,4194304] 0 2024-09-12T01:43:11.621 INFO:tasks.workunit.client.1.smithi153.stdout:8/715: truncate d17/d1d/f73 245093 0 2024-09-12T01:43:11.621 INFO:tasks.workunit.client.1.smithi153.stdout:8/716: fdatasync d17/d21/d56/d96/d6c/d89/d9c/fa9 0 2024-09-12T01:43:11.624 INFO:tasks.workunit.client.1.smithi153.stdout:4/689: mknod d6/d9/d11/d13/dce/cf2 0 2024-09-12T01:43:11.626 INFO:tasks.workunit.client.1.smithi153.stdout:6/852: creat d1/f110 x:0 0 0 2024-09-12T01:43:11.628 INFO:tasks.workunit.client.1.smithi153.stdout:1/821: creat d2/d34/d3d/d106/f10d x:0 0 0 2024-09-12T01:43:11.628 INFO:tasks.workunit.client.1.smithi153.stdout:1/822: stat d2/d34/d3d/d106 0 2024-09-12T01:43:11.628 INFO:tasks.workunit.client.1.smithi153.stdout:1/823: read d2/d34/f53 [205506,64138] 0 2024-09-12T01:43:11.629 INFO:tasks.workunit.client.1.smithi153.stdout:9/774: write d3/d5f/d62/f64 [647361,78436] 0 2024-09-12T01:43:11.632 INFO:tasks.workunit.client.1.smithi153.stdout:7/740: symlink d12/d21/d29/d35/d37/le8 0 2024-09-12T01:43:11.632 INFO:tasks.workunit.client.1.smithi153.stdout:2/745: write d7/f9b [934301,6304] 0 2024-09-12T01:43:11.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/357: rmdir d0/d26/d2d/d42 39 2024-09-12T01:43:11.634 INFO:tasks.workunit.client.0.smithi066.stdout:6/482: dwrite d2/f4e [0,4194304] 0 2024-09-12T01:43:11.634 INFO:tasks.workunit.client.0.smithi066.stdout:6/483: readlink d2/d99/d7b/l8c 0 2024-09-12T01:43:11.635 INFO:tasks.workunit.client.1.smithi153.stdout:0/890: symlink d22/d30/l12a 0 2024-09-12T01:43:11.635 INFO:tasks.workunit.client.1.smithi153.stdout:0/891: write d22/d30/d4c/fad [1797183,7628] 0 2024-09-12T01:43:11.636 INFO:tasks.workunit.client.0.smithi066.stdout:3/514: mkdir d5/d6/d1b/d45/d66/d67/d7f/da8 0 2024-09-12T01:43:11.637 INFO:tasks.workunit.client.1.smithi153.stdout:8/717: dread d17/d21/d56/f84 [0,4194304] 0 2024-09-12T01:43:11.642 INFO:tasks.workunit.client.1.smithi153.stdout:5/793: rmdir d0/df/db8/d2f/d55/d9c/d75 39 2024-09-12T01:43:11.645 INFO:tasks.workunit.client.1.smithi153.stdout:5/794: dread d0/d20/f26 [0,4194304] 0 2024-09-12T01:43:11.645 INFO:tasks.workunit.client.1.smithi153.stdout:5/795: write d0/df/d83/d36/f7d [2532912,72058] 0 2024-09-12T01:43:11.648 INFO:tasks.workunit.client.0.smithi066.stdout:7/380: rename d2/d5/da/d3f/d52 to d2/d5/d6/d22/d75/d1d/d84 0 2024-09-12T01:43:11.654 INFO:tasks.workunit.client.1.smithi153.stdout:4/690: dwrite d6/d9/dc/d31/d76/fc2 [0,4194304] 0 2024-09-12T01:43:11.654 INFO:tasks.workunit.client.1.smithi153.stdout:4/691: fsync d6/d9/dc/d31/d7d/d94/fde 0 2024-09-12T01:43:11.655 INFO:tasks.workunit.client.0.smithi066.stdout:1/422: unlink d5/d15/d4d/f59 0 2024-09-12T01:43:11.655 INFO:tasks.workunit.client.0.smithi066.stdout:1/423: fsync f4 0 2024-09-12T01:43:11.655 INFO:tasks.workunit.client.0.smithi066.stdout:3/515: write d5/d6/d1b/d45/d66/f3b [1021740,125169] 0 2024-09-12T01:43:11.655 INFO:tasks.workunit.client.0.smithi066.stdout:3/516: creat d5/d6/d48/fa9 x:0 0 0 2024-09-12T01:43:11.655 INFO:tasks.workunit.client.0.smithi066.stdout:3/517: creat d5/d6/d1b/d28/faa x:0 0 0 2024-09-12T01:43:11.655 INFO:tasks.workunit.client.0.smithi066.stdout:3/518: creat d5/d6/d48/fab x:0 0 0 2024-09-12T01:43:11.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/358: truncate d0/dd/f6d 839989 0 2024-09-12T01:43:11.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/359: fdatasync d0/f4 0 2024-09-12T01:43:11.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/360: creat d0/d26/f70 x:0 0 0 2024-09-12T01:43:11.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/361: fdatasync d0/d26/f35 0 2024-09-12T01:43:11.657 INFO:tasks.workunit.client.0.smithi066.stdout:5/362: read d0/d26/f2e [848970,109968] 0 2024-09-12T01:43:11.658 INFO:tasks.workunit.client.1.smithi153.stdout:6/853: symlink d1/d6/da/d19/d3a/db0/l111 0 2024-09-12T01:43:11.658 INFO:tasks.workunit.client.1.smithi153.stdout:1/824: mknod d2/d68/d6b/c10e 0 2024-09-12T01:43:11.659 INFO:tasks.workunit.client.1.smithi153.stdout:1/825: chown d2/d9/c16 1800832 1 2024-09-12T01:43:11.667 INFO:tasks.workunit.client.1.smithi153.stdout:9/775: dwrite d3/d66/fd2 [0,4194304] 0 2024-09-12T01:43:11.667 INFO:tasks.workunit.client.1.smithi153.stdout:9/776: fdatasync d3/d55/f32 0 2024-09-12T01:43:11.669 INFO:tasks.workunit.client.1.smithi153.stdout:2/746: mknod d7/db/d27/cea 0 2024-09-12T01:43:11.670 INFO:tasks.workunit.client.1.smithi153.stdout:1/826: write d2/d9/d1d/d25/f38 [2684509,87349] 0 2024-09-12T01:43:11.671 INFO:tasks.workunit.client.0.smithi066.stdout:3/519: dread d5/f8a [0,4194304] 0 2024-09-12T01:43:11.673 INFO:tasks.workunit.client.1.smithi153.stdout:8/718: rename d17/d21/d56/f63 to d17/d1f/d4f/d34/db4/dda/fea 0 2024-09-12T01:43:11.673 INFO:tasks.workunit.client.1.smithi153.stdout:8/719: fdatasync d17/d75/fe6 0 2024-09-12T01:43:11.679 INFO:tasks.workunit.client.1.smithi153.stdout:0/892: dwrite d22/f83 [0,4194304] 0 2024-09-12T01:43:11.679 INFO:tasks.workunit.client.1.smithi153.stdout:0/893: creat d22/d79/d8e/dc6/dd6/f12b x:0 0 0 2024-09-12T01:43:11.679 INFO:tasks.workunit.client.1.smithi153.stdout:4/692: truncate d6/d9/dc/f64 1383773 0 2024-09-12T01:43:11.681 INFO:tasks.workunit.client.0.smithi066.stdout:5/363: symlink d0/d26/d2f/d30/l71 0 2024-09-12T01:43:11.681 INFO:tasks.workunit.client.0.smithi066.stdout:5/364: chown d0/dd/f13 1227 1 2024-09-12T01:43:11.682 INFO:tasks.workunit.client.1.smithi153.stdout:7/741: mkdir d12/d21/d29/d35/dcb/de9 0 2024-09-12T01:43:11.682 INFO:tasks.workunit.client.0.smithi066.stdout:3/520: symlink d5/d6/d1b/d45/d66/d67/lac 0 2024-09-12T01:43:11.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/365: creat d0/d21/d27/f72 x:0 0 0 2024-09-12T01:43:11.684 INFO:tasks.workunit.client.0.smithi066.stdout:5/366: chown d0/d26/f70 2 1 2024-09-12T01:43:11.684 INFO:tasks.workunit.client.0.smithi066.stdout:5/367: readlink d0/d26/d2f/d30/l48 0 2024-09-12T01:43:11.684 INFO:tasks.workunit.client.0.smithi066.stdout:3/521: creat d5/d6/d1b/d45/d66/d67/d75/d8e/fad x:0 0 0 2024-09-12T01:43:11.685 INFO:tasks.workunit.client.0.smithi066.stdout:3/522: fsync d5/d6/d1b/d28/d4f/d5e/f4e 0 2024-09-12T01:43:11.686 INFO:tasks.workunit.client.0.smithi066.stdout:5/368: unlink d0/d26/d2d/d33/d55/f5e 0 2024-09-12T01:43:11.687 INFO:tasks.workunit.client.0.smithi066.stdout:6/484: dwrite d2/d99/d12/d1d/f91 [0,4194304] 0 2024-09-12T01:43:11.689 INFO:tasks.workunit.client.0.smithi066.stdout:3/523: mkdir d5/d6/d1b/d45/d66/dae 0 2024-09-12T01:43:11.689 INFO:tasks.workunit.client.1.smithi153.stdout:5/796: dwrite d0/df/d1c/fc4 [0,4194304] 0 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.0.smithi066.stdout:1/424: dwrite d5/fa [4194304,4194304] 0 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.0.smithi066.stdout:1/425: creat d5/f7f x:0 0 0 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.0.smithi066.stdout:1/426: write d5/dc/d36/d4b/f11 [4546228,15139] 0 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.0.smithi066.stdout:1/427: chown d5/dc/d53/f5a 3 1 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.0.smithi066.stdout:1/428: truncate d5/dc/f1f 4650329 0 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.0.smithi066.stdout:7/381: dwrite d2/d5/d6/d22/d75/d25/d4d/f76 [0,4194304] 0 2024-09-12T01:43:11.690 INFO:tasks.workunit.client.1.smithi153.stdout:9/777: link d3/d55/d30/d95/d84/d8b/lcd d3/d3a/d42/d72/le8 0 2024-09-12T01:43:11.691 INFO:tasks.workunit.client.0.smithi066.stdout:5/369: dread d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:11.697 INFO:tasks.workunit.client.1.smithi153.stdout:2/747: link d7/d17/f48 d7/db/d27/d56/feb 0 2024-09-12T01:43:11.697 INFO:tasks.workunit.client.1.smithi153.stdout:2/748: write d7/db/d1d/d1e/d6d/fe6 [158156,130919] 0 2024-09-12T01:43:11.698 INFO:tasks.workunit.client.0.smithi066.stdout:3/524: getdents d5/d6/d1b/d65/d89 0 2024-09-12T01:43:11.702 INFO:tasks.workunit.client.1.smithi153.stdout:1/827: link d2/d9/d17/d69/c90 d2/d9/d17/d100/c10f 0 2024-09-12T01:43:11.704 INFO:tasks.workunit.client.0.smithi066.stdout:1/429: symlink d5/dc/d4f/l80 0 2024-09-12T01:43:11.707 INFO:tasks.workunit.client.0.smithi066.stdout:7/382: creat d2/d41/d53/f85 x:0 0 0 2024-09-12T01:43:11.707 INFO:tasks.workunit.client.0.smithi066.stdout:7/383: chown d2/d5/da/f36 2908460 1 2024-09-12T01:43:11.709 INFO:tasks.workunit.client.0.smithi066.stdout:5/370: mkdir d0/d26/d2d/d33/d55/d73 0 2024-09-12T01:43:11.711 INFO:tasks.workunit.client.1.smithi153.stdout:5/797: dwrite d0/df/f35 [0,4194304] 0 2024-09-12T01:43:11.712 INFO:tasks.workunit.client.1.smithi153.stdout:2/749: dwrite d7/d17/f8c [0,4194304] 0 2024-09-12T01:43:11.712 INFO:tasks.workunit.client.1.smithi153.stdout:2/750: chown d7/db/d6c/d76/f96 13 1 2024-09-12T01:43:11.717 INFO:tasks.workunit.client.1.smithi153.stdout:8/720: link d17/d21/d56/d96/fa4 d17/d1f/d4f/d42/d79/feb 0 2024-09-12T01:43:11.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/525: rename d5/d6/d1b/d45/fa6 to d5/d6/d1b/d45/d66/d67/d7f/da8/faf 0 2024-09-12T01:43:11.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/526: creat d5/d6/d1b/d45/d66/d67/d6d/fb0 x:0 0 0 2024-09-12T01:43:11.722 INFO:tasks.workunit.client.0.smithi066.stdout:3/527: chown d5/d6/d1b/f2e 1 1 2024-09-12T01:43:11.725 INFO:tasks.workunit.client.1.smithi153.stdout:0/894: creat d22/d79/dca/ded/f12c x:0 0 0 2024-09-12T01:43:11.725 INFO:tasks.workunit.client.1.smithi153.stdout:5/798: write d0/d15/f25 [2924670,128048] 0 2024-09-12T01:43:11.727 INFO:tasks.workunit.client.0.smithi066.stdout:1/430: symlink d5/dc/d36/d57/l81 0 2024-09-12T01:43:11.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/371: mkdir d0/d26/d2d/d33/d55/d73/d74 0 2024-09-12T01:43:11.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/372: write d0/dd/d18/f5a [761222,59844] 0 2024-09-12T01:43:11.732 INFO:tasks.workunit.client.1.smithi153.stdout:7/742: mkdir d12/d21/d29/d35/d95/dea 0 2024-09-12T01:43:11.732 INFO:tasks.workunit.client.1.smithi153.stdout:8/721: read d17/d1f/d4f/d34/f40 [787694,130910] 0 2024-09-12T01:43:11.741 INFO:tasks.workunit.client.0.smithi066.stdout:3/528: creat d5/d6/d1b/d65/d89/fb1 x:0 0 0 2024-09-12T01:43:11.742 INFO:tasks.workunit.client.1.smithi153.stdout:9/778: mkdir d3/d55/de5/de9 0 2024-09-12T01:43:11.745 INFO:tasks.workunit.client.0.smithi066.stdout:5/373: creat d0/dd/d18/f75 x:0 0 0 2024-09-12T01:43:11.747 INFO:tasks.workunit.client.1.smithi153.stdout:1/828: unlink d2/d9/d28/lf7 0 2024-09-12T01:43:11.749 INFO:tasks.workunit.client.0.smithi066.stdout:3/529: creat d5/d6/d1b/d45/d66/d67/fb2 x:0 0 0 2024-09-12T01:43:11.749 INFO:tasks.workunit.client.0.smithi066.stdout:3/530: truncate d5/d6/d1b/f88 1077185 0 2024-09-12T01:43:11.749 INFO:tasks.workunit.client.0.smithi066.stdout:3/531: write d5/f17 [3250131,81704] 0 2024-09-12T01:43:11.752 INFO:tasks.workunit.client.0.smithi066.stdout:3/532: rename d5/d6/d1b/d28/l70 to d5/d6/d1b/d45/d66/d67/d7f/d84/lb3 0 2024-09-12T01:43:11.753 INFO:tasks.workunit.client.1.smithi153.stdout:0/895: symlink d22/d79/dca/l12d 0 2024-09-12T01:43:11.754 INFO:tasks.workunit.client.1.smithi153.stdout:2/751: dwrite d7/db/d7c/fe4 [0,4194304] 0 2024-09-12T01:43:11.754 INFO:tasks.workunit.client.0.smithi066.stdout:7/384: dwrite d2/d5/da/f11 [0,4194304] 0 2024-09-12T01:43:11.754 INFO:tasks.workunit.client.0.smithi066.stdout:7/385: chown d2/d5/f39 17905151 1 2024-09-12T01:43:11.754 INFO:tasks.workunit.client.0.smithi066.stdout:7/386: dread - d2/d5/d6/d22/d75/d25/d4d/f4f zero size 2024-09-12T01:43:11.754 INFO:tasks.workunit.client.0.smithi066.stdout:1/431: dwrite d5/fa [4194304,4194304] 0 2024-09-12T01:43:11.754 INFO:tasks.workunit.client.0.smithi066.stdout:1/432: write d5/f7f [15147,33917] 0 2024-09-12T01:43:11.755 INFO:tasks.workunit.client.1.smithi153.stdout:7/743: dwrite d12/f31 [0,4194304] 0 2024-09-12T01:43:11.755 INFO:tasks.workunit.client.1.smithi153.stdout:7/744: write d12/d21/d29/d35/d37/d58/f98 [843504,85436] 0 2024-09-12T01:43:11.756 INFO:tasks.workunit.client.1.smithi153.stdout:5/799: rename d0/df/db8/d2f/d55/d9c/d75/l8f to d0/df/d83/d36/d39/da4/lfc 0 2024-09-12T01:43:11.757 INFO:tasks.workunit.client.0.smithi066.stdout:7/387: creat d2/d5/d6/d40/d63/f86 x:0 0 0 2024-09-12T01:43:11.758 INFO:tasks.workunit.client.0.smithi066.stdout:7/388: write d2/d5/da/f7a [386617,124874] 0 2024-09-12T01:43:11.758 INFO:tasks.workunit.client.0.smithi066.stdout:7/389: truncate d2/d5/d6/d22/d75/d25/f48 734569 0 2024-09-12T01:43:11.764 INFO:tasks.workunit.client.0.smithi066.stdout:5/374: dread d0/d26/d2d/f49 [0,4194304] 0 2024-09-12T01:43:11.779 INFO:tasks.workunit.client.1.smithi153.stdout:7/745: dwrite d12/d21/d29/d35/d37/f97 [0,4194304] 0 2024-09-12T01:43:11.779 INFO:tasks.workunit.client.1.smithi153.stdout:0/896: dwrite d22/d30/f59 [0,4194304] 0 2024-09-12T01:43:11.808 INFO:tasks.workunit.client.1.smithi153.stdout:4/693: rmdir d6/d15 39 2024-09-12T01:43:11.809 INFO:tasks.workunit.client.0.smithi066.stdout:9/437: sync 2024-09-12T01:43:11.810 INFO:tasks.workunit.client.1.smithi153.stdout:9/779: link d3/d55/f1e d3/d55/d30/d95/fea 0 2024-09-12T01:43:11.810 INFO:tasks.workunit.client.1.smithi153.stdout:9/780: read d3/d5f/d62/f64 [5001078,120100] 0 2024-09-12T01:43:11.811 INFO:tasks.workunit.client.1.smithi153.stdout:9/781: dread - d3/d55/fb4 zero size 2024-09-12T01:43:11.811 INFO:tasks.workunit.client.1.smithi153.stdout:9/782: chown d3/d3a/d42 64923 1 2024-09-12T01:43:11.813 INFO:tasks.workunit.client.1.smithi153.stdout:1/829: unlink d2/d9/f7b 0 2024-09-12T01:43:11.813 INFO:tasks.workunit.client.1.smithi153.stdout:1/830: fsync d2/d9/d17/d2f/d56/d71/d9a/ffb 0 2024-09-12T01:43:11.817 INFO:tasks.workunit.client.0.smithi066.stdout:7/390: creat d2/d5/d6/d22/d75/d1d/d84/f87 x:0 0 0 2024-09-12T01:43:11.819 INFO:tasks.workunit.client.1.smithi153.stdout:2/752: creat d7/db/d6c/fec x:0 0 0 2024-09-12T01:43:11.820 INFO:tasks.workunit.client.0.smithi066.stdout:5/375: mknod d0/d26/d2d/c76 0 2024-09-12T01:43:11.823 INFO:tasks.workunit.client.0.smithi066.stdout:5/376: unlink d0/dd/d18/f5a 0 2024-09-12T01:43:11.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/831: dread d2/d34/d3d/f59 [0,4194304] 0 2024-09-12T01:43:11.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/832: dread - d2/d9/d17/d2f/ff4 zero size 2024-09-12T01:43:11.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/833: truncate d2/d9/d17/d2f/d56/fc9 1039134 0 2024-09-12T01:43:11.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/834: chown d2/d9/d17/d2f/l3c 1771957 1 2024-09-12T01:43:11.825 INFO:tasks.workunit.client.1.smithi153.stdout:1/835: truncate d2/d9/d58/d74/f102 474322 0 2024-09-12T01:43:11.826 INFO:tasks.workunit.client.0.smithi066.stdout:5/377: write d0/f20 [618138,43507] 0 2024-09-12T01:43:11.826 INFO:tasks.workunit.client.1.smithi153.stdout:5/800: creat d0/df/d1c/ffd x:0 0 0 2024-09-12T01:43:11.829 INFO:tasks.workunit.client.1.smithi153.stdout:7/746: creat d12/d21/d29/d35/dcb/de9/feb x:0 0 0 2024-09-12T01:43:11.830 INFO:tasks.workunit.client.0.smithi066.stdout:5/378: mkdir d0/d26/d2d/d31/d77 0 2024-09-12T01:43:11.830 INFO:tasks.workunit.client.0.smithi066.stdout:5/379: write d0/f4 [9125515,5701] 0 2024-09-12T01:43:11.831 INFO:tasks.workunit.client.0.smithi066.stdout:7/391: dread d2/d5/d6/d22/d75/d1d/d6c/d80/f66 [0,4194304] 0 2024-09-12T01:43:11.831 INFO:tasks.workunit.client.0.smithi066.stdout:7/392: chown d2/d5/d6/d22/d75/d2f/f34 527 1 2024-09-12T01:43:11.831 INFO:tasks.workunit.client.0.smithi066.stdout:7/393: chown d2/d5/da/c10 265269695 1 2024-09-12T01:43:11.834 INFO:tasks.workunit.client.0.smithi066.stdout:9/438: dwrite d0/d6/d17/d4f/d12/d46/d68/f70 [0,4194304] 0 2024-09-12T01:43:11.834 INFO:tasks.workunit.client.0.smithi066.stdout:5/380: link d0/d26/d2d/d33/d55/l56 d0/d26/d2d/d31/d77/l78 0 2024-09-12T01:43:11.835 INFO:tasks.workunit.client.1.smithi153.stdout:0/897: mkdir d22/d79/d8e/dc6/dd6/d12e 0 2024-09-12T01:43:11.836 INFO:tasks.workunit.client.0.smithi066.stdout:7/394: symlink d2/d5/d6/d22/d75/l88 0 2024-09-12T01:43:11.836 INFO:tasks.workunit.client.0.smithi066.stdout:1/433: dwrite d5/dc/f34 [0,4194304] 0 2024-09-12T01:43:11.841 INFO:tasks.workunit.client.0.smithi066.stdout:9/439: creat d0/d6/d17/d4f/d9/de/f9c x:0 0 0 2024-09-12T01:43:11.844 INFO:tasks.workunit.client.0.smithi066.stdout:7/395: symlink d2/d71/l89 0 2024-09-12T01:43:11.844 INFO:tasks.workunit.client.0.smithi066.stdout:7/396: fsync d2/d5/d6/d22/d75/d1d/f7e 0 2024-09-12T01:43:11.847 INFO:tasks.workunit.client.1.smithi153.stdout:2/753: dwrite d7/db/d6c/d76/db8/dcf/f8e [0,4194304] 0 2024-09-12T01:43:11.848 INFO:tasks.workunit.client.1.smithi153.stdout:2/754: write d7/db/f64 [5079210,39653] 0 2024-09-12T01:43:11.848 INFO:tasks.workunit.client.1.smithi153.stdout:7/747: dwrite d12/d21/d29/d2d/fac [0,4194304] 0 2024-09-12T01:43:11.848 INFO:tasks.workunit.client.1.smithi153.stdout:4/694: mkdir d6/d9/d11/d90/db7/df3 0 2024-09-12T01:43:11.849 INFO:tasks.workunit.client.1.smithi153.stdout:4/695: chown d6/d9/dc/d98/d3e/fdf 1931 1 2024-09-12T01:43:11.850 INFO:tasks.workunit.client.0.smithi066.stdout:5/381: dread d0/f20 [0,4194304] 0 2024-09-12T01:43:11.853 INFO:tasks.workunit.client.1.smithi153.stdout:9/783: unlink d3/d5f/l99 0 2024-09-12T01:43:11.853 INFO:tasks.workunit.client.0.smithi066.stdout:7/397: dread d2/d5/d6/d22/f59 [0,4194304] 0 2024-09-12T01:43:11.854 INFO:tasks.workunit.client.1.smithi153.stdout:7/748: dread d12/d21/d29/d35/d37/d4c/d5c/f70 [0,4194304] 0 2024-09-12T01:43:11.854 INFO:tasks.workunit.client.1.smithi153.stdout:7/749: chown d12/d21/d29/d35/d37/d4c/d5c/ldf 0 1 2024-09-12T01:43:11.857 INFO:tasks.workunit.client.1.smithi153.stdout:5/801: link d0/df/d1c/d69/l6d d0/df/db8/d2f/d55/d9c/d75/d58/d70/lfe 0 2024-09-12T01:43:11.857 INFO:tasks.workunit.client.1.smithi153.stdout:5/802: write d0/df/fad [337882,21606] 0 2024-09-12T01:43:11.857 INFO:tasks.workunit.client.1.smithi153.stdout:5/803: getdents d0/d43/d8d/d8e/dd7 0 2024-09-12T01:43:11.859 INFO:tasks.workunit.client.0.smithi066.stdout:1/434: truncate f4 3820321 0 2024-09-12T01:43:11.859 INFO:tasks.workunit.client.0.smithi066.stdout:1/435: fdatasync d5/dc/f5b 0 2024-09-12T01:43:11.859 INFO:tasks.workunit.client.0.smithi066.stdout:1/436: read - d5/d15/f6e zero size 2024-09-12T01:43:11.864 INFO:tasks.workunit.client.0.smithi066.stdout:9/440: dwrite d0/d6/d17/d4f/d12/f25 [0,4194304] 0 2024-09-12T01:43:11.864 INFO:tasks.workunit.client.0.smithi066.stdout:9/441: write d0/d6/d17/d4f/d12/f27 [1452617,67774] 0 2024-09-12T01:43:11.866 INFO:tasks.workunit.client.1.smithi153.stdout:0/898: rename d22/d30/d4c/d6f/dfb to d22/d79/d8e/dae/dff/d11e/d12f 0 2024-09-12T01:43:11.871 INFO:tasks.workunit.client.0.smithi066.stdout:1/437: chown d5/dc/ce 246 1 2024-09-12T01:43:11.878 INFO:tasks.workunit.client.0.smithi066.stdout:9/442: unlink d0/d6/d17/d4f/d9/de/l15 0 2024-09-12T01:43:11.878 INFO:tasks.workunit.client.0.smithi066.stdout:9/443: chown d0/d6/d17/d4f/d12/f27 286632 1 2024-09-12T01:43:11.878 INFO:tasks.workunit.client.1.smithi153.stdout:9/784: symlink d3/d3a/d42/d72/leb 0 2024-09-12T01:43:11.879 INFO:tasks.workunit.client.1.smithi153.stdout:9/785: creat d3/d66/d80/fec x:0 0 0 2024-09-12T01:43:11.879 INFO:tasks.workunit.client.0.smithi066.stdout:7/398: getdents d2/d5/da/d3f 0 2024-09-12T01:43:11.880 INFO:tasks.workunit.client.1.smithi153.stdout:5/804: creat d0/d43/d8d/d8e/dd7/df6/fff x:0 0 0 2024-09-12T01:43:11.881 INFO:tasks.workunit.client.1.smithi153.stdout:2/755: dwrite d7/db/d6c/d7e/f5f [0,4194304] 0 2024-09-12T01:43:11.881 INFO:tasks.workunit.client.0.smithi066.stdout:1/438: symlink d5/dc/d36/l82 0 2024-09-12T01:43:11.881 INFO:tasks.workunit.client.0.smithi066.stdout:1/439: truncate d5/d52/d60/f79 675993 0 2024-09-12T01:43:11.882 INFO:tasks.workunit.client.0.smithi066.stdout:1/440: fdatasync d5/dc/d53/f35 0 2024-09-12T01:43:11.884 INFO:tasks.workunit.client.0.smithi066.stdout:9/444: rename d0/d6/d17/d4f/d9/de/c7e to d0/d6/d17/d4f/d12/d46/c9d 0 2024-09-12T01:43:11.884 INFO:tasks.workunit.client.0.smithi066.stdout:1/441: write d5/d15/f3a [268957,122732] 0 2024-09-12T01:43:11.885 INFO:tasks.workunit.client.1.smithi153.stdout:0/899: symlink d22/d30/d4c/d6e/d7f/dbd/l130 0 2024-09-12T01:43:11.885 INFO:tasks.workunit.client.0.smithi066.stdout:5/382: dwrite d0/dd/d18/d36/f5c [0,4194304] 0 2024-09-12T01:43:11.886 INFO:tasks.workunit.client.1.smithi153.stdout:7/750: dwrite d12/d21/d29/d35/d37/f76 [0,4194304] 0 2024-09-12T01:43:11.886 INFO:tasks.workunit.client.1.smithi153.stdout:4/696: dwrite d6/d9/d11/d13/f65 [0,4194304] 0 2024-09-12T01:43:11.886 INFO:tasks.workunit.client.0.smithi066.stdout:7/399: rmdir d2/d3c 39 2024-09-12T01:43:11.888 INFO:tasks.workunit.client.1.smithi153.stdout:9/786: symlink d3/d3a/d42/d72/dce/led 0 2024-09-12T01:43:11.890 INFO:tasks.workunit.client.0.smithi066.stdout:9/445: creat d0/d6/d7f/d90/d9a/f9e x:0 0 0 2024-09-12T01:43:11.892 INFO:tasks.workunit.client.1.smithi153.stdout:5/805: creat d0/df/d1c/d69/f100 x:0 0 0 2024-09-12T01:43:11.892 INFO:tasks.workunit.client.1.smithi153.stdout:5/806: readlink d0/df/db8/d2f/d55/d9c/d75/led 0 2024-09-12T01:43:11.892 INFO:tasks.workunit.client.1.smithi153.stdout:3/848: sync 2024-09-12T01:43:11.892 INFO:tasks.workunit.client.1.smithi153.stdout:6/854: sync 2024-09-12T01:43:11.892 INFO:tasks.workunit.client.1.smithi153.stdout:6/855: fdatasync d1/d6/d23/d98/d53/f78 0 2024-09-12T01:43:11.892 INFO:tasks.workunit.client.1.smithi153.stdout:3/849: creat d1/d13/d23/d47/d71/d8e/d93/d79/db5/ffb x:0 0 0 2024-09-12T01:43:11.894 INFO:tasks.workunit.client.0.smithi066.stdout:7/400: dread d2/d5/d6/d22/d75/d25/d4d/f60 [0,4194304] 0 2024-09-12T01:43:11.894 INFO:tasks.workunit.client.0.smithi066.stdout:7/401: write d2/d5/d6/d22/d75/d2f/f34 [898059,101625] 0 2024-09-12T01:43:11.894 INFO:tasks.workunit.client.0.smithi066.stdout:7/402: write d2/f2b [1336985,8227] 0 2024-09-12T01:43:11.896 INFO:tasks.workunit.client.0.smithi066.stdout:1/442: dread - d5/dc/f29 zero size 2024-09-12T01:43:11.896 INFO:tasks.workunit.client.0.smithi066.stdout:1/443: write d5/f6d [5145976,73418] 0 2024-09-12T01:43:11.898 INFO:tasks.workunit.client.0.smithi066.stdout:1/444: dread d5/dc/d4f/f69 [0,4194304] 0 2024-09-12T01:43:11.898 INFO:tasks.workunit.client.0.smithi066.stdout:1/445: readlink d5/dc/d53/l64 0 2024-09-12T01:43:11.899 INFO:tasks.workunit.client.1.smithi153.stdout:7/751: dread d12/f36 [0,4194304] 0 2024-09-12T01:43:11.899 INFO:tasks.workunit.client.1.smithi153.stdout:7/752: write d12/d4e/f74 [980510,31739] 0 2024-09-12T01:43:11.902 INFO:tasks.workunit.client.1.smithi153.stdout:3/850: dread d1/d13/d25/d26/d4b/f8c [0,4194304] 0 2024-09-12T01:43:11.903 INFO:tasks.workunit.client.0.smithi066.stdout:5/383: dread d0/dd/d18/d36/d4c/f61 [0,4194304] 0 2024-09-12T01:43:11.904 INFO:tasks.workunit.client.1.smithi153.stdout:2/756: rmdir d7/d19 39 2024-09-12T01:43:11.904 INFO:tasks.workunit.client.0.smithi066.stdout:9/446: write d0/d6/d17/f18 [1995204,39611] 0 2024-09-12T01:43:11.907 INFO:tasks.workunit.client.1.smithi153.stdout:7/753: dread d12/d21/f44 [4194304,4194304] 0 2024-09-12T01:43:11.912 INFO:tasks.workunit.client.1.smithi153.stdout:6/856: dwrite d1/d6/da/d19/d3a/f7e [0,4194304] 0 2024-09-12T01:43:11.913 INFO:tasks.workunit.client.1.smithi153.stdout:0/900: creat d22/d30/d4c/f131 x:0 0 0 2024-09-12T01:43:11.927 INFO:tasks.workunit.client.1.smithi153.stdout:6/857: read d1/d6/d23/d98/d53/f78 [4124992,130208] 0 2024-09-12T01:43:11.969 INFO:tasks.workunit.client.1.smithi153.stdout:9/787: unlink d3/d55/l41 0 2024-09-12T01:43:11.969 INFO:tasks.workunit.client.1.smithi153.stdout:9/788: creat d3/d55/d30/d88/fee x:0 0 0 2024-09-12T01:43:11.970 INFO:tasks.workunit.client.1.smithi153.stdout:5/807: mkdir d0/d20/dc0/d101 0 2024-09-12T01:43:11.976 INFO:tasks.workunit.client.1.smithi153.stdout:3/851: unlink d1/d64/db0/fd0 0 2024-09-12T01:43:11.977 INFO:tasks.workunit.client.1.smithi153.stdout:2/757: symlink d7/db/d6c/d76/db8/led 0 2024-09-12T01:43:11.983 INFO:tasks.workunit.client.0.smithi066.stdout:7/403: rename d2/d5/d6/d22/f4e to d2/d5/d6/d22/d75/d1d/d84/f8a 0 2024-09-12T01:43:11.983 INFO:tasks.workunit.client.0.smithi066.stdout:7/404: creat d2/d5/d6/d40/d51/f8b x:0 0 0 2024-09-12T01:43:11.984 INFO:tasks.workunit.client.1.smithi153.stdout:0/901: rmdir d22/d30/d4c/d8a 39 2024-09-12T01:43:11.984 INFO:tasks.workunit.client.1.smithi153.stdout:0/902: creat d22/d79/d8e/dae/db7/f132 x:0 0 0 2024-09-12T01:43:11.988 INFO:tasks.workunit.client.0.smithi066.stdout:1/446: creat d5/dc/d4f/f83 x:0 0 0 2024-09-12T01:43:11.991 INFO:tasks.workunit.client.0.smithi066.stdout:9/447: creat d0/d6/d17/d1b/d4c/d4b/d86/f9f x:0 0 0 2024-09-12T01:43:11.991 INFO:tasks.workunit.client.0.smithi066.stdout:9/448: dread - d0/d6/d17/d1b/d4c/d4b/d86/f9f zero size 2024-09-12T01:43:12.015 INFO:tasks.workunit.client.1.smithi153.stdout:6/858: mkdir d1/d6/da/d19/d34/d10e/d112 0 2024-09-12T01:43:12.031 INFO:tasks.workunit.client.1.smithi153.stdout:3/852: dwrite d1/d16/faf [0,4194304] 0 2024-09-12T01:43:12.031 INFO:tasks.workunit.client.1.smithi153.stdout:3/853: stat d1/d16/d1c/fd9 0 2024-09-12T01:43:12.031 INFO:tasks.workunit.client.1.smithi153.stdout:3/854: truncate d1/d1e/d9a/ff5 862184 0 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: [12/Sep/2024:01:43:10] ENGINE Bus STARTING 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: [12/Sep/2024:01:43:10] ENGINE Serving on https://172.21.15.153:7150 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: [12/Sep/2024:01:43:10] ENGINE Error in HTTPServer.serve 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Traceback (most recent call last): 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:43:12.051 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._run(expiration_interval) 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s = self.context.wrap_socket( 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: return self.sslsocket_class._create( 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self.do_handshake() 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._sslobj.do_handshake() 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:43:12.052 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: [12/Sep/2024:01:43:10] ENGINE Serving on http://172.21.15.153:8765 2024-09-12T01:43:12.053 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: [12/Sep/2024:01:43:10] ENGINE Bus STARTED 2024-09-12T01:43:12.053 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:11 smithi066 ceph-mon[27875]: mgrmap e24: smithi153.jpnqza(active, since 3s) 2024-09-12T01:43:12.080 INFO:tasks.workunit.client.0.smithi066.stdout:0/454: sync 2024-09-12T01:43:12.080 INFO:tasks.workunit.client.0.smithi066.stdout:4/398: sync 2024-09-12T01:43:12.088 INFO:tasks.workunit.client.0.smithi066.stdout:0/455: dread d1/d62/d9f/d4a/d67/d1b/d26/f77 [0,4194304] 0 2024-09-12T01:43:12.093 INFO:tasks.workunit.client.0.smithi066.stdout:2/428: sync 2024-09-12T01:43:12.094 INFO:tasks.workunit.client.0.smithi066.stdout:6/485: sync 2024-09-12T01:43:12.094 INFO:tasks.workunit.client.0.smithi066.stdout:8/503: sync 2024-09-12T01:43:12.094 INFO:tasks.workunit.client.0.smithi066.stdout:2/429: chown de/d13/d1e/d25/l7d 16430 1 2024-09-12T01:43:12.094 INFO:tasks.workunit.client.0.smithi066.stdout:8/504: dread - d12/d21/d2f/d57/d84/d89/f96 zero size 2024-09-12T01:43:12.094 INFO:tasks.workunit.client.0.smithi066.stdout:2/430: readlink de/d13/d1e/d25/l7d 0 2024-09-12T01:43:12.094 INFO:tasks.workunit.client.0.smithi066.stdout:8/505: rename d12/d21/d2f/d57 to d12/d21/d2f/d57/d84/d89/d9f 22 2024-09-12T01:43:12.097 INFO:tasks.workunit.client.0.smithi066.stdout:2/431: dread de/d13/d1e/d22/f54 [0,4194304] 0 2024-09-12T01:43:12.098 INFO:tasks.workunit.client.0.smithi066.stdout:2/432: readlink de/d3c/l64 0 2024-09-12T01:43:12.098 INFO:tasks.workunit.client.0.smithi066.stdout:2/433: creat de/d3c/f8d x:0 0 0 2024-09-12T01:43:12.123 INFO:tasks.workunit.client.0.smithi066.stdout:1/447: link d5/dc/l78 d5/d15/d58/l84 0 2024-09-12T01:43:12.123 INFO:tasks.workunit.client.0.smithi066.stdout:1/448: write d5/d52/f66 [307440,4171] 0 2024-09-12T01:43:12.136 INFO:tasks.workunit.client.0.smithi066.stdout:0/456: creat d1/d62/d9f/d4a/d67/d6e/d80/fa6 x:0 0 0 2024-09-12T01:43:12.138 INFO:tasks.workunit.client.0.smithi066.stdout:6/486: mkdir d2/d21/d92/d9f 0 2024-09-12T01:43:12.138 INFO:tasks.workunit.client.0.smithi066.stdout:6/487: readlink d2/d31/d5e/l64 0 2024-09-12T01:43:12.140 INFO:tasks.workunit.client.0.smithi066.stdout:8/506: truncate d12/d21/d2f/f63 2351719 0 2024-09-12T01:43:12.143 INFO:tasks.workunit.client.0.smithi066.stdout:1/449: dwrite d5/f47 [0,4194304] 0 2024-09-12T01:43:12.150 INFO:tasks.workunit.client.0.smithi066.stdout:7/405: getdents d2/d5/d6/d22/d75/d25 0 2024-09-12T01:43:12.150 INFO:tasks.workunit.client.0.smithi066.stdout:7/406: chown d2/d5/d6/l44 6 1 2024-09-12T01:43:12.151 INFO:tasks.workunit.client.1.smithi153.stdout:9/789: mknod d3/d3a/d42/d72/dc3/cef 0 2024-09-12T01:43:12.153 INFO:tasks.workunit.client.0.smithi066.stdout:4/399: getdents d4 0 2024-09-12T01:43:12.153 INFO:tasks.workunit.client.0.smithi066.stdout:4/400: chown d4/d6/d27/d66/d6c/d75 3 1 2024-09-12T01:43:12.153 INFO:tasks.workunit.client.0.smithi066.stdout:4/401: write d4/d6/d8/d18/d45/f57 [309952,10870] 0 2024-09-12T01:43:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: [12/Sep/2024:01:43:10] ENGINE Bus STARTING 2024-09-12T01:43:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: [12/Sep/2024:01:43:10] ENGINE Serving on https://172.21.15.153:7150 2024-09-12T01:43:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: [12/Sep/2024:01:43:10] ENGINE Error in HTTPServer.serve 2024-09-12T01:43:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Traceback (most recent call last): 2024-09-12T01:43:12.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._run(expiration_interval) 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s = self.context.wrap_socket( 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: return self.sslsocket_class._create( 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self.do_handshake() 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:43:12.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._sslobj.do_handshake() 2024-09-12T01:43:12.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:43:12.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: [12/Sep/2024:01:43:10] ENGINE Serving on http://172.21.15.153:8765 2024-09-12T01:43:12.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: [12/Sep/2024:01:43:10] ENGINE Bus STARTED 2024-09-12T01:43:12.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:11 smithi153 ceph-mon[34713]: mgrmap e24: smithi153.jpnqza(active, since 3s) 2024-09-12T01:43:12.156 INFO:tasks.workunit.client.0.smithi066.stdout:0/457: truncate d1/d72/de/f4b 1063973 0 2024-09-12T01:43:12.156 INFO:tasks.workunit.client.1.smithi153.stdout:5/808: rename d0/df/db8/d2f/d55/d9c/d7b to d0/df/d102 0 2024-09-12T01:43:12.158 INFO:tasks.workunit.client.1.smithi153.stdout:7/754: symlink d12/d21/d29/d35/dc7/lec 0 2024-09-12T01:43:12.158 INFO:tasks.workunit.client.1.smithi153.stdout:7/755: read d12/f20 [1957191,42776] 0 2024-09-12T01:43:12.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/488: mknod d2/d31/d5e/ca0 0 2024-09-12T01:43:12.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/489: fdatasync d2/d99/f2d 0 2024-09-12T01:43:12.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/490: chown d2/d99/d7b 38 1 2024-09-12T01:43:12.162 INFO:tasks.workunit.client.0.smithi066.stdout:8/507: dwrite d12/d21/f32 [0,4194304] 0 2024-09-12T01:43:12.165 INFO:tasks.workunit.client.1.smithi153.stdout:0/903: mknod d22/d30/d4c/d6f/c133 0 2024-09-12T01:43:12.168 INFO:tasks.workunit.client.1.smithi153.stdout:6/859: symlink d1/d80/db6/d103/l113 0 2024-09-12T01:43:12.169 INFO:tasks.workunit.client.1.smithi153.stdout:6/860: stat d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb 0 2024-09-12T01:43:12.170 INFO:tasks.workunit.client.0.smithi066.stdout:1/450: creat d5/dc/d36/d57/f85 x:0 0 0 2024-09-12T01:43:12.170 INFO:tasks.workunit.client.0.smithi066.stdout:1/451: chown d5/d52/d60/f79 0 1 2024-09-12T01:43:12.171 INFO:tasks.workunit.client.1.smithi153.stdout:3/855: mknod d1/d13/d23/d47/d71/d8e/d93/d79/cfc 0 2024-09-12T01:43:12.173 INFO:tasks.workunit.client.0.smithi066.stdout:7/407: rename d2/d5/d6/d22/d75/d1d/d6c/d80/l7f to d2/d5/d6/d22/l8c 0 2024-09-12T01:43:12.174 INFO:tasks.workunit.client.0.smithi066.stdout:0/458: dwrite d1/d62/d9f/f6b [0,4194304] 0 2024-09-12T01:43:12.177 INFO:tasks.workunit.client.0.smithi066.stdout:4/402: creat d4/d6/d8/d4a/f7e x:0 0 0 2024-09-12T01:43:12.180 INFO:tasks.workunit.client.1.smithi153.stdout:6/861: dread d1/d6/da/d19/d34/f61 [0,4194304] 0 2024-09-12T01:43:12.180 INFO:tasks.workunit.client.1.smithi153.stdout:6/862: dread - d1/d6/da/d19/d3a/fe2 zero size 2024-09-12T01:43:12.181 INFO:tasks.workunit.client.0.smithi066.stdout:6/491: creat d2/d99/fa1 x:0 0 0 2024-09-12T01:43:12.182 INFO:tasks.workunit.client.1.smithi153.stdout:9/790: unlink d3/d55/d30/l87 0 2024-09-12T01:43:12.185 INFO:tasks.workunit.client.0.smithi066.stdout:8/508: creat d12/d21/d2f/d57/d84/d89/d92/fa0 x:0 0 0 2024-09-12T01:43:12.187 INFO:tasks.workunit.client.1.smithi153.stdout:5/809: rename d0/df/d1c/l49 to d0/d15/dae/dfb/l103 0 2024-09-12T01:43:12.187 INFO:tasks.workunit.client.1.smithi153.stdout:5/810: write d0/df/db8/d2f/d55/d9c/d75/f8c [5559992,91069] 0 2024-09-12T01:43:12.190 INFO:tasks.workunit.client.1.smithi153.stdout:7/756: creat d12/d21/d29/d35/fed x:0 0 0 2024-09-12T01:43:12.196 INFO:tasks.workunit.client.0.smithi066.stdout:2/434: creat de/d13/d28/f8e x:0 0 0 2024-09-12T01:43:12.198 INFO:tasks.workunit.client.1.smithi153.stdout:7/757: write d12/d21/d29/d35/d37/f97 [2097757,86922] 0 2024-09-12T01:43:12.202 INFO:tasks.workunit.client.0.smithi066.stdout:8/509: dwrite d12/d21/f33 [0,4194304] 0 2024-09-12T01:43:12.202 INFO:tasks.workunit.client.0.smithi066.stdout:8/510: readlink d12/d21/d2f/d57/d84/d6f/l8d 0 2024-09-12T01:43:12.202 INFO:tasks.workunit.client.0.smithi066.stdout:8/511: chown d12/c71 49340 1 2024-09-12T01:43:12.202 INFO:tasks.workunit.client.1.smithi153.stdout:0/904: mknod d22/d79/dca/dec/c134 0 2024-09-12T01:43:12.202 INFO:tasks.workunit.client.1.smithi153.stdout:0/905: chown d22/d30/d4c/d6f/l8b 5148307 1 2024-09-12T01:43:12.204 INFO:tasks.workunit.client.0.smithi066.stdout:8/512: dread d12/d21/d2f/d57/d84/d50/d56/f59 [0,4194304] 0 2024-09-12T01:43:12.209 INFO:tasks.workunit.client.1.smithi153.stdout:6/863: link d1/d6/d23/d98/d4f/f107 d1/d6/d39/d76/f114 0 2024-09-12T01:43:12.209 INFO:tasks.workunit.client.1.smithi153.stdout:6/864: write d1/d6/d23/d98/d4f/ffb [198481,14216] 0 2024-09-12T01:43:12.209 INFO:tasks.workunit.client.1.smithi153.stdout:6/865: stat d1/d6/d46/d73/cc0 0 2024-09-12T01:43:12.212 INFO:tasks.workunit.client.1.smithi153.stdout:7/758: dread d12/d21/d29/d35/d37/d4c/f73 [0,4194304] 0 2024-09-12T01:43:12.213 INFO:tasks.workunit.client.1.smithi153.stdout:9/791: unlink d3/f1f 0 2024-09-12T01:43:12.219 INFO:tasks.workunit.client.1.smithi153.stdout:5/811: creat d0/df/db8/d2f/d55/d9c/d75/d58/d71/f104 x:0 0 0 2024-09-12T01:43:12.220 INFO:tasks.workunit.client.1.smithi153.stdout:5/812: write d0/df/d83/d36/d39/f74 [4087776,17388] 0 2024-09-12T01:43:12.220 INFO:tasks.workunit.client.1.smithi153.stdout:5/813: dread - d0/d20/dc0/fdc zero size 2024-09-12T01:43:12.220 INFO:tasks.workunit.client.1.smithi153.stdout:5/814: stat d0/df/db8/d2f/d55/d9c/d75/d58/d70/l64 0 2024-09-12T01:43:12.220 INFO:tasks.workunit.client.1.smithi153.stdout:5/815: truncate d0/d43/d68/dcc/fe4 937078 0 2024-09-12T01:43:12.220 INFO:tasks.workunit.client.1.smithi153.stdout:5/816: write d0/df/d1c/d69/f100 [40369,18003] 0 2024-09-12T01:43:12.227 INFO:tasks.workunit.client.0.smithi066.stdout:0/459: getdents d1/d62/d9f/d7c 0 2024-09-12T01:43:12.229 INFO:tasks.workunit.client.1.smithi153.stdout:0/906: rmdir d22/d79/d8e/dc6/dd6/d12e 0 2024-09-12T01:43:12.234 INFO:tasks.workunit.client.0.smithi066.stdout:4/403: link d4/d6/d8/d18/c3d d4/d15/d33/c7f 0 2024-09-12T01:43:12.239 INFO:tasks.workunit.client.0.smithi066.stdout:6/492: symlink d2/d31/d5e/la2 0 2024-09-12T01:43:12.239 INFO:tasks.workunit.client.0.smithi066.stdout:6/493: chown d2/d99/d12/d1d/d6b/c98 3362 1 2024-09-12T01:43:12.240 INFO:tasks.workunit.client.0.smithi066.stdout:1/452: mkdir d5/d15/d4d/d86 0 2024-09-12T01:43:12.240 INFO:tasks.workunit.client.0.smithi066.stdout:2/435: mkdir de/d3c/d8f 0 2024-09-12T01:43:12.245 INFO:tasks.workunit.client.0.smithi066.stdout:8/513: dwrite d12/d21/d2f/d57/d3c/f76 [0,4194304] 0 2024-09-12T01:43:12.248 INFO:tasks.workunit.client.0.smithi066.stdout:6/494: link d2/d99/d12/f5c d2/fa3 0 2024-09-12T01:43:12.250 INFO:tasks.workunit.client.0.smithi066.stdout:7/408: creat d2/d5/d6/d22/d75/f8d x:0 0 0 2024-09-12T01:43:12.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/453: dread d5/dc/f40 [0,4194304] 0 2024-09-12T01:43:12.257 INFO:tasks.workunit.client.0.smithi066.stdout:8/514: symlink d12/d21/d2f/d53/la1 0 2024-09-12T01:43:12.258 INFO:tasks.workunit.client.1.smithi153.stdout:9/792: dwrite d3/d3a/d42/f4c [0,4194304] 0 2024-09-12T01:43:12.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/495: mknod d2/ca4 0 2024-09-12T01:43:12.262 INFO:tasks.workunit.client.0.smithi066.stdout:1/454: truncate d5/dc/d53/f35 1654917 0 2024-09-12T01:43:12.265 INFO:tasks.workunit.client.0.smithi066.stdout:2/436: dwrite de/d13/d28/f8e [0,4194304] 0 2024-09-12T01:43:12.265 INFO:tasks.workunit.client.0.smithi066.stdout:8/515: symlink d12/d21/d2f/d57/d84/d89/la2 0 2024-09-12T01:43:12.271 INFO:tasks.workunit.client.1.smithi153.stdout:6/866: dwrite d1/d6/d23/f6e [0,4194304] 0 2024-09-12T01:43:12.271 INFO:tasks.workunit.client.1.smithi153.stdout:6/867: truncate d1/d6/d23/d98/d53/d8d/ff3 455646 0 2024-09-12T01:43:12.273 INFO:tasks.workunit.client.0.smithi066.stdout:2/437: mknod de/d13/d1e/d25/d5e/c90 0 2024-09-12T01:43:12.288 INFO:tasks.workunit.client.1.smithi153.stdout:9/793: dwrite d3/d55/d30/d95/d84/d8b/fcf [0,4194304] 0 2024-09-12T01:43:12.288 INFO:tasks.workunit.client.0.smithi066.stdout:1/455: dwrite d5/d15/f56 [4194304,4194304] 0 2024-09-12T01:43:12.311 INFO:tasks.workunit.client.1.smithi153.stdout:9/794: dwrite d3/d55/d30/d90/fd3 [0,4194304] 0 2024-09-12T01:43:12.311 INFO:tasks.workunit.client.1.smithi153.stdout:9/795: write d3/d55/d30/fe6 [273074,1424] 0 2024-09-12T01:43:12.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/516: creat d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 x:0 0 0 2024-09-12T01:43:12.339 INFO:tasks.workunit.client.0.smithi066.stdout:0/460: dwrite d1/d62/f8e [0,4194304] 0 2024-09-12T01:43:12.345 INFO:tasks.workunit.client.0.smithi066.stdout:2/438: rename de/d3c/f8d to de/d13/d28/f91 0 2024-09-12T01:43:12.346 INFO:tasks.workunit.client.1.smithi153.stdout:8/722: sync 2024-09-12T01:43:12.346 INFO:tasks.workunit.client.1.smithi153.stdout:1/836: sync 2024-09-12T01:43:12.346 INFO:tasks.workunit.client.1.smithi153.stdout:4/697: sync 2024-09-12T01:43:12.349 INFO:tasks.workunit.client.1.smithi153.stdout:6/868: creat d1/d6/d23/d98/d53/da4/f115 x:0 0 0 2024-09-12T01:43:12.352 INFO:tasks.workunit.client.0.smithi066.stdout:9/449: creat d0/d6/d17/fa0 x:0 0 0 2024-09-12T01:43:12.352 INFO:tasks.workunit.client.0.smithi066.stdout:1/456: rmdir d5/dc 39 2024-09-12T01:43:12.355 INFO:tasks.workunit.client.0.smithi066.stdout:1/457: write d5/d15/f43 [1084751,37869] 0 2024-09-12T01:43:12.356 INFO:tasks.workunit.client.0.smithi066.stdout:1/458: creat d5/f87 x:0 0 0 2024-09-12T01:43:12.356 INFO:tasks.workunit.client.0.smithi066.stdout:1/459: readlink d5/dc/d53/l3d 0 2024-09-12T01:43:12.356 INFO:tasks.workunit.client.0.smithi066.stdout:0/461: read d1/d72/de/f19 [1909848,104135] 0 2024-09-12T01:43:12.356 INFO:tasks.workunit.client.0.smithi066.stdout:0/462: fdatasync d1/d72/de/f7b 0 2024-09-12T01:43:12.356 INFO:tasks.workunit.client.1.smithi153.stdout:9/796: symlink d3/d3a/lf0 0 2024-09-12T01:43:12.356 INFO:tasks.workunit.client.1.smithi153.stdout:9/797: write d3/d5f/d62/f64 [1508331,109846] 0 2024-09-12T01:43:12.357 INFO:tasks.workunit.client.1.smithi153.stdout:9/798: write d3/d3a/fb2 [676198,94412] 0 2024-09-12T01:43:12.360 INFO:tasks.workunit.client.1.smithi153.stdout:4/698: mknod d6/d9/dc/d31/d76/cf4 0 2024-09-12T01:43:12.362 INFO:tasks.workunit.client.1.smithi153.stdout:6/869: mkdir d1/d6/d116 0 2024-09-12T01:43:12.364 INFO:tasks.workunit.client.0.smithi066.stdout:2/439: mkdir de/d13/d1e/d92 0 2024-09-12T01:43:12.367 INFO:tasks.workunit.client.1.smithi153.stdout:8/723: link d17/f85 d17/fec 0 2024-09-12T01:43:12.367 INFO:tasks.workunit.client.1.smithi153.stdout:8/724: fdatasync d17/d1f/d4f/d42/d79/dac/fe9 0 2024-09-12T01:43:12.367 INFO:tasks.workunit.client.1.smithi153.stdout:8/725: chown d17/d1d/ca0 13 1 2024-09-12T01:43:12.368 INFO:tasks.workunit.client.0.smithi066.stdout:2/440: dread de/d13/d1e/d22/f54 [0,4194304] 0 2024-09-12T01:43:12.368 INFO:tasks.workunit.client.0.smithi066.stdout:2/441: dread - de/d13/d1e/d22/f74 zero size 2024-09-12T01:43:12.368 INFO:tasks.workunit.client.0.smithi066.stdout:9/450: rename d0/d6/d17/d1b/d4c/d4b/d86/f9f to d0/d6/d17/d1b/d4c/d42/fa1 0 2024-09-12T01:43:12.369 INFO:tasks.workunit.client.1.smithi153.stdout:1/837: dwrite d2/d9/d58/d74/d103/d89/fbe [0,4194304] 0 2024-09-12T01:43:12.372 INFO:tasks.workunit.client.0.smithi066.stdout:1/460: link d5/fa d5/d15/d4d/d86/f88 0 2024-09-12T01:43:12.376 INFO:tasks.workunit.client.0.smithi066.stdout:0/463: link d1/d62/d89/d83/d8b/fa5 d1/d62/d9f/d4a/d67/d20/d5e/fa7 0 2024-09-12T01:43:12.380 INFO:tasks.workunit.client.0.smithi066.stdout:8/517: getdents d12/d21/d2f/d57/d84/d6f 0 2024-09-12T01:43:12.382 INFO:tasks.workunit.client.0.smithi066.stdout:2/442: link de/d13/d1e/d25/f5b de/d13/d28/f93 0 2024-09-12T01:43:12.384 INFO:tasks.workunit.client.1.smithi153.stdout:9/799: symlink d3/d66/ddc/lf1 0 2024-09-12T01:43:12.384 INFO:tasks.workunit.client.1.smithi153.stdout:4/699: symlink d6/d9/d11/d90/lf5 0 2024-09-12T01:43:12.386 INFO:tasks.workunit.client.1.smithi153.stdout:6/870: mknod d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/c117 0 2024-09-12T01:43:12.387 INFO:tasks.workunit.client.0.smithi066.stdout:1/461: truncate d5/dc/f1f 2335714 0 2024-09-12T01:43:12.389 INFO:tasks.workunit.client.0.smithi066.stdout:0/464: mkdir d1/d62/d9f/d4a/d67/d20/da8 0 2024-09-12T01:43:12.392 INFO:tasks.workunit.client.1.smithi153.stdout:8/726: dwrite d17/d21/d56/f8f [4194304,4194304] 0 2024-09-12T01:43:12.392 INFO:tasks.workunit.client.1.smithi153.stdout:9/800: creat d3/d55/d30/d90/ff2 x:0 0 0 2024-09-12T01:43:12.393 INFO:tasks.workunit.client.1.smithi153.stdout:1/838: dwrite d2/d34/d3d/d106/f10d [0,4194304] 0 2024-09-12T01:43:12.393 INFO:tasks.workunit.client.0.smithi066.stdout:8/518: dread d12/d21/f33 [0,4194304] 0 2024-09-12T01:43:12.393 INFO:tasks.workunit.client.0.smithi066.stdout:2/443: mknod de/d13/d5c/c94 0 2024-09-12T01:43:12.393 INFO:tasks.workunit.client.0.smithi066.stdout:2/444: read de/f15 [84365,112479] 0 2024-09-12T01:43:12.393 INFO:tasks.workunit.client.0.smithi066.stdout:4/404: fsync d4/d6/d8/d4a/f7e 0 2024-09-12T01:43:12.394 INFO:tasks.workunit.client.1.smithi153.stdout:4/700: creat d6/d9/d11/d90/db7/ff6 x:0 0 0 2024-09-12T01:43:12.394 INFO:tasks.workunit.client.1.smithi153.stdout:6/871: symlink d1/d6/d39/dc4/dcb/l118 0 2024-09-12T01:43:12.396 INFO:tasks.workunit.client.1.smithi153.stdout:2/758: sync 2024-09-12T01:43:12.396 INFO:tasks.workunit.client.1.smithi153.stdout:2/759: fsync d7/db/f50 0 2024-09-12T01:43:12.396 INFO:tasks.workunit.client.1.smithi153.stdout:2/760: read d7/db/d62/f7f [3540097,19766] 0 2024-09-12T01:43:12.397 INFO:tasks.workunit.client.1.smithi153.stdout:3/856: link d1/d16/l7f d1/d13/d23/d47/d71/d8e/lfd 0 2024-09-12T01:43:12.398 INFO:tasks.workunit.client.0.smithi066.stdout:1/462: creat d5/dc/d36/f89 x:0 0 0 2024-09-12T01:43:12.398 INFO:tasks.workunit.client.0.smithi066.stdout:1/463: readlink d5/d52/d60/l76 0 2024-09-12T01:43:12.398 INFO:tasks.workunit.client.0.smithi066.stdout:1/464: creat d5/dc/d36/d57/f8a x:0 0 0 2024-09-12T01:43:12.398 INFO:tasks.workunit.client.0.smithi066.stdout:1/465: getdents d5/dc/d53/d7a 0 2024-09-12T01:43:12.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/465: creat d1/d62/d9f/d4a/d67/d20/fa9 x:0 0 0 2024-09-12T01:43:12.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/466: fdatasync d1/d62/d9f/d4a/d67/d1b/f7d 0 2024-09-12T01:43:12.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/467: chown d1/d62/d9f/f6b 26188142 1 2024-09-12T01:43:12.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/468: dread - d1/d62/d9f/d4a/d67/d6e/fa1 zero size 2024-09-12T01:43:12.401 INFO:tasks.workunit.client.0.smithi066.stdout:0/469: dread - d1/d62/fa4 zero size 2024-09-12T01:43:12.402 INFO:tasks.workunit.client.1.smithi153.stdout:8/727: mkdir d17/d21/d56/d96/d6c/d89/ded 0 2024-09-12T01:43:12.406 INFO:tasks.workunit.client.0.smithi066.stdout:2/445: mknod de/d13/d7f/c95 0 2024-09-12T01:43:12.406 INFO:tasks.workunit.client.0.smithi066.stdout:2/446: write de/d13/d1e/d84/f8a [398227,108003] 0 2024-09-12T01:43:12.406 INFO:tasks.workunit.client.0.smithi066.stdout:2/447: dread - de/d13/f6a zero size 2024-09-12T01:43:12.406 INFO:tasks.workunit.client.0.smithi066.stdout:2/448: getdents de/d3c/d8f 0 2024-09-12T01:43:12.406 INFO:tasks.workunit.client.1.smithi153.stdout:2/761: dread d7/db/d62/f7f [0,4194304] 0 2024-09-12T01:43:12.407 INFO:tasks.workunit.client.0.smithi066.stdout:4/405: mkdir d4/d6/d8/d80 0 2024-09-12T01:43:12.407 INFO:tasks.workunit.client.0.smithi066.stdout:4/406: chown d4/d6 34923874 1 2024-09-12T01:43:12.412 INFO:tasks.workunit.client.1.smithi153.stdout:9/801: dwrite d3/f6a [4194304,4194304] 0 2024-09-12T01:43:12.413 INFO:tasks.workunit.client.1.smithi153.stdout:0/907: symlink d22/d79/l135 0 2024-09-12T01:43:12.414 INFO:tasks.workunit.client.0.smithi066.stdout:1/466: creat d5/dc/d53/f8b x:0 0 0 2024-09-12T01:43:12.416 INFO:tasks.workunit.client.1.smithi153.stdout:8/728: dread d17/d1f/d4f/d34/f47 [0,4194304] 0 2024-09-12T01:43:12.416 INFO:tasks.workunit.client.1.smithi153.stdout:1/839: creat d2/d68/d6b/d9e/dc7/f110 x:0 0 0 2024-09-12T01:43:12.418 INFO:tasks.workunit.client.1.smithi153.stdout:4/701: truncate d6/d9/d11/f6c 4098820 0 2024-09-12T01:43:12.418 INFO:tasks.workunit.client.1.smithi153.stdout:4/702: write d6/d9/fc9 [1288412,43795] 0 2024-09-12T01:43:12.421 INFO:tasks.workunit.client.0.smithi066.stdout:4/407: creat d4/d6/f81 x:0 0 0 2024-09-12T01:43:12.424 INFO:tasks.workunit.client.1.smithi153.stdout:3/857: mknod d1/d13/d23/d47/d71/d8e/d93/cfe 0 2024-09-12T01:43:12.426 INFO:tasks.workunit.client.0.smithi066.stdout:4/408: truncate d4/d6/f34 2106244 0 2024-09-12T01:43:12.426 INFO:tasks.workunit.client.1.smithi153.stdout:9/802: dread d3/f49 [0,4194304] 0 2024-09-12T01:43:12.426 INFO:tasks.workunit.client.1.smithi153.stdout:9/803: chown d3/d3a/d42/d72/f94 129415 1 2024-09-12T01:43:12.427 INFO:tasks.workunit.client.1.smithi153.stdout:0/908: truncate d22/d30/d4c/d6f/d88/f89 4179825 0 2024-09-12T01:43:12.429 INFO:tasks.workunit.client.0.smithi066.stdout:0/470: dwrite d1/d72/f4f [0,4194304] 0 2024-09-12T01:43:12.429 INFO:tasks.workunit.client.1.smithi153.stdout:1/840: symlink d2/d9/d58/d74/l111 0 2024-09-12T01:43:12.430 INFO:tasks.workunit.client.1.smithi153.stdout:1/841: chown d2/d9/d58/d74/l9b 0 1 2024-09-12T01:43:12.432 INFO:tasks.workunit.client.1.smithi153.stdout:4/703: mkdir d6/d9/dc/d31/d7d/d94/df7 0 2024-09-12T01:43:12.433 INFO:tasks.workunit.client.1.smithi153.stdout:9/804: getdents d3/d35 0 2024-09-12T01:43:12.433 INFO:tasks.workunit.client.1.smithi153.stdout:9/805: creat d3/d5f/dc4/ff3 x:0 0 0 2024-09-12T01:43:12.439 INFO:tasks.workunit.client.1.smithi153.stdout:2/762: dwrite d7/db/d27/d56/f9a [0,4194304] 0 2024-09-12T01:43:12.439 INFO:tasks.workunit.client.1.smithi153.stdout:2/763: creat d7/d17/da4/fee x:0 0 0 2024-09-12T01:43:12.439 INFO:tasks.workunit.client.1.smithi153.stdout:8/729: mkdir d17/d1f/d4f/d34/dee 0 2024-09-12T01:43:12.441 INFO:tasks.workunit.client.1.smithi153.stdout:2/764: read d7/db/d27/f7d [99199,41702] 0 2024-09-12T01:43:12.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/806: creat d3/d55/d30/d95/d84/ff4 x:0 0 0 2024-09-12T01:43:12.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/807: write d3/f51 [4335053,28055] 0 2024-09-12T01:43:12.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/808: chown d3/d5f/dbb/fda 104 1 2024-09-12T01:43:12.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/809: truncate d3/f2d 4693443 0 2024-09-12T01:43:12.443 INFO:tasks.workunit.client.0.smithi066.stdout:4/409: dread d4/f16 [4194304,4194304] 0 2024-09-12T01:43:12.444 INFO:tasks.workunit.client.1.smithi153.stdout:2/765: stat d7/d19/f79 0 2024-09-12T01:43:12.447 INFO:tasks.workunit.client.1.smithi153.stdout:9/810: mknod d3/d55/d30/d88/cf5 0 2024-09-12T01:43:12.449 INFO:tasks.workunit.client.1.smithi153.stdout:2/766: symlink d7/d19/lef 0 2024-09-12T01:43:12.456 INFO:tasks.workunit.client.1.smithi153.stdout:3/858: dwrite d1/d16/f6f [4194304,4194304] 0 2024-09-12T01:43:12.458 INFO:tasks.workunit.client.0.smithi066.stdout:0/471: dwrite d1/d62/d9f/d4a/d67/d1b/f33 [0,4194304] 0 2024-09-12T01:43:12.459 INFO:tasks.workunit.client.1.smithi153.stdout:1/842: dwrite d2/d9/d17/d2f/d56/da0/f109 [0,4194304] 0 2024-09-12T01:43:12.461 INFO:tasks.workunit.client.1.smithi153.stdout:3/859: creat d1/d13/d23/d47/d6c/fff x:0 0 0 2024-09-12T01:43:12.466 INFO:tasks.workunit.client.0.smithi066.stdout:0/472: unlink d1/d62/d9f/f6b 0 2024-09-12T01:43:12.468 INFO:tasks.workunit.client.1.smithi153.stdout:4/704: dwrite d6/d9/dc/d31/d7d/d94/fde [0,4194304] 0 2024-09-12T01:43:12.468 INFO:tasks.workunit.client.0.smithi066.stdout:4/410: dwrite d4/d6/d8/f32 [0,4194304] 0 2024-09-12T01:43:12.468 INFO:tasks.workunit.client.0.smithi066.stdout:0/473: dread d1/f9 [0,4194304] 0 2024-09-12T01:43:12.469 INFO:tasks.workunit.client.1.smithi153.stdout:1/843: dread d2/d9/d17/d2f/d56/fc9 [0,4194304] 0 2024-09-12T01:43:12.469 INFO:tasks.workunit.client.1.smithi153.stdout:3/860: link d1/d45/fde d1/d13/ddb/f100 0 2024-09-12T01:43:12.470 INFO:tasks.workunit.client.1.smithi153.stdout:1/844: dread d2/d9/d17/d69/f70 [0,4194304] 0 2024-09-12T01:43:12.471 INFO:tasks.workunit.client.0.smithi066.stdout:4/411: stat d4/d6/d27/d2f/f54 0 2024-09-12T01:43:12.473 INFO:tasks.workunit.client.1.smithi153.stdout:0/909: rename d22/d79/d8e/dae to d22/d79/dca/dec/d136 0 2024-09-12T01:43:12.473 INFO:tasks.workunit.client.1.smithi153.stdout:0/910: chown d22/d30/d4c/l51 144078256 1 2024-09-12T01:43:12.473 INFO:tasks.workunit.client.0.smithi066.stdout:0/474: mknod d1/d72/de/caa 0 2024-09-12T01:43:12.473 INFO:tasks.workunit.client.0.smithi066.stdout:0/475: write d1/d62/d6c/f5d [1295936,71628] 0 2024-09-12T01:43:12.475 INFO:tasks.workunit.client.0.smithi066.stdout:4/412: symlink d4/d6/d27/d2f/d72/l82 0 2024-09-12T01:43:12.477 INFO:tasks.workunit.client.0.smithi066.stdout:9/451: rename d0/d6/d37/d85/d89 to d0/d6/d17/d1b/da2 0 2024-09-12T01:43:12.479 INFO:tasks.workunit.client.1.smithi153.stdout:9/811: dwrite d3/d35/f8a [0,4194304] 0 2024-09-12T01:43:12.479 INFO:tasks.workunit.client.1.smithi153.stdout:2/767: dwrite d7/db/d1d/d1e/d6d/fe6 [0,4194304] 0 2024-09-12T01:43:12.480 INFO:tasks.workunit.client.1.smithi153.stdout:2/768: stat d7/d19/d83 0 2024-09-12T01:43:12.480 INFO:tasks.workunit.client.1.smithi153.stdout:2/769: chown d7/db/d7c/fe4 29787526 1 2024-09-12T01:43:12.480 INFO:tasks.workunit.client.1.smithi153.stdout:0/911: dread d22/d30/d4c/d6e/f7b [0,4194304] 0 2024-09-12T01:43:12.480 INFO:tasks.workunit.client.1.smithi153.stdout:0/912: chown d22/d79/dca/dec 6602 1 2024-09-12T01:43:12.481 INFO:tasks.workunit.client.0.smithi066.stdout:0/476: rename d1/d72/de/l55 to d1/d72/de/lab 0 2024-09-12T01:43:12.481 INFO:tasks.workunit.client.0.smithi066.stdout:0/477: write d1/d62/d9f/d4a/d67/f91 [1701005,3402] 0 2024-09-12T01:43:12.485 INFO:tasks.workunit.client.1.smithi153.stdout:9/812: dread d3/d3a/d42/f4f [0,4194304] 0 2024-09-12T01:43:12.485 INFO:tasks.workunit.client.0.smithi066.stdout:4/413: rename d4/d6/d8/f4e to d4/d6/d8/d18/d45/f83 0 2024-09-12T01:43:12.487 INFO:tasks.workunit.client.1.smithi153.stdout:3/861: creat d1/d13/d25/d26/d4b/f101 x:0 0 0 2024-09-12T01:43:12.487 INFO:tasks.workunit.client.1.smithi153.stdout:3/862: truncate d1/d13/d23/d47/d6c/fa8 996313 0 2024-09-12T01:43:12.488 INFO:tasks.workunit.client.0.smithi066.stdout:0/478: mkdir d1/d62/d89/d83/d8b/dac 0 2024-09-12T01:43:12.490 INFO:tasks.workunit.client.1.smithi153.stdout:1/845: mknod d2/d68/d6b/c112 0 2024-09-12T01:43:12.490 INFO:tasks.workunit.client.0.smithi066.stdout:9/452: rmdir d0/d6/d17/d4f/d9 39 2024-09-12T01:43:12.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/705: rename d6/d9/d11/l2c to d6/d9/dc/d98/d3e/d66/lf8 0 2024-09-12T01:43:12.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/706: write d6/d9/dc/d31/feb [665841,4580] 0 2024-09-12T01:43:12.494 INFO:tasks.workunit.client.1.smithi153.stdout:4/707: read f0 [2636341,79747] 0 2024-09-12T01:43:12.495 INFO:tasks.workunit.client.0.smithi066.stdout:4/414: mkdir d4/d84 0 2024-09-12T01:43:12.497 INFO:tasks.workunit.client.1.smithi153.stdout:9/813: write d3/d55/d30/d95/d84/d8b/fcf [2443958,60774] 0 2024-09-12T01:43:12.497 INFO:tasks.workunit.client.1.smithi153.stdout:9/814: creat d3/d55/d30/d5b/ff6 x:0 0 0 2024-09-12T01:43:12.497 INFO:tasks.workunit.client.0.smithi066.stdout:0/479: mkdir d1/d62/d6c/dad 0 2024-09-12T01:43:12.497 INFO:tasks.workunit.client.0.smithi066.stdout:1/467: dwrite d5/dc/f33 [0,4194304] 0 2024-09-12T01:43:12.499 INFO:tasks.workunit.client.1.smithi153.stdout:1/846: dread d2/d9/d17/dab/fee [0,4194304] 0 2024-09-12T01:43:12.501 INFO:tasks.workunit.client.0.smithi066.stdout:0/480: creat d1/d62/d9f/d4a/d67/d1b/d26/d9c/fae x:0 0 0 2024-09-12T01:43:12.502 INFO:tasks.workunit.client.1.smithi153.stdout:6/872: getdents d1/d6 0 2024-09-12T01:43:12.505 INFO:tasks.workunit.client.1.smithi153.stdout:2/770: symlink d7/d4d/d7b/lf0 0 2024-09-12T01:43:12.505 INFO:tasks.workunit.client.0.smithi066.stdout:9/453: write d0/f2 [4090581,75610] 0 2024-09-12T01:43:12.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/449: getdents de/d13/d1e 0 2024-09-12T01:43:12.509 INFO:tasks.workunit.client.0.smithi066.stdout:1/468: rename d5/dc/d36/d57/f85 to d5/d52/f8c 0 2024-09-12T01:43:12.511 INFO:tasks.workunit.client.1.smithi153.stdout:0/913: creat d22/d79/dca/f137 x:0 0 0 2024-09-12T01:43:12.514 INFO:tasks.workunit.client.0.smithi066.stdout:9/454: dread d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:12.515 INFO:tasks.workunit.client.1.smithi153.stdout:3/863: mkdir d1/d16/d102 0 2024-09-12T01:43:12.517 INFO:tasks.workunit.client.0.smithi066.stdout:0/481: getdents d1/d62 0 2024-09-12T01:43:12.519 INFO:tasks.workunit.client.0.smithi066.stdout:2/450: dread de/f1d [0,4194304] 0 2024-09-12T01:43:12.520 INFO:tasks.workunit.client.1.smithi153.stdout:9/815: symlink d3/d66/ddc/lf7 0 2024-09-12T01:43:12.522 INFO:tasks.workunit.client.0.smithi066.stdout:4/415: dwrite d4/d6/d8/d18/d45/f57 [0,4194304] 0 2024-09-12T01:43:12.522 INFO:tasks.workunit.client.0.smithi066.stdout:4/416: fsync d4/d6/d8/f43 0 2024-09-12T01:43:12.522 INFO:tasks.workunit.client.0.smithi066.stdout:9/455: unlink d0/d6/d43/c47 0 2024-09-12T01:43:12.522 INFO:tasks.workunit.client.0.smithi066.stdout:9/456: truncate d0/d6/d17/d1b/d4c/d42/f5d 260763 0 2024-09-12T01:43:12.523 INFO:tasks.workunit.client.0.smithi066.stdout:9/457: chown d0/d6/c99 15 1 2024-09-12T01:43:12.524 INFO:tasks.workunit.client.1.smithi153.stdout:1/847: mknod d2/d9/d17/d2f/d56/d91/c113 0 2024-09-12T01:43:12.526 INFO:tasks.workunit.client.1.smithi153.stdout:2/771: symlink d7/d4d/lf1 0 2024-09-12T01:43:12.528 INFO:tasks.workunit.client.1.smithi153.stdout:0/914: creat d22/d30/d4c/d6e/f138 x:0 0 0 2024-09-12T01:43:12.531 INFO:tasks.workunit.client.1.smithi153.stdout:3/864: getdents d1/d13/d23/d47/d71 0 2024-09-12T01:43:12.531 INFO:tasks.workunit.client.1.smithi153.stdout:3/865: chown d1/d1e/fba 270041 1 2024-09-12T01:43:12.537 INFO:tasks.workunit.client.0.smithi066.stdout:4/417: dread d4/d6/d27/d2f/f54 [0,4194304] 0 2024-09-12T01:43:12.538 INFO:tasks.workunit.client.1.smithi153.stdout:9/816: unlink d3/d5f/fd6 0 2024-09-12T01:43:12.538 INFO:tasks.workunit.client.1.smithi153.stdout:2/772: mkdir d7/db/d6c/d9f/df2 0 2024-09-12T01:43:12.538 INFO:tasks.workunit.client.1.smithi153.stdout:2/773: chown d7/db/d27/f4c 5881 1 2024-09-12T01:43:12.538 INFO:tasks.workunit.client.1.smithi153.stdout:2/774: readlink d7/d4d/lf1 0 2024-09-12T01:43:12.538 INFO:tasks.workunit.client.1.smithi153.stdout:2/775: read d7/d4d/d7b/f90 [512644,12032] 0 2024-09-12T01:43:12.542 INFO:tasks.workunit.client.0.smithi066.stdout:4/418: creat d4/d5f/f85 x:0 0 0 2024-09-12T01:43:12.542 INFO:tasks.workunit.client.1.smithi153.stdout:0/915: mknod d22/d30/d4c/d6e/d7f/c139 0 2024-09-12T01:43:12.543 INFO:tasks.workunit.client.1.smithi153.stdout:9/817: mknod d3/d3a/d42/d72/dc3/cf8 0 2024-09-12T01:43:12.544 INFO:tasks.workunit.client.1.smithi153.stdout:2/776: getdents d7/db/d6c 0 2024-09-12T01:43:12.544 INFO:tasks.workunit.client.1.smithi153.stdout:2/777: creat d7/db/d36/ff3 x:0 0 0 2024-09-12T01:43:12.546 INFO:tasks.workunit.client.0.smithi066.stdout:4/419: unlink d4/d15/d33/d5e/f6f 0 2024-09-12T01:43:12.547 INFO:tasks.workunit.client.0.smithi066.stdout:4/420: stat d4/d6/d8/l21 0 2024-09-12T01:43:12.547 INFO:tasks.workunit.client.0.smithi066.stdout:4/421: write d4/d15/d33/f5d [853542,16655] 0 2024-09-12T01:43:12.547 INFO:tasks.workunit.client.1.smithi153.stdout:0/916: truncate f3 886003 0 2024-09-12T01:43:12.547 INFO:tasks.workunit.client.1.smithi153.stdout:0/917: truncate d22/d79/dca/dec/d136/dff/d11e/f119 5105931 0 2024-09-12T01:43:12.547 INFO:tasks.workunit.client.1.smithi153.stdout:0/918: chown d22/d79/d8e/dc6/dd6/f11c 273 1 2024-09-12T01:43:12.548 INFO:tasks.workunit.client.1.smithi153.stdout:3/866: dread d1/d13/d25/da6/f5f [4194304,4194304] 0 2024-09-12T01:43:12.548 INFO:tasks.workunit.client.1.smithi153.stdout:3/867: write d1/d16/d17/f67 [410266,106900] 0 2024-09-12T01:43:12.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/384: sync 2024-09-12T01:43:12.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/385: chown d0/d26/f35 712177 1 2024-09-12T01:43:12.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/386: creat d0/dd/d18/d36/f79 x:0 0 0 2024-09-12T01:43:12.551 INFO:tasks.workunit.client.1.smithi153.stdout:9/818: creat d3/d3a/d42/d72/dc3/ff9 x:0 0 0 2024-09-12T01:43:12.551 INFO:tasks.workunit.client.1.smithi153.stdout:9/819: write d3/d55/d30/d90/fa5 [1672715,16555] 0 2024-09-12T01:43:12.551 INFO:tasks.workunit.client.1.smithi153.stdout:9/820: fdatasync d3/d55/f32 0 2024-09-12T01:43:12.551 INFO:tasks.workunit.client.1.smithi153.stdout:9/821: write d3/d55/d30/d90/fa5 [4084284,55152] 0 2024-09-12T01:43:12.551 INFO:tasks.workunit.client.0.smithi066.stdout:4/422: rename d4/f46 to d4/f86 0 2024-09-12T01:43:12.554 INFO:tasks.workunit.client.0.smithi066.stdout:3/533: sync 2024-09-12T01:43:12.554 INFO:tasks.workunit.client.0.smithi066.stdout:3/534: write d5/d6/d1b/d28/d4f/d5e/f7d [2192230,129230] 0 2024-09-12T01:43:12.554 INFO:tasks.workunit.client.0.smithi066.stdout:3/535: fdatasync d5/d6/d1b/d65/d89/f1c 0 2024-09-12T01:43:12.556 INFO:tasks.workunit.client.1.smithi153.stdout:3/868: unlink d1/d13/d25/d26/fda 0 2024-09-12T01:43:12.558 INFO:tasks.workunit.client.1.smithi153.stdout:4/708: dwrite d6/d9/d11/d13/f65 [0,4194304] 0 2024-09-12T01:43:12.561 INFO:tasks.workunit.client.1.smithi153.stdout:9/822: truncate d3/d66/f6f 356504 0 2024-09-12T01:43:12.562 INFO:tasks.workunit.client.1.smithi153.stdout:0/919: read f20 [45208,96733] 0 2024-09-12T01:43:12.562 INFO:tasks.workunit.client.1.smithi153.stdout:0/920: write d22/d79/f102 [188758,27861] 0 2024-09-12T01:43:12.562 INFO:tasks.workunit.client.1.smithi153.stdout:0/921: write d22/d79/dca/dec/d136/dff/f129 [608995,75416] 0 2024-09-12T01:43:12.563 INFO:tasks.workunit.client.1.smithi153.stdout:3/869: rmdir d1/d16/d102 0 2024-09-12T01:43:12.568 INFO:tasks.workunit.client.0.smithi066.stdout:5/387: write d0/d26/f35 [522170,56306] 0 2024-09-12T01:43:12.569 INFO:tasks.workunit.client.0.smithi066.stdout:5/388: stat d0/d26/c37 0 2024-09-12T01:43:12.575 INFO:tasks.workunit.client.1.smithi153.stdout:3/870: mkdir d1/d13/d23/d47/d71/d8e/d93/dd1/d103 0 2024-09-12T01:43:12.575 INFO:tasks.workunit.client.1.smithi153.stdout:3/871: stat d1/d45/fdf 0 2024-09-12T01:43:12.577 INFO:tasks.workunit.client.1.smithi153.stdout:4/709: dread d6/d15/db4/ff0 [0,4194304] 0 2024-09-12T01:43:12.577 INFO:tasks.workunit.client.1.smithi153.stdout:4/710: write d6/d9/dc/ff1 [607465,84669] 0 2024-09-12T01:43:12.578 INFO:tasks.workunit.client.1.smithi153.stdout:3/872: rename d1/d45/dc2/fc8 to d1/d13/d23/d47/d6c/f104 0 2024-09-12T01:43:12.578 INFO:tasks.workunit.client.1.smithi153.stdout:0/922: write d22/d30/d4c/d6e/f48 [3033457,18665] 0 2024-09-12T01:43:12.578 INFO:tasks.workunit.client.1.smithi153.stdout:0/923: write d22/d30/d4c/d6f/f99 [728060,123277] 0 2024-09-12T01:43:12.579 INFO:tasks.workunit.client.1.smithi153.stdout:4/711: getdents d6/d15/db4/dbd/dec 0 2024-09-12T01:43:12.580 INFO:tasks.workunit.client.1.smithi153.stdout:5/817: sync 2024-09-12T01:43:12.580 INFO:tasks.workunit.client.1.smithi153.stdout:7/759: sync 2024-09-12T01:43:12.580 INFO:tasks.workunit.client.1.smithi153.stdout:7/760: chown d12/d21/d29/d35/d37/d58/l9d 184872434 1 2024-09-12T01:43:12.580 INFO:tasks.workunit.client.1.smithi153.stdout:7/761: creat d12/d21/d29/d35/d37/d4c/d8e/fee x:0 0 0 2024-09-12T01:43:12.580 INFO:tasks.workunit.client.1.smithi153.stdout:7/762: creat d12/d21/d29/d2d/d8b/fef x:0 0 0 2024-09-12T01:43:12.580 INFO:tasks.workunit.client.1.smithi153.stdout:7/763: stat d12/d7e/f72 0 2024-09-12T01:43:12.581 INFO:tasks.workunit.client.1.smithi153.stdout:3/873: symlink d1/d16/d17/l105 0 2024-09-12T01:43:12.581 INFO:tasks.workunit.client.0.smithi066.stdout:1/469: dwrite d5/dc/d53/f5a [0,4194304] 0 2024-09-12T01:43:12.581 INFO:tasks.workunit.client.0.smithi066.stdout:4/423: dwrite d4/d6/f30 [0,4194304] 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.0.smithi066.stdout:9/458: dwrite d0/d6/d17/d4f/d12/f27 [0,4194304] 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.0.smithi066.stdout:9/459: fsync d0/d6/f69 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.0.smithi066.stdout:9/460: fsync d0/d6/d17/f71 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.0.smithi066.stdout:0/482: dwrite d1/d72/de/f3c [0,4194304] 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.1.smithi153.stdout:1/848: dwrite d2/d34/d3d/d80/fea [0,4194304] 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.1.smithi153.stdout:0/924: symlink d22/d79/dca/dec/d136/db7/l13a 0 2024-09-12T01:43:12.585 INFO:tasks.workunit.client.1.smithi153.stdout:2/778: dwrite d7/d17/da4/fd9 [0,4194304] 0 2024-09-12T01:43:12.586 INFO:tasks.workunit.client.1.smithi153.stdout:9/823: rmdir d3/d55/d30/d88 39 2024-09-12T01:43:12.587 INFO:tasks.workunit.client.0.smithi066.stdout:1/470: mknod d5/dc/d53/c8d 0 2024-09-12T01:43:12.593 INFO:tasks.workunit.client.0.smithi066.stdout:3/536: dread d5/d6/d1b/f3f [0,4194304] 0 2024-09-12T01:43:12.593 INFO:tasks.workunit.client.1.smithi153.stdout:5/818: dread d0/df/db8/d2f/d55/fd5 [0,4194304] 0 2024-09-12T01:43:12.593 INFO:tasks.workunit.client.1.smithi153.stdout:5/819: chown d0/df/d102/fec 55059799 1 2024-09-12T01:43:12.593 INFO:tasks.workunit.client.1.smithi153.stdout:5/820: readlink d0/d20/dc0/ld6 0 2024-09-12T01:43:12.593 INFO:tasks.workunit.client.1.smithi153.stdout:5/821: fsync d0/df/db8/d2f/f87 0 2024-09-12T01:43:12.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/389: dread d0/dd/d18/d36/d4c/f61 [0,4194304] 0 2024-09-12T01:43:12.594 INFO:tasks.workunit.client.0.smithi066.stdout:5/390: stat d0/d26/f2e 0 2024-09-12T01:43:12.595 INFO:tasks.workunit.client.0.smithi066.stdout:9/461: symlink d0/d6/d17/d4f/d12/d84/la3 0 2024-09-12T01:43:12.595 INFO:tasks.workunit.client.0.smithi066.stdout:9/462: chown d0/d6/d17/d4f/d12/d46/d68/f70 297 1 2024-09-12T01:43:12.597 INFO:tasks.workunit.client.1.smithi153.stdout:6/873: dwrite d1/df/d9d/fe3 [0,4194304] 0 2024-09-12T01:43:12.598 INFO:tasks.workunit.client.0.smithi066.stdout:0/483: write d1/d72/de/f4b [770092,22089] 0 2024-09-12T01:43:12.598 INFO:tasks.workunit.client.1.smithi153.stdout:7/764: write d12/d21/d29/d2d/da6/fcf [277903,2262] 0 2024-09-12T01:43:12.599 INFO:tasks.workunit.client.1.smithi153.stdout:3/874: rename d1/d13/d25/l63 to d1/d13/d23/d47/d6c/l106 0 2024-09-12T01:43:12.600 INFO:tasks.workunit.client.0.smithi066.stdout:5/391: write d0/d26/d2d/f49 [3954288,63888] 0 2024-09-12T01:43:12.602 INFO:tasks.workunit.client.1.smithi153.stdout:9/824: dread d3/d55/d30/d88/fab [0,4194304] 0 2024-09-12T01:43:12.606 INFO:tasks.workunit.client.1.smithi153.stdout:9/825: read d3/d3a/d42/d72/f96 [64386,82320] 0 2024-09-12T01:43:12.609 INFO:tasks.workunit.client.0.smithi066.stdout:3/537: mkdir d5/d6/d1b/d45/d66/d67/d75/d8e/db4 0 2024-09-12T01:43:12.610 INFO:tasks.workunit.client.0.smithi066.stdout:3/538: read - d5/d6/d1b/d45/d66/d67/d7f/da8/faf zero size 2024-09-12T01:43:12.610 INFO:tasks.workunit.client.1.smithi153.stdout:4/712: getdents d6/d9/d11/d90/db7 0 2024-09-12T01:43:12.610 INFO:tasks.workunit.client.1.smithi153.stdout:4/713: fsync d6/d15/fc3 0 2024-09-12T01:43:12.613 INFO:tasks.workunit.client.0.smithi066.stdout:9/463: link d0/d6/d17/d1b/d4c/d42/f5e d0/d6/d43/fa4 0 2024-09-12T01:43:12.614 INFO:tasks.workunit.client.1.smithi153.stdout:5/822: unlink d0/fd 0 2024-09-12T01:43:12.614 INFO:tasks.workunit.client.1.smithi153.stdout:5/823: chown d0/d43/dac 119 1 2024-09-12T01:43:12.614 INFO:tasks.workunit.client.1.smithi153.stdout:5/824: write d0/d15/f53 [757127,31284] 0 2024-09-12T01:43:12.616 INFO:tasks.workunit.client.0.smithi066.stdout:0/484: symlink d1/d62/d9f/d4a/d67/d1b/d3b/laf 0 2024-09-12T01:43:12.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/424: dwrite d4/f52 [0,4194304] 0 2024-09-12T01:43:12.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/425: creat d4/d6/d27/d2f/f87 x:0 0 0 2024-09-12T01:43:12.627 INFO:tasks.workunit.client.0.smithi066.stdout:9/464: creat d0/d6/d17/d1b/d4c/d42/fa5 x:0 0 0 2024-09-12T01:43:12.630 INFO:tasks.workunit.client.1.smithi153.stdout:2/779: dwrite d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:12.631 INFO:tasks.workunit.client.1.smithi153.stdout:2/780: fsync d7/db/d62/d87/dc9/fdf 0 2024-09-12T01:43:12.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/392: dwrite d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:12.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/393: stat d0/d26/d2d/c76 0 2024-09-12T01:43:12.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/394: stat d0/dd 0 2024-09-12T01:43:12.636 INFO:tasks.workunit.client.0.smithi066.stdout:9/465: mknod d0/d6/d17/d4f/d12/d46/ca6 0 2024-09-12T01:43:12.637 INFO:tasks.workunit.client.1.smithi153.stdout:9/826: creat d3/d66/ddc/ffa x:0 0 0 2024-09-12T01:43:12.637 INFO:tasks.workunit.client.1.smithi153.stdout:5/825: write d0/f32 [2116580,65678] 0 2024-09-12T01:43:12.637 INFO:tasks.workunit.client.1.smithi153.stdout:5/826: chown d0/df/db8/d2f/ff7 1 1 2024-09-12T01:43:12.638 INFO:tasks.workunit.client.1.smithi153.stdout:4/714: mkdir d6/d6a/df9 0 2024-09-12T01:43:12.638 INFO:tasks.workunit.client.1.smithi153.stdout:0/925: dwrite d22/d79/dca/dec/d136/db7/fc9 [0,4194304] 0 2024-09-12T01:43:12.639 INFO:tasks.workunit.client.0.smithi066.stdout:3/539: dwrite d5/d6/d48/fab [0,4194304] 0 2024-09-12T01:43:12.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/875: rmdir d1/d64/db0 39 2024-09-12T01:43:12.643 INFO:tasks.workunit.client.1.smithi153.stdout:7/765: dwrite d12/d21/d5f/f8c [0,4194304] 0 2024-09-12T01:43:12.643 INFO:tasks.workunit.client.0.smithi066.stdout:5/395: mknod d0/d26/d2d/c7a 0 2024-09-12T01:43:12.647 INFO:tasks.workunit.client.1.smithi153.stdout:2/781: mkdir d7/db/d6c/d76/df4 0 2024-09-12T01:43:12.648 INFO:tasks.workunit.client.1.smithi153.stdout:3/876: dread d1/d13/d25/da6/f7e [0,4194304] 0 2024-09-12T01:43:12.650 INFO:tasks.workunit.client.1.smithi153.stdout:9/827: dread d3/d5f/d62/f64 [0,4194304] 0 2024-09-12T01:43:12.650 INFO:tasks.workunit.client.1.smithi153.stdout:5/827: rename d0/df/db8/f38 to d0/df/db8/d2f/d55/d9c/d75/d58/d71/de9/f105 0 2024-09-12T01:43:12.653 INFO:tasks.workunit.client.1.smithi153.stdout:4/715: rmdir d6/d15/db4/dbd/dec 39 2024-09-12T01:43:12.653 INFO:tasks.workunit.client.1.smithi153.stdout:4/716: write d6/d9/d11/d90/f95 [362616,85369] 0 2024-09-12T01:43:12.660 INFO:tasks.workunit.client.1.smithi153.stdout:6/874: dwrite d1/d6/d23/fb5 [4194304,4194304] 0 2024-09-12T01:43:12.661 INFO:tasks.workunit.client.0.smithi066.stdout:0/485: dwrite d1/d62/d9f/d4a/d67/d20/f21 [0,4194304] 0 2024-09-12T01:43:12.661 INFO:tasks.workunit.client.0.smithi066.stdout:4/426: rename d4/d6/d48/d5a to d4/d6/d48/d88 0 2024-09-12T01:43:12.664 INFO:tasks.workunit.client.0.smithi066.stdout:9/466: link d0/d6/d17/d4f/l26 d0/d6/d17/d28/d79/la7 0 2024-09-12T01:43:12.665 INFO:tasks.workunit.client.0.smithi066.stdout:3/540: rmdir d5/d6/d1b/d45/d66/d67/d6d 39 2024-09-12T01:43:12.667 INFO:tasks.workunit.client.0.smithi066.stdout:5/396: dread d0/dd/d18/d36/f5c [0,4194304] 0 2024-09-12T01:43:12.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/467: dread d0/d6/d17/d4f/d12/f1f [0,4194304] 0 2024-09-12T01:43:12.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/468: chown d0/f3c 1876912 1 2024-09-12T01:43:12.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/469: read - d0/d6/d17/d1b/d4c/d4b/f94 zero size 2024-09-12T01:43:12.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/470: chown d0/d6/d17/d4f/d12/f87 0 1 2024-09-12T01:43:12.672 INFO:tasks.workunit.client.1.smithi153.stdout:3/877: dwrite d1/d13/d23/f2b [0,4194304] 0 2024-09-12T01:43:12.675 INFO:tasks.workunit.client.0.smithi066.stdout:3/541: creat d5/d6/d1b/d28/fb5 x:0 0 0 2024-09-12T01:43:12.675 INFO:tasks.workunit.client.0.smithi066.stdout:3/542: write d5/d6/d1b/d28/d4f/d5e/f4e [1119029,60559] 0 2024-09-12T01:43:12.676 INFO:tasks.workunit.client.0.smithi066.stdout:4/427: dread d4/d6/d48/d88/f6b [0,4194304] 0 2024-09-12T01:43:12.676 INFO:tasks.workunit.client.1.smithi153.stdout:7/766: symlink d12/d21/d29/d2d/d8b/lf0 0 2024-09-12T01:43:12.677 INFO:tasks.workunit.client.1.smithi153.stdout:0/926: write f3 [34488,101789] 0 2024-09-12T01:43:12.677 INFO:tasks.workunit.client.1.smithi153.stdout:4/717: dwrite d6/d9/fc9 [0,4194304] 0 2024-09-12T01:43:12.678 INFO:tasks.workunit.client.0.smithi066.stdout:5/397: rename d0/dd/d18/f64 to d0/d26/d2d/d42/f7b 0 2024-09-12T01:43:12.683 INFO:tasks.workunit.client.1.smithi153.stdout:9/828: link d3/d5f/d62/f64 d3/d3a/d42/d72/dce/ffb 0 2024-09-12T01:43:12.685 INFO:tasks.workunit.client.1.smithi153.stdout:5/828: rmdir d0/d43/d68 39 2024-09-12T01:43:12.687 INFO:tasks.workunit.client.1.smithi153.stdout:6/875: creat d1/d80/f119 x:0 0 0 2024-09-12T01:43:12.688 INFO:tasks.workunit.client.0.smithi066.stdout:9/471: unlink d0/d6/d43/f8b 0 2024-09-12T01:43:12.689 INFO:tasks.workunit.client.1.smithi153.stdout:3/878: mkdir d1/d13/d23/d47/d6c/d9c/d107 0 2024-09-12T01:43:12.689 INFO:tasks.workunit.client.1.smithi153.stdout:3/879: dread - d1/d59/de4/ff1 zero size 2024-09-12T01:43:12.689 INFO:tasks.workunit.client.1.smithi153.stdout:8/730: sync 2024-09-12T01:43:12.690 INFO:tasks.workunit.client.0.smithi066.stdout:4/428: symlink d4/d6/d8/d80/l89 0 2024-09-12T01:43:12.691 INFO:tasks.workunit.client.1.smithi153.stdout:7/767: mknod d12/d7e/cf1 0 2024-09-12T01:43:12.693 INFO:tasks.workunit.client.1.smithi153.stdout:0/927: rmdir d22/d79/dca/dec/d136/dff 39 2024-09-12T01:43:12.697 INFO:tasks.workunit.client.0.smithi066.stdout:5/398: rename d0/dd/fe to d0/dd/d18/f7c 0 2024-09-12T01:43:12.707 INFO:tasks.workunit.client.1.smithi153.stdout:8/731: dread d17/d21/faf [0,4194304] 0 2024-09-12T01:43:12.708 INFO:tasks.workunit.client.1.smithi153.stdout:4/718: dwrite d6/d9/d11/d90/fda [4194304,4194304] 0 2024-09-12T01:43:12.708 INFO:tasks.workunit.client.1.smithi153.stdout:4/719: chown d6/d9/dc/d31/d7d/c86 1801191 1 2024-09-12T01:43:12.708 INFO:tasks.workunit.client.1.smithi153.stdout:4/720: chown d6/d9/cb 3 1 2024-09-12T01:43:12.708 INFO:tasks.workunit.client.1.smithi153.stdout:9/829: link d3/c93 d3/d55/d30/d88/cfc 0 2024-09-12T01:43:12.710 INFO:tasks.workunit.client.1.smithi153.stdout:5/829: mknod d0/d43/d68/c106 0 2024-09-12T01:43:12.710 INFO:tasks.workunit.client.1.smithi153.stdout:5/830: getdents d0/d20/dc0/d101 0 2024-09-12T01:43:12.710 INFO:tasks.workunit.client.1.smithi153.stdout:5/831: chown d0/d15 198464012 1 2024-09-12T01:43:12.712 INFO:tasks.workunit.client.1.smithi153.stdout:6/876: creat d1/d6/d23/d98/d53/f11a x:0 0 0 2024-09-12T01:43:12.713 INFO:tasks.workunit.client.0.smithi066.stdout:3/543: dwrite d5/d6/d1b/d28/f2b [0,4194304] 0 2024-09-12T01:43:12.713 INFO:tasks.workunit.client.0.smithi066.stdout:3/544: creat d5/d35/fb6 x:0 0 0 2024-09-12T01:43:12.713 INFO:tasks.workunit.client.0.smithi066.stdout:9/472: dwrite d0/d6/f50 [0,4194304] 0 2024-09-12T01:43:12.714 INFO:tasks.workunit.client.1.smithi153.stdout:3/880: symlink d1/d13/d25/da6/l108 0 2024-09-12T01:43:12.714 INFO:tasks.workunit.client.1.smithi153.stdout:3/881: chown d1/d13/d23/d47/d71/fbb 465709673 1 2024-09-12T01:43:12.715 INFO:tasks.workunit.client.0.smithi066.stdout:5/399: unlink d0/d26/d2d/c7a 0 2024-09-12T01:43:12.716 INFO:tasks.workunit.client.1.smithi153.stdout:7/768: mknod d12/d21/d4d/dae/cf2 0 2024-09-12T01:43:12.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/928: link d22/d30/d4c/d6e/l45 d22/d79/dca/dec/d136/dff/d11e/d12f/l13b 0 2024-09-12T01:43:12.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/929: chown d22/d79/la7 58442015 1 2024-09-12T01:43:12.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/930: chown d22/d30/d4c/f131 14 1 2024-09-12T01:43:12.718 INFO:tasks.workunit.client.1.smithi153.stdout:0/931: chown d22/d30/d4c/d6f/d88/faa 2 1 2024-09-12T01:43:12.719 INFO:tasks.workunit.client.1.smithi153.stdout:0/932: chown d22/d30/l71 14 1 2024-09-12T01:43:12.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/486: rmdir d1/d62/d9f 39 2024-09-12T01:43:12.720 INFO:tasks.workunit.client.0.smithi066.stdout:3/545: creat d5/d6/d1b/d45/d66/d67/d75/fb7 x:0 0 0 2024-09-12T01:43:12.721 INFO:tasks.workunit.client.1.smithi153.stdout:3/882: dread d1/d16/d1c/f33 [0,4194304] 0 2024-09-12T01:43:12.722 INFO:tasks.workunit.client.0.smithi066.stdout:9/473: creat d0/d6/d37/d85/fa8 x:0 0 0 2024-09-12T01:43:12.724 INFO:tasks.workunit.client.1.smithi153.stdout:7/769: dread d12/d21/d29/d35/d37/d58/f98 [0,4194304] 0 2024-09-12T01:43:12.726 INFO:tasks.workunit.client.0.smithi066.stdout:0/487: symlink d1/d62/d9f/d4a/d67/d3e/lb0 0 2024-09-12T01:43:12.726 INFO:tasks.workunit.client.0.smithi066.stdout:0/488: write d1/d62/d89/f9b [840250,66758] 0 2024-09-12T01:43:12.726 INFO:tasks.workunit.client.0.smithi066.stdout:0/489: write d1/d62/d9f/d4a/d67/d1b/d61/f7f [176222,85028] 0 2024-09-12T01:43:12.727 INFO:tasks.workunit.client.1.smithi153.stdout:5/832: symlink d0/df/d83/d36/d39/da4/l107 0 2024-09-12T01:43:12.728 INFO:tasks.workunit.client.0.smithi066.stdout:9/474: symlink d0/d6/d17/d1b/da2/la9 0 2024-09-12T01:43:12.730 INFO:tasks.workunit.client.1.smithi153.stdout:6/877: creat d1/d6/da/d19/d94/f11b x:0 0 0 2024-09-12T01:43:12.730 INFO:tasks.workunit.client.0.smithi066.stdout:5/400: truncate d0/d26/d2d/f49 4111267 0 2024-09-12T01:43:12.734 INFO:tasks.workunit.client.0.smithi066.stdout:0/490: mknod d1/d62/d89/d83/d8b/dac/cb1 0 2024-09-12T01:43:12.734 INFO:tasks.workunit.client.0.smithi066.stdout:0/491: chown d1/d62/d9f/d4a/d67/d20/d5e/fa7 42246 1 2024-09-12T01:43:12.735 INFO:tasks.workunit.client.1.smithi153.stdout:6/878: read d1/d6/da/d19/d34/f61 [118928,21173] 0 2024-09-12T01:43:12.735 INFO:tasks.workunit.client.1.smithi153.stdout:0/933: symlink d22/d79/dca/ded/l13c 0 2024-09-12T01:43:12.736 INFO:tasks.workunit.client.1.smithi153.stdout:0/934: fsync d22/d82/fa4 0 2024-09-12T01:43:12.736 INFO:tasks.workunit.client.0.smithi066.stdout:3/546: dwrite d5/d6/d1b/d45/d66/d67/d6d/fa1 [4194304,4194304] 0 2024-09-12T01:43:12.736 INFO:tasks.workunit.client.0.smithi066.stdout:3/547: creat d5/d6/d1b/d28/fb8 x:0 0 0 2024-09-12T01:43:12.737 INFO:tasks.workunit.client.0.smithi066.stdout:9/475: dread d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:12.738 INFO:tasks.workunit.client.0.smithi066.stdout:5/401: rename d0/d26/c37 to d0/dd/d18/d36/d4c/c7d 0 2024-09-12T01:43:12.738 INFO:tasks.workunit.client.0.smithi066.stdout:5/402: write d0/dd/d18/f3d [1700945,34070] 0 2024-09-12T01:43:12.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/721: getdents d6/d9/dc 0 2024-09-12T01:43:12.740 INFO:tasks.workunit.client.1.smithi153.stdout:5/833: dread d0/df/db8/d2f/d55/d9c/d75/d58/d71/fd1 [0,4194304] 0 2024-09-12T01:43:12.741 INFO:tasks.workunit.client.1.smithi153.stdout:0/935: dread d22/d30/d4c/d6e/d7f/d98/fc1 [0,4194304] 0 2024-09-12T01:43:12.742 INFO:tasks.workunit.client.1.smithi153.stdout:7/770: mknod d12/d21/d4d/dae/cf3 0 2024-09-12T01:43:12.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/830: getdents d3/d3a/da6 0 2024-09-12T01:43:12.743 INFO:tasks.workunit.client.1.smithi153.stdout:9/831: write d3/d55/d30/d95/d84/d8b/fcf [528595,68426] 0 2024-09-12T01:43:12.744 INFO:tasks.workunit.client.1.smithi153.stdout:9/832: write d3/d66/d80/fec [376479,11483] 0 2024-09-12T01:43:12.745 INFO:tasks.workunit.client.1.smithi153.stdout:6/879: mknod d1/d6/d39/c11c 0 2024-09-12T01:43:12.745 INFO:tasks.workunit.client.0.smithi066.stdout:0/492: rename d1/d62/d89/f76 to d1/d62/d9f/d92/d95/fb2 0 2024-09-12T01:43:12.747 INFO:tasks.workunit.client.1.smithi153.stdout:4/722: creat d6/d9/d20/ffa x:0 0 0 2024-09-12T01:43:12.748 INFO:tasks.workunit.client.1.smithi153.stdout:4/723: getdents d6/d9/d11/d90/db7 0 2024-09-12T01:43:12.749 INFO:tasks.workunit.client.1.smithi153.stdout:7/771: dread d12/d21/d29/d35/d95/fcd [0,4194304] 0 2024-09-12T01:43:12.749 INFO:tasks.workunit.client.1.smithi153.stdout:7/772: chown d12/d7e/f82 4892071 1 2024-09-12T01:43:12.750 INFO:tasks.workunit.client.0.smithi066.stdout:5/403: mknod d0/c7e 0 2024-09-12T01:43:12.751 INFO:tasks.workunit.client.1.smithi153.stdout:9/833: mknod d3/d5f/dc4/cfd 0 2024-09-12T01:43:12.751 INFO:tasks.workunit.client.1.smithi153.stdout:9/834: fdatasync d3/d55/f6b 0 2024-09-12T01:43:12.752 INFO:tasks.workunit.client.0.smithi066.stdout:3/548: mknod d5/cb9 0 2024-09-12T01:43:12.752 INFO:tasks.workunit.client.0.smithi066.stdout:3/549: write d5/d35/f8f [680995,118760] 0 2024-09-12T01:43:12.752 INFO:tasks.workunit.client.0.smithi066.stdout:3/550: creat d5/d6/d1b/d28/d4f/d9b/fba x:0 0 0 2024-09-12T01:43:12.753 INFO:tasks.workunit.client.1.smithi153.stdout:7/773: fsync d12/d21/d29/d35/f6e 0 2024-09-12T01:43:12.756 INFO:tasks.workunit.client.1.smithi153.stdout:7/774: mknod d12/d21/d4d/cf4 0 2024-09-12T01:43:12.756 INFO:tasks.workunit.client.1.smithi153.stdout:7/775: fdatasync d12/d21/d29/d35/d37/d4c/d5c/f70 0 2024-09-12T01:43:12.756 INFO:tasks.workunit.client.0.smithi066.stdout:5/404: mknod d0/d26/d2f/d3b/c7f 0 2024-09-12T01:43:12.761 INFO:tasks.workunit.client.1.smithi153.stdout:9/835: write d3/d3a/d42/faf [313647,18080] 0 2024-09-12T01:43:12.763 INFO:tasks.workunit.client.1.smithi153.stdout:4/724: write d6/d9/dc/d98/f3f [7410181,59678] 0 2024-09-12T01:43:12.776 INFO:tasks.workunit.client.1.smithi153.stdout:9/836: dread d3/d3a/f7a [0,4194304] 0 2024-09-12T01:43:12.777 INFO:tasks.workunit.client.0.smithi066.stdout:9/476: dwrite d0/d6/d17/d1b/d4c/f2a [0,4194304] 0 2024-09-12T01:43:12.779 INFO:tasks.workunit.client.1.smithi153.stdout:6/880: write d1/d6/d23/d98/d53/d69/d7c/d7f/f9b [3761657,109421] 0 2024-09-12T01:43:12.779 INFO:tasks.workunit.client.1.smithi153.stdout:6/881: write d1/fff [542264,96970] 0 2024-09-12T01:43:12.779 INFO:tasks.workunit.client.1.smithi153.stdout:5/834: dwrite d0/df/db8/d6e/fd4 [0,4194304] 0 2024-09-12T01:43:12.780 INFO:tasks.workunit.client.1.smithi153.stdout:0/936: dwrite d22/d30/d4c/d6f/d88/faa [0,4194304] 0 2024-09-12T01:43:12.785 INFO:tasks.workunit.client.1.smithi153.stdout:5/835: dread d0/df/db8/d2f/d55/d9c/d75/d58/d71/fbd [0,4194304] 0 2024-09-12T01:43:12.789 INFO:tasks.workunit.client.1.smithi153.stdout:5/836: dread d0/df/d102/fd2 [0,4194304] 0 2024-09-12T01:43:12.789 INFO:tasks.workunit.client.1.smithi153.stdout:5/837: chown d0/df/db8/d2f/d55/d9c/d75/d58/d70/c57 0 1 2024-09-12T01:43:12.789 INFO:tasks.workunit.client.1.smithi153.stdout:5/838: chown d0/ce6 59071628 1 2024-09-12T01:43:12.789 INFO:tasks.workunit.client.1.smithi153.stdout:5/839: write d0/df/db8/d2f/d55/d9c/d75/f6a [20561,78129] 0 2024-09-12T01:43:12.794 INFO:tasks.workunit.client.1.smithi153.stdout:6/882: dwrite d1/d6/d23/d98/d4f/feb [0,4194304] 0 2024-09-12T01:43:12.805 INFO:tasks.workunit.client.1.smithi153.stdout:7/776: truncate d12/d21/d29/d35/d37/f97 2745361 0 2024-09-12T01:43:12.806 INFO:tasks.workunit.client.0.smithi066.stdout:3/551: mknod d5/d6/d1b/d77/d8b/cbb 0 2024-09-12T01:43:12.808 INFO:tasks.workunit.client.0.smithi066.stdout:5/405: link d0/f20 d0/d26/d2d/d42/f80 0 2024-09-12T01:43:12.808 INFO:tasks.workunit.client.0.smithi066.stdout:5/406: chown d0/d26/d2d/d33/f4f 461264 1 2024-09-12T01:43:12.808 INFO:tasks.workunit.client.0.smithi066.stdout:5/407: chown d0/dd/d18/d36/l63 84068 1 2024-09-12T01:43:12.811 INFO:tasks.workunit.client.1.smithi153.stdout:4/725: creat d6/d9/d11/ffb x:0 0 0 2024-09-12T01:43:12.812 INFO:tasks.workunit.client.0.smithi066.stdout:4/429: rmdir d4/d6 39 2024-09-12T01:43:12.812 INFO:tasks.workunit.client.0.smithi066.stdout:4/430: readlink d4/d15/l20 0 2024-09-12T01:43:12.812 INFO:tasks.workunit.client.1.smithi153.stdout:9/837: creat d3/d66/ffe x:0 0 0 2024-09-12T01:43:12.817 INFO:tasks.workunit.client.0.smithi066.stdout:4/431: read d4/d15/f7d [5298279,121653] 0 2024-09-12T01:43:12.817 INFO:tasks.workunit.client.0.smithi066.stdout:4/432: write d4/f17 [8154634,38910] 0 2024-09-12T01:43:12.830 INFO:tasks.workunit.client.1.smithi153.stdout:5/840: getdents d0/df/db8/d2f/d55 0 2024-09-12T01:43:12.830 INFO:tasks.workunit.client.0.smithi066.stdout:4/433: dwrite d4/d15/f38 [0,4194304] 0 2024-09-12T01:43:12.835 INFO:tasks.workunit.client.1.smithi153.stdout:6/883: rename d1/d6/d23/d98/d53/f97 to d1/df/d9d/f11d 0 2024-09-12T01:43:12.835 INFO:tasks.workunit.client.1.smithi153.stdout:6/884: stat d1/d6/d46/ca2 0 2024-09-12T01:43:12.837 INFO:tasks.workunit.client.1.smithi153.stdout:7/777: creat d12/d21/d5f/ff5 x:0 0 0 2024-09-12T01:43:12.838 INFO:tasks.workunit.client.0.smithi066.stdout:3/552: chown d5/d6/d1b/d28/d4f/d5e/l87 56945699 1 2024-09-12T01:43:12.840 INFO:tasks.workunit.client.1.smithi153.stdout:4/726: creat d6/d9/dc/d31/d7d/d94/df7/ffc x:0 0 0 2024-09-12T01:43:12.841 INFO:tasks.workunit.client.0.smithi066.stdout:5/408: getdents d0/d26/d2d/d31/d77 0 2024-09-12T01:43:12.842 INFO:tasks.workunit.client.1.smithi153.stdout:4/727: dread d6/d9/dc/d31/d7d/d94/f97 [0,4194304] 0 2024-09-12T01:43:12.844 INFO:tasks.workunit.client.1.smithi153.stdout:9/838: unlink d3/d66/ddc/lf7 0 2024-09-12T01:43:12.848 INFO:tasks.workunit.client.1.smithi153.stdout:5/841: rename d0/d43/d8d/d8e/cb6 to d0/d15/c108 0 2024-09-12T01:43:12.849 INFO:tasks.workunit.client.1.smithi153.stdout:5/842: dread d0/d43/d68/dcc/fe4 [0,4194304] 0 2024-09-12T01:43:12.850 INFO:tasks.workunit.client.0.smithi066.stdout:0/493: fsync d1/d62/d9f/d92/d95/fb2 0 2024-09-12T01:43:12.851 INFO:tasks.workunit.client.0.smithi066.stdout:4/434: mknod d4/d6/d27/d2f/c8a 0 2024-09-12T01:43:12.852 INFO:tasks.workunit.client.0.smithi066.stdout:4/435: fsync d4/f86 0 2024-09-12T01:43:12.853 INFO:tasks.workunit.client.1.smithi153.stdout:7/778: mknod d12/d4e/cf6 0 2024-09-12T01:43:12.854 INFO:tasks.workunit.client.0.smithi066.stdout:3/553: mknod d5/d6/d1b/d45/d66/d67/d75/d8e/cbc 0 2024-09-12T01:43:12.854 INFO:tasks.workunit.client.0.smithi066.stdout:3/554: fdatasync f4 0 2024-09-12T01:43:12.855 INFO:tasks.workunit.client.0.smithi066.stdout:3/555: chown d5/d6/d1b/d77/f7c 675563194 1 2024-09-12T01:43:12.856 INFO:tasks.workunit.client.1.smithi153.stdout:4/728: unlink d6/d9/d20/l55 0 2024-09-12T01:43:12.856 INFO:tasks.workunit.client.1.smithi153.stdout:4/729: write d6/d15/fc3 [437686,16285] 0 2024-09-12T01:43:12.857 INFO:tasks.workunit.client.0.smithi066.stdout:5/409: mknod d0/d26/d2d/d42/c81 0 2024-09-12T01:43:12.859 INFO:tasks.workunit.client.1.smithi153.stdout:9/839: rmdir d3/d55/d30/d7b/de4 0 2024-09-12T01:43:12.861 INFO:tasks.workunit.client.0.smithi066.stdout:0/494: rename d1/d72/de/caa to d1/cb3 0 2024-09-12T01:43:12.862 INFO:tasks.workunit.client.0.smithi066.stdout:3/556: read f4 [2077511,100140] 0 2024-09-12T01:43:12.865 INFO:tasks.workunit.client.0.smithi066.stdout:4/436: rename d4/f17 to d4/d6/d48/f8b 0 2024-09-12T01:43:12.866 INFO:tasks.workunit.client.1.smithi153.stdout:5/843: rmdir d0/df/db8 39 2024-09-12T01:43:12.868 INFO:tasks.workunit.client.0.smithi066.stdout:0/495: truncate d1/d72/de/f19 2213956 0 2024-09-12T01:43:12.868 INFO:tasks.workunit.client.0.smithi066.stdout:0/496: fsync d1/d62/d9f/d4a/d67/d6e/d80/f58 0 2024-09-12T01:43:12.869 INFO:tasks.workunit.client.1.smithi153.stdout:6/885: mknod d1/d6/d23/c11e 0 2024-09-12T01:43:12.870 INFO:tasks.workunit.client.0.smithi066.stdout:3/557: mkdir d5/d6/d1b/d28/d4f/d9b/dbd 0 2024-09-12T01:43:12.871 INFO:tasks.workunit.client.1.smithi153.stdout:7/779: creat d12/d21/d29/ff7 x:0 0 0 2024-09-12T01:43:12.871 INFO:tasks.workunit.client.1.smithi153.stdout:7/780: creat d12/d21/d29/ff8 x:0 0 0 2024-09-12T01:43:12.871 INFO:tasks.workunit.client.1.smithi153.stdout:7/781: creat d12/d21/d29/d35/dcb/de9/ff9 x:0 0 0 2024-09-12T01:43:12.871 INFO:tasks.workunit.client.1.smithi153.stdout:7/782: chown d12/c1e 29773910 1 2024-09-12T01:43:12.872 INFO:tasks.workunit.client.1.smithi153.stdout:4/730: getdents d6/d6a 0 2024-09-12T01:43:12.873 INFO:tasks.workunit.client.0.smithi066.stdout:0/497: chown d1/d62/d9f/d4a/d67/l22 34 1 2024-09-12T01:43:12.874 INFO:tasks.workunit.client.1.smithi153.stdout:9/840: symlink d3/d5f/d62/lff 0 2024-09-12T01:43:12.874 INFO:tasks.workunit.client.1.smithi153.stdout:9/841: fdatasync d3/d55/d30/d88/fee 0 2024-09-12T01:43:12.875 INFO:tasks.workunit.client.0.smithi066.stdout:3/558: mknod d5/d6/d1b/d28/d4f/d9b/cbe 0 2024-09-12T01:43:12.879 INFO:tasks.workunit.client.1.smithi153.stdout:6/886: mknod d1/d6/da/d19/d34/d10e/d112/c11f 0 2024-09-12T01:43:12.883 INFO:tasks.workunit.client.0.smithi066.stdout:0/498: write d1/d62/d9f/d4a/d67/d20/f35 [3903754,54687] 0 2024-09-12T01:43:12.883 INFO:tasks.workunit.client.1.smithi153.stdout:2/782: sync 2024-09-12T01:43:12.884 INFO:tasks.workunit.client.1.smithi153.stdout:1/849: sync 2024-09-12T01:43:12.884 INFO:tasks.workunit.client.1.smithi153.stdout:2/783: readlink d7/db/d27/d56/ld2 0 2024-09-12T01:43:12.884 INFO:tasks.workunit.client.1.smithi153.stdout:1/850: read d2/d9/d28/d73/f78 [759419,92123] 0 2024-09-12T01:43:12.885 INFO:tasks.workunit.client.1.smithi153.stdout:2/784: dread d7/d4d/d70/f92 [0,4194304] 0 2024-09-12T01:43:12.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/844: write d0/df/f35 [3872530,106211] 0 2024-09-12T01:43:12.885 INFO:tasks.workunit.client.1.smithi153.stdout:5/845: write d0/d20/f26 [510333,120448] 0 2024-09-12T01:43:12.887 INFO:tasks.workunit.client.0.smithi066.stdout:5/410: rename d0/d21/d27 to d0/d26/d2d/d33/d55/d82 0 2024-09-12T01:43:12.888 INFO:tasks.workunit.client.1.smithi153.stdout:4/731: dread d6/d9/fc9 [0,4194304] 0 2024-09-12T01:43:12.888 INFO:tasks.workunit.client.1.smithi153.stdout:6/887: symlink d1/d6/d23/d98/d53/d69/d7c/l120 0 2024-09-12T01:43:12.888 INFO:tasks.workunit.client.1.smithi153.stdout:6/888: chown d1/d6/d46/l81 978580 1 2024-09-12T01:43:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:12 smithi066 ceph-mon[27875]: pgmap v5: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail 2024-09-12T01:43:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:12 smithi066 ceph-mon[27875]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:12.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/851: unlink d2/d9/d17/d2f/d56/d71/d9a/lcc 0 2024-09-12T01:43:12.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/852: chown d2/d9/d28/c96 505 1 2024-09-12T01:43:12.890 INFO:tasks.workunit.client.1.smithi153.stdout:1/853: dread - d2/d68/d6b/d9e/dc7/f110 zero size 2024-09-12T01:43:12.890 INFO:tasks.workunit.client.0.smithi066.stdout:3/559: getdents d5/d6/d48 0 2024-09-12T01:43:12.890 INFO:tasks.workunit.client.0.smithi066.stdout:3/560: creat d5/d35/fbf x:0 0 0 2024-09-12T01:43:12.891 INFO:tasks.workunit.client.0.smithi066.stdout:0/499: rename d1/d62/d9f/d4a/d67/d20/d3d to d1/d62/d9f/db4 0 2024-09-12T01:43:12.892 INFO:tasks.workunit.client.0.smithi066.stdout:5/411: symlink d0/d26/l83 0 2024-09-12T01:43:12.894 INFO:tasks.workunit.client.1.smithi153.stdout:4/732: creat d6/d9/dc/d98/d3e/ffd x:0 0 0 2024-09-12T01:43:12.894 INFO:tasks.workunit.client.1.smithi153.stdout:4/733: write d6/d15/fc3 [1202644,10674] 0 2024-09-12T01:43:12.894 INFO:tasks.workunit.client.1.smithi153.stdout:4/734: read d6/d9/d11/d13/dce/dd7/f47 [585398,95782] 0 2024-09-12T01:43:12.895 INFO:tasks.workunit.client.1.smithi153.stdout:1/854: mkdir d2/d68/d114 0 2024-09-12T01:43:12.895 INFO:tasks.workunit.client.1.smithi153.stdout:2/785: symlink d7/lf5 0 2024-09-12T01:43:12.897 INFO:tasks.workunit.client.1.smithi153.stdout:5/846: rename d0/df to d0/d43/dac/db0/d109 0 2024-09-12T01:43:12.899 INFO:tasks.workunit.client.1.smithi153.stdout:4/735: unlink d6/d15/db4/dbd/dec/fdd 0 2024-09-12T01:43:12.900 INFO:tasks.workunit.client.1.smithi153.stdout:6/889: mknod d1/df/c121 0 2024-09-12T01:43:12.902 INFO:tasks.workunit.client.1.smithi153.stdout:2/786: mknod d7/db/d62/cf6 0 2024-09-12T01:43:12.902 INFO:tasks.workunit.client.1.smithi153.stdout:2/787: read - d7/db/d36/fdc zero size 2024-09-12T01:43:12.902 INFO:tasks.workunit.client.1.smithi153.stdout:5/847: mkdir d0/d43/dac/db0/d109/db8/d2f/d55/d10a 0 2024-09-12T01:43:12.903 INFO:tasks.workunit.client.1.smithi153.stdout:5/848: stat d0/d43/d8d 0 2024-09-12T01:43:12.903 INFO:tasks.workunit.client.1.smithi153.stdout:4/736: mkdir d6/d15/db4/dbd/dfe 0 2024-09-12T01:43:12.903 INFO:tasks.workunit.client.1.smithi153.stdout:4/737: chown d6/d15/db4/dbd/fd6 536879 1 2024-09-12T01:43:12.904 INFO:tasks.workunit.client.1.smithi153.stdout:6/890: truncate d1/d6/d23/d98/d53/d8d/ff3 404709 0 2024-09-12T01:43:12.905 INFO:tasks.workunit.client.1.smithi153.stdout:4/738: symlink d6/d9/dc/lff 0 2024-09-12T01:43:12.905 INFO:tasks.workunit.client.0.smithi066.stdout:3/561: write d5/d6/d1b/f62 [455356,108082] 0 2024-09-12T01:43:12.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/891: dread d1/d6/d23/d98/d53/da0/fe8 [0,4194304] 0 2024-09-12T01:43:12.908 INFO:tasks.workunit.client.1.smithi153.stdout:6/892: truncate d1/f110 878064 0 2024-09-12T01:43:12.908 INFO:tasks.workunit.client.0.smithi066.stdout:3/562: unlink d5/d6/d1b/d45/d66/l2f 0 2024-09-12T01:43:12.908 INFO:tasks.workunit.client.0.smithi066.stdout:3/563: fsync d5/d6/d1b/d45/d66/d67/d6d/fa5 0 2024-09-12T01:43:12.909 INFO:tasks.workunit.client.0.smithi066.stdout:0/500: dread d1/d62/d9f/d92/d95/fb2 [0,4194304] 0 2024-09-12T01:43:12.911 INFO:tasks.workunit.client.1.smithi153.stdout:6/893: getdents d1/d6/d39/d76 0 2024-09-12T01:43:12.911 INFO:tasks.workunit.client.1.smithi153.stdout:6/894: write d1/d80/fae [1359513,84223] 0 2024-09-12T01:43:12.912 INFO:tasks.workunit.client.1.smithi153.stdout:2/788: dread d7/d4d/d7b/f90 [0,4194304] 0 2024-09-12T01:43:12.912 INFO:tasks.workunit.client.1.smithi153.stdout:2/789: chown d7/db/d27/d56/fb4 511 1 2024-09-12T01:43:12.914 INFO:tasks.workunit.client.1.smithi153.stdout:2/790: truncate d7/db/d6c/d7e/f66 2935784 0 2024-09-12T01:43:12.914 INFO:tasks.workunit.client.1.smithi153.stdout:2/791: dread - d7/db/d6c/d76/fc0 zero size 2024-09-12T01:43:12.914 INFO:tasks.workunit.client.1.smithi153.stdout:2/792: write d7/d19/d40/f37 [627061,29855] 0 2024-09-12T01:43:12.914 INFO:tasks.workunit.client.1.smithi153.stdout:1/855: dwrite d2/d9/d17/f4e [0,4194304] 0 2024-09-12T01:43:12.916 INFO:tasks.workunit.client.1.smithi153.stdout:2/793: unlink d7/d19/d83/c9c 0 2024-09-12T01:43:12.918 INFO:tasks.workunit.client.0.smithi066.stdout:3/564: dread d5/f17 [0,4194304] 0 2024-09-12T01:43:12.920 INFO:tasks.workunit.client.1.smithi153.stdout:1/856: unlink d2/d68/f77 0 2024-09-12T01:43:12.920 INFO:tasks.workunit.client.1.smithi153.stdout:6/895: dread d1/d6/da/d19/d3a/f9f [0,4194304] 0 2024-09-12T01:43:12.922 INFO:tasks.workunit.client.1.smithi153.stdout:1/857: rename d2/d9/d17/d69/d95/la2 to d2/d9/d17/d2c/ddd/l115 0 2024-09-12T01:43:12.925 INFO:tasks.workunit.client.1.smithi153.stdout:4/739: dwrite d6/d15/f4c [0,4194304] 0 2024-09-12T01:43:12.925 INFO:tasks.workunit.client.1.smithi153.stdout:4/740: write d6/d9/dc/d98/d3e/fdf [844463,10484] 0 2024-09-12T01:43:12.934 INFO:tasks.workunit.client.1.smithi153.stdout:1/858: read d2/d9/d1d/f22 [1248423,35869] 0 2024-09-12T01:43:12.956 INFO:tasks.workunit.client.1.smithi153.stdout:5/849: dread d0/d15/f96 [4194304,4194304] 0 2024-09-12T01:43:12.956 INFO:tasks.workunit.client.1.smithi153.stdout:5/850: readlink d0/d43/dac/db0/d109/db8/l3c 0 2024-09-12T01:43:12.956 INFO:tasks.workunit.client.1.smithi153.stdout:5/851: write d0/d43/dac/db0/d109/db8/f77 [4474506,66083] 0 2024-09-12T01:43:12.966 INFO:tasks.workunit.client.1.smithi153.stdout:6/896: dread d1/df/f30 [0,4194304] 0 2024-09-12T01:43:12.968 INFO:tasks.workunit.client.1.smithi153.stdout:6/897: unlink d1/d6/da/d19/l22 0 2024-09-12T01:43:12.978 INFO:tasks.workunit.client.0.smithi066.stdout:4/437: write d4/d6/d8/d18/f69 [35014,40291] 0 2024-09-12T01:43:12.978 INFO:tasks.workunit.client.0.smithi066.stdout:4/438: chown d4/d84 352 1 2024-09-12T01:43:12.982 INFO:tasks.workunit.client.0.smithi066.stdout:4/439: getdents d4/d5f 0 2024-09-12T01:43:12.984 INFO:tasks.workunit.client.0.smithi066.stdout:4/440: rename d4/d6/d27/d66/c70 to d4/d6/d27/d66/d6c/d75/c8c 0 2024-09-12T01:43:12.992 INFO:tasks.workunit.client.1.smithi153.stdout:7/783: dwrite d12/d21/d29/d35/d37/d58/fa7 [0,4194304] 0 2024-09-12T01:43:12.993 INFO:tasks.workunit.client.1.smithi153.stdout:7/784: dread - d12/d21/d5f/ff5 zero size 2024-09-12T01:43:13.004 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:12 smithi153 ceph-mon[34713]: pgmap v5: 65 pgs: 65 active+clean; 2.1 GiB data, 7.8 GiB used, 529 GiB / 536 GiB avail 2024-09-12T01:43:13.004 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:12 smithi153 ceph-mon[34713]: from='client.24395 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:13.016 INFO:tasks.workunit.client.0.smithi066.stdout:5/412: dwrite d0/d26/f34 [4194304,4194304] 0 2024-09-12T01:43:13.016 INFO:tasks.workunit.client.0.smithi066.stdout:5/413: readlink d0/d21/l5f 0 2024-09-12T01:43:13.016 INFO:tasks.workunit.client.0.smithi066.stdout:5/414: chown d0 42782 1 2024-09-12T01:43:13.017 INFO:tasks.workunit.client.0.smithi066.stdout:5/415: rmdir d0 39 2024-09-12T01:43:13.017 INFO:tasks.workunit.client.1.smithi153.stdout:7/785: dread d12/d21/d29/d35/d37/d58/fa7 [0,4194304] 0 2024-09-12T01:43:13.023 INFO:tasks.workunit.client.1.smithi153.stdout:9/842: dwrite d3/d3a/d42/f4c [0,4194304] 0 2024-09-12T01:43:13.023 INFO:tasks.workunit.client.0.smithi066.stdout:0/501: dwrite d1/d62/fa4 [0,4194304] 0 2024-09-12T01:43:13.027 INFO:tasks.workunit.client.1.smithi153.stdout:1/859: dwrite d2/d9/d28/d73/fb7 [0,4194304] 0 2024-09-12T01:43:13.029 INFO:tasks.workunit.client.0.smithi066.stdout:3/565: dwrite d5/d6/d1b/d45/d66/d67/d7f/da8/faf [0,4194304] 0 2024-09-12T01:43:13.029 INFO:tasks.workunit.client.1.smithi153.stdout:4/741: dwrite d6/d9/dc/d98/d3e/f50 [0,4194304] 0 2024-09-12T01:43:13.029 INFO:tasks.workunit.client.1.smithi153.stdout:4/742: truncate d6/d9/dc/d98/f57 1009469 0 2024-09-12T01:43:13.029 INFO:tasks.workunit.client.0.smithi066.stdout:4/441: dwrite d4/f86 [4194304,4194304] 0 2024-09-12T01:43:13.030 INFO:tasks.workunit.client.0.smithi066.stdout:4/442: write d4/d6/d8/d4a/f7e [771687,35755] 0 2024-09-12T01:43:13.030 INFO:tasks.workunit.client.0.smithi066.stdout:5/416: dread d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:13.031 INFO:tasks.workunit.client.1.smithi153.stdout:5/852: dwrite d0/d43/dac/db0/d109/f35 [4194304,4194304] 0 2024-09-12T01:43:13.035 INFO:tasks.workunit.client.1.smithi153.stdout:9/843: write d3/d55/d30/d88/fab [2835046,111102] 0 2024-09-12T01:43:13.036 INFO:tasks.workunit.client.0.smithi066.stdout:3/566: link d5/d35/l5a d5/d6/lc0 0 2024-09-12T01:43:13.036 INFO:tasks.workunit.client.1.smithi153.stdout:7/786: dwrite d12/d21/d29/d2d/d8b/fef [0,4194304] 0 2024-09-12T01:43:13.041 INFO:tasks.workunit.client.1.smithi153.stdout:5/853: symlink d0/d43/dac/db0/d109/db8/d2f/d55/l10b 0 2024-09-12T01:43:13.041 INFO:tasks.workunit.client.1.smithi153.stdout:5/854: write d0/d43/dac/db0/d109/d83/d36/fa8 [509450,90331] 0 2024-09-12T01:43:13.041 INFO:tasks.workunit.client.1.smithi153.stdout:5/855: chown d0/d43/dac/db0/d109/c14 2842290 1 2024-09-12T01:43:13.043 INFO:tasks.workunit.client.1.smithi153.stdout:1/860: dread d2/d34/d8a/f94 [0,4194304] 0 2024-09-12T01:43:13.043 INFO:tasks.workunit.client.1.smithi153.stdout:6/898: dwrite d1/d6/d39/d76/f114 [0,4194304] 0 2024-09-12T01:43:13.043 INFO:tasks.workunit.client.1.smithi153.stdout:9/844: mknod d3/d5f/dc4/c100 0 2024-09-12T01:43:13.043 INFO:tasks.workunit.client.1.smithi153.stdout:9/845: write d3/d3a/d42/f48 [211108,6537] 0 2024-09-12T01:43:13.044 INFO:tasks.workunit.client.0.smithi066.stdout:4/443: creat d4/d6/d27/d66/d58/f8d x:0 0 0 2024-09-12T01:43:13.048 INFO:tasks.workunit.client.0.smithi066.stdout:5/417: truncate d0/f20 1054863 0 2024-09-12T01:43:13.048 INFO:tasks.workunit.client.0.smithi066.stdout:5/418: chown d0/d26/l43 9270413 1 2024-09-12T01:43:13.049 INFO:tasks.workunit.client.1.smithi153.stdout:4/743: write d6/d9/d11/f6c [579192,127396] 0 2024-09-12T01:43:13.050 INFO:tasks.workunit.client.0.smithi066.stdout:0/502: dwrite d1/d72/de/f3c [0,4194304] 0 2024-09-12T01:43:13.052 INFO:tasks.workunit.client.0.smithi066.stdout:3/567: mknod d5/d6/d1b/d45/d85/cc1 0 2024-09-12T01:43:13.054 INFO:tasks.workunit.client.1.smithi153.stdout:8/732: sync 2024-09-12T01:43:13.054 INFO:tasks.workunit.client.1.smithi153.stdout:7/787: dwrite d12/d21/d5f/f8c [0,4194304] 0 2024-09-12T01:43:13.056 INFO:tasks.workunit.client.1.smithi153.stdout:5/856: truncate d0/d15/f25 3480137 0 2024-09-12T01:43:13.057 INFO:tasks.workunit.client.0.smithi066.stdout:0/503: rename d1/d62/d9f/d4a/d67/d1b/d26/c4c to d1/d62/d6c/dad/cb5 0 2024-09-12T01:43:13.057 INFO:tasks.workunit.client.1.smithi153.stdout:9/846: dread d3/d35/f5d [0,4194304] 0 2024-09-12T01:43:13.057 INFO:tasks.workunit.client.1.smithi153.stdout:9/847: fsync d3/d66/ddc/ffa 0 2024-09-12T01:43:13.058 INFO:tasks.workunit.client.1.smithi153.stdout:9/848: dread - d3/d5f/dc4/fd5 zero size 2024-09-12T01:43:13.058 INFO:tasks.workunit.client.1.smithi153.stdout:9/849: write d3/d3a/d42/d72/f7c [980403,90558] 0 2024-09-12T01:43:13.058 INFO:tasks.workunit.client.1.smithi153.stdout:9/850: fdatasync d3/d3a/fb2 0 2024-09-12T01:43:13.062 INFO:tasks.workunit.client.0.smithi066.stdout:3/568: mknod d5/d6/d1b/d45/d66/d67/d75/d8e/cc2 0 2024-09-12T01:43:13.066 INFO:tasks.workunit.client.1.smithi153.stdout:5/857: dread d0/d15/f53 [0,4194304] 0 2024-09-12T01:43:13.066 INFO:tasks.workunit.client.0.smithi066.stdout:0/504: symlink d1/d62/d9f/d4a/d67/d1b/d26/d5b/lb6 0 2024-09-12T01:43:13.069 INFO:tasks.workunit.client.0.smithi066.stdout:3/569: link d5/f92 d5/d6/d1b/d45/d85/fc3 0 2024-09-12T01:43:13.073 INFO:tasks.workunit.client.0.smithi066.stdout:0/505: creat d1/d72/fb7 x:0 0 0 2024-09-12T01:43:13.077 INFO:tasks.workunit.client.0.smithi066.stdout:0/506: creat d1/d62/d9f/d4a/d67/d3e/fb8 x:0 0 0 2024-09-12T01:43:13.079 INFO:tasks.workunit.client.1.smithi153.stdout:1/861: mkdir d2/d9/d17/d100/d116 0 2024-09-12T01:43:13.080 INFO:tasks.workunit.client.0.smithi066.stdout:0/507: mkdir d1/d62/d9f/d92/db9 0 2024-09-12T01:43:13.080 INFO:tasks.workunit.client.0.smithi066.stdout:0/508: write d1/d72/de/f2a [4972322,8162] 0 2024-09-12T01:43:13.080 INFO:tasks.workunit.client.0.smithi066.stdout:0/509: readlink d1/d72/l39 0 2024-09-12T01:43:13.081 INFO:tasks.workunit.client.1.smithi153.stdout:6/899: mkdir d1/d6/d23/d98/d4f/d122 0 2024-09-12T01:43:13.082 INFO:tasks.workunit.client.0.smithi066.stdout:0/510: read d1/d62/d89/f9b [539093,65269] 0 2024-09-12T01:43:13.082 INFO:tasks.workunit.client.0.smithi066.stdout:0/511: fdatasync d1/f2d 0 2024-09-12T01:43:13.084 INFO:tasks.workunit.client.1.smithi153.stdout:4/744: truncate d6/d9/dc/d98/f88 297426 0 2024-09-12T01:43:13.085 INFO:tasks.workunit.client.0.smithi066.stdout:0/512: mkdir d1/d62/d9f/d4a/dba 0 2024-09-12T01:43:13.086 INFO:tasks.workunit.client.0.smithi066.stdout:0/513: dread - d1/d62/d9f/d4a/d67/d20/fa9 zero size 2024-09-12T01:43:13.086 INFO:tasks.workunit.client.0.smithi066.stdout:0/514: chown d1/d62/d9f/d7c/l93 110487 1 2024-09-12T01:43:13.086 INFO:tasks.workunit.client.1.smithi153.stdout:8/733: chown d17/d1f/d4f/d34/l38 2970 1 2024-09-12T01:43:13.087 INFO:tasks.workunit.client.1.smithi153.stdout:8/734: fdatasync d17/fec 0 2024-09-12T01:43:13.087 INFO:tasks.workunit.client.0.smithi066.stdout:5/419: dwrite d0/d26/d2d/f49 [0,4194304] 0 2024-09-12T01:43:13.089 INFO:tasks.workunit.client.0.smithi066.stdout:4/444: dwrite d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:13.089 INFO:tasks.workunit.client.0.smithi066.stdout:0/515: rename d1/d62/d9f/d4a/d67/l2f to d1/d62/d9f/d4a/d67/d6e/lbb 0 2024-09-12T01:43:13.089 INFO:tasks.workunit.client.0.smithi066.stdout:3/570: dwrite d5/d6/d1b/d28/f46 [0,4194304] 0 2024-09-12T01:43:13.090 INFO:tasks.workunit.client.1.smithi153.stdout:7/788: mknod d12/d21/d4d/dae/dc0/cfa 0 2024-09-12T01:43:13.091 INFO:tasks.workunit.client.0.smithi066.stdout:5/420: mkdir d0/d26/d2d/d33/d55/d84 0 2024-09-12T01:43:13.091 INFO:tasks.workunit.client.0.smithi066.stdout:5/421: chown d0/d26/d2d/d33/f69 1732975 1 2024-09-12T01:43:13.093 INFO:tasks.workunit.client.1.smithi153.stdout:9/851: mkdir d3/d55/de3/d101 0 2024-09-12T01:43:13.094 INFO:tasks.workunit.client.0.smithi066.stdout:4/445: symlink d4/d6/d27/d2f/d72/l8e 0 2024-09-12T01:43:13.098 INFO:tasks.workunit.client.1.smithi153.stdout:5/858: rename d0/d43/dac/db0/d109/db8/d6e/fcb to d0/d43/d8d/d8e/dd7/f10c 0 2024-09-12T01:43:13.100 INFO:tasks.workunit.client.0.smithi066.stdout:0/516: mknod d1/d72/cbc 0 2024-09-12T01:43:13.101 INFO:tasks.workunit.client.1.smithi153.stdout:1/862: mkdir d2/d9/d17/d69/d107/d117 0 2024-09-12T01:43:13.103 INFO:tasks.workunit.client.1.smithi153.stdout:4/745: stat d6/d9/dc/d98/d3e/f61 0 2024-09-12T01:43:13.106 INFO:tasks.workunit.client.0.smithi066.stdout:3/571: unlink d5/d6/la3 0 2024-09-12T01:43:13.106 INFO:tasks.workunit.client.1.smithi153.stdout:8/735: mknod d17/d1f/d4f/d34/d6f/cef 0 2024-09-12T01:43:13.107 INFO:tasks.workunit.client.0.smithi066.stdout:5/422: truncate d0/dd/f6d 585376 0 2024-09-12T01:43:13.109 INFO:tasks.workunit.client.1.smithi153.stdout:9/852: dwrite d3/d55/d30/d7b/d8f/f9c [0,4194304] 0 2024-09-12T01:43:13.109 INFO:tasks.workunit.client.1.smithi153.stdout:7/789: creat d12/d4e/ffb x:0 0 0 2024-09-12T01:43:13.110 INFO:tasks.workunit.client.1.smithi153.stdout:7/790: readlink d12/d21/d29/d35/d37/l96 0 2024-09-12T01:43:13.110 INFO:tasks.workunit.client.1.smithi153.stdout:7/791: fsync d12/d21/d29/d35/d37/d4c/d8e/fa1 0 2024-09-12T01:43:13.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/859: symlink d0/d43/dac/db0/d109/l10d 0 2024-09-12T01:43:13.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/860: stat d0/d43/dac/db0/d109/db8/ffa 0 2024-09-12T01:43:13.115 INFO:tasks.workunit.client.1.smithi153.stdout:5/861: read d0/d43/dac/db0/d109/f21 [1067376,64440] 0 2024-09-12T01:43:13.117 INFO:tasks.workunit.client.1.smithi153.stdout:3/883: sync 2024-09-12T01:43:13.118 INFO:tasks.workunit.client.1.smithi153.stdout:3/884: write d1/d16/ff4 [1196497,18823] 0 2024-09-12T01:43:13.118 INFO:tasks.workunit.client.1.smithi153.stdout:1/863: mkdir d2/d9/d17/d2c/d118 0 2024-09-12T01:43:13.118 INFO:tasks.workunit.client.1.smithi153.stdout:3/885: dread d1/d13/d23/d47/d6c/fa8 [0,4194304] 0 2024-09-12T01:43:13.119 INFO:tasks.workunit.client.0.smithi066.stdout:4/446: creat d4/d6/d48/d88/f8f x:0 0 0 2024-09-12T01:43:13.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/447: chown d4/d6/l3c 509352575 1 2024-09-12T01:43:13.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/448: creat d4/d15/d33/f90 x:0 0 0 2024-09-12T01:43:13.121 INFO:tasks.workunit.client.1.smithi153.stdout:4/746: link d6/d9/d11/d13/f65 d6/d9/dc/d31/f100 0 2024-09-12T01:43:13.123 INFO:tasks.workunit.client.0.smithi066.stdout:0/517: mknod d1/d62/d9f/d4a/d67/d1b/d26/d9c/cbd 0 2024-09-12T01:43:13.123 INFO:tasks.workunit.client.0.smithi066.stdout:0/518: truncate d1/d62/d9f/d4a/d67/d6e/d80/fa6 49395 0 2024-09-12T01:43:13.126 INFO:tasks.workunit.client.1.smithi153.stdout:9/853: dwrite d3/d66/d80/fec [0,4194304] 0 2024-09-12T01:43:13.127 INFO:tasks.workunit.client.0.smithi066.stdout:3/572: unlink d5/d6/d48/f71 0 2024-09-12T01:43:13.132 INFO:tasks.workunit.client.0.smithi066.stdout:5/423: unlink d0/dd/d18/d36/d4c/c7d 0 2024-09-12T01:43:13.135 INFO:tasks.workunit.client.1.smithi153.stdout:7/792: mknod d12/d21/d29/d35/dcb/de9/cfc 0 2024-09-12T01:43:13.135 INFO:tasks.workunit.client.1.smithi153.stdout:9/854: dread d3/d35/f8a [0,4194304] 0 2024-09-12T01:43:13.138 INFO:tasks.workunit.client.0.smithi066.stdout:3/573: mknod d5/d6/d1b/d45/d66/dae/cc4 0 2024-09-12T01:43:13.138 INFO:tasks.workunit.client.0.smithi066.stdout:3/574: creat d5/d6/d1b/d65/d89/d50/fc5 x:0 0 0 2024-09-12T01:43:13.141 INFO:tasks.workunit.client.0.smithi066.stdout:5/424: mknod d0/d26/d2d/d33/d55/d84/c85 0 2024-09-12T01:43:13.141 INFO:tasks.workunit.client.0.smithi066.stdout:5/425: chown d0/d26/d2d/f49 1321 1 2024-09-12T01:43:13.142 INFO:tasks.workunit.client.1.smithi153.stdout:5/862: creat d0/d43/dac/db0/d109/db8/d2f/d55/f10e x:0 0 0 2024-09-12T01:43:13.145 INFO:tasks.workunit.client.0.smithi066.stdout:5/426: dread d0/d26/d2f/d30/f65 [0,4194304] 0 2024-09-12T01:43:13.147 INFO:tasks.workunit.client.0.smithi066.stdout:3/575: mkdir d5/d6/d1b/d45/d66/d67/d7f/d84/dc6 0 2024-09-12T01:43:13.149 INFO:tasks.workunit.client.1.smithi153.stdout:1/864: dwrite d2/d9/d1d/d25/f35 [4194304,4194304] 0 2024-09-12T01:43:13.150 INFO:tasks.workunit.client.0.smithi066.stdout:5/427: creat d0/d26/f86 x:0 0 0 2024-09-12T01:43:13.150 INFO:tasks.workunit.client.0.smithi066.stdout:5/428: write d0/f20 [283356,117622] 0 2024-09-12T01:43:13.150 INFO:tasks.workunit.client.0.smithi066.stdout:5/429: truncate d0/dd/d18/f75 929680 0 2024-09-12T01:43:13.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/430: stat d0/d26/f34 0 2024-09-12T01:43:13.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/431: write d0/dd/d18/f7c [1653497,130072] 0 2024-09-12T01:43:13.151 INFO:tasks.workunit.client.1.smithi153.stdout:7/793: symlink d12/d21/d29/d2d/d8b/lfd 0 2024-09-12T01:43:13.151 INFO:tasks.workunit.client.1.smithi153.stdout:7/794: read - d12/d21/d29/d35/d37/d4c/fc2 zero size 2024-09-12T01:43:13.152 INFO:tasks.workunit.client.1.smithi153.stdout:7/795: fsync d12/d21/d29/d35/d37/d4c/fc2 0 2024-09-12T01:43:13.152 INFO:tasks.workunit.client.1.smithi153.stdout:7/796: dread - d12/d21/d29/ff8 zero size 2024-09-12T01:43:13.152 INFO:tasks.workunit.client.1.smithi153.stdout:7/797: dread - d12/d21/d4d/dae/dc0/dc4/fca zero size 2024-09-12T01:43:13.152 INFO:tasks.workunit.client.1.smithi153.stdout:7/798: write d12/f26 [617073,105443] 0 2024-09-12T01:43:13.152 INFO:tasks.workunit.client.0.smithi066.stdout:4/449: dwrite d4/d6/d8/d18/d45/f83 [4194304,4194304] 0 2024-09-12T01:43:13.152 INFO:tasks.workunit.client.0.smithi066.stdout:4/450: stat d4/d6/d27/d66/d58/f78 0 2024-09-12T01:43:13.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/886: dwrite d1/d16/d1c/f91 [0,4194304] 0 2024-09-12T01:43:13.153 INFO:tasks.workunit.client.1.smithi153.stdout:3/887: fsync d1/d16/d17/d82/d92/fd5 0 2024-09-12T01:43:13.154 INFO:tasks.workunit.client.1.smithi153.stdout:3/888: chown d1/d16/d1c/f91 76 1 2024-09-12T01:43:13.154 INFO:tasks.workunit.client.1.smithi153.stdout:3/889: chown d1/l56 5 1 2024-09-12T01:43:13.154 INFO:tasks.workunit.client.0.smithi066.stdout:0/519: dwrite d1/d62/d9f/d4a/d67/d1b/d26/d9c/fae [0,4194304] 0 2024-09-12T01:43:13.155 INFO:tasks.workunit.client.1.smithi153.stdout:9/855: link d3/d35/f79 d3/d5f/dbb/f102 0 2024-09-12T01:43:13.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/576: dread d5/d6/d1b/d45/f49 [0,4194304] 0 2024-09-12T01:43:13.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/577: write d5/d6/d1b/d65/d89/f81 [1809838,20880] 0 2024-09-12T01:43:13.161 INFO:tasks.workunit.client.0.smithi066.stdout:4/451: creat d4/d6/d27/d2f/f91 x:0 0 0 2024-09-12T01:43:13.161 INFO:tasks.workunit.client.0.smithi066.stdout:4/452: chown d4/d15/l20 0 1 2024-09-12T01:43:13.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/453: read - d4/d6/d8/d18/f76 zero size 2024-09-12T01:43:13.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/454: chown d4/d6/d8/d18/l26 444838315 1 2024-09-12T01:43:13.163 INFO:tasks.workunit.client.1.smithi153.stdout:3/890: dread d1/d16/f53 [0,4194304] 0 2024-09-12T01:43:13.163 INFO:tasks.workunit.client.1.smithi153.stdout:3/891: readlink d1/d13/d23/d47/d71/d8e/d93/d79/l8d 0 2024-09-12T01:43:13.163 INFO:tasks.workunit.client.1.smithi153.stdout:3/892: fsync d1/f12 0 2024-09-12T01:43:13.164 INFO:tasks.workunit.client.0.smithi066.stdout:5/432: dread d0/dd/d18/f7c [4194304,4194304] 0 2024-09-12T01:43:13.165 INFO:tasks.workunit.client.0.smithi066.stdout:5/433: fdatasync d0/d26/d2d/d42/f80 0 2024-09-12T01:43:13.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/900: rename d1/d6/da/d19/d94 to d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/d123 0 2024-09-12T01:43:13.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/901: dread - d1/d6/d23/d98/d53/d8d/fd3 zero size 2024-09-12T01:43:13.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/902: fdatasync d1/d6/d23/d98/d53/f78 0 2024-09-12T01:43:13.165 INFO:tasks.workunit.client.1.smithi153.stdout:6/903: chown d1/d6/d46 0 1 2024-09-12T01:43:13.168 INFO:tasks.workunit.client.1.smithi153.stdout:5/863: dread d0/d43/dac/db0/d109/d83/f9f [0,4194304] 0 2024-09-12T01:43:13.170 INFO:tasks.workunit.client.0.smithi066.stdout:5/434: dread d0/dd/d18/d36/f5c [0,4194304] 0 2024-09-12T01:43:13.173 INFO:tasks.workunit.client.1.smithi153.stdout:6/904: read d1/d6/d23/d98/d4f/feb [2839668,77704] 0 2024-09-12T01:43:13.175 INFO:tasks.workunit.client.0.smithi066.stdout:4/455: write d4/d6/d8/f32 [96642,45983] 0 2024-09-12T01:43:13.175 INFO:tasks.workunit.client.0.smithi066.stdout:4/456: stat d4/d15/f38 0 2024-09-12T01:43:13.175 INFO:tasks.workunit.client.0.smithi066.stdout:4/457: write d4/f12 [801278,63585] 0 2024-09-12T01:43:13.177 INFO:tasks.workunit.client.0.smithi066.stdout:5/435: mkdir d0/d26/d2d/d33/d55/d82/d87 0 2024-09-12T01:43:13.177 INFO:tasks.workunit.client.0.smithi066.stdout:5/436: getdents d0/d26/d2d/d33/d55/d82/d87 0 2024-09-12T01:43:13.177 INFO:tasks.workunit.client.0.smithi066.stdout:5/437: creat d0/d26/d2d/d33/f88 x:0 0 0 2024-09-12T01:43:13.177 INFO:tasks.workunit.client.0.smithi066.stdout:0/520: dwrite d1/d62/d6c/f5d [0,4194304] 0 2024-09-12T01:43:13.178 INFO:tasks.workunit.client.0.smithi066.stdout:7/409: sync 2024-09-12T01:43:13.178 INFO:tasks.workunit.client.0.smithi066.stdout:7/410: truncate d2/d41/d53/f85 142581 0 2024-09-12T01:43:13.178 INFO:tasks.workunit.client.0.smithi066.stdout:7/411: fdatasync d2/d5/d6/d22/d75/d1d/f4b 0 2024-09-12T01:43:13.178 INFO:tasks.workunit.client.0.smithi066.stdout:7/412: chown d2/d5/d6/d22/d75 1 1 2024-09-12T01:43:13.184 INFO:tasks.workunit.client.1.smithi153.stdout:9/856: unlink d3/d3a/c4d 0 2024-09-12T01:43:13.184 INFO:tasks.workunit.client.1.smithi153.stdout:9/857: dread - d3/d55/d30/f73 zero size 2024-09-12T01:43:13.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/858: read d3/f6a [3101322,80717] 0 2024-09-12T01:43:13.185 INFO:tasks.workunit.client.1.smithi153.stdout:9/859: truncate d3/d3a/d42/f47 3261254 0 2024-09-12T01:43:13.186 INFO:tasks.workunit.client.0.smithi066.stdout:4/458: dread d4/f52 [0,4194304] 0 2024-09-12T01:43:13.186 INFO:tasks.workunit.client.0.smithi066.stdout:4/459: write d4/d6/d48/d88/f7a [534390,67187] 0 2024-09-12T01:43:13.187 INFO:tasks.workunit.client.1.smithi153.stdout:3/893: creat d1/d16/f109 x:0 0 0 2024-09-12T01:43:13.189 INFO:tasks.workunit.client.1.smithi153.stdout:8/736: rename d17/d1d/ce1 to d17/d21/d56/ddf/de3/cf0 0 2024-09-12T01:43:13.191 INFO:tasks.workunit.client.0.smithi066.stdout:0/521: creat d1/d62/d9f/d64/fbe x:0 0 0 2024-09-12T01:43:13.192 INFO:tasks.workunit.client.0.smithi066.stdout:5/438: dwrite d0/d26/f34 [4194304,4194304] 0 2024-09-12T01:43:13.194 INFO:tasks.workunit.client.0.smithi066.stdout:7/413: mkdir d2/d5/d6/d22/d75/d1d/d6c/d8e 0 2024-09-12T01:43:13.194 INFO:tasks.workunit.client.1.smithi153.stdout:7/799: rmdir d12/d21/d4d/dae 39 2024-09-12T01:43:13.197 INFO:tasks.workunit.client.0.smithi066.stdout:4/460: creat d4/d6/d62/f92 x:0 0 0 2024-09-12T01:43:13.197 INFO:tasks.workunit.client.0.smithi066.stdout:4/461: creat d4/d6/d48/d88/f93 x:0 0 0 2024-09-12T01:43:13.199 INFO:tasks.workunit.client.0.smithi066.stdout:0/522: rename d1/d62/d6c/f74 to d1/d62/d6c/fbf 0 2024-09-12T01:43:13.201 INFO:tasks.workunit.client.1.smithi153.stdout:9/860: symlink d3/d3a/l103 0 2024-09-12T01:43:13.201 INFO:tasks.workunit.client.1.smithi153.stdout:9/861: fdatasync d3/d55/fc2 0 2024-09-12T01:43:13.201 INFO:tasks.workunit.client.1.smithi153.stdout:9/862: fdatasync d3/f6a 0 2024-09-12T01:43:13.203 INFO:tasks.workunit.client.1.smithi153.stdout:3/894: mknod d1/d13/d23/d47/d71/d8e/de6/c10a 0 2024-09-12T01:43:13.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/439: truncate d0/d26/d2d/d33/f69 3486648 0 2024-09-12T01:43:13.204 INFO:tasks.workunit.client.0.smithi066.stdout:5/440: dread - d0/dd/d18/d36/f79 zero size 2024-09-12T01:43:13.207 INFO:tasks.workunit.client.0.smithi066.stdout:5/441: dread d0/d26/d2f/d30/f65 [0,4194304] 0 2024-09-12T01:43:13.209 INFO:tasks.workunit.client.1.smithi153.stdout:1/865: rename d2/d9/d17/d2f/d56/d71/d9a/cdc to d2/d9/d58/c119 0 2024-09-12T01:43:13.210 INFO:tasks.workunit.client.1.smithi153.stdout:9/863: dread d3/d55/d30/d5b/f7d [0,4194304] 0 2024-09-12T01:43:13.210 INFO:tasks.workunit.client.0.smithi066.stdout:7/414: rename d2/d5/f23 to d2/d5/d6/d22/d75/d1d/f8f 0 2024-09-12T01:43:13.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/415: write d2/d5/d6/d22/d75/d1d/f8f [2991794,70529] 0 2024-09-12T01:43:13.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/737: mkdir d17/d1d/d27/df1 0 2024-09-12T01:43:13.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/738: creat d17/d1f/dcf/ff2 x:0 0 0 2024-09-12T01:43:13.214 INFO:tasks.workunit.client.1.smithi153.stdout:7/800: symlink d12/d21/d4d/lfe 0 2024-09-12T01:43:13.220 INFO:tasks.workunit.client.1.smithi153.stdout:6/905: rename d1/d80/db6 to d1/d6/d39/d76/d124 0 2024-09-12T01:43:13.220 INFO:tasks.workunit.client.1.smithi153.stdout:6/906: dread - d1/d6/d46/d73/d8a/d84/fed zero size 2024-09-12T01:43:13.222 INFO:tasks.workunit.client.0.smithi066.stdout:0/523: symlink d1/d62/d9f/lc0 0 2024-09-12T01:43:13.223 INFO:tasks.workunit.client.0.smithi066.stdout:0/524: read d1/d62/d89/f9b [419343,68622] 0 2024-09-12T01:43:13.225 INFO:tasks.workunit.client.1.smithi153.stdout:3/895: dwrite d1/d13/d23/d47/d71/d8e/d93/dd1/ff2 [0,4194304] 0 2024-09-12T01:43:13.225 INFO:tasks.workunit.client.0.smithi066.stdout:5/442: rmdir d0 39 2024-09-12T01:43:13.225 INFO:tasks.workunit.client.0.smithi066.stdout:5/443: write d0/d26/f35 [4311587,21529] 0 2024-09-12T01:43:13.229 INFO:tasks.workunit.client.1.smithi153.stdout:8/739: mknod d17/d1d/cf3 0 2024-09-12T01:43:13.229 INFO:tasks.workunit.client.1.smithi153.stdout:8/740: chown d17/d1f/d4f/d42/d79/dac/dce/ddc/fde 6 1 2024-09-12T01:43:13.229 INFO:tasks.workunit.client.1.smithi153.stdout:8/741: readlink d17/d1d/d27/ld7 0 2024-09-12T01:43:13.230 INFO:tasks.workunit.client.1.smithi153.stdout:0/937: sync 2024-09-12T01:43:13.230 INFO:tasks.workunit.client.1.smithi153.stdout:0/938: chown d22/d79/dca/dec/d136/dff/d11e/d12f 917 1 2024-09-12T01:43:13.231 INFO:tasks.workunit.client.1.smithi153.stdout:2/794: sync 2024-09-12T01:43:13.233 INFO:tasks.workunit.client.1.smithi153.stdout:1/866: rename d2/d9/d17/d2f/d56/d83/ca6 to d2/d9/d17/dab/c11a 0 2024-09-12T01:43:13.235 INFO:tasks.workunit.client.1.smithi153.stdout:6/907: link d1/df/ldd d1/d6/da/d19/d34/l125 0 2024-09-12T01:43:13.238 INFO:tasks.workunit.client.0.smithi066.stdout:4/462: link d4/d6/d48/d88/f93 d4/d15/f94 0 2024-09-12T01:43:13.238 INFO:tasks.workunit.client.0.smithi066.stdout:4/463: truncate d4/d6/d27/d2f/f54 5198510 0 2024-09-12T01:43:13.238 INFO:tasks.workunit.client.0.smithi066.stdout:4/464: truncate d4/d15/f94 667163 0 2024-09-12T01:43:13.238 INFO:tasks.workunit.client.0.smithi066.stdout:4/465: write d4/d6/d8/d18/f69 [1889595,117279] 0 2024-09-12T01:43:13.238 INFO:tasks.workunit.client.0.smithi066.stdout:4/466: readlink d4/d6/d8/l21 0 2024-09-12T01:43:13.238 INFO:tasks.workunit.client.1.smithi153.stdout:3/896: write d1/d64/db0/fd7 [891374,63975] 0 2024-09-12T01:43:13.243 INFO:tasks.workunit.client.0.smithi066.stdout:5/444: creat d0/d26/d2d/d42/f89 x:0 0 0 2024-09-12T01:43:13.243 INFO:tasks.workunit.client.0.smithi066.stdout:5/445: truncate d0/d26/d2f/d30/f65 1983181 0 2024-09-12T01:43:13.245 INFO:tasks.workunit.client.1.smithi153.stdout:0/939: unlink d22/d82/fa4 0 2024-09-12T01:43:13.246 INFO:tasks.workunit.client.1.smithi153.stdout:2/795: mkdir d7/db/d1d/d59/df7 0 2024-09-12T01:43:13.247 INFO:tasks.workunit.client.0.smithi066.stdout:4/467: creat d4/d6/d8/d18/d45/f95 x:0 0 0 2024-09-12T01:43:13.249 INFO:tasks.workunit.client.0.smithi066.stdout:5/446: unlink d0/d26/d2d/d42/c81 0 2024-09-12T01:43:13.249 INFO:tasks.workunit.client.0.smithi066.stdout:5/447: fsync d0/d26/f6f 0 2024-09-12T01:43:13.249 INFO:tasks.workunit.client.0.smithi066.stdout:5/448: chown d0/f4 1 1 2024-09-12T01:43:13.252 INFO:tasks.workunit.client.0.smithi066.stdout:4/468: symlink d4/d15/d33/d5e/l96 0 2024-09-12T01:43:13.254 INFO:tasks.workunit.client.0.smithi066.stdout:7/416: dwrite d2/d5/d6/d40/d63/f86 [0,4194304] 0 2024-09-12T01:43:13.255 INFO:tasks.workunit.client.1.smithi153.stdout:6/908: mkdir d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/d10f/d126 0 2024-09-12T01:43:13.256 INFO:tasks.workunit.client.0.smithi066.stdout:5/449: rmdir d0/d26/d2f 39 2024-09-12T01:43:13.260 INFO:tasks.workunit.client.0.smithi066.stdout:4/469: creat d4/d6/d27/d66/d6c/f97 x:0 0 0 2024-09-12T01:43:13.260 INFO:tasks.workunit.client.0.smithi066.stdout:4/470: write d4/d6/d8/f3b [2647844,118759] 0 2024-09-12T01:43:13.260 INFO:tasks.workunit.client.0.smithi066.stdout:0/525: dwrite d1/d62/d9f/d4a/d67/f91 [0,4194304] 0 2024-09-12T01:43:13.261 INFO:tasks.workunit.client.1.smithi153.stdout:3/897: mknod d1/c10b 0 2024-09-12T01:43:13.261 INFO:tasks.workunit.client.1.smithi153.stdout:9/864: dwrite d3/f11 [0,4194304] 0 2024-09-12T01:43:13.263 INFO:tasks.workunit.client.1.smithi153.stdout:7/801: dwrite d12/f31 [0,4194304] 0 2024-09-12T01:43:13.265 INFO:tasks.workunit.client.1.smithi153.stdout:0/940: creat d22/d79/dca/dec/f13d x:0 0 0 2024-09-12T01:43:13.265 INFO:tasks.workunit.client.1.smithi153.stdout:0/941: stat d22/d79/dca/dec/d136/db7/le0 0 2024-09-12T01:43:13.266 INFO:tasks.workunit.client.1.smithi153.stdout:1/867: dwrite d2/d9/fe5 [0,4194304] 0 2024-09-12T01:43:13.267 INFO:tasks.workunit.client.1.smithi153.stdout:8/742: dwrite d17/d1f/d4f/d34/db4/fa8 [0,4194304] 0 2024-09-12T01:43:13.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/526: dread d1/d72/de/f19 [0,4194304] 0 2024-09-12T01:43:13.268 INFO:tasks.workunit.client.0.smithi066.stdout:0/527: chown d1/d62/d9f/d4a/d67/d1b/d3b/f86 5060729 1 2024-09-12T01:43:13.268 INFO:tasks.workunit.client.0.smithi066.stdout:5/450: creat d0/d26/d2f/d3b/d6b/f8a x:0 0 0 2024-09-12T01:43:13.271 INFO:tasks.workunit.client.1.smithi153.stdout:9/865: rename d3/d55/d30/d95/d84/d8b/cad to d3/d3a/d42/d72/dce/c104 0 2024-09-12T01:43:13.273 INFO:tasks.workunit.client.1.smithi153.stdout:3/898: symlink d1/d13/d23/d47/d71/l10c 0 2024-09-12T01:43:13.273 INFO:tasks.workunit.client.1.smithi153.stdout:3/899: write d1/d16/d17/d82/d92/fd5 [459856,125619] 0 2024-09-12T01:43:13.278 INFO:tasks.workunit.client.1.smithi153.stdout:2/796: dwrite d7/db/d1d/f28 [4194304,4194304] 0 2024-09-12T01:43:13.286 INFO:tasks.workunit.client.0.smithi066.stdout:0/528: dread d1/d72/f38 [0,4194304] 0 2024-09-12T01:43:13.306 INFO:tasks.workunit.client.1.smithi153.stdout:8/743: dread f15 [0,4194304] 0 2024-09-12T01:43:13.306 INFO:tasks.workunit.client.1.smithi153.stdout:6/909: dwrite d1/d6/d46/d73/d8a/f89 [4194304,4194304] 0 2024-09-12T01:43:13.306 INFO:tasks.workunit.client.1.smithi153.stdout:6/910: chown d1/d6/da 14 1 2024-09-12T01:43:13.306 INFO:tasks.workunit.client.1.smithi153.stdout:8/744: dread - d17/d1f/d4f/d42/d79/dac/fe9 zero size 2024-09-12T01:43:13.306 INFO:tasks.workunit.client.0.smithi066.stdout:4/471: creat d4/d6/d27/f98 x:0 0 0 2024-09-12T01:43:13.308 INFO:tasks.workunit.client.1.smithi153.stdout:7/802: mkdir d12/d21/d29/d35/d95/dff 0 2024-09-12T01:43:13.308 INFO:tasks.workunit.client.1.smithi153.stdout:7/803: write d12/d21/d29/d35/fed [943240,112384] 0 2024-09-12T01:43:13.314 INFO:tasks.workunit.client.1.smithi153.stdout:2/797: dread d7/db/d27/d56/da3/fb3 [0,4194304] 0 2024-09-12T01:43:13.314 INFO:tasks.workunit.client.0.smithi066.stdout:0/529: rmdir d1/d62/d9f/d4a/d67/d3e 39 2024-09-12T01:43:13.315 INFO:tasks.workunit.client.0.smithi066.stdout:7/417: dwrite d2/d5/da/f11 [4194304,4194304] 0 2024-09-12T01:43:13.316 INFO:tasks.workunit.client.0.smithi066.stdout:5/451: dwrite d0/f20 [0,4194304] 0 2024-09-12T01:43:13.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/530: rename d1/d62/d89/d83/d8b/dac to d1/d62/d89/da3/dc1 0 2024-09-12T01:43:13.319 INFO:tasks.workunit.client.0.smithi066.stdout:4/472: dread d4/f2b [0,4194304] 0 2024-09-12T01:43:13.320 INFO:tasks.workunit.client.1.smithi153.stdout:9/866: truncate d3/d5f/dbb/f102 894848 0 2024-09-12T01:43:13.322 INFO:tasks.workunit.client.1.smithi153.stdout:3/900: getdents d1/d64/db0 0 2024-09-12T01:43:13.329 INFO:tasks.workunit.client.1.smithi153.stdout:8/745: symlink d17/d1f/d4f/d34/db4/lf4 0 2024-09-12T01:43:13.329 INFO:tasks.workunit.client.1.smithi153.stdout:8/746: creat d17/d1f/d4f/d42/ff5 x:0 0 0 2024-09-12T01:43:13.333 INFO:tasks.workunit.client.1.smithi153.stdout:1/868: getdents d2/d9/d17/d2f/d56/da0 0 2024-09-12T01:43:13.336 INFO:tasks.workunit.client.0.smithi066.stdout:0/531: dwrite d1/d62/fa4 [0,4194304] 0 2024-09-12T01:43:13.336 INFO:tasks.workunit.client.0.smithi066.stdout:0/532: fdatasync d1/d62/d89/d83/d8b/fa5 0 2024-09-12T01:43:13.336 INFO:tasks.workunit.client.0.smithi066.stdout:0/533: stat d1/d62/d9f/d4a/d67/d20/fa9 0 2024-09-12T01:43:13.336 INFO:tasks.workunit.client.1.smithi153.stdout:2/798: truncate d7/d17/f3c 1448201 0 2024-09-12T01:43:13.347 INFO:tasks.workunit.client.1.smithi153.stdout:3/901: mkdir d1/d13/d23/d47/d6c/d9c/d107/d10d 0 2024-09-12T01:43:13.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/418: truncate d2/d5/d6/f2a 4025737 0 2024-09-12T01:43:13.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/419: readlink d2/d3c/l74 0 2024-09-12T01:43:13.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/420: fdatasync d2/d5/d6/d22/d75/d1d/f3b 0 2024-09-12T01:43:13.348 INFO:tasks.workunit.client.0.smithi066.stdout:7/421: write d2/f2b [3466298,89137] 0 2024-09-12T01:43:13.349 INFO:tasks.workunit.client.0.smithi066.stdout:7/422: read - d2/d5/d6/d22/d75/d25/f78 zero size 2024-09-12T01:43:13.350 INFO:tasks.workunit.client.0.smithi066.stdout:5/452: mkdir d0/d26/d2f/d30/d8b 0 2024-09-12T01:43:13.351 INFO:tasks.workunit.client.0.smithi066.stdout:5/453: stat d0/dd 0 2024-09-12T01:43:13.351 INFO:tasks.workunit.client.0.smithi066.stdout:5/454: write d0/d26/d2d/d42/f7b [965544,125580] 0 2024-09-12T01:43:13.352 INFO:tasks.workunit.client.1.smithi153.stdout:8/747: creat d17/d1f/d4f/d42/d79/dac/dd3/ff6 x:0 0 0 2024-09-12T01:43:13.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/473: mknod d4/d6/d8/d18/d45/c99 0 2024-09-12T01:43:13.355 INFO:tasks.workunit.client.0.smithi066.stdout:4/474: write d4/d6/d8/d18/d45/f95 [180665,26480] 0 2024-09-12T01:43:13.356 INFO:tasks.workunit.client.1.smithi153.stdout:1/869: getdents d2/d34/d3d 0 2024-09-12T01:43:13.356 INFO:tasks.workunit.client.1.smithi153.stdout:1/870: readlink d2/d34/l5d 0 2024-09-12T01:43:13.359 INFO:tasks.workunit.client.1.smithi153.stdout:2/799: symlink d7/db/d6c/d76/lf8 0 2024-09-12T01:43:13.361 INFO:tasks.workunit.client.1.smithi153.stdout:9/867: getdents d3/d66 0 2024-09-12T01:43:13.361 INFO:tasks.workunit.client.1.smithi153.stdout:2/800: dread d7/db/d62/f7f [4194304,4194304] 0 2024-09-12T01:43:13.363 INFO:tasks.workunit.client.0.smithi066.stdout:0/534: rmdir d1/d62/d9f/d4a 39 2024-09-12T01:43:13.363 INFO:tasks.workunit.client.0.smithi066.stdout:0/535: write d1/d62/d9f/d64/fbe [183058,112624] 0 2024-09-12T01:43:13.364 INFO:tasks.workunit.client.1.smithi153.stdout:8/748: getdents d17/d21/d56/d96/d6c/d6e/d7f 0 2024-09-12T01:43:13.365 INFO:tasks.workunit.client.1.smithi153.stdout:1/871: mknod d2/d34/df5/c11b 0 2024-09-12T01:43:13.366 INFO:tasks.workunit.client.1.smithi153.stdout:1/872: dread d2/d9/d1d/f4b [0,4194304] 0 2024-09-12T01:43:13.366 INFO:tasks.workunit.client.1.smithi153.stdout:1/873: chown d2/d34/d3d/l4f 132 1 2024-09-12T01:43:13.367 INFO:tasks.workunit.client.1.smithi153.stdout:9/868: truncate d3/f24 4004798 0 2024-09-12T01:43:13.367 INFO:tasks.workunit.client.1.smithi153.stdout:9/869: readlink d3/d55/l69 0 2024-09-12T01:43:13.367 INFO:tasks.workunit.client.1.smithi153.stdout:9/870: write d3/f8 [2105025,40254] 0 2024-09-12T01:43:13.367 INFO:tasks.workunit.client.1.smithi153.stdout:9/871: stat d3/d55/d30/d7b 0 2024-09-12T01:43:13.367 INFO:tasks.workunit.client.0.smithi066.stdout:7/423: rename d2/d3c/c6d to d2/d5/d6/d40/d51/c90 0 2024-09-12T01:43:13.372 INFO:tasks.workunit.client.1.smithi153.stdout:3/902: rmdir d1/d13/d23/d47/d71/d8e/d93/dd1 39 2024-09-12T01:43:13.372 INFO:tasks.workunit.client.1.smithi153.stdout:3/903: fsync d1/d16/faf 0 2024-09-12T01:43:13.372 INFO:tasks.workunit.client.1.smithi153.stdout:3/904: readlink d1/d1e/d9a/la1 0 2024-09-12T01:43:13.373 INFO:tasks.workunit.client.0.smithi066.stdout:0/536: getdents d1/d62/d9f/d4a 0 2024-09-12T01:43:13.373 INFO:tasks.workunit.client.0.smithi066.stdout:0/537: fdatasync d1/d72/f6f 0 2024-09-12T01:43:13.373 INFO:tasks.workunit.client.0.smithi066.stdout:0/538: fsync d1/d62/d89/d83/f99 0 2024-09-12T01:43:13.373 INFO:tasks.workunit.client.0.smithi066.stdout:0/539: readlink d1/d62/d9f/d4a/d67/d1b/d3b/laf 0 2024-09-12T01:43:13.375 INFO:tasks.workunit.client.1.smithi153.stdout:8/749: mknod d17/d1f/d4f/cf7 0 2024-09-12T01:43:13.375 INFO:tasks.workunit.client.1.smithi153.stdout:8/750: write d17/d1f/d4f/d42/f59 [2611847,117451] 0 2024-09-12T01:43:13.375 INFO:tasks.workunit.client.0.smithi066.stdout:5/455: mkdir d0/dd/d18/d8c 0 2024-09-12T01:43:13.375 INFO:tasks.workunit.client.0.smithi066.stdout:5/456: dread - d0/d26/d2f/d30/f66 zero size 2024-09-12T01:43:13.377 INFO:tasks.workunit.client.0.smithi066.stdout:4/475: truncate d4/d6/d27/d2f/f54 3434278 0 2024-09-12T01:43:13.379 INFO:tasks.workunit.client.1.smithi153.stdout:1/874: rename d2/d34/f39 to d2/d9/d17/d2c/f11c 0 2024-09-12T01:43:13.381 INFO:tasks.workunit.client.0.smithi066.stdout:0/540: symlink d1/d62/d89/lc2 0 2024-09-12T01:43:13.384 INFO:tasks.workunit.client.0.smithi066.stdout:5/457: truncate d0/dd/d18/f53 3347712 0 2024-09-12T01:43:13.386 INFO:tasks.workunit.client.1.smithi153.stdout:9/872: mkdir d3/d55/d30/d95/d84/d105 0 2024-09-12T01:43:13.387 INFO:tasks.workunit.client.1.smithi153.stdout:9/873: readlink d3/d35/l50 0 2024-09-12T01:43:13.389 INFO:tasks.workunit.client.0.smithi066.stdout:4/476: mkdir d4/d5f/d9a 0 2024-09-12T01:43:13.389 INFO:tasks.workunit.client.0.smithi066.stdout:4/477: chown d4/d6/d27/d66/l55 2860441 1 2024-09-12T01:43:13.389 INFO:tasks.workunit.client.0.smithi066.stdout:4/478: write d4/f12 [2010178,115163] 0 2024-09-12T01:43:13.389 INFO:tasks.workunit.client.0.smithi066.stdout:4/479: dread - d4/d6/d62/f92 zero size 2024-09-12T01:43:13.389 INFO:tasks.workunit.client.0.smithi066.stdout:4/480: stat d4/d6/d27/d2f/c7b 0 2024-09-12T01:43:13.391 INFO:tasks.workunit.client.0.smithi066.stdout:5/458: creat d0/dd/f8d x:0 0 0 2024-09-12T01:43:13.391 INFO:tasks.workunit.client.0.smithi066.stdout:0/541: dread d1/d72/de/f1f [0,4194304] 0 2024-09-12T01:43:13.393 INFO:tasks.workunit.client.1.smithi153.stdout:3/905: rename d1/d59/ce7 to d1/d13/d25/da6/c10e 0 2024-09-12T01:43:13.393 INFO:tasks.workunit.client.1.smithi153.stdout:3/906: fdatasync d1/d13/d25/da6/f9e 0 2024-09-12T01:43:13.393 INFO:tasks.workunit.client.1.smithi153.stdout:7/804: truncate d12/d21/d29/d35/fed 248931 0 2024-09-12T01:43:13.394 INFO:tasks.workunit.client.0.smithi066.stdout:4/481: rename d4/c2e to d4/d6/d27/d66/d6c/c9b 0 2024-09-12T01:43:13.395 INFO:tasks.workunit.client.1.smithi153.stdout:7/805: read d12/d21/d29/d35/d95/fcd [517490,99686] 0 2024-09-12T01:43:13.395 INFO:tasks.workunit.client.1.smithi153.stdout:9/874: link d3/f5 d3/d3a/d42/d72/d98/d9a/f106 0 2024-09-12T01:43:13.395 INFO:tasks.workunit.client.1.smithi153.stdout:9/875: write d3/d55/d30/f31 [1313784,126702] 0 2024-09-12T01:43:13.396 INFO:tasks.workunit.client.0.smithi066.stdout:5/459: mkdir d0/d26/d2d/d33/d55/d82/d87/d8e 0 2024-09-12T01:43:13.398 INFO:tasks.workunit.client.1.smithi153.stdout:7/806: link d12/d4e/ffb d12/f100 0 2024-09-12T01:43:13.398 INFO:tasks.workunit.client.1.smithi153.stdout:7/807: fsync d12/d21/d29/d35/d37/d4c/d8e/fb5 0 2024-09-12T01:43:13.399 INFO:tasks.workunit.client.1.smithi153.stdout:3/907: read d1/d13/d25/da6/f7e [387285,33628] 0 2024-09-12T01:43:13.399 INFO:tasks.workunit.client.1.smithi153.stdout:3/908: write d1/d1e/d9a/ff5 [1470209,45814] 0 2024-09-12T01:43:13.400 INFO:tasks.workunit.client.0.smithi066.stdout:0/542: symlink d1/d62/d89/da3/dc1/lc3 0 2024-09-12T01:43:13.400 INFO:tasks.workunit.client.0.smithi066.stdout:8/519: sync 2024-09-12T01:43:13.404 INFO:tasks.workunit.client.1.smithi153.stdout:9/876: mkdir d3/d3a/d42/d72/d107 0 2024-09-12T01:43:13.404 INFO:tasks.workunit.client.0.smithi066.stdout:8/520: creat d12/d21/d2f/d57/d84/d89/fa4 x:0 0 0 2024-09-12T01:43:13.404 INFO:tasks.workunit.client.0.smithi066.stdout:2/451: sync 2024-09-12T01:43:13.405 INFO:tasks.workunit.client.0.smithi066.stdout:6/496: sync 2024-09-12T01:43:13.405 INFO:tasks.workunit.client.0.smithi066.stdout:6/497: write d2/d31/f33 [343131,18234] 0 2024-09-12T01:43:13.405 INFO:tasks.workunit.client.0.smithi066.stdout:6/498: truncate d2/d31/d5e/f8a 656146 0 2024-09-12T01:43:13.405 INFO:tasks.workunit.client.0.smithi066.stdout:7/424: dwrite d2/d5/d6/d22/d75/d25/f67 [0,4194304] 0 2024-09-12T01:43:13.406 INFO:tasks.workunit.client.1.smithi153.stdout:1/875: dwrite d2/d9/d1d/d25/f35 [4194304,4194304] 0 2024-09-12T01:43:13.410 INFO:tasks.workunit.client.0.smithi066.stdout:4/482: mknod d4/d6/d48/d88/c9c 0 2024-09-12T01:43:13.410 INFO:tasks.workunit.client.0.smithi066.stdout:0/543: creat d1/d62/d9f/d4a/dba/fc4 x:0 0 0 2024-09-12T01:43:13.410 INFO:tasks.workunit.client.0.smithi066.stdout:4/483: write d4/f12 [3982238,120482] 0 2024-09-12T01:43:13.410 INFO:tasks.workunit.client.0.smithi066.stdout:4/484: write d4/d6/d8/f3b [3272703,89243] 0 2024-09-12T01:43:13.418 INFO:tasks.workunit.client.0.smithi066.stdout:8/521: dread d12/f23 [0,4194304] 0 2024-09-12T01:43:13.418 INFO:tasks.workunit.client.0.smithi066.stdout:9/477: sync 2024-09-12T01:43:13.418 INFO:tasks.workunit.client.0.smithi066.stdout:1/471: sync 2024-09-12T01:43:13.418 INFO:tasks.workunit.client.0.smithi066.stdout:1/472: truncate d5/f47 5075372 0 2024-09-12T01:43:13.429 INFO:tasks.workunit.client.0.smithi066.stdout:1/473: write d5/d52/d60/f61 [951453,41174] 0 2024-09-12T01:43:13.431 INFO:tasks.workunit.client.0.smithi066.stdout:8/522: creat d12/d21/fa5 x:0 0 0 2024-09-12T01:43:13.432 INFO:tasks.workunit.client.0.smithi066.stdout:1/474: mkdir d5/dc/d4f/d8e 0 2024-09-12T01:43:13.434 INFO:tasks.workunit.client.0.smithi066.stdout:8/523: link d12/d21/d2f/d57/d43/d82/l8e d12/d21/d2f/d53/la6 0 2024-09-12T01:43:13.436 INFO:tasks.workunit.client.0.smithi066.stdout:1/475: creat d5/dc/f8f x:0 0 0 2024-09-12T01:43:13.436 INFO:tasks.workunit.client.0.smithi066.stdout:1/476: creat d5/d52/d5d/f90 x:0 0 0 2024-09-12T01:43:13.438 INFO:tasks.workunit.client.0.smithi066.stdout:1/477: unlink d5/d52/d60/f61 0 2024-09-12T01:43:13.448 INFO:tasks.workunit.client.1.smithi153.stdout:8/751: dwrite d17/d21/d56/d99/f9e [0,4194304] 0 2024-09-12T01:43:13.448 INFO:tasks.workunit.client.1.smithi153.stdout:8/752: readlink d17/d21/d56/d99/ld2 0 2024-09-12T01:43:13.452 INFO:tasks.workunit.client.1.smithi153.stdout:8/753: rename d17/d1f/d4f/d42/d79/c7d to d17/d1d/d27/df1/cf8 0 2024-09-12T01:43:13.460 INFO:tasks.workunit.client.1.smithi153.stdout:3/909: dwrite d1/d45/f58 [0,4194304] 0 2024-09-12T01:43:13.460 INFO:tasks.workunit.client.1.smithi153.stdout:3/910: write d1/d1e/fef [171309,37667] 0 2024-09-12T01:43:13.468 INFO:tasks.workunit.client.0.smithi066.stdout:9/478: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:13.468 INFO:tasks.workunit.client.1.smithi153.stdout:7/808: dwrite d12/d21/d4d/ddc/fe6 [0,4194304] 0 2024-09-12T01:43:13.468 INFO:tasks.workunit.client.1.smithi153.stdout:7/809: write d12/f26 [3656243,121393] 0 2024-09-12T01:43:13.468 INFO:tasks.workunit.client.1.smithi153.stdout:7/810: chown d12/d7e/db2 32562264 1 2024-09-12T01:43:13.471 INFO:tasks.workunit.client.0.smithi066.stdout:4/485: dwrite d4/d15/f79 [0,4194304] 0 2024-09-12T01:43:13.471 INFO:tasks.workunit.client.0.smithi066.stdout:9/479: getdents d0/d6 0 2024-09-12T01:43:13.471 INFO:tasks.workunit.client.0.smithi066.stdout:9/480: chown d0/d6/d17/d1b/d4c/d42/l49 28 1 2024-09-12T01:43:13.471 INFO:tasks.workunit.client.0.smithi066.stdout:1/478: dread d5/f47 [0,4194304] 0 2024-09-12T01:43:13.471 INFO:tasks.workunit.client.0.smithi066.stdout:0/544: dwrite d1/d72/f4f [0,4194304] 0 2024-09-12T01:43:13.474 INFO:tasks.workunit.client.0.smithi066.stdout:4/486: rmdir d4/d6/d8/d18/d4d 39 2024-09-12T01:43:13.474 INFO:tasks.workunit.client.0.smithi066.stdout:4/487: fsync d4/d6/d8/d18/d45/f95 0 2024-09-12T01:43:13.476 INFO:tasks.workunit.client.0.smithi066.stdout:9/481: mknod d0/d6/d7f/caa 0 2024-09-12T01:43:13.477 INFO:tasks.workunit.client.0.smithi066.stdout:5/460: dwrite d0/d26/d2d/d42/f89 [0,4194304] 0 2024-09-12T01:43:13.477 INFO:tasks.workunit.client.0.smithi066.stdout:6/499: dwrite d2/f2a [0,4194304] 0 2024-09-12T01:43:13.477 INFO:tasks.workunit.client.0.smithi066.stdout:6/500: chown d2/d21/d92 19104 1 2024-09-12T01:43:13.479 INFO:tasks.workunit.client.0.smithi066.stdout:0/545: creat d1/d62/d89/d83/d8b/fc5 x:0 0 0 2024-09-12T01:43:13.480 INFO:tasks.workunit.client.0.smithi066.stdout:8/524: dwrite d12/d21/d2f/d57/d43/f91 [0,4194304] 0 2024-09-12T01:43:13.480 INFO:tasks.workunit.client.0.smithi066.stdout:8/525: write d12/d21/d2f/f95 [222107,36391] 0 2024-09-12T01:43:13.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/811: dread d12/d21/d29/d2d/da6/fcf [0,4194304] 0 2024-09-12T01:43:13.482 INFO:tasks.workunit.client.0.smithi066.stdout:4/488: creat d4/d6/f9d x:0 0 0 2024-09-12T01:43:13.482 INFO:tasks.workunit.client.0.smithi066.stdout:4/489: creat d4/d6/d62/f9e x:0 0 0 2024-09-12T01:43:13.482 INFO:tasks.workunit.client.0.smithi066.stdout:4/490: chown d4/d6/d27/d2f/c7b 1742 1 2024-09-12T01:43:13.483 INFO:tasks.workunit.client.1.smithi153.stdout:8/754: dwrite d17/d1f/d4f/d34/f47 [0,4194304] 0 2024-09-12T01:43:13.486 INFO:tasks.workunit.client.0.smithi066.stdout:9/482: mkdir d0/d6/d17/d1b/d4c/d42/dab 0 2024-09-12T01:43:13.488 INFO:tasks.workunit.client.1.smithi153.stdout:2/801: dwrite d7/db/d1d/f5d [0,4194304] 0 2024-09-12T01:43:13.489 INFO:tasks.workunit.client.1.smithi153.stdout:3/911: dwrite d1/d13/d23/f2b [0,4194304] 0 2024-09-12T01:43:13.491 INFO:tasks.workunit.client.0.smithi066.stdout:5/461: creat d0/d26/d2d/d33/d55/d73/f8f x:0 0 0 2024-09-12T01:43:13.492 INFO:tasks.workunit.client.1.smithi153.stdout:1/876: dwrite d2/d9/d17/d2f/d56/f5c [0,4194304] 0 2024-09-12T01:43:13.492 INFO:tasks.workunit.client.1.smithi153.stdout:9/877: dread d3/f24 [0,4194304] 0 2024-09-12T01:43:13.492 INFO:tasks.workunit.client.1.smithi153.stdout:1/877: chown d2/d68/d6b/d9e/dc7/f110 350900507 1 2024-09-12T01:43:13.493 INFO:tasks.workunit.client.1.smithi153.stdout:8/755: symlink d17/d1f/d4f/lf9 0 2024-09-12T01:43:13.493 INFO:tasks.workunit.client.1.smithi153.stdout:8/756: write d17/f85 [5191259,115578] 0 2024-09-12T01:43:13.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/812: getdents d12/d4e 0 2024-09-12T01:43:13.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/813: chown d12/cba 2261 1 2024-09-12T01:43:13.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/814: write d12/f100 [673504,66060] 0 2024-09-12T01:43:13.494 INFO:tasks.workunit.client.1.smithi153.stdout:7/815: stat d12/d21/d29/d35/d95/dea 0 2024-09-12T01:43:13.496 INFO:tasks.workunit.client.0.smithi066.stdout:8/526: mknod d12/d21/d2f/d57/ca7 0 2024-09-12T01:43:13.501 INFO:tasks.workunit.client.0.smithi066.stdout:4/491: unlink d4/d6/d8/d18/d45/f83 0 2024-09-12T01:43:13.501 INFO:tasks.workunit.client.1.smithi153.stdout:2/802: write d7/db/d36/f84 [3146562,110397] 0 2024-09-12T01:43:13.501 INFO:tasks.workunit.client.0.smithi066.stdout:8/527: dread d12/f5b [0,4194304] 0 2024-09-12T01:43:13.502 INFO:tasks.workunit.client.1.smithi153.stdout:9/878: truncate d3/d55/f22 4093724 0 2024-09-12T01:43:13.505 INFO:tasks.workunit.client.1.smithi153.stdout:1/878: creat d2/d9/d17/d69/f11d x:0 0 0 2024-09-12T01:43:13.509 INFO:tasks.workunit.client.0.smithi066.stdout:5/462: link d0/d26/d2d/f49 d0/d26/d2d/f90 0 2024-09-12T01:43:13.510 INFO:tasks.workunit.client.0.smithi066.stdout:5/463: write d0/d26/d2f/f58 [999723,10056] 0 2024-09-12T01:43:13.511 INFO:tasks.workunit.client.0.smithi066.stdout:4/492: dread d4/d6/d8/d18/f69 [0,4194304] 0 2024-09-12T01:43:13.511 INFO:tasks.workunit.client.0.smithi066.stdout:4/493: stat d4/d6/d27/d2f 0 2024-09-12T01:43:13.514 INFO:tasks.workunit.client.0.smithi066.stdout:4/494: symlink d4/d6/d14/l9f 0 2024-09-12T01:43:13.515 INFO:tasks.workunit.client.0.smithi066.stdout:4/495: chown d4/d6/d8/d18/d45/f57 379 1 2024-09-12T01:43:13.515 INFO:tasks.workunit.client.0.smithi066.stdout:4/496: stat d4/d6/d27/d66/l55 0 2024-09-12T01:43:13.515 INFO:tasks.workunit.client.0.smithi066.stdout:4/497: truncate d4/d6/d27/d66/d58/f78 18316 0 2024-09-12T01:43:13.515 INFO:tasks.workunit.client.0.smithi066.stdout:4/498: read d4/d6/d8/d18/d45/f95 [103748,56001] 0 2024-09-12T01:43:13.515 INFO:tasks.workunit.client.0.smithi066.stdout:4/499: readlink d4/d15/l20 0 2024-09-12T01:43:13.516 INFO:tasks.workunit.client.0.smithi066.stdout:0/546: dwrite d1/d72/f38 [0,4194304] 0 2024-09-12T01:43:13.517 INFO:tasks.workunit.client.0.smithi066.stdout:6/501: dwrite d2/d99/d12/d49/f55 [0,4194304] 0 2024-09-12T01:43:13.517 INFO:tasks.workunit.client.0.smithi066.stdout:6/502: truncate d2/d99/d72/d76/f83 655035 0 2024-09-12T01:43:13.518 INFO:tasks.workunit.client.1.smithi153.stdout:3/912: dwrite d1/d13/d25/d26/d4b/f101 [0,4194304] 0 2024-09-12T01:43:13.520 INFO:tasks.workunit.client.1.smithi153.stdout:8/757: link d17/f46 d17/d75/ffa 0 2024-09-12T01:43:13.520 INFO:tasks.workunit.client.1.smithi153.stdout:8/758: fsync d17/d1f/d4f/d34/db4/dda/fea 0 2024-09-12T01:43:13.522 INFO:tasks.workunit.client.0.smithi066.stdout:0/547: rename d1/d62/d9f/d4a/d67/d1b/d26/fa0 to d1/d62/d9f/d4a/d67/d6e/fc6 0 2024-09-12T01:43:13.522 INFO:tasks.workunit.client.0.smithi066.stdout:0/548: chown d1/d72/de/c29 15292 1 2024-09-12T01:43:13.523 INFO:tasks.workunit.client.0.smithi066.stdout:8/528: dwrite d12/d21/d2f/f62 [0,4194304] 0 2024-09-12T01:43:13.524 INFO:tasks.workunit.client.0.smithi066.stdout:8/529: fdatasync d12/f74 0 2024-09-12T01:43:13.525 INFO:tasks.workunit.client.1.smithi153.stdout:7/816: mkdir d12/d21/d4d/dae/dc0/dc4/d101 0 2024-09-12T01:43:13.525 INFO:tasks.workunit.client.1.smithi153.stdout:7/817: chown d12/d21/d4d/c90 535139 1 2024-09-12T01:43:13.526 INFO:tasks.workunit.client.0.smithi066.stdout:4/500: dread d4/d6/f23 [4194304,4194304] 0 2024-09-12T01:43:13.526 INFO:tasks.workunit.client.0.smithi066.stdout:4/501: chown d4/d6/d27/d66 735 1 2024-09-12T01:43:13.529 INFO:tasks.workunit.client.0.smithi066.stdout:0/549: write d1/d62/d9f/d92/d95/fb2 [3656788,31831] 0 2024-09-12T01:43:13.529 INFO:tasks.workunit.client.0.smithi066.stdout:0/550: chown d1/d62/d9f/lc0 256872 1 2024-09-12T01:43:13.529 INFO:tasks.workunit.client.0.smithi066.stdout:0/551: fsync d1/d62/fa4 0 2024-09-12T01:43:13.530 INFO:tasks.workunit.client.1.smithi153.stdout:2/803: rename d7/db/d6c/d9f/df2 to d7/db/d6c/d9f/df9 0 2024-09-12T01:43:13.531 INFO:tasks.workunit.client.1.smithi153.stdout:4/747: sync 2024-09-12T01:43:13.534 INFO:tasks.workunit.client.0.smithi066.stdout:0/552: symlink d1/d62/d9f/d4a/d67/d1b/lc7 0 2024-09-12T01:43:13.536 INFO:tasks.workunit.client.1.smithi153.stdout:8/759: dread d17/d21/f30 [0,4194304] 0 2024-09-12T01:43:13.536 INFO:tasks.workunit.client.1.smithi153.stdout:1/879: mkdir d2/d34/d3d/d11e 0 2024-09-12T01:43:13.538 INFO:tasks.workunit.client.1.smithi153.stdout:7/818: write d12/d21/f45 [1841502,16152] 0 2024-09-12T01:43:13.538 INFO:tasks.workunit.client.1.smithi153.stdout:3/913: creat d1/d13/d23/f10f x:0 0 0 2024-09-12T01:43:13.539 INFO:tasks.workunit.client.0.smithi066.stdout:4/502: write d4/f71 [4968752,122817] 0 2024-09-12T01:43:13.539 INFO:tasks.workunit.client.0.smithi066.stdout:4/503: stat d4/d15/d33/l7c 0 2024-09-12T01:43:13.539 INFO:tasks.workunit.client.0.smithi066.stdout:4/504: creat d4/d6/d27/d66/d6c/fa0 x:0 0 0 2024-09-12T01:43:13.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/804: mknod d7/db/d6c/d76/db8/cfa 0 2024-09-12T01:43:13.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/805: readlink d7/lf5 0 2024-09-12T01:43:13.542 INFO:tasks.workunit.client.1.smithi153.stdout:2/806: dread - d7/d19/d40/fac zero size 2024-09-12T01:43:13.542 INFO:tasks.workunit.client.0.smithi066.stdout:6/503: dwrite d2/f38 [0,4194304] 0 2024-09-12T01:43:13.543 INFO:tasks.workunit.client.0.smithi066.stdout:5/464: dwrite d0/d26/f70 [0,4194304] 0 2024-09-12T01:43:13.543 INFO:tasks.workunit.client.1.smithi153.stdout:4/748: link d6/d9/d11/ffb d6/d15/db4/dbd/f101 0 2024-09-12T01:43:13.544 INFO:tasks.workunit.client.1.smithi153.stdout:3/914: dread d1/d16/d17/d82/d92/fd5 [0,4194304] 0 2024-09-12T01:43:13.544 INFO:tasks.workunit.client.1.smithi153.stdout:3/915: dread - d1/d13/d23/f10f zero size 2024-09-12T01:43:13.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/880: dread d2/d68/fae [0,4194304] 0 2024-09-12T01:43:13.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/881: stat d2/d68/cdf 0 2024-09-12T01:43:13.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/882: fsync d2/d9/fe5 0 2024-09-12T01:43:13.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/883: write d2/d9/fcf [4762878,94727] 0 2024-09-12T01:43:13.545 INFO:tasks.workunit.client.1.smithi153.stdout:1/884: chown d2/d34 69492112 1 2024-09-12T01:43:13.545 INFO:tasks.workunit.client.1.smithi153.stdout:8/760: mknod d17/d21/d56/ddf/cfb 0 2024-09-12T01:43:13.546 INFO:tasks.workunit.client.0.smithi066.stdout:6/504: mknod d2/d99/d72/d76/ca5 0 2024-09-12T01:43:13.548 INFO:tasks.workunit.client.0.smithi066.stdout:0/553: write d1/d62/d9f/d4a/d67/d1b/f33 [3985916,52042] 0 2024-09-12T01:43:13.549 INFO:tasks.workunit.client.1.smithi153.stdout:8/761: dread d17/d21/faf [0,4194304] 0 2024-09-12T01:43:13.549 INFO:tasks.workunit.client.1.smithi153.stdout:7/819: creat d12/d21/d4d/dae/dc0/dc4/d101/f102 x:0 0 0 2024-09-12T01:43:13.549 INFO:tasks.workunit.client.1.smithi153.stdout:7/820: stat d12/d21/d29/d35/d37/l96 0 2024-09-12T01:43:13.549 INFO:tasks.workunit.client.1.smithi153.stdout:7/821: write d12/d21/d29/ff7 [739917,117438] 0 2024-09-12T01:43:13.551 INFO:tasks.workunit.client.1.smithi153.stdout:2/807: truncate d7/db/d6c/d76/fa8 886697 0 2024-09-12T01:43:13.552 INFO:tasks.workunit.client.0.smithi066.stdout:5/465: rename d0/d26/d2f/d3b/f54 to d0/d21/f91 0 2024-09-12T01:43:13.556 INFO:tasks.workunit.client.1.smithi153.stdout:3/916: symlink d1/d13/d23/d47/d71/d8e/d93/d79/db5/df8/l110 0 2024-09-12T01:43:13.558 INFO:tasks.workunit.client.0.smithi066.stdout:4/505: dwrite d4/d6/d8/d18/d45/f95 [0,4194304] 0 2024-09-12T01:43:13.558 INFO:tasks.workunit.client.0.smithi066.stdout:6/505: creat d2/d99/d12/d49/d9e/fa6 x:0 0 0 2024-09-12T01:43:13.563 INFO:tasks.workunit.client.0.smithi066.stdout:0/554: symlink d1/d62/d9f/d92/db9/lc8 0 2024-09-12T01:43:13.563 INFO:tasks.workunit.client.1.smithi153.stdout:2/808: write d7/d17/f8d [2155260,106347] 0 2024-09-12T01:43:13.563 INFO:tasks.workunit.client.1.smithi153.stdout:2/809: chown d7/db/d6c/d7e/f5f 56 1 2024-09-12T01:43:13.563 INFO:tasks.workunit.client.1.smithi153.stdout:2/810: truncate d7/db/d36/ff3 38721 0 2024-09-12T01:43:13.564 INFO:tasks.workunit.client.1.smithi153.stdout:8/762: rmdir d17/d1f/d4f/d42/d79/dd4/de5 0 2024-09-12T01:43:13.564 INFO:tasks.workunit.client.1.smithi153.stdout:8/763: creat d17/d21/d56/d99/ffc x:0 0 0 2024-09-12T01:43:13.565 INFO:tasks.workunit.client.0.smithi066.stdout:5/466: link d0/d26/f6f d0/d26/d2d/d42/f92 0 2024-09-12T01:43:13.566 INFO:tasks.workunit.client.1.smithi153.stdout:7/822: mknod d12/d21/d29/d2d/c103 0 2024-09-12T01:43:13.567 INFO:tasks.workunit.client.0.smithi066.stdout:3/578: sync 2024-09-12T01:43:13.568 INFO:tasks.workunit.client.1.smithi153.stdout:4/749: creat d6/d9/dc/d98/d3e/d66/f102 x:0 0 0 2024-09-12T01:43:13.570 INFO:tasks.workunit.client.1.smithi153.stdout:2/811: dread d7/db/d62/f72 [0,4194304] 0 2024-09-12T01:43:13.571 INFO:tasks.workunit.client.1.smithi153.stdout:3/917: mkdir d1/d13/d23/d47/d6c/d9c/d107/d111 0 2024-09-12T01:43:13.572 INFO:tasks.workunit.client.0.smithi066.stdout:0/555: dread d1/d62/d9f/d4a/d67/d1b/d26/f2e [4194304,4194304] 0 2024-09-12T01:43:13.572 INFO:tasks.workunit.client.0.smithi066.stdout:0/556: chown d1/d62/d9f/d4a/d67 66592212 1 2024-09-12T01:43:13.574 INFO:tasks.workunit.client.0.smithi066.stdout:6/506: symlink d2/d21/d92/d9f/la7 0 2024-09-12T01:43:13.577 INFO:tasks.workunit.client.1.smithi153.stdout:7/823: dread d12/f36 [4194304,4194304] 0 2024-09-12T01:43:13.577 INFO:tasks.workunit.client.1.smithi153.stdout:1/885: rmdir d2/d9/d17/d69 39 2024-09-12T01:43:13.577 INFO:tasks.workunit.client.1.smithi153.stdout:2/812: dread d7/db/d6c/d7e/f66 [0,4194304] 0 2024-09-12T01:43:13.580 INFO:tasks.workunit.client.0.smithi066.stdout:5/467: creat d0/d26/d2d/d33/d55/d73/d74/f93 x:0 0 0 2024-09-12T01:43:13.582 INFO:tasks.workunit.client.0.smithi066.stdout:0/557: mkdir d1/d62/d9f/d4a/d67/d20/dc9 0 2024-09-12T01:43:13.583 INFO:tasks.workunit.client.1.smithi153.stdout:5/864: sync 2024-09-12T01:43:13.583 INFO:tasks.workunit.client.1.smithi153.stdout:0/942: sync 2024-09-12T01:43:13.583 INFO:tasks.workunit.client.1.smithi153.stdout:6/911: sync 2024-09-12T01:43:13.584 INFO:tasks.workunit.client.1.smithi153.stdout:8/764: link d17/f85 d17/d21/d56/d99/ffd 0 2024-09-12T01:43:13.587 INFO:tasks.workunit.client.0.smithi066.stdout:3/579: dwrite d5/d6/d1b/d65/d89/d50/fc5 [0,4194304] 0 2024-09-12T01:43:13.587 INFO:tasks.workunit.client.0.smithi066.stdout:3/580: write d5/d6/d1b/f2e [207485,7175] 0 2024-09-12T01:43:13.588 INFO:tasks.workunit.client.1.smithi153.stdout:4/750: unlink d6/d9/d11/d13/ca6 0 2024-09-12T01:43:13.588 INFO:tasks.workunit.client.0.smithi066.stdout:6/507: write d2/d21/f52 [4595086,80172] 0 2024-09-12T01:43:13.588 INFO:tasks.workunit.client.0.smithi066.stdout:0/558: symlink d1/d62/d9f/d4a/d67/d1b/d3b/lca 0 2024-09-12T01:43:13.592 INFO:tasks.workunit.client.1.smithi153.stdout:9/879: write d3/d35/f79 [572507,58383] 0 2024-09-12T01:43:13.595 INFO:tasks.workunit.client.1.smithi153.stdout:3/918: unlink d1/d13/d23/d47/d6c/f6d 0 2024-09-12T01:43:13.597 INFO:tasks.workunit.client.1.smithi153.stdout:1/886: mknod d2/d9/d17/d100/d116/c11f 0 2024-09-12T01:43:13.601 INFO:tasks.workunit.client.1.smithi153.stdout:3/919: dread d1/d1e/f80 [0,4194304] 0 2024-09-12T01:43:13.601 INFO:tasks.workunit.client.1.smithi153.stdout:3/920: creat d1/d1e/d9a/f112 x:0 0 0 2024-09-12T01:43:13.603 INFO:tasks.workunit.client.1.smithi153.stdout:2/813: unlink d7/db/d6c/d76/db8/led 0 2024-09-12T01:43:13.608 INFO:tasks.workunit.client.1.smithi153.stdout:6/912: link d1/d6/d39/d76/f42 d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/f127 0 2024-09-12T01:43:13.608 INFO:tasks.workunit.client.1.smithi153.stdout:6/913: readlink d1/d6/d23/d98/d53/da4/lcc 0 2024-09-12T01:43:13.609 INFO:tasks.workunit.client.0.smithi066.stdout:6/508: getdents d2/d99/d12 0 2024-09-12T01:43:13.610 INFO:tasks.workunit.client.1.smithi153.stdout:5/865: mknod d0/d43/dac/db0/d109/d1c/c10f 0 2024-09-12T01:43:13.610 INFO:tasks.workunit.client.1.smithi153.stdout:5/866: stat d0/d43/dac/db0/d109/db8/f86 0 2024-09-12T01:43:13.611 INFO:tasks.workunit.client.0.smithi066.stdout:0/559: symlink d1/d62/d9f/d7e/lcb 0 2024-09-12T01:43:13.614 INFO:tasks.workunit.client.1.smithi153.stdout:1/887: truncate d2/d9/f1a 570009 0 2024-09-12T01:43:13.622 INFO:tasks.workunit.client.1.smithi153.stdout:3/921: rename d1/d16/d1c/f33 to d1/d13/d23/d47/d71/d8e/d93/d79/db5/f113 0 2024-09-12T01:43:13.624 INFO:tasks.workunit.client.1.smithi153.stdout:6/914: dread d1/d6/d23/d98/d53/f6a [0,4194304] 0 2024-09-12T01:43:13.624 INFO:tasks.workunit.client.1.smithi153.stdout:6/915: chown d1/d6/d23/d98 402 1 2024-09-12T01:43:13.625 INFO:tasks.workunit.client.0.smithi066.stdout:6/509: dread d2/f2a [0,4194304] 0 2024-09-12T01:43:13.626 INFO:tasks.workunit.client.0.smithi066.stdout:3/581: rename d5/d6/d1b/d28 to d5/d6/d1b/d45/d66/d67/d6d/dc7 0 2024-09-12T01:43:13.627 INFO:tasks.workunit.client.1.smithi153.stdout:7/824: dwrite d12/d21/d29/d2d/f30 [0,4194304] 0 2024-09-12T01:43:13.627 INFO:tasks.workunit.client.1.smithi153.stdout:0/943: dwrite d22/d79/dca/dec/d136/dff/d11e/f10f [0,4194304] 0 2024-09-12T01:43:13.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/867: dread d0/d20/f4a [0,4194304] 0 2024-09-12T01:43:13.627 INFO:tasks.workunit.client.1.smithi153.stdout:5/868: chown d0/d43/dac/db0/d109/d102/le2 333 1 2024-09-12T01:43:13.628 INFO:tasks.workunit.client.1.smithi153.stdout:1/888: mknod d2/d34/d8a/c120 0 2024-09-12T01:43:13.628 INFO:tasks.workunit.client.1.smithi153.stdout:1/889: read - d2/d9/d17/d2f/d56/d83/fc2 zero size 2024-09-12T01:43:13.628 INFO:tasks.workunit.client.1.smithi153.stdout:1/890: chown d2/d9/cca 1626201584 1 2024-09-12T01:43:13.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/510: creat d2/d31/fa8 x:0 0 0 2024-09-12T01:43:13.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/916: truncate d1/d6/d23/d98/d53/f85 1349535 0 2024-09-12T01:43:13.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/917: chown d1/df/fea 52526985 1 2024-09-12T01:43:13.635 INFO:tasks.workunit.client.0.smithi066.stdout:6/511: symlink d2/d31/d57/la9 0 2024-09-12T01:43:13.637 INFO:tasks.workunit.client.1.smithi153.stdout:7/825: symlink d12/d21/d4d/dae/l104 0 2024-09-12T01:43:13.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/751: dwrite d6/d9/dc/d31/d7d/fb0 [0,4194304] 0 2024-09-12T01:43:13.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/752: chown d6/d9/dc/d98/fee 188548 1 2024-09-12T01:43:13.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/753: chown d6/d15/db4/c83 2374995 1 2024-09-12T01:43:13.638 INFO:tasks.workunit.client.1.smithi153.stdout:8/765: dwrite d17/d21/d56/d96/fa4 [4194304,4194304] 0 2024-09-12T01:43:13.638 INFO:tasks.workunit.client.0.smithi066.stdout:3/582: dread f4 [0,4194304] 0 2024-09-12T01:43:13.638 INFO:tasks.workunit.client.0.smithi066.stdout:3/583: creat d5/d6/d1b/d45/d66/d67/d75/d8e/fc8 x:0 0 0 2024-09-12T01:43:13.639 INFO:tasks.workunit.client.1.smithi153.stdout:0/944: truncate d22/d30/f67 668342 0 2024-09-12T01:43:13.639 INFO:tasks.workunit.client.1.smithi153.stdout:5/869: creat d0/d43/d8d/d8e/dd7/f110 x:0 0 0 2024-09-12T01:43:13.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/922: write d1/d1e/f5e [1820144,9042] 0 2024-09-12T01:43:13.641 INFO:tasks.workunit.client.1.smithi153.stdout:3/923: stat d1/d45/f51 0 2024-09-12T01:43:13.644 INFO:tasks.workunit.client.1.smithi153.stdout:1/891: creat d2/d9/d28/d73/f121 x:0 0 0 2024-09-12T01:43:13.645 INFO:tasks.workunit.client.1.smithi153.stdout:9/880: dwrite d3/d3a/d42/d72/d98/d9a/f106 [4194304,4194304] 0 2024-09-12T01:43:13.645 INFO:tasks.workunit.client.1.smithi153.stdout:9/881: dread - d3/d66/ffe zero size 2024-09-12T01:43:13.645 INFO:tasks.workunit.client.1.smithi153.stdout:9/882: fdatasync d3/d55/f59 0 2024-09-12T01:43:13.645 INFO:tasks.workunit.client.0.smithi066.stdout:0/560: dwrite d1/d62/d9f/d4a/d67/f91 [0,4194304] 0 2024-09-12T01:43:13.649 INFO:tasks.workunit.client.1.smithi153.stdout:7/826: dread d12/d21/d29/f5a [4194304,4194304] 0 2024-09-12T01:43:13.649 INFO:tasks.workunit.client.1.smithi153.stdout:0/945: creat d22/d79/dca/df2/f13e x:0 0 0 2024-09-12T01:43:13.649 INFO:tasks.workunit.client.1.smithi153.stdout:7/827: creat d12/d21/d29/f105 x:0 0 0 2024-09-12T01:43:13.649 INFO:tasks.workunit.client.1.smithi153.stdout:7/828: fdatasync d12/d7e/f8f 0 2024-09-12T01:43:13.649 INFO:tasks.workunit.client.1.smithi153.stdout:5/870: mkdir d0/d43/dac/db0/d109/db8/d6e/d111 0 2024-09-12T01:43:13.650 INFO:tasks.workunit.client.0.smithi066.stdout:0/561: dread d1/f2d [0,4194304] 0 2024-09-12T01:43:13.650 INFO:tasks.workunit.client.0.smithi066.stdout:0/562: chown d1/d72/cbc 3645 1 2024-09-12T01:43:13.653 INFO:tasks.workunit.client.0.smithi066.stdout:0/563: creat d1/d62/d9f/d4a/d67/d1b/d3b/fcc x:0 0 0 2024-09-12T01:43:13.654 INFO:tasks.workunit.client.1.smithi153.stdout:8/766: dread d17/d1d/d27/f7e [0,4194304] 0 2024-09-12T01:43:13.655 INFO:tasks.workunit.client.1.smithi153.stdout:2/814: dwrite d7/db/f50 [0,4194304] 0 2024-09-12T01:43:13.655 INFO:tasks.workunit.client.1.smithi153.stdout:8/767: readlink d17/d1f/l3d 0 2024-09-12T01:43:13.655 INFO:tasks.workunit.client.1.smithi153.stdout:3/924: write d1/d16/f6f [1411056,39149] 0 2024-09-12T01:43:13.655 INFO:tasks.workunit.client.1.smithi153.stdout:3/925: dread - d1/d1e/fba zero size 2024-09-12T01:43:13.656 INFO:tasks.workunit.client.1.smithi153.stdout:1/892: rmdir d2/d9/d17/d69 39 2024-09-12T01:43:13.659 INFO:tasks.workunit.client.1.smithi153.stdout:9/883: mknod d3/d55/d30/d88/dc6/c108 0 2024-09-12T01:43:13.659 INFO:tasks.workunit.client.1.smithi153.stdout:9/884: truncate d3/d55/d30/d95/d84/d8b/fb6 1019444 0 2024-09-12T01:43:13.663 INFO:tasks.workunit.client.1.smithi153.stdout:4/754: dwrite d6/d9/d11/d90/f95 [0,4194304] 0 2024-09-12T01:43:13.667 INFO:tasks.workunit.client.0.smithi066.stdout:6/512: dwrite d2/d21/f41 [0,4194304] 0 2024-09-12T01:43:13.671 INFO:tasks.workunit.client.1.smithi153.stdout:0/946: rename d22/d79/d8e/dc6/dd6/l107 to d22/d79/dca/dec/d136/db7/de8/l13f 0 2024-09-12T01:43:13.671 INFO:tasks.workunit.client.1.smithi153.stdout:0/947: creat d22/d79/dca/ded/df8/f140 x:0 0 0 2024-09-12T01:43:13.671 INFO:tasks.workunit.client.1.smithi153.stdout:0/948: chown d22/d30/d4c/d6f/d88/fd0 8278 1 2024-09-12T01:43:13.671 INFO:tasks.workunit.client.1.smithi153.stdout:1/893: write d2/d9/fb5 [621625,104714] 0 2024-09-12T01:43:13.671 INFO:tasks.workunit.client.1.smithi153.stdout:1/894: write d2/d9/d28/d73/f121 [836637,84944] 0 2024-09-12T01:43:13.671 INFO:tasks.workunit.client.1.smithi153.stdout:1/895: fdatasync d2/d34/d8a/da7/ff2 0 2024-09-12T01:43:13.672 INFO:tasks.workunit.client.1.smithi153.stdout:7/829: link d12/d21/d29/d35/d37/d58/cd7 d12/d21/d29/d2d/d8b/c106 0 2024-09-12T01:43:13.674 INFO:tasks.workunit.client.1.smithi153.stdout:5/871: creat d0/d43/dac/db0/d109/db8/f112 x:0 0 0 2024-09-12T01:43:13.676 INFO:tasks.workunit.client.0.smithi066.stdout:6/513: write d2/d21/f41 [2065747,87862] 0 2024-09-12T01:43:13.676 INFO:tasks.workunit.client.0.smithi066.stdout:6/514: fsync d2/fe 0 2024-09-12T01:43:13.676 INFO:tasks.workunit.client.0.smithi066.stdout:6/515: rename d2 to d2/d99/daa 22 2024-09-12T01:43:13.679 INFO:tasks.workunit.client.1.smithi153.stdout:3/926: dwrite d1/d13/d25/da6/f5f [4194304,4194304] 0 2024-09-12T01:43:13.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/516: symlink d2/lab 0 2024-09-12T01:43:13.680 INFO:tasks.workunit.client.0.smithi066.stdout:0/564: dwrite d1/d62/d9f/d4a/d67/f52 [0,4194304] 0 2024-09-12T01:43:13.680 INFO:tasks.workunit.client.1.smithi153.stdout:2/815: getdents d7/d4d 0 2024-09-12T01:43:13.683 INFO:tasks.workunit.client.0.smithi066.stdout:6/517: symlink d2/d31/lac 0 2024-09-12T01:43:13.683 INFO:tasks.workunit.client.0.smithi066.stdout:6/518: write d2/d99/f8e [516351,75385] 0 2024-09-12T01:43:13.683 INFO:tasks.workunit.client.1.smithi153.stdout:9/885: symlink d3/d3a/d42/l109 0 2024-09-12T01:43:13.684 INFO:tasks.workunit.client.0.smithi066.stdout:0/565: mkdir d1/d62/d9f/d92/d95/dcd 0 2024-09-12T01:43:13.687 INFO:tasks.workunit.client.0.smithi066.stdout:6/519: write d2/d21/f34 [871354,63981] 0 2024-09-12T01:43:13.688 INFO:tasks.workunit.client.0.smithi066.stdout:0/566: link d1/d62/d9f/db4/l84 d1/d62/d9f/db4/lce 0 2024-09-12T01:43:13.688 INFO:tasks.workunit.client.0.smithi066.stdout:0/567: truncate d1/d62/d9f/d4a/d67/f70 4338968 0 2024-09-12T01:43:13.688 INFO:tasks.workunit.client.0.smithi066.stdout:0/568: write d1/d62/d9f/d4a/d67/d3e/f75 [422969,107277] 0 2024-09-12T01:43:13.688 INFO:tasks.workunit.client.0.smithi066.stdout:0/569: fdatasync d1/d62/d9f/d92/d95/fb2 0 2024-09-12T01:43:13.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/520: mknod d2/d99/d72/d87/cad 0 2024-09-12T01:43:13.692 INFO:tasks.workunit.client.1.smithi153.stdout:4/755: mknod d6/d9/d11/d13/dce/dd7/c103 0 2024-09-12T01:43:13.692 INFO:tasks.workunit.client.1.smithi153.stdout:4/756: write d6/d15/db4/ff0 [2394200,51080] 0 2024-09-12T01:43:13.693 INFO:tasks.workunit.client.0.smithi066.stdout:0/570: creat d1/d62/d9f/fcf x:0 0 0 2024-09-12T01:43:13.694 INFO:tasks.workunit.client.1.smithi153.stdout:8/768: rename d17/d1d/lb6 to d17/d21/d56/d95/dd6/lfe 0 2024-09-12T01:43:13.695 INFO:tasks.workunit.client.0.smithi066.stdout:6/521: getdents d2/d21/d92/d9f 0 2024-09-12T01:43:13.695 INFO:tasks.workunit.client.0.smithi066.stdout:6/522: write d2/d21/f52 [8473020,39090] 0 2024-09-12T01:43:13.695 INFO:tasks.workunit.client.0.smithi066.stdout:6/523: chown d2/d31/d5e/f71 5 1 2024-09-12T01:43:13.695 INFO:tasks.workunit.client.0.smithi066.stdout:6/524: chown d2/d99/d12/d1d/f91 0 1 2024-09-12T01:43:13.697 INFO:tasks.workunit.client.1.smithi153.stdout:0/949: creat d22/d82/d10e/f141 x:0 0 0 2024-09-12T01:43:13.698 INFO:tasks.workunit.client.1.smithi153.stdout:4/757: dread d6/d15/db4/ff0 [0,4194304] 0 2024-09-12T01:43:13.698 INFO:tasks.workunit.client.0.smithi066.stdout:0/571: mkdir d1/d62/d9f/d4a/d67/dd0 0 2024-09-12T01:43:13.700 INFO:tasks.workunit.client.1.smithi153.stdout:1/896: creat d2/d34/d3d/d11e/f122 x:0 0 0 2024-09-12T01:43:13.701 INFO:tasks.workunit.client.1.smithi153.stdout:1/897: chown d2/d9/d17/d2c/d118 55264133 1 2024-09-12T01:43:13.701 INFO:tasks.workunit.client.1.smithi153.stdout:1/898: truncate d2/d9/d17/d2f/d56/d71/f75 978145 0 2024-09-12T01:43:13.701 INFO:tasks.workunit.client.1.smithi153.stdout:7/830: rmdir d12/d21/d4d/ddc 39 2024-09-12T01:43:13.702 INFO:tasks.workunit.client.1.smithi153.stdout:5/872: rmdir d0/d43/dac/db0/d109/db8/d88 39 2024-09-12T01:43:13.702 INFO:tasks.workunit.client.1.smithi153.stdout:5/873: chown d0/d43/dac/db0/d109/d83/d36/d39/da4/lfc 7449912 1 2024-09-12T01:43:13.704 INFO:tasks.workunit.client.0.smithi066.stdout:6/525: write d2/d99/d12/f5c [6116,42301] 0 2024-09-12T01:43:13.704 INFO:tasks.workunit.client.0.smithi066.stdout:6/526: chown d2/d99/d12/d1d/d6b/c6f 296507 1 2024-09-12T01:43:13.707 INFO:tasks.workunit.client.1.smithi153.stdout:0/950: write d22/d30/d4c/d6f/d88/faa [1617384,127117] 0 2024-09-12T01:43:13.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/927: rename d1/d13/d23/d47/d6c/fe0 to d1/d13/d25/da6/f114 0 2024-09-12T01:43:13.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/928: write d1/d1e/fba [831483,101606] 0 2024-09-12T01:43:13.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/929: read - d1/d64/db0/fd2 zero size 2024-09-12T01:43:13.707 INFO:tasks.workunit.client.1.smithi153.stdout:3/930: chown d1/d16/d17/d82/d92 43116882 1 2024-09-12T01:43:13.709 INFO:tasks.workunit.client.1.smithi153.stdout:4/758: mknod d6/d9/dc/d31/d76/d99/dd2/c104 0 2024-09-12T01:43:13.711 INFO:tasks.workunit.client.1.smithi153.stdout:5/874: dread d0/d15/f96 [0,4194304] 0 2024-09-12T01:43:13.714 INFO:tasks.workunit.client.0.smithi066.stdout:6/527: rmdir d2/d99/d12/d1d/d6b/d9a 0 2024-09-12T01:43:13.719 INFO:tasks.workunit.client.1.smithi153.stdout:2/816: rename d7/db/d7c/fe4 to d7/db/d62/d87/ffb 0 2024-09-12T01:43:13.722 INFO:tasks.workunit.client.1.smithi153.stdout:0/951: link d22/d30/d4c/d6f/l8b d22/d79/dca/ded/l142 0 2024-09-12T01:43:13.722 INFO:tasks.workunit.client.1.smithi153.stdout:0/952: fdatasync d22/d30/d4c/f131 0 2024-09-12T01:43:13.724 INFO:tasks.workunit.client.1.smithi153.stdout:3/931: mkdir d1/d13/d23/d47/d71/d8e/d93/db1/d115 0 2024-09-12T01:43:13.724 INFO:tasks.workunit.client.1.smithi153.stdout:3/932: dread - d1/d64/db0/fc7 zero size 2024-09-12T01:43:13.724 INFO:tasks.workunit.client.1.smithi153.stdout:3/933: read - d1/d13/d23/d47/d71/fee zero size 2024-09-12T01:43:13.725 INFO:tasks.workunit.client.0.smithi066.stdout:0/572: dwrite d1/d62/d9f/d64/fbe [0,4194304] 0 2024-09-12T01:43:13.725 INFO:tasks.workunit.client.0.smithi066.stdout:0/573: rename d1/d62 to d1/d62/d9f/d92/dd1 22 2024-09-12T01:43:13.725 INFO:tasks.workunit.client.0.smithi066.stdout:0/574: fsync d1/d62/d9f/d4a/d67/d20/f21 0 2024-09-12T01:43:13.726 INFO:tasks.workunit.client.1.smithi153.stdout:4/759: mknod d6/d9/dc/c105 0 2024-09-12T01:43:13.726 INFO:tasks.workunit.client.1.smithi153.stdout:4/760: chown d6/d9/d11/d13/dce/dd7/c4d 4645 1 2024-09-12T01:43:13.727 INFO:tasks.workunit.client.1.smithi153.stdout:4/761: fsync d6/d9/dc/d31/d7d/d94/df7/ffc 0 2024-09-12T01:43:13.732 INFO:tasks.workunit.client.1.smithi153.stdout:1/899: rmdir d2/d68 39 2024-09-12T01:43:13.732 INFO:tasks.workunit.client.1.smithi153.stdout:1/900: stat d2/d9/d17/d2f/d56/d91 0 2024-09-12T01:43:13.732 INFO:tasks.workunit.client.1.smithi153.stdout:1/901: chown d2/d9/d17/cf8 7188 1 2024-09-12T01:43:13.732 INFO:tasks.workunit.client.1.smithi153.stdout:1/902: write d2/d9/d17/d2f/d56/d97/fb1 [1010012,105377] 0 2024-09-12T01:43:13.734 INFO:tasks.workunit.client.1.smithi153.stdout:9/886: rename d3/d35/f8a to d3/d3a/d42/d72/dc3/dd9/f10a 0 2024-09-12T01:43:13.736 INFO:tasks.workunit.client.1.smithi153.stdout:2/817: mkdir d7/db/d27/dfc 0 2024-09-12T01:43:13.736 INFO:tasks.workunit.client.1.smithi153.stdout:2/818: creat d7/db/d1d/d1e/d6d/ffd x:0 0 0 2024-09-12T01:43:13.736 INFO:tasks.workunit.client.1.smithi153.stdout:2/819: dread - d7/db/d6c/fec zero size 2024-09-12T01:43:13.737 INFO:tasks.workunit.client.1.smithi153.stdout:0/953: symlink d22/d30/d4c/d6f/l143 0 2024-09-12T01:43:13.738 INFO:tasks.workunit.client.1.smithi153.stdout:3/934: creat d1/d13/d25/d26/d4b/d97/f116 x:0 0 0 2024-09-12T01:43:13.740 INFO:tasks.workunit.client.1.smithi153.stdout:4/762: chown d6/d9/dc/d98/d3e/l40 946880203 1 2024-09-12T01:43:13.740 INFO:tasks.workunit.client.1.smithi153.stdout:4/763: truncate d6/d9/dc/d31/d76/d99/f6b 374798 0 2024-09-12T01:43:13.741 INFO:tasks.workunit.client.1.smithi153.stdout:7/831: dwrite d12/f33 [0,4194304] 0 2024-09-12T01:43:13.741 INFO:tasks.workunit.client.1.smithi153.stdout:7/832: creat d12/d21/d29/d35/d37/d4c/f107 x:0 0 0 2024-09-12T01:43:13.741 INFO:tasks.workunit.client.1.smithi153.stdout:7/833: chown d12/d21/d29/d35/d37/d4c/d5c 1441196 1 2024-09-12T01:43:13.741 INFO:tasks.workunit.client.1.smithi153.stdout:7/834: creat d12/d21/d29/d35/d37/d4c/f108 x:0 0 0 2024-09-12T01:43:13.741 INFO:tasks.workunit.client.1.smithi153.stdout:7/835: fdatasync d12/d21/d29/d35/d37/d58/fa7 0 2024-09-12T01:43:13.743 INFO:tasks.workunit.client.1.smithi153.stdout:8/769: rename f15 to d17/d21/d56/d96/d6c/d89/ded/fff 0 2024-09-12T01:43:13.744 INFO:tasks.workunit.client.1.smithi153.stdout:5/875: dwrite d0/d43/dac/db0/d109/db8/f112 [0,4194304] 0 2024-09-12T01:43:13.745 INFO:tasks.workunit.client.1.smithi153.stdout:9/887: creat d3/d55/d30/d88/f10b x:0 0 0 2024-09-12T01:43:13.746 INFO:tasks.workunit.client.1.smithi153.stdout:9/888: truncate d3/d55/fb4 970840 0 2024-09-12T01:43:13.746 INFO:tasks.workunit.client.1.smithi153.stdout:9/889: stat d3/d55/d30/d5b/ff6 0 2024-09-12T01:43:13.746 INFO:tasks.workunit.client.1.smithi153.stdout:9/890: creat d3/d66/d80/f10c x:0 0 0 2024-09-12T01:43:13.747 INFO:tasks.workunit.client.0.smithi066.stdout:6/528: dwrite d2/d31/f93 [0,4194304] 0 2024-09-12T01:43:13.750 INFO:tasks.workunit.client.1.smithi153.stdout:0/954: creat d22/d30/d4c/d8a/f144 x:0 0 0 2024-09-12T01:43:13.750 INFO:tasks.workunit.client.1.smithi153.stdout:0/955: readlink d22/d30/d4c/d6e/l45 0 2024-09-12T01:43:13.753 INFO:tasks.workunit.client.1.smithi153.stdout:4/764: mkdir d6/d15/db4/dbd/d106 0 2024-09-12T01:43:13.760 INFO:tasks.workunit.client.1.smithi153.stdout:7/836: truncate d12/f26 137868 0 2024-09-12T01:43:13.762 INFO:tasks.workunit.client.1.smithi153.stdout:8/770: creat d17/d21/d56/d96/d6c/d89/ded/f100 x:0 0 0 2024-09-12T01:43:13.768 INFO:tasks.workunit.client.1.smithi153.stdout:5/876: mkdir d0/d43/dac/db0/d109/db8/d2f/d55/d113 0 2024-09-12T01:43:13.769 INFO:tasks.workunit.client.1.smithi153.stdout:3/935: dwrite d1/d64/f86 [0,4194304] 0 2024-09-12T01:43:13.778 INFO:tasks.workunit.client.1.smithi153.stdout:4/765: creat d6/d9/dc/d31/d76/d99/f107 x:0 0 0 2024-09-12T01:43:13.779 INFO:tasks.workunit.client.1.smithi153.stdout:4/766: fsync d6/d9/dc/f64 0 2024-09-12T01:43:13.779 INFO:tasks.workunit.client.1.smithi153.stdout:4/767: write d6/d9/dc/d31/d76/d99/f85 [975146,101774] 0 2024-09-12T01:43:13.779 INFO:tasks.workunit.client.1.smithi153.stdout:4/768: fsync d6/d9/dc/d31/d7d/d94/df7/ffc 0 2024-09-12T01:43:13.780 INFO:tasks.workunit.client.1.smithi153.stdout:4/769: dread d6/d6a/f8c [0,4194304] 0 2024-09-12T01:43:13.780 INFO:tasks.workunit.client.1.smithi153.stdout:4/770: readlink d6/d9/d20/lcc 0 2024-09-12T01:43:13.780 INFO:tasks.workunit.client.1.smithi153.stdout:4/771: write d6/d15/fc3 [1553070,83334] 0 2024-09-12T01:43:13.780 INFO:tasks.workunit.client.1.smithi153.stdout:3/936: mknod d1/d64/db0/c117 0 2024-09-12T01:43:13.781 INFO:tasks.workunit.client.1.smithi153.stdout:9/891: rmdir d3/d5f/d62 39 2024-09-12T01:43:13.785 INFO:tasks.workunit.client.1.smithi153.stdout:0/956: rmdir d22/d79/dca 39 2024-09-12T01:43:13.787 INFO:tasks.workunit.client.1.smithi153.stdout:4/772: mkdir d6/d9/dc/d31/d7d/d94/df7/d108 0 2024-09-12T01:43:13.789 INFO:tasks.workunit.client.1.smithi153.stdout:9/892: mknod d3/d55/d30/d88/dc6/c10d 0 2024-09-12T01:43:13.791 INFO:tasks.workunit.client.1.smithi153.stdout:0/957: truncate d22/f2c 3441501 0 2024-09-12T01:43:13.792 INFO:tasks.workunit.client.1.smithi153.stdout:3/937: rmdir d1/d1e/d9a 39 2024-09-12T01:43:13.792 INFO:tasks.workunit.client.1.smithi153.stdout:3/938: chown d1/d16/d1c/c3c 463 1 2024-09-12T01:43:13.792 INFO:tasks.workunit.client.1.smithi153.stdout:3/939: creat d1/d45/f118 x:0 0 0 2024-09-12T01:43:13.792 INFO:tasks.workunit.client.1.smithi153.stdout:9/893: symlink d3/d66/ddc/l10e 0 2024-09-12T01:43:13.793 INFO:tasks.workunit.client.1.smithi153.stdout:4/773: dread d6/d9/dc/d31/d7d/d94/fe5 [0,4194304] 0 2024-09-12T01:43:13.794 INFO:tasks.workunit.client.1.smithi153.stdout:3/940: mkdir d1/d13/d23/d47/d6c/d119 0 2024-09-12T01:43:13.794 INFO:tasks.workunit.client.1.smithi153.stdout:3/941: truncate d1/d16/f109 170881 0 2024-09-12T01:43:13.795 INFO:tasks.workunit.client.1.smithi153.stdout:4/774: symlink d6/d6a/l109 0 2024-09-12T01:43:13.795 INFO:tasks.workunit.client.1.smithi153.stdout:4/775: creat d6/d9/d11/d90/f10a x:0 0 0 2024-09-12T01:43:13.795 INFO:tasks.workunit.client.1.smithi153.stdout:4/776: readlink d6/d9/dc/l5f 0 2024-09-12T01:43:13.795 INFO:tasks.workunit.client.1.smithi153.stdout:0/958: dread d22/f26 [0,4194304] 0 2024-09-12T01:43:13.798 INFO:tasks.workunit.client.1.smithi153.stdout:0/959: creat d22/d30/d4c/d6f/d88/f145 x:0 0 0 2024-09-12T01:43:13.798 INFO:tasks.workunit.client.1.smithi153.stdout:0/960: chown d22/d30/d4c/d6f/ce3 52 1 2024-09-12T01:43:13.800 INFO:tasks.workunit.client.1.smithi153.stdout:0/961: truncate d22/d79/fb8 340032 0 2024-09-12T01:43:13.801 INFO:tasks.workunit.client.1.smithi153.stdout:0/962: symlink d22/d79/dca/df2/l146 0 2024-09-12T01:43:13.803 INFO:tasks.workunit.client.1.smithi153.stdout:0/963: mkdir d22/d79/dca/dec/d136/dff/d147 0 2024-09-12T01:43:13.803 INFO:tasks.workunit.client.1.smithi153.stdout:0/964: chown d22/d79/d8e/dc6/c11d 71102 1 2024-09-12T01:43:13.803 INFO:tasks.workunit.client.1.smithi153.stdout:9/894: dread d3/d3a/d42/faf [0,4194304] 0 2024-09-12T01:43:13.803 INFO:tasks.workunit.client.1.smithi153.stdout:9/895: chown d3/d55/l78 807162 1 2024-09-12T01:43:13.804 INFO:tasks.workunit.client.1.smithi153.stdout:9/896: creat d3/d66/f10f x:0 0 0 2024-09-12T01:43:13.805 INFO:tasks.workunit.client.1.smithi153.stdout:9/897: creat d3/d3a/d42/f110 x:0 0 0 2024-09-12T01:43:13.805 INFO:tasks.workunit.client.1.smithi153.stdout:6/918: sync 2024-09-12T01:43:13.808 INFO:tasks.workunit.client.1.smithi153.stdout:6/919: creat d1/d6/d23/d98/d53/d69/d7c/f128 x:0 0 0 2024-09-12T01:43:13.808 INFO:tasks.workunit.client.1.smithi153.stdout:9/898: truncate d3/f29 807963 0 2024-09-12T01:43:13.809 INFO:tasks.workunit.client.1.smithi153.stdout:9/899: rmdir d3/d5f/dbb 39 2024-09-12T01:43:13.809 INFO:tasks.workunit.client.1.smithi153.stdout:9/900: creat d3/d3a/d42/d72/dc3/f111 x:0 0 0 2024-09-12T01:43:13.813 INFO:tasks.workunit.client.1.smithi153.stdout:2/820: dwrite d7/d4d/d7b/fb6 [0,4194304] 0 2024-09-12T01:43:13.815 INFO:tasks.workunit.client.1.smithi153.stdout:6/920: dread d1/d6/d23/d98/d53/d8d/ff4 [0,4194304] 0 2024-09-12T01:43:13.817 INFO:tasks.workunit.client.1.smithi153.stdout:2/821: symlink d7/db/d6c/lfe 0 2024-09-12T01:43:13.817 INFO:tasks.workunit.client.1.smithi153.stdout:6/921: getdents d1/d6/d39/dc4/dcb 0 2024-09-12T01:43:13.818 INFO:tasks.workunit.client.1.smithi153.stdout:6/922: creat d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/f129 x:0 0 0 2024-09-12T01:43:13.827 INFO:tasks.workunit.client.1.smithi153.stdout:6/923: dread d1/d80/fae [0,4194304] 0 2024-09-12T01:43:13.829 INFO:tasks.workunit.client.1.smithi153.stdout:6/924: rename d1/d6/d39/dc4/dcb/l118 to d1/d6/d23/d98/l12a 0 2024-09-12T01:43:13.829 INFO:tasks.workunit.client.1.smithi153.stdout:6/925: stat d1/df/c121 0 2024-09-12T01:43:13.829 INFO:tasks.workunit.client.1.smithi153.stdout:6/926: fsync d1/d6/d39/d76/f3c 0 2024-09-12T01:43:13.830 INFO:tasks.workunit.client.1.smithi153.stdout:6/927: rename d1/d6/d39/dc4/dcb/cd7 to d1/d6/da/d19/d3a/db0/c12b 0 2024-09-12T01:43:13.831 INFO:tasks.workunit.client.1.smithi153.stdout:6/928: chown d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/d123/f11b 25 1 2024-09-12T01:43:13.831 INFO:tasks.workunit.client.1.smithi153.stdout:2/822: write d7/db/d62/d87/ffb [2125576,10978] 0 2024-09-12T01:43:13.831 INFO:tasks.workunit.client.1.smithi153.stdout:2/823: write d7/db/d27/f7d [439052,63613] 0 2024-09-12T01:43:13.831 INFO:tasks.workunit.client.1.smithi153.stdout:6/929: mkdir d1/d6/da/d12c 0 2024-09-12T01:43:13.831 INFO:tasks.workunit.client.1.smithi153.stdout:6/930: truncate d1/d6/d46/d73/fa6 1211692 0 2024-09-12T01:43:13.832 INFO:tasks.workunit.client.1.smithi153.stdout:2/824: creat d7/db/d62/fff x:0 0 0 2024-09-12T01:43:13.832 INFO:tasks.workunit.client.1.smithi153.stdout:2/825: dread - d7/fce zero size 2024-09-12T01:43:13.832 INFO:tasks.workunit.client.1.smithi153.stdout:2/826: write d7/db/d62/d87/dc9/fdf [651692,8015] 0 2024-09-12T01:43:13.833 INFO:tasks.workunit.client.1.smithi153.stdout:6/931: mknod d1/d6/d39/d76/c12d 0 2024-09-12T01:43:13.833 INFO:tasks.workunit.client.1.smithi153.stdout:2/827: truncate d7/db/d62/f72 1984620 0 2024-09-12T01:43:13.834 INFO:tasks.workunit.client.1.smithi153.stdout:6/932: mknod d1/d6/d23/d98/d53/de0/c12e 0 2024-09-12T01:43:13.842 INFO:tasks.workunit.client.1.smithi153.stdout:2/828: write d7/db/d1d/f28 [1089554,111818] 0 2024-09-12T01:43:13.844 INFO:tasks.workunit.client.1.smithi153.stdout:4/777: dwrite d6/d9/dc/d31/f9a [0,4194304] 0 2024-09-12T01:43:13.845 INFO:tasks.workunit.client.0.smithi066.stdout:6/529: dwrite d2/d31/fa8 [0,4194304] 0 2024-09-12T01:43:13.845 INFO:tasks.workunit.client.0.smithi066.stdout:6/530: dread - d2/d31/f81 zero size 2024-09-12T01:43:13.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/877: dread d0/d43/dac/db0/d109/db8/d6e/fd4 [0,4194304] 0 2024-09-12T01:43:13.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/878: getdents d0/d43/dac/db0/d109/db8/d6e/d111 0 2024-09-12T01:43:13.847 INFO:tasks.workunit.client.1.smithi153.stdout:7/837: dwrite d12/d21/d29/f3d [0,4194304] 0 2024-09-12T01:43:13.849 INFO:tasks.workunit.client.1.smithi153.stdout:4/778: symlink d6/d6a/d9c/l10b 0 2024-09-12T01:43:13.849 INFO:tasks.workunit.client.1.smithi153.stdout:6/933: dread d1/d6/da/d19/d3a/f4d [0,4194304] 0 2024-09-12T01:43:13.849 INFO:tasks.workunit.client.1.smithi153.stdout:4/779: stat d6/d9/dc/d31/d7d/d94/fe5 0 2024-09-12T01:43:13.849 INFO:tasks.workunit.client.1.smithi153.stdout:4/780: fdatasync d6/d9/d11/d90/f95 0 2024-09-12T01:43:13.850 INFO:tasks.workunit.client.0.smithi066.stdout:6/531: symlink d2/d99/d12/lae 0 2024-09-12T01:43:13.852 INFO:tasks.workunit.client.0.smithi066.stdout:6/532: creat d2/d99/d12/faf x:0 0 0 2024-09-12T01:43:13.853 INFO:tasks.workunit.client.1.smithi153.stdout:5/879: mkdir d0/d15/dae/d114 0 2024-09-12T01:43:13.855 INFO:tasks.workunit.client.1.smithi153.stdout:0/965: dread d22/d79/dca/dec/d136/f122 [0,4194304] 0 2024-09-12T01:43:13.855 INFO:tasks.workunit.client.1.smithi153.stdout:8/771: dwrite d17/d75/f8d [4194304,4194304] 0 2024-09-12T01:43:13.855 INFO:tasks.workunit.client.1.smithi153.stdout:7/838: rename d12/d4e/lbc to d12/d21/d29/d2d/d8b/l109 0 2024-09-12T01:43:13.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/934: rmdir d1/d6/d116 0 2024-09-12T01:43:13.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/935: dread - d1/d6/d23/d98/d53/f104 zero size 2024-09-12T01:43:13.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/936: readlink d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/d123/le6 0 2024-09-12T01:43:13.858 INFO:tasks.workunit.client.1.smithi153.stdout:4/781: creat d6/d9/dc/d98/d3e/f10c x:0 0 0 2024-09-12T01:43:13.860 INFO:tasks.workunit.client.1.smithi153.stdout:5/880: creat d0/d43/dac/db0/d109/db8/d2f/f115 x:0 0 0 2024-09-12T01:43:13.860 INFO:tasks.workunit.client.1.smithi153.stdout:9/901: dread d3/d55/d30/d88/fd4 [0,4194304] 0 2024-09-12T01:43:13.862 INFO:tasks.workunit.client.1.smithi153.stdout:8/772: link d17/fec d17/d1f/d4f/d42/f101 0 2024-09-12T01:43:13.864 INFO:tasks.workunit.client.1.smithi153.stdout:7/839: mkdir d12/d21/d4d/dae/d10a 0 2024-09-12T01:43:13.865 INFO:tasks.workunit.client.1.smithi153.stdout:0/966: write d22/d30/d4c/d6e/d7f/d98/fd5 [3172838,112789] 0 2024-09-12T01:43:13.865 INFO:tasks.workunit.client.1.smithi153.stdout:6/937: chown d1/d6/d23/f2b 4460 1 2024-09-12T01:43:13.865 INFO:tasks.workunit.client.1.smithi153.stdout:6/938: fdatasync d1/d6/d46/d73/d8a/d84/d96/fdc 0 2024-09-12T01:43:13.865 INFO:tasks.workunit.client.1.smithi153.stdout:6/939: fdatasync d1/d6/d39/dc4/f10b 0 2024-09-12T01:43:13.867 INFO:tasks.workunit.client.1.smithi153.stdout:4/782: truncate d6/d9/d11/d13/dce/dd7/f47 576776 0 2024-09-12T01:43:13.867 INFO:tasks.workunit.client.1.smithi153.stdout:4/783: creat d6/d9/dc/d31/d76/d99/f10d x:0 0 0 2024-09-12T01:43:13.868 INFO:tasks.workunit.client.1.smithi153.stdout:5/881: creat d0/d43/dac/db0/d109/f116 x:0 0 0 2024-09-12T01:43:13.870 INFO:tasks.workunit.client.1.smithi153.stdout:9/902: rename d3/d55/d30/d95/d84/d8b/fb6 to d3/d55/d30/d95/d84/d8b/de2/f112 0 2024-09-12T01:43:13.870 INFO:tasks.workunit.client.1.smithi153.stdout:9/903: write d3/d55/d30/f31 [1835592,1865] 0 2024-09-12T01:43:13.871 INFO:tasks.workunit.client.1.smithi153.stdout:2/829: getdents d7/db/d62 0 2024-09-12T01:43:13.874 INFO:tasks.workunit.client.0.smithi066.stdout:6/533: dwrite d2/d99/d12/faf [0,4194304] 0 2024-09-12T01:43:13.875 INFO:tasks.workunit.client.1.smithi153.stdout:6/940: unlink d1/df/f8e 0 2024-09-12T01:43:13.877 INFO:tasks.workunit.client.1.smithi153.stdout:7/840: read d12/d21/d29/d2d/fac [3643502,111878] 0 2024-09-12T01:43:13.879 INFO:tasks.workunit.client.1.smithi153.stdout:0/967: read d22/d30/d4c/d6f/d88/f89 [2155881,13821] 0 2024-09-12T01:43:13.881 INFO:tasks.workunit.client.1.smithi153.stdout:4/784: write d6/d9/d11/d90/fda [3337574,128110] 0 2024-09-12T01:43:13.883 INFO:tasks.workunit.client.0.smithi066.stdout:6/534: link d2/d99/d12/f6e d2/d21/d92/d9f/fb0 0 2024-09-12T01:43:13.885 INFO:tasks.workunit.client.1.smithi153.stdout:9/904: getdents d3/d55/d30/d7b 0 2024-09-12T01:43:13.886 INFO:tasks.workunit.client.1.smithi153.stdout:6/941: mknod d1/d6/d23/d98/d53/d69/d7c/d7f/df0/c12f 0 2024-09-12T01:43:13.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/841: creat d12/d21/d29/d35/dcb/f10b x:0 0 0 2024-09-12T01:43:13.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/842: truncate d12/d7e/fe3 351434 0 2024-09-12T01:43:13.887 INFO:tasks.workunit.client.1.smithi153.stdout:7/843: dread - d12/d21/d29/d35/d37/d4c/d8e/fee zero size 2024-09-12T01:43:13.890 INFO:tasks.workunit.client.1.smithi153.stdout:0/968: rmdir d22/d30/d4c/d6e/d7f 39 2024-09-12T01:43:13.891 INFO:tasks.workunit.client.1.smithi153.stdout:0/969: fdatasync d22/d79/dca/dec/d136/db7/f109 0 2024-09-12T01:43:13.891 INFO:tasks.workunit.client.0.smithi066.stdout:6/535: dread d2/d99/d12/d1d/f91 [0,4194304] 0 2024-09-12T01:43:13.894 INFO:tasks.workunit.client.0.smithi066.stdout:6/536: rename d2/d31/c7f to d2/d99/d7b/cb1 0 2024-09-12T01:43:13.896 INFO:tasks.workunit.client.0.smithi066.stdout:6/537: mkdir d2/d31/d57/db2 0 2024-09-12T01:43:13.896 INFO:tasks.workunit.client.0.smithi066.stdout:6/538: chown d2/d99/f6a 1 1 2024-09-12T01:43:13.899 INFO:tasks.workunit.client.0.smithi066.stdout:6/539: symlink d2/d21/d92/d9f/lb3 0 2024-09-12T01:43:13.900 INFO:tasks.workunit.client.1.smithi153.stdout:5/882: getdents d0/d43/dac/db0/d109/db8/d2f/d55 0 2024-09-12T01:43:13.901 INFO:tasks.workunit.client.1.smithi153.stdout:4/785: unlink d6/d15/db4/l75 0 2024-09-12T01:43:13.904 INFO:tasks.workunit.client.1.smithi153.stdout:8/773: rename d17/d21/d56/ddf/cfb to d17/d1f/d4f/d34/c102 0 2024-09-12T01:43:13.904 INFO:tasks.workunit.client.1.smithi153.stdout:8/774: write d17/d1d/f36 [9145332,4424] 0 2024-09-12T01:43:13.905 INFO:tasks.workunit.client.1.smithi153.stdout:9/905: mkdir d3/d55/d30/d7b/d113 0 2024-09-12T01:43:13.905 INFO:tasks.workunit.client.1.smithi153.stdout:9/906: fsync d3/d55/d30/f86 0 2024-09-12T01:43:13.905 INFO:tasks.workunit.client.1.smithi153.stdout:9/907: chown d3/d66/ddc/lf1 348090997 1 2024-09-12T01:43:13.906 INFO:tasks.workunit.client.1.smithi153.stdout:6/942: symlink d1/d6/d23/d98/d53/d69/d7c/d7f/df0/l130 0 2024-09-12T01:43:13.906 INFO:tasks.workunit.client.1.smithi153.stdout:5/883: dread d0/d15/f96 [0,4194304] 0 2024-09-12T01:43:13.907 INFO:tasks.workunit.client.1.smithi153.stdout:0/970: creat d22/d30/d4c/d6e/d7f/f148 x:0 0 0 2024-09-12T01:43:13.911 INFO:tasks.workunit.client.1.smithi153.stdout:4/786: creat d6/d6a/f10e x:0 0 0 2024-09-12T01:43:13.913 INFO:tasks.workunit.client.1.smithi153.stdout:2/830: rename d7/db/d6c/d76/db8/cfa to d7/d4d/d7b/c100 0 2024-09-12T01:43:13.913 INFO:tasks.workunit.client.1.smithi153.stdout:2/831: stat d7/db/d6c/d76/db8/dcf/dae 0 2024-09-12T01:43:13.913 INFO:tasks.workunit.client.1.smithi153.stdout:2/832: write d7/d4d/d7b/f90 [4756094,16671] 0 2024-09-12T01:43:13.915 INFO:tasks.workunit.client.1.smithi153.stdout:8/775: symlink d17/d1f/d4f/d42/d79/dac/dce/l103 0 2024-09-12T01:43:13.916 INFO:tasks.workunit.client.0.smithi066.stdout:2/452: sync 2024-09-12T01:43:13.917 INFO:tasks.workunit.client.1.smithi153.stdout:9/908: unlink d3/d55/d30/f31 0 2024-09-12T01:43:13.917 INFO:tasks.workunit.client.1.smithi153.stdout:5/884: dread d0/d15/f96 [4194304,4194304] 0 2024-09-12T01:43:13.917 INFO:tasks.workunit.client.1.smithi153.stdout:5/885: write d0/d43/dac/db0/d109/db8/f2b [1031746,65687] 0 2024-09-12T01:43:13.917 INFO:tasks.workunit.client.1.smithi153.stdout:5/886: truncate d0/d43/dac/db0/d109/db8/d2f/f115 83610 0 2024-09-12T01:43:13.917 INFO:tasks.workunit.client.1.smithi153.stdout:6/943: mknod d1/d6/d23/d98/d53/d69/d7c/d7f/df0/c131 0 2024-09-12T01:43:13.919 INFO:tasks.workunit.client.1.smithi153.stdout:0/971: mknod d22/d79/dca/ded/c149 0 2024-09-12T01:43:13.921 INFO:tasks.workunit.client.1.smithi153.stdout:7/844: rename d12/d21/d29/d35/d37/d4c/d5c/fbe to d12/f10c 0 2024-09-12T01:43:13.923 INFO:tasks.workunit.client.1.smithi153.stdout:2/833: dread d7/db/d27/d56/f9a [0,4194304] 0 2024-09-12T01:43:13.925 INFO:tasks.workunit.client.1.smithi153.stdout:5/887: unlink d0/d43/dac/db0/d109/db8/d2f/ff0 0 2024-09-12T01:43:13.926 INFO:tasks.workunit.client.1.smithi153.stdout:6/944: unlink d1/d6/lc7 0 2024-09-12T01:43:13.928 INFO:tasks.workunit.client.1.smithi153.stdout:0/972: creat d22/d79/dca/dec/d136/dff/d147/f14a x:0 0 0 2024-09-12T01:43:13.929 INFO:tasks.workunit.client.0.smithi066.stdout:6/540: rename d2/d21/d92/d9f to d2/d31/d57/db4 0 2024-09-12T01:43:13.930 INFO:tasks.workunit.client.1.smithi153.stdout:9/909: rename d3/d55/c7f to d3/d55/de5/c114 0 2024-09-12T01:43:13.932 INFO:tasks.workunit.client.1.smithi153.stdout:7/845: mknod d12/d21/d4d/dae/dc0/dc4/c10d 0 2024-09-12T01:43:13.933 INFO:tasks.workunit.client.0.smithi066.stdout:6/541: creat d2/d99/d72/fb5 x:0 0 0 2024-09-12T01:43:13.935 INFO:tasks.workunit.client.1.smithi153.stdout:6/945: symlink d1/d6/d46/l132 0 2024-09-12T01:43:13.935 INFO:tasks.workunit.client.1.smithi153.stdout:6/946: read d1/d6/d23/d98/d53/d8d/ff4 [3302521,6091] 0 2024-09-12T01:43:13.935 INFO:tasks.workunit.client.1.smithi153.stdout:6/947: write d1/d6/d23/d98/d53/d69/d7c/d7f/f95 [2421128,47325] 0 2024-09-12T01:43:13.935 INFO:tasks.workunit.client.1.smithi153.stdout:0/973: getdents d22/d79/dca/dec/d136/db7 0 2024-09-12T01:43:13.936 INFO:tasks.workunit.client.1.smithi153.stdout:4/787: dwrite d6/d9/dc/d98/d3e/f61 [0,4194304] 0 2024-09-12T01:43:13.938 INFO:tasks.workunit.client.0.smithi066.stdout:6/542: rename d2/d99/c35 to d2/d31/d57/db2/cb6 0 2024-09-12T01:43:13.939 INFO:tasks.workunit.client.1.smithi153.stdout:9/910: mkdir d3/d55/d30/d95/d84/d115 0 2024-09-12T01:43:13.939 INFO:tasks.workunit.client.1.smithi153.stdout:9/911: chown d3/d55/lae 7381787 1 2024-09-12T01:43:13.940 INFO:tasks.workunit.client.1.smithi153.stdout:6/948: mknod d1/d6/d39/d76/d124/c133 0 2024-09-12T01:43:13.940 INFO:tasks.workunit.client.1.smithi153.stdout:2/834: dread d7/d4d/d70/f88 [0,4194304] 0 2024-09-12T01:43:13.941 INFO:tasks.workunit.client.0.smithi066.stdout:6/543: mkdir d2/d99/d72/db7 0 2024-09-12T01:43:13.941 INFO:tasks.workunit.client.0.smithi066.stdout:6/544: stat c0 0 2024-09-12T01:43:13.941 INFO:tasks.workunit.client.0.smithi066.stdout:6/545: creat d2/d99/fb8 x:0 0 0 2024-09-12T01:43:13.945 INFO:tasks.workunit.client.1.smithi153.stdout:7/846: write d12/d21/d29/d2d/f30 [3693246,66379] 0 2024-09-12T01:43:13.946 INFO:tasks.workunit.client.1.smithi153.stdout:2/835: dread d7/d17/f48 [0,4194304] 0 2024-09-12T01:43:13.948 INFO:tasks.workunit.client.1.smithi153.stdout:8/776: dwrite d17/d1f/d4f/d42/d79/dac/dd3/ff6 [0,4194304] 0 2024-09-12T01:43:13.949 INFO:tasks.workunit.client.0.smithi066.stdout:6/546: write d2/d99/d12/d1d/f91 [1569806,6069] 0 2024-09-12T01:43:13.952 INFO:tasks.workunit.client.1.smithi153.stdout:8/777: dread d17/d21/faf [0,4194304] 0 2024-09-12T01:43:13.952 INFO:tasks.workunit.client.1.smithi153.stdout:8/778: write d17/d21/d56/d95/dbc/fcd [102415,90206] 0 2024-09-12T01:43:13.962 INFO:tasks.workunit.client.0.smithi066.stdout:2/453: dwrite f9 [0,4194304] 0 2024-09-12T01:43:13.963 INFO:tasks.workunit.client.1.smithi153.stdout:5/888: dwrite d0/d43/dac/db0/d109/d83/d36/f7d [0,4194304] 0 2024-09-12T01:43:13.964 INFO:tasks.workunit.client.1.smithi153.stdout:9/912: dwrite d3/d3a/d42/f58 [0,4194304] 0 2024-09-12T01:43:13.964 INFO:tasks.workunit.client.1.smithi153.stdout:9/913: creat d3/d66/d80/f116 x:0 0 0 2024-09-12T01:43:14.025 INFO:tasks.workunit.client.1.smithi153.stdout:0/974: creat d22/d79/dca/ded/df8/f14b x:0 0 0 2024-09-12T01:43:14.027 INFO:tasks.workunit.client.1.smithi153.stdout:6/949: symlink d1/d6/d23/d98/d53/d69/d7c/d7f/df0/l134 0 2024-09-12T01:43:14.028 INFO:tasks.workunit.client.1.smithi153.stdout:4/788: dread d6/d9/dc/d98/d3e/fdf [0,4194304] 0 2024-09-12T01:43:14.028 INFO:tasks.workunit.client.0.smithi066.stdout:6/547: symlink d2/d99/d72/d87/lb9 0 2024-09-12T01:43:14.029 INFO:tasks.workunit.client.0.smithi066.stdout:6/548: chown d2/d31 3530 1 2024-09-12T01:43:14.029 INFO:tasks.workunit.client.0.smithi066.stdout:6/549: getdents d2/d99/d72/db7 0 2024-09-12T01:43:14.037 INFO:tasks.workunit.client.1.smithi153.stdout:4/789: dread d6/d15/f4c [0,4194304] 0 2024-09-12T01:43:14.049 INFO:tasks.workunit.client.0.smithi066.stdout:6/550: dwrite d2/d99/f82 [0,4194304] 0 2024-09-12T01:43:14.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/551: dwrite d2/d99/d12/d1d/f26 [0,4194304] 0 2024-09-12T01:43:14.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/552: readlink d2/d31/d57/l94 0 2024-09-12T01:43:14.066 INFO:tasks.workunit.client.0.smithi066.stdout:6/553: dread - d2/d31/d5e/f80 zero size 2024-09-12T01:43:14.084 INFO:tasks.workunit.client.1.smithi153.stdout:2/836: rmdir d7/db/d6c/d76/df4 0 2024-09-12T01:43:14.089 INFO:tasks.workunit.client.1.smithi153.stdout:8/779: creat d17/d21/d56/d96/d6c/d89/d9c/f104 x:0 0 0 2024-09-12T01:43:14.092 INFO:tasks.workunit.client.0.smithi066.stdout:6/554: rename d2/d31/d57/l94 to d2/d31/d57/lba 0 2024-09-12T01:43:14.093 INFO:tasks.workunit.client.1.smithi153.stdout:8/780: dread d17/f46 [0,4194304] 0 2024-09-12T01:43:14.093 INFO:tasks.workunit.client.1.smithi153.stdout:8/781: readlink d17/d1f/l7c 0 2024-09-12T01:43:14.096 INFO:tasks.workunit.client.0.smithi066.stdout:2/454: rename de/l1a to de/d13/d28/d3a/l96 0 2024-09-12T01:43:14.098 INFO:tasks.workunit.client.0.smithi066.stdout:6/555: mknod d2/d99/d7b/cbb 0 2024-09-12T01:43:14.099 INFO:tasks.workunit.client.1.smithi153.stdout:5/889: symlink d0/d43/dac/db0/d109/d1c/d69/l117 0 2024-09-12T01:43:14.101 INFO:tasks.workunit.client.0.smithi066.stdout:6/556: rename d2/d31/d57/db2 to d2/d99/d12/d1d/d6b/dbc 0 2024-09-12T01:43:14.105 INFO:tasks.workunit.client.0.smithi066.stdout:6/557: creat d2/d99/d7b/fbd x:0 0 0 2024-09-12T01:43:14.105 INFO:tasks.workunit.client.0.smithi066.stdout:6/558: dread - d2/d31/d57/db4/fb0 zero size 2024-09-12T01:43:14.105 INFO:tasks.workunit.client.0.smithi066.stdout:6/559: write d2/d99/fb8 [454137,81871] 0 2024-09-12T01:43:14.107 INFO:tasks.workunit.client.1.smithi153.stdout:5/890: dread d0/d43/dac/db0/d109/db8/d6e/fd4 [0,4194304] 0 2024-09-12T01:43:14.107 INFO:tasks.workunit.client.1.smithi153.stdout:5/891: chown d0/d43/dac/db0/d109/db8 11071 1 2024-09-12T01:43:14.107 INFO:tasks.workunit.client.0.smithi066.stdout:6/560: mknod d2/d99/d12/d1d/d6b/cbe 0 2024-09-12T01:43:14.109 INFO:tasks.workunit.client.1.smithi153.stdout:8/782: write d17/d1f/d4f/d42/d79/dac/dd3/ff6 [4593781,118413] 0 2024-09-12T01:43:14.111 INFO:tasks.workunit.client.1.smithi153.stdout:0/975: mknod d22/d79/dca/ded/c14c 0 2024-09-12T01:43:14.113 INFO:tasks.workunit.client.1.smithi153.stdout:6/950: creat d1/d6/d23/d98/d4f/d122/f135 x:0 0 0 2024-09-12T01:43:14.114 INFO:tasks.workunit.client.0.smithi066.stdout:7/425: sync 2024-09-12T01:43:14.115 INFO:tasks.workunit.client.0.smithi066.stdout:6/561: getdents d2/d31 0 2024-09-12T01:43:14.116 INFO:tasks.workunit.client.1.smithi153.stdout:4/790: mkdir d6/d9/d11/d90/db7/df3/d10f 0 2024-09-12T01:43:14.117 INFO:tasks.workunit.client.0.smithi066.stdout:2/455: dwrite de/d13/d1e/d41/d58/f73 [0,4194304] 0 2024-09-12T01:43:14.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/426: rename d2/d5/da/c13 to d2/d5/d6/d22/c91 0 2024-09-12T01:43:14.120 INFO:tasks.workunit.client.0.smithi066.stdout:6/562: dread d2/d99/f2d [0,4194304] 0 2024-09-12T01:43:14.121 INFO:tasks.workunit.client.1.smithi153.stdout:1/903: sync 2024-09-12T01:43:14.123 INFO:tasks.workunit.client.1.smithi153.stdout:9/914: symlink d3/d3a/d42/d72/d98/l117 0 2024-09-12T01:43:14.127 INFO:tasks.workunit.client.1.smithi153.stdout:8/783: symlink d17/d21/d56/ddf/de3/l105 0 2024-09-12T01:43:14.131 INFO:tasks.workunit.client.1.smithi153.stdout:6/951: link d1/d6/d39/d76/l7b d1/d6/d39/d76/d124/l136 0 2024-09-12T01:43:14.131 INFO:tasks.workunit.client.1.smithi153.stdout:6/952: write d1/d6/d23/d98/d53/d8d/ff3 [805177,69574] 0 2024-09-12T01:43:14.131 INFO:tasks.workunit.client.1.smithi153.stdout:6/953: write d1/d80/f119 [120409,130934] 0 2024-09-12T01:43:14.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/942: sync 2024-09-12T01:43:14.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/943: write d1/d13/d23/d47/d71/d8e/d93/d79/fea [302063,45651] 0 2024-09-12T01:43:14.132 INFO:tasks.workunit.client.1.smithi153.stdout:3/944: chown d1/d64/db0/fd7 94 1 2024-09-12T01:43:14.133 INFO:tasks.workunit.client.1.smithi153.stdout:5/892: dwrite d0/d43/f92 [0,4194304] 0 2024-09-12T01:43:14.133 INFO:tasks.workunit.client.1.smithi153.stdout:5/893: stat d0/d43/dac/db0/d109/d102/lc9 0 2024-09-12T01:43:14.133 INFO:tasks.workunit.client.1.smithi153.stdout:5/894: chown d0/d43/d8d/d8e/dd7/f110 125 1 2024-09-12T01:43:14.133 INFO:tasks.workunit.client.1.smithi153.stdout:5/895: fsync d0/d43/dac/db0/d109/d1c/d69/f100 0 2024-09-12T01:43:14.134 INFO:tasks.workunit.client.0.smithi066.stdout:7/427: symlink d2/d5/d6/d22/d75/l92 0 2024-09-12T01:43:14.135 INFO:tasks.workunit.client.1.smithi153.stdout:7/847: sync 2024-09-12T01:43:14.136 INFO:tasks.workunit.client.0.smithi066.stdout:6/563: creat d2/d99/d12/d1d/d6b/fbf x:0 0 0 2024-09-12T01:43:14.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:13 smithi066 ceph-mon[27875]: pgmap v6: 65 pgs: 65 active+clean; 2.6 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 149 MiB/s rd, 206 MiB/s wr, 298 op/s 2024-09-12T01:43:14.139 INFO:tasks.workunit.client.1.smithi153.stdout:2/837: rename d7/d17 to d7/d19/d83/d101 0 2024-09-12T01:43:14.142 INFO:tasks.workunit.client.1.smithi153.stdout:6/954: truncate d1/d6/d23/d98/ff1 709815 0 2024-09-12T01:43:14.148 INFO:tasks.workunit.client.1.smithi153.stdout:5/896: read d0/d43/dac/db0/d109/d83/f4c [7041424,24740] 0 2024-09-12T01:43:14.148 INFO:tasks.workunit.client.0.smithi066.stdout:2/456: symlink de/l97 0 2024-09-12T01:43:14.148 INFO:tasks.workunit.client.0.smithi066.stdout:2/457: chown de/d13/d1e/c5a 473 1 2024-09-12T01:43:14.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:13 smithi153 ceph-mon[34713]: pgmap v6: 65 pgs: 65 active+clean; 2.6 GiB data, 9.3 GiB used, 527 GiB / 536 GiB avail; 149 MiB/s rd, 206 MiB/s wr, 298 op/s 2024-09-12T01:43:14.155 INFO:tasks.workunit.client.1.smithi153.stdout:2/838: rmdir d7/db/d6c/d76/db8/dcf 39 2024-09-12T01:43:14.156 INFO:tasks.workunit.client.0.smithi066.stdout:6/564: mkdir d2/d99/d12/d49/d9e/dc0 0 2024-09-12T01:43:14.160 INFO:tasks.workunit.client.1.smithi153.stdout:9/915: write d3/d3a/d42/fa2 [3270128,45773] 0 2024-09-12T01:43:14.160 INFO:tasks.workunit.client.1.smithi153.stdout:9/916: readlink d3/d66/l82 0 2024-09-12T01:43:14.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/565: dread d2/d21/f34 [0,4194304] 0 2024-09-12T01:43:14.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/566: creat d2/d99/fc1 x:0 0 0 2024-09-12T01:43:14.162 INFO:tasks.workunit.client.0.smithi066.stdout:1/479: sync 2024-09-12T01:43:14.162 INFO:tasks.workunit.client.0.smithi066.stdout:1/480: read - d5/d52/d60/f72 zero size 2024-09-12T01:43:14.163 INFO:tasks.workunit.client.0.smithi066.stdout:6/567: mknod d2/d99/d7b/cc2 0 2024-09-12T01:43:14.164 INFO:tasks.workunit.client.0.smithi066.stdout:1/481: creat d5/dc/d4f/d8e/f91 x:0 0 0 2024-09-12T01:43:14.164 INFO:tasks.workunit.client.0.smithi066.stdout:6/568: creat d2/d99/d72/d87/fc3 x:0 0 0 2024-09-12T01:43:14.164 INFO:tasks.workunit.client.1.smithi153.stdout:2/839: dread d7/db/d62/d87/ffb [0,4194304] 0 2024-09-12T01:43:14.172 INFO:tasks.workunit.client.0.smithi066.stdout:9/483: sync 2024-09-12T01:43:14.174 INFO:tasks.workunit.client.0.smithi066.stdout:9/484: unlink d0/d6/d17/d4f/d9/de/f9c 0 2024-09-12T01:43:14.174 INFO:tasks.workunit.client.0.smithi066.stdout:9/485: write d0/d6/d17/d1b/d4c/d42/f5a [4551177,48479] 0 2024-09-12T01:43:14.174 INFO:tasks.workunit.client.0.smithi066.stdout:9/486: readlink d0/d6/d17/d4f/d12/d84/l8d 0 2024-09-12T01:43:14.197 INFO:tasks.workunit.client.0.smithi066.stdout:9/487: read d0/d6/d17/d4f/d9/de/f51 [2127257,52463] 0 2024-09-12T01:43:14.199 INFO:tasks.workunit.client.0.smithi066.stdout:9/488: creat d0/d6/d17/d4f/d12/d84/fac x:0 0 0 2024-09-12T01:43:14.200 INFO:tasks.workunit.client.0.smithi066.stdout:9/489: mknod d0/d6/d17/d4f/d9/cad 0 2024-09-12T01:43:14.200 INFO:tasks.workunit.client.0.smithi066.stdout:9/490: read d0/d6/d17/d1b/d4c/d42/f5d [114184,102217] 0 2024-09-12T01:43:14.201 INFO:tasks.workunit.client.0.smithi066.stdout:9/491: getdents d0/d6/d17/d1b 0 2024-09-12T01:43:14.201 INFO:tasks.workunit.client.0.smithi066.stdout:9/492: fsync d0/d6/d17/d1b/d4c/d42/fa1 0 2024-09-12T01:43:14.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/493: getdents d0/d6/d17/d1b 0 2024-09-12T01:43:14.202 INFO:tasks.workunit.client.0.smithi066.stdout:9/494: write d0/d6/d17/d1b/d4c/d4b/d86/f91 [1008489,113636] 0 2024-09-12T01:43:14.202 INFO:tasks.workunit.client.0.smithi066.stdout:6/569: read d2/f38 [2774851,107683] 0 2024-09-12T01:43:14.203 INFO:tasks.workunit.client.0.smithi066.stdout:9/495: rename d0/d6/d17/d4f/d12/d46/d68 to d0/d6/d17/d1b/da2/dae 0 2024-09-12T01:43:14.204 INFO:tasks.workunit.client.0.smithi066.stdout:9/496: mknod d0/d6/d17/d1b/d4c/d4b/d7d/caf 0 2024-09-12T01:43:14.206 INFO:tasks.workunit.client.0.smithi066.stdout:6/570: dread d2/d31/f33 [0,4194304] 0 2024-09-12T01:43:14.206 INFO:tasks.workunit.client.0.smithi066.stdout:6/571: chown d2/d21/c5d 14 1 2024-09-12T01:43:14.207 INFO:tasks.workunit.client.1.smithi153.stdout:6/955: dwrite d1/d6/d39/d76/f114 [0,4194304] 0 2024-09-12T01:43:14.207 INFO:tasks.workunit.client.1.smithi153.stdout:6/956: chown d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/d123/le6 24382026 1 2024-09-12T01:43:14.207 INFO:tasks.workunit.client.1.smithi153.stdout:2/840: dwrite d7/d19/d83/d101/f8c [0,4194304] 0 2024-09-12T01:43:14.207 INFO:tasks.workunit.client.1.smithi153.stdout:2/841: fsync d7/d19/d40/f82 0 2024-09-12T01:43:14.208 INFO:tasks.workunit.client.1.smithi153.stdout:1/904: dwrite d2/d9/d17/d2f/d56/da0/f40 [0,4194304] 0 2024-09-12T01:43:14.208 INFO:tasks.workunit.client.1.smithi153.stdout:1/905: truncate d2/d9/d17/d2f/d56/d83/fd5 1008428 0 2024-09-12T01:43:14.208 INFO:tasks.workunit.client.0.smithi066.stdout:7/428: dwrite d2/d5/d6/d22/d75/d1d/f4b [0,4194304] 0 2024-09-12T01:43:14.209 INFO:tasks.workunit.client.1.smithi153.stdout:4/791: dwrite d6/d9/d20/ffa [0,4194304] 0 2024-09-12T01:43:14.209 INFO:tasks.workunit.client.1.smithi153.stdout:6/957: mkdir d1/d6/da/d12c/d137 0 2024-09-12T01:43:14.209 INFO:tasks.workunit.client.0.smithi066.stdout:1/482: dwrite d5/dc/d36/d4b/f5f [0,4194304] 0 2024-09-12T01:43:14.209 INFO:tasks.workunit.client.0.smithi066.stdout:2/458: dwrite de/d13/d28/f93 [0,4194304] 0 2024-09-12T01:43:14.210 INFO:tasks.workunit.client.1.smithi153.stdout:5/897: dwrite d0/d43/d8d/fee [0,4194304] 0 2024-09-12T01:43:14.210 INFO:tasks.workunit.client.1.smithi153.stdout:5/898: chown d0/d43/dac/db0/d109/db8/d2f/d55/fc7 48449673 1 2024-09-12T01:43:14.212 INFO:tasks.workunit.client.1.smithi153.stdout:8/784: rename d17/d21/d56 to d17/d1f/dcf/d106 0 2024-09-12T01:43:14.214 INFO:tasks.workunit.client.1.smithi153.stdout:2/842: unlink d7/db/d6c/d7e/f5f 0 2024-09-12T01:43:14.216 INFO:tasks.workunit.client.1.smithi153.stdout:7/848: dwrite d12/d21/d4d/dae/dc0/dc4/fca [0,4194304] 0 2024-09-12T01:43:14.223 INFO:tasks.workunit.client.0.smithi066.stdout:1/483: dread d5/dc/d36/d4b/f5f [0,4194304] 0 2024-09-12T01:43:14.223 INFO:tasks.workunit.client.0.smithi066.stdout:1/484: fdatasync d5/dc/f8f 0 2024-09-12T01:43:14.228 INFO:tasks.workunit.client.1.smithi153.stdout:1/906: symlink d2/d68/d6b/d9e/dc7/l123 0 2024-09-12T01:43:14.235 INFO:tasks.workunit.client.0.smithi066.stdout:2/459: symlink de/d13/d1e/d22/d4f/l98 0 2024-09-12T01:43:14.236 INFO:tasks.workunit.client.1.smithi153.stdout:8/785: truncate d17/d1f/d4f/d34/f47 1250184 0 2024-09-12T01:43:14.237 INFO:tasks.workunit.client.0.smithi066.stdout:2/460: read de/d13/d1e/d22/f89 [555043,4384] 0 2024-09-12T01:43:14.238 INFO:tasks.workunit.client.1.smithi153.stdout:3/945: rename d1/d64/db0 to d1/d11a 0 2024-09-12T01:43:14.238 INFO:tasks.workunit.client.1.smithi153.stdout:2/843: mkdir d7/db/d62/d87/dc9/d102 0 2024-09-12T01:43:14.239 INFO:tasks.workunit.client.0.smithi066.stdout:2/461: creat de/d13/d1e/d25/f99 x:0 0 0 2024-09-12T01:43:14.239 INFO:tasks.workunit.client.0.smithi066.stdout:2/462: chown f5 380 1 2024-09-12T01:43:14.242 INFO:tasks.workunit.client.0.smithi066.stdout:2/463: creat de/d13/d1e/d92/f9a x:0 0 0 2024-09-12T01:43:14.244 INFO:tasks.workunit.client.1.smithi153.stdout:8/786: creat d17/d1f/dcf/d106/d96/d6c/d89/ded/f107 x:0 0 0 2024-09-12T01:43:14.244 INFO:tasks.workunit.client.1.smithi153.stdout:8/787: stat d17/d1d/d27 0 2024-09-12T01:43:14.245 INFO:tasks.workunit.client.0.smithi066.stdout:2/464: link de/d13/d1e/c5a de/d13/c9b 0 2024-09-12T01:43:14.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/497: dwrite d0/d6/d17/d4f/d12/f67 [0,4194304] 0 2024-09-12T01:43:14.248 INFO:tasks.workunit.client.0.smithi066.stdout:1/485: dread d5/d52/f7e [0,4194304] 0 2024-09-12T01:43:14.248 INFO:tasks.workunit.client.0.smithi066.stdout:1/486: write d5/d52/d5d/f90 [581587,21134] 0 2024-09-12T01:43:14.250 INFO:tasks.workunit.client.1.smithi153.stdout:2/844: mkdir d7/d19/d83/d101/da9/d103 0 2024-09-12T01:43:14.250 INFO:tasks.workunit.client.1.smithi153.stdout:8/788: mkdir d17/d1f/d4f/d42/d79/dac/d108 0 2024-09-12T01:43:14.252 INFO:tasks.workunit.client.1.smithi153.stdout:2/845: write d7/db/d27/f73 [660482,19010] 0 2024-09-12T01:43:14.252 INFO:tasks.workunit.client.1.smithi153.stdout:2/846: truncate d7/db/d27/f31 1325142 0 2024-09-12T01:43:14.254 INFO:tasks.workunit.client.0.smithi066.stdout:7/429: dwrite d2/d5/d6/d22/d75/d25/f67 [4194304,4194304] 0 2024-09-12T01:43:14.254 INFO:tasks.workunit.client.0.smithi066.stdout:7/430: chown d2/d71/l89 0 1 2024-09-12T01:43:14.255 INFO:tasks.workunit.client.1.smithi153.stdout:9/917: rename d3/d55/d30/d7b/d8f to d3/d5f/d62/d118 0 2024-09-12T01:43:14.255 INFO:tasks.workunit.client.1.smithi153.stdout:8/789: dread d17/d1f/d4f/d42/d79/f98 [0,4194304] 0 2024-09-12T01:43:14.255 INFO:tasks.workunit.client.1.smithi153.stdout:6/958: dwrite d1/d6/d23/f2b [0,4194304] 0 2024-09-12T01:43:14.256 INFO:tasks.workunit.client.0.smithi066.stdout:6/572: dwrite d2/d99/d12/d1d/d6b/f89 [0,4194304] 0 2024-09-12T01:43:14.258 INFO:tasks.workunit.client.1.smithi153.stdout:4/792: rename d6/d9/dc/d31/fa9 to d6/d9/dc/f110 0 2024-09-12T01:43:14.258 INFO:tasks.workunit.client.1.smithi153.stdout:4/793: creat d6/d9/dc/d31/d7d/d94/df7/f111 x:0 0 0 2024-09-12T01:43:14.258 INFO:tasks.workunit.client.1.smithi153.stdout:4/794: read d6/d9/dc/d98/f3f [5987903,9428] 0 2024-09-12T01:43:14.258 INFO:tasks.workunit.client.1.smithi153.stdout:4/795: write d6/d9/d11/d13/dce/dd7/fe9 [888074,4805] 0 2024-09-12T01:43:14.258 INFO:tasks.workunit.client.1.smithi153.stdout:4/796: chown d6/d15/f4c 61076482 1 2024-09-12T01:43:14.261 INFO:tasks.workunit.client.1.smithi153.stdout:7/849: dwrite d12/d21/d29/d35/d37/d58/f63 [0,4194304] 0 2024-09-12T01:43:14.261 INFO:tasks.workunit.client.1.smithi153.stdout:7/850: chown d12/d7e 18413 1 2024-09-12T01:43:14.261 INFO:tasks.workunit.client.1.smithi153.stdout:5/899: dwrite d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/d70/f5a [0,4194304] 0 2024-09-12T01:43:14.265 INFO:tasks.workunit.client.1.smithi153.stdout:2/847: write d7/d19/f79 [675759,80729] 0 2024-09-12T01:43:14.265 INFO:tasks.workunit.client.0.smithi066.stdout:2/465: dread f5 [0,4194304] 0 2024-09-12T01:43:14.265 INFO:tasks.workunit.client.0.smithi066.stdout:2/466: truncate de/d13/d1e/f36 1546556 0 2024-09-12T01:43:14.265 INFO:tasks.workunit.client.0.smithi066.stdout:1/487: dread d5/f7f [0,4194304] 0 2024-09-12T01:43:14.267 INFO:tasks.workunit.client.1.smithi153.stdout:7/851: mkdir d12/d21/d29/d35/dcb/d10e 0 2024-09-12T01:43:14.272 INFO:tasks.workunit.client.1.smithi153.stdout:5/900: getdents d0/d43/dac/db0/d109/d1c 0 2024-09-12T01:43:14.272 INFO:tasks.workunit.client.1.smithi153.stdout:5/901: chown d0/d15/l61 14 1 2024-09-12T01:43:14.275 INFO:tasks.workunit.client.0.smithi066.stdout:6/573: truncate d2/d31/f39 3525031 0 2024-09-12T01:43:14.275 INFO:tasks.workunit.client.0.smithi066.stdout:6/574: chown d2/d99/l17 2592889 1 2024-09-12T01:43:14.277 INFO:tasks.workunit.client.1.smithi153.stdout:6/959: truncate d1/d6/d39/d76/f114 361166 0 2024-09-12T01:43:14.277 INFO:tasks.workunit.client.1.smithi153.stdout:6/960: read d1/df/d9d/f11d [898151,124802] 0 2024-09-12T01:43:14.277 INFO:tasks.workunit.client.0.smithi066.stdout:2/467: getdents de/d13/d1e/d84 0 2024-09-12T01:43:14.278 INFO:tasks.workunit.client.0.smithi066.stdout:2/468: write de/d13/d1e/d25/f99 [611467,37880] 0 2024-09-12T01:43:14.278 INFO:tasks.workunit.client.0.smithi066.stdout:2/469: write de/f21 [1810099,70722] 0 2024-09-12T01:43:14.278 INFO:tasks.workunit.client.0.smithi066.stdout:2/470: chown f2 2034423472 1 2024-09-12T01:43:14.279 INFO:tasks.workunit.client.1.smithi153.stdout:2/848: symlink d7/db/l104 0 2024-09-12T01:43:14.281 INFO:tasks.workunit.client.1.smithi153.stdout:8/790: getdents d17/d1f/dcf 0 2024-09-12T01:43:14.281 INFO:tasks.workunit.client.0.smithi066.stdout:2/471: mkdir de/d13/d9c 0 2024-09-12T01:43:14.283 INFO:tasks.workunit.client.1.smithi153.stdout:5/902: creat d0/d43/dac/db0/d109/d83/d36/da5/f118 x:0 0 0 2024-09-12T01:43:14.284 INFO:tasks.workunit.client.1.smithi153.stdout:6/961: mkdir d1/d6/da/d12c/d138 0 2024-09-12T01:43:14.288 INFO:tasks.workunit.client.1.smithi153.stdout:8/791: creat d17/d21/f109 x:0 0 0 2024-09-12T01:43:14.289 INFO:tasks.workunit.client.0.smithi066.stdout:2/472: dread de/d13/d1e/d41/d58/f73 [0,4194304] 0 2024-09-12T01:43:14.289 INFO:tasks.workunit.client.0.smithi066.stdout:2/473: stat de/f42 0 2024-09-12T01:43:14.290 INFO:tasks.workunit.client.0.smithi066.stdout:2/474: write de/d13/d1e/d41/d58/f73 [4602756,119383] 0 2024-09-12T01:43:14.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/903: rename d0/d43/d8d/d8e/dd7/ldf to d0/d43/dac/db0/d109/d83/d36/d39/da4/l119 0 2024-09-12T01:43:14.291 INFO:tasks.workunit.client.1.smithi153.stdout:5/904: write d0/d43/dac/db0/d109/d1c/fc4 [4275351,43646] 0 2024-09-12T01:43:14.293 INFO:tasks.workunit.client.1.smithi153.stdout:6/962: creat d1/d6/d23/d98/d53/d69/d7c/d7f/f139 x:0 0 0 2024-09-12T01:43:14.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/575: dread d2/fa [0,4194304] 0 2024-09-12T01:43:14.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/576: write d2/d99/fa1 [300413,54169] 0 2024-09-12T01:43:14.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/577: readlink d2/d99/d12/d1d/d6b/l6c 0 2024-09-12T01:43:14.294 INFO:tasks.workunit.client.0.smithi066.stdout:6/578: fdatasync d2/d31/d57/db4/fb0 0 2024-09-12T01:43:14.296 INFO:tasks.workunit.client.1.smithi153.stdout:3/946: dwrite d1/d13/d25/da6/f9e [0,4194304] 0 2024-09-12T01:43:14.296 INFO:tasks.workunit.client.1.smithi153.stdout:3/947: write d1/d16/d1c/fd9 [838929,33934] 0 2024-09-12T01:43:14.297 INFO:tasks.workunit.client.0.smithi066.stdout:2/475: unlink de/d13/d28/d3d/l6e 0 2024-09-12T01:43:14.297 INFO:tasks.workunit.client.0.smithi066.stdout:2/476: fdatasync f9 0 2024-09-12T01:43:14.297 INFO:tasks.workunit.client.0.smithi066.stdout:9/498: dwrite d0/d6/d17/d1b/d4c/d4b/f94 [0,4194304] 0 2024-09-12T01:43:14.299 INFO:tasks.workunit.client.0.smithi066.stdout:5/468: sync 2024-09-12T01:43:14.299 INFO:tasks.workunit.client.0.smithi066.stdout:5/469: readlink d0/dd/l5d 0 2024-09-12T01:43:14.299 INFO:tasks.workunit.client.0.smithi066.stdout:8/530: sync 2024-09-12T01:43:14.299 INFO:tasks.workunit.client.0.smithi066.stdout:8/531: chown d12/d21/d2f/d57/d3c/f7b 5755 1 2024-09-12T01:43:14.300 INFO:tasks.workunit.client.1.smithi153.stdout:5/905: creat d0/d43/d68/db2/f11a x:0 0 0 2024-09-12T01:43:14.301 INFO:tasks.workunit.client.0.smithi066.stdout:7/431: dwrite d2/d5/d6/d22/d75/d1d/f8f [0,4194304] 0 2024-09-12T01:43:14.301 INFO:tasks.workunit.client.0.smithi066.stdout:7/432: fdatasync d2/d5/d6/d22/d75/d1d/d6c/d80/f62 0 2024-09-12T01:43:14.301 INFO:tasks.workunit.client.0.smithi066.stdout:7/433: write d2/d5/d6/d22/d75/d1d/d84/f87 [584428,74016] 0 2024-09-12T01:43:14.301 INFO:tasks.workunit.client.1.smithi153.stdout:5/906: read d0/d20/fa1 [298033,123344] 0 2024-09-12T01:43:14.302 INFO:tasks.workunit.client.0.smithi066.stdout:2/477: mknod de/d13/d1e/d22/c9d 0 2024-09-12T01:43:14.303 INFO:tasks.workunit.client.1.smithi153.stdout:8/792: dread d17/d1f/dcf/d106/f8f [0,4194304] 0 2024-09-12T01:43:14.305 INFO:tasks.workunit.client.1.smithi153.stdout:3/948: creat d1/d1e/f11b x:0 0 0 2024-09-12T01:43:14.306 INFO:tasks.workunit.client.0.smithi066.stdout:4/506: sync 2024-09-12T01:43:14.306 INFO:tasks.workunit.client.0.smithi066.stdout:4/507: stat d4/d6/d8/f3b 0 2024-09-12T01:43:14.307 INFO:tasks.workunit.client.0.smithi066.stdout:9/499: symlink d0/d6/d17/d1b/da2/lb0 0 2024-09-12T01:43:14.307 INFO:tasks.workunit.client.0.smithi066.stdout:9/500: creat d0/d6/d17/d4f/d12/fb1 x:0 0 0 2024-09-12T01:43:14.307 INFO:tasks.workunit.client.0.smithi066.stdout:9/501: write d0/d6/d17/d4f/d12/f25 [4792998,58234] 0 2024-09-12T01:43:14.308 INFO:tasks.workunit.client.1.smithi153.stdout:5/907: rename d0/d20/dc0 to d0/d43/d8d/d8e/dd7/d11b 0 2024-09-12T01:43:14.311 INFO:tasks.workunit.client.0.smithi066.stdout:5/470: mknod d0/d26/d2d/d33/d55/d73/c94 0 2024-09-12T01:43:14.311 INFO:tasks.workunit.client.0.smithi066.stdout:5/471: fdatasync d0/d26/d2d/d33/f88 0 2024-09-12T01:43:14.312 INFO:tasks.workunit.client.0.smithi066.stdout:9/502: dread d0/d6/d17/d4f/d9/fa [0,4194304] 0 2024-09-12T01:43:14.312 INFO:tasks.workunit.client.0.smithi066.stdout:9/503: fdatasync d0/d6/d17/f23 0 2024-09-12T01:43:14.312 INFO:tasks.workunit.client.1.smithi153.stdout:6/963: getdents d1/d6/d23/d98/d53/da4 0 2024-09-12T01:43:14.314 INFO:tasks.workunit.client.0.smithi066.stdout:8/532: creat d12/d21/d2f/d53/fa8 x:0 0 0 2024-09-12T01:43:14.315 INFO:tasks.workunit.client.1.smithi153.stdout:7/852: dwrite d12/d21/d29/d35/d95/fcd [0,4194304] 0 2024-09-12T01:43:14.315 INFO:tasks.workunit.client.1.smithi153.stdout:2/849: dwrite d7/d19/d40/fac [0,4194304] 0 2024-09-12T01:43:14.315 INFO:tasks.workunit.client.1.smithi153.stdout:9/918: dwrite d3/f8 [0,4194304] 0 2024-09-12T01:43:14.315 INFO:tasks.workunit.client.1.smithi153.stdout:3/949: getdents d1 0 2024-09-12T01:43:14.317 INFO:tasks.workunit.client.0.smithi066.stdout:1/488: dwrite d5/d52/f7e [0,4194304] 0 2024-09-12T01:43:14.317 INFO:tasks.workunit.client.0.smithi066.stdout:7/434: mkdir d2/d71/d93 0 2024-09-12T01:43:14.319 INFO:tasks.workunit.client.1.smithi153.stdout:8/793: rename d17/d1f/dcf/d106/f84 to d17/d1f/d4f/d42/f10a 0 2024-09-12T01:43:14.320 INFO:tasks.workunit.client.1.smithi153.stdout:8/794: fsync d17/d1f/dcf/d106/f82 0 2024-09-12T01:43:14.320 INFO:tasks.workunit.client.1.smithi153.stdout:8/795: readlink d17/d1f/l7c 0 2024-09-12T01:43:14.320 INFO:tasks.workunit.client.1.smithi153.stdout:8/796: chown d17/d1f/dcf/d106/d99/ffc 0 1 2024-09-12T01:43:14.320 INFO:tasks.workunit.client.1.smithi153.stdout:8/797: chown d17/d1f/d4f/d42/f10a 373 1 2024-09-12T01:43:14.320 INFO:tasks.workunit.client.0.smithi066.stdout:6/579: dread d2/d99/fa1 [0,4194304] 0 2024-09-12T01:43:14.322 INFO:tasks.workunit.client.0.smithi066.stdout:2/478: rename de/d13/d28/l5d to de/d13/d1e/d92/l9e 0 2024-09-12T01:43:14.324 INFO:tasks.workunit.client.1.smithi153.stdout:7/853: mkdir d12/d21/d4d/dae/dc0/dc4/d101/d10f 0 2024-09-12T01:43:14.327 INFO:tasks.workunit.client.0.smithi066.stdout:4/508: mkdir d4/d6/d27/d66/da1 0 2024-09-12T01:43:14.327 INFO:tasks.workunit.client.0.smithi066.stdout:4/509: chown d4/d6/d8/d18/d45/c99 505 1 2024-09-12T01:43:14.327 INFO:tasks.workunit.client.0.smithi066.stdout:4/510: stat d4/f16 0 2024-09-12T01:43:14.335 INFO:tasks.workunit.client.1.smithi153.stdout:2/850: creat d7/db/d62/f105 x:0 0 0 2024-09-12T01:43:14.335 INFO:tasks.workunit.client.1.smithi153.stdout:2/851: dread - d7/db/d6c/d76/fc0 zero size 2024-09-12T01:43:14.337 INFO:tasks.workunit.client.0.smithi066.stdout:5/472: unlink d0/d26/d2d/d42/f7b 0 2024-09-12T01:43:14.340 INFO:tasks.workunit.client.0.smithi066.stdout:8/533: link d12/d21/d2f/f95 d12/d21/d2f/d57/d43/fa9 0 2024-09-12T01:43:14.340 INFO:tasks.workunit.client.0.smithi066.stdout:8/534: dread - d12/d21/d2f/d57/d84/d89/fa4 zero size 2024-09-12T01:43:14.340 INFO:tasks.workunit.client.0.smithi066.stdout:4/511: dread d4/d6/d8/f43 [4194304,4194304] 0 2024-09-12T01:43:14.341 INFO:tasks.workunit.client.1.smithi153.stdout:9/919: mknod d3/d3a/d42/d72/dce/c119 0 2024-09-12T01:43:14.341 INFO:tasks.workunit.client.1.smithi153.stdout:9/920: readlink d3/d5f/d62/d118/ld0 0 2024-09-12T01:43:14.341 INFO:tasks.workunit.client.1.smithi153.stdout:9/921: readlink d3/d66/l82 0 2024-09-12T01:43:14.341 INFO:tasks.workunit.client.1.smithi153.stdout:9/922: fdatasync d3/d3a/d42/d72/d98/d9a/da0/fac 0 2024-09-12T01:43:14.341 INFO:tasks.workunit.client.1.smithi153.stdout:9/923: read - d3/d3a/d42/d72/d98/d9a/da0/fac zero size 2024-09-12T01:43:14.342 INFO:tasks.workunit.client.0.smithi066.stdout:1/489: mknod d5/d52/d60/c92 0 2024-09-12T01:43:14.344 INFO:tasks.workunit.client.0.smithi066.stdout:3/584: sync 2024-09-12T01:43:14.344 INFO:tasks.workunit.client.0.smithi066.stdout:3/585: readlink d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/l87 0 2024-09-12T01:43:14.344 INFO:tasks.workunit.client.0.smithi066.stdout:0/575: sync 2024-09-12T01:43:14.344 INFO:tasks.workunit.client.1.smithi153.stdout:3/950: unlink d1/l56 0 2024-09-12T01:43:14.345 INFO:tasks.workunit.client.0.smithi066.stdout:9/504: dwrite d0/d6/d17/d1b/d4c/f2b [0,4194304] 0 2024-09-12T01:43:14.345 INFO:tasks.workunit.client.0.smithi066.stdout:9/505: fsync d0/d6/f20 0 2024-09-12T01:43:14.345 INFO:tasks.workunit.client.0.smithi066.stdout:9/506: write d0/d6/d17/d1b/d4c/d42/f5e [130390,11522] 0 2024-09-12T01:43:14.346 INFO:tasks.workunit.client.0.smithi066.stdout:6/580: mknod d2/d21/d92/cc4 0 2024-09-12T01:43:14.346 INFO:tasks.workunit.client.0.smithi066.stdout:6/581: chown d2/fa3 3 1 2024-09-12T01:43:14.346 INFO:tasks.workunit.client.0.smithi066.stdout:6/582: chown d2/d31/d5e/l7e 11 1 2024-09-12T01:43:14.346 INFO:tasks.workunit.client.0.smithi066.stdout:6/583: fsync d2/d99/f6a 0 2024-09-12T01:43:14.352 INFO:tasks.workunit.client.0.smithi066.stdout:2/479: creat de/d13/f9f x:0 0 0 2024-09-12T01:43:14.353 INFO:tasks.workunit.client.0.smithi066.stdout:8/535: rename d12/f1b to d12/d21/d2f/d57/d84/d6f/faa 0 2024-09-12T01:43:14.355 INFO:tasks.workunit.client.1.smithi153.stdout:8/798: dwrite d17/d1f/dcf/d106/d96/f6a [4194304,4194304] 0 2024-09-12T01:43:14.355 INFO:tasks.workunit.client.1.smithi153.stdout:8/799: fdatasync d17/d1f/d4f/d42/d79/dac/fe9 0 2024-09-12T01:43:14.355 INFO:tasks.workunit.client.1.smithi153.stdout:8/800: creat d17/d21/f10b x:0 0 0 2024-09-12T01:43:14.356 INFO:tasks.workunit.client.1.smithi153.stdout:1/907: dwrite d2/d9/f5a [0,4194304] 0 2024-09-12T01:43:14.356 INFO:tasks.workunit.client.0.smithi066.stdout:7/435: dwrite d2/d5/d6/d22/d75/d25/f67 [4194304,4194304] 0 2024-09-12T01:43:14.356 INFO:tasks.workunit.client.0.smithi066.stdout:5/473: dread d0/d26/f34 [4194304,4194304] 0 2024-09-12T01:43:14.358 INFO:tasks.workunit.client.1.smithi153.stdout:5/908: rename d0/d43/dac/db0/d109/f21 to d0/d43/d8d/d8e/f11c 0 2024-09-12T01:43:14.360 INFO:tasks.workunit.client.1.smithi153.stdout:8/801: dread d17/d1f/dcf/d106/d99/ffd [4194304,4194304] 0 2024-09-12T01:43:14.361 INFO:tasks.workunit.client.0.smithi066.stdout:1/490: write d5/d52/f7e [2232747,43489] 0 2024-09-12T01:43:14.361 INFO:tasks.workunit.client.0.smithi066.stdout:4/512: creat d4/d6/d14/fa2 x:0 0 0 2024-09-12T01:43:14.361 INFO:tasks.workunit.client.0.smithi066.stdout:4/513: chown d4/d6/d48/d88/c68 4081962 1 2024-09-12T01:43:14.362 INFO:tasks.workunit.client.0.smithi066.stdout:4/514: stat d4/d15/c2a 0 2024-09-12T01:43:14.362 INFO:tasks.workunit.client.1.smithi153.stdout:7/854: mknod d12/d21/d29/d35/d37/c110 0 2024-09-12T01:43:14.363 INFO:tasks.workunit.client.0.smithi066.stdout:3/586: mknod d5/d6/d1b/d77/d8b/cc9 0 2024-09-12T01:43:14.364 INFO:tasks.workunit.client.0.smithi066.stdout:0/576: mknod d1/d62/d9f/d4a/d67/d1b/d26/d9c/cd2 0 2024-09-12T01:43:14.365 INFO:tasks.workunit.client.1.smithi153.stdout:2/852: dwrite d7/db/d27/d56/f6e [0,4194304] 0 2024-09-12T01:43:14.373 INFO:tasks.workunit.client.0.smithi066.stdout:9/507: symlink d0/d6/d17/d1b/d4c/d4b/d86/lb2 0 2024-09-12T01:43:14.375 INFO:tasks.workunit.client.1.smithi153.stdout:3/951: getdents d1/d1e/d9a 0 2024-09-12T01:43:14.375 INFO:tasks.workunit.client.1.smithi153.stdout:3/952: write d1/d1e/d9a/fc9 [5017263,98063] 0 2024-09-12T01:43:14.376 INFO:tasks.workunit.client.0.smithi066.stdout:2/480: mknod de/d13/d1e/d41/d81/ca0 0 2024-09-12T01:43:14.377 INFO:tasks.workunit.client.1.smithi153.stdout:2/853: dread d7/d4d/fbe [0,4194304] 0 2024-09-12T01:43:14.381 INFO:tasks.workunit.client.0.smithi066.stdout:8/536: rename d12/d21/l29 to d12/d21/d2f/lab 0 2024-09-12T01:43:14.381 INFO:tasks.workunit.client.0.smithi066.stdout:8/537: write d12/d21/d2f/d57/d3c/f99 [112749,40778] 0 2024-09-12T01:43:14.381 INFO:tasks.workunit.client.0.smithi066.stdout:8/538: creat d12/d21/fac x:0 0 0 2024-09-12T01:43:14.382 INFO:tasks.workunit.client.0.smithi066.stdout:8/539: chown d12/d21/f33 0 1 2024-09-12T01:43:14.383 INFO:tasks.workunit.client.0.smithi066.stdout:7/436: mknod d2/d71/d93/c94 0 2024-09-12T01:43:14.384 INFO:tasks.workunit.client.1.smithi153.stdout:8/802: dwrite d17/d1d/d27/f7e [0,4194304] 0 2024-09-12T01:43:14.384 INFO:tasks.workunit.client.1.smithi153.stdout:8/803: chown d17/d1f/l20 95585 1 2024-09-12T01:43:14.386 INFO:tasks.workunit.client.0.smithi066.stdout:5/474: mkdir d0/d26/d2d/d42/d95 0 2024-09-12T01:43:14.386 INFO:tasks.workunit.client.0.smithi066.stdout:5/475: chown d0/d26/d2f/d30/l48 879784 1 2024-09-12T01:43:14.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/908: mknod d2/d9/d17/d2f/d56/d71/c124 0 2024-09-12T01:43:14.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/909: write d2/d68/d6b/d9e/dc7/fe9 [702594,1295] 0 2024-09-12T01:43:14.387 INFO:tasks.workunit.client.1.smithi153.stdout:1/910: fdatasync d2/d9/d1d/d25/f5f 0 2024-09-12T01:43:14.389 INFO:tasks.workunit.client.1.smithi153.stdout:5/909: symlink d0/d43/dac/db0/d109/db8/d2f/dc6/l11d 0 2024-09-12T01:43:14.391 INFO:tasks.workunit.client.1.smithi153.stdout:7/855: symlink d12/d21/d29/d35/d37/d58/l111 0 2024-09-12T01:43:14.395 INFO:tasks.workunit.client.0.smithi066.stdout:4/515: mknod d4/d6/d14/ca3 0 2024-09-12T01:43:14.397 INFO:tasks.workunit.client.0.smithi066.stdout:4/516: write d4/f37 [522743,116360] 0 2024-09-12T01:43:14.397 INFO:tasks.workunit.client.0.smithi066.stdout:4/517: fdatasync d4/d6/d8/f1a 0 2024-09-12T01:43:14.398 INFO:tasks.workunit.client.1.smithi153.stdout:9/924: getdents d3/d55/d30 0 2024-09-12T01:43:14.399 INFO:tasks.workunit.client.0.smithi066.stdout:3/587: symlink d5/d6/d1b/d45/d66/d67/d75/d8e/lca 0 2024-09-12T01:43:14.399 INFO:tasks.workunit.client.0.smithi066.stdout:0/577: dwrite d1/d62/d9f/d4a/d67/d1b/d61/f81 [0,4194304] 0 2024-09-12T01:43:14.402 INFO:tasks.workunit.client.0.smithi066.stdout:9/508: creat d0/d6/d17/d4f/d12/d46/fb3 x:0 0 0 2024-09-12T01:43:14.402 INFO:tasks.workunit.client.0.smithi066.stdout:9/509: creat d0/d6/d43/fb4 x:0 0 0 2024-09-12T01:43:14.402 INFO:tasks.workunit.client.0.smithi066.stdout:9/510: write d0/d6/d17/f71 [4742461,15860] 0 2024-09-12T01:43:14.404 INFO:tasks.workunit.client.0.smithi066.stdout:2/481: creat de/d13/d1e/d25/d5e/fa1 x:0 0 0 2024-09-12T01:43:14.407 INFO:tasks.workunit.client.1.smithi153.stdout:2/854: creat d7/db/d27/dfc/f106 x:0 0 0 2024-09-12T01:43:14.407 INFO:tasks.workunit.client.1.smithi153.stdout:2/855: stat d7/lda 0 2024-09-12T01:43:14.407 INFO:tasks.workunit.client.1.smithi153.stdout:2/856: chown d7/f9b 32345366 1 2024-09-12T01:43:14.411 INFO:tasks.workunit.client.0.smithi066.stdout:7/437: mknod d2/d71/d93/c95 0 2024-09-12T01:43:14.413 INFO:tasks.workunit.client.1.smithi153.stdout:5/910: creat d0/d43/dac/db0/d109/d99/f11e x:0 0 0 2024-09-12T01:43:14.413 INFO:tasks.workunit.client.1.smithi153.stdout:3/953: dwrite d1/d1e/f80 [0,4194304] 0 2024-09-12T01:43:14.413 INFO:tasks.workunit.client.1.smithi153.stdout:3/954: chown d1/d11a/fd2 14230 1 2024-09-12T01:43:14.413 INFO:tasks.workunit.client.1.smithi153.stdout:3/955: chown d1/d13/d23/d47/d71/d8e/d93/cfe 436 1 2024-09-12T01:43:14.414 INFO:tasks.workunit.client.0.smithi066.stdout:5/476: creat d0/d26/d2d/f96 x:0 0 0 2024-09-12T01:43:14.415 INFO:tasks.workunit.client.1.smithi153.stdout:1/911: dread d2/d9/d58/d74/fbf [0,4194304] 0 2024-09-12T01:43:14.415 INFO:tasks.workunit.client.1.smithi153.stdout:3/956: dread d1/d13/d23/d47/d71/d8e/d93/fb6 [0,4194304] 0 2024-09-12T01:43:14.415 INFO:tasks.workunit.client.1.smithi153.stdout:3/957: write d1/d16/d1c/fd9 [1265652,99153] 0 2024-09-12T01:43:14.415 INFO:tasks.workunit.client.1.smithi153.stdout:3/958: chown d1/d13/d23/d47/d6c/d9c/ca7 127 1 2024-09-12T01:43:14.415 INFO:tasks.workunit.client.1.smithi153.stdout:3/959: dread - d1/d59/de4/ff1 zero size 2024-09-12T01:43:14.416 INFO:tasks.workunit.client.1.smithi153.stdout:7/856: rmdir d12/d21/d4d/dae/dc0/dc4 39 2024-09-12T01:43:14.424 INFO:tasks.workunit.client.1.smithi153.stdout:2/857: creat d7/db/d62/d87/ddd/f107 x:0 0 0 2024-09-12T01:43:14.424 INFO:tasks.workunit.client.1.smithi153.stdout:2/858: chown d7/db/d36/f84 77493840 1 2024-09-12T01:43:14.425 INFO:tasks.workunit.client.0.smithi066.stdout:3/588: mknod d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d9b/dbd/ccb 0 2024-09-12T01:43:14.425 INFO:tasks.workunit.client.0.smithi066.stdout:3/589: write d5/d6/d1b/d45/d85/fc3 [289716,69506] 0 2024-09-12T01:43:14.425 INFO:tasks.workunit.client.0.smithi066.stdout:3/590: stat d5/d6/d1b/d45/d66/d67/d7f/d84/dc6 0 2024-09-12T01:43:14.431 INFO:tasks.workunit.client.0.smithi066.stdout:1/491: getdents d5/d52/d60 0 2024-09-12T01:43:14.431 INFO:tasks.workunit.client.0.smithi066.stdout:1/492: fsync d5/dc/d36/d4b/f11 0 2024-09-12T01:43:14.433 INFO:tasks.workunit.client.1.smithi153.stdout:8/804: dwrite d17/d1f/d4f/d42/d79/dac/dd3/ff6 [0,4194304] 0 2024-09-12T01:43:14.433 INFO:tasks.workunit.client.1.smithi153.stdout:8/805: readlink d17/d1f/l20 0 2024-09-12T01:43:14.433 INFO:tasks.workunit.client.1.smithi153.stdout:8/806: chown d17/d21/f30 21305 1 2024-09-12T01:43:14.434 INFO:tasks.workunit.client.0.smithi066.stdout:0/578: write d1/d72/f4f [55386,100818] 0 2024-09-12T01:43:14.434 INFO:tasks.workunit.client.0.smithi066.stdout:8/540: dwrite d12/d21/fac [0,4194304] 0 2024-09-12T01:43:14.434 INFO:tasks.workunit.client.0.smithi066.stdout:0/579: chown d1/c59 1314832 1 2024-09-12T01:43:14.434 INFO:tasks.workunit.client.0.smithi066.stdout:0/580: write d1/d62/d9f/d4a/d67/d1b/d61/f7f [871655,30322] 0 2024-09-12T01:43:14.434 INFO:tasks.workunit.client.0.smithi066.stdout:0/581: chown d1/d62/d6c/f5d 86 1 2024-09-12T01:43:14.438 INFO:tasks.workunit.client.1.smithi153.stdout:2/859: dread d7/db/d1d/d1e/d6d/fe6 [0,4194304] 0 2024-09-12T01:43:14.438 INFO:tasks.workunit.client.1.smithi153.stdout:2/860: chown d7/db/d1d/d1e/d6d/fe6 773915 1 2024-09-12T01:43:14.439 INFO:tasks.workunit.client.1.smithi153.stdout:1/912: creat d2/d68/d6b/f125 x:0 0 0 2024-09-12T01:43:14.445 INFO:tasks.workunit.client.1.smithi153.stdout:3/960: creat d1/d13/d23/d47/d71/d8e/f11c x:0 0 0 2024-09-12T01:43:14.449 INFO:tasks.workunit.client.1.smithi153.stdout:9/925: symlink d3/d55/d30/d7b/l11a 0 2024-09-12T01:43:14.450 INFO:tasks.workunit.client.0.smithi066.stdout:9/511: truncate d0/d6/d17/d4f/d12/f67 192097 0 2024-09-12T01:43:14.450 INFO:tasks.workunit.client.0.smithi066.stdout:9/512: read - d0/d6/d17/d1b/d4c/d42/fa1 zero size 2024-09-12T01:43:14.453 INFO:tasks.workunit.client.1.smithi153.stdout:1/913: rename d2/d68/d6b/c10e to d2/d68/d6b/d9e/dc7/c126 0 2024-09-12T01:43:14.457 INFO:tasks.workunit.client.1.smithi153.stdout:9/926: creat d3/d55/d30/d88/dc6/f11b x:0 0 0 2024-09-12T01:43:14.459 INFO:tasks.workunit.client.0.smithi066.stdout:3/591: creat d5/d6/d1b/d45/d66/d67/d7f/fcc x:0 0 0 2024-09-12T01:43:14.459 INFO:tasks.workunit.client.0.smithi066.stdout:3/592: creat d5/d6/d1b/d45/d66/d67/d75/d8e/fcd x:0 0 0 2024-09-12T01:43:14.460 INFO:tasks.workunit.client.1.smithi153.stdout:3/961: rename d1/c74 to d1/d59/c11d 0 2024-09-12T01:43:14.463 INFO:tasks.workunit.client.1.smithi153.stdout:1/914: mkdir d2/d9/d1d/d25/d127 0 2024-09-12T01:43:14.464 INFO:tasks.workunit.client.0.smithi066.stdout:7/438: dwrite d2/d5/d6/d22/d75/d25/f48 [0,4194304] 0 2024-09-12T01:43:14.465 INFO:tasks.workunit.client.1.smithi153.stdout:9/927: creat d3/f11c x:0 0 0 2024-09-12T01:43:14.466 INFO:tasks.workunit.client.1.smithi153.stdout:1/915: stat d2/d68/d6b/d9e/dc7/c126 0 2024-09-12T01:43:14.467 INFO:tasks.workunit.client.0.smithi066.stdout:8/541: rmdir d12/d21/d2f/d57/d84/d6f 39 2024-09-12T01:43:14.468 INFO:tasks.workunit.client.1.smithi153.stdout:9/928: getdents d3/d3a/d42/d72/dce 0 2024-09-12T01:43:14.469 INFO:tasks.workunit.client.0.smithi066.stdout:0/582: unlink d1/d62/fa4 0 2024-09-12T01:43:14.470 INFO:tasks.workunit.client.0.smithi066.stdout:0/583: truncate d1/d72/f6f 1160051 0 2024-09-12T01:43:14.470 INFO:tasks.workunit.client.0.smithi066.stdout:0/584: fdatasync d1/d62/d9f/d4a/d67/d1b/d61/f81 0 2024-09-12T01:43:14.470 INFO:tasks.workunit.client.0.smithi066.stdout:1/493: dread d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:14.472 INFO:tasks.workunit.client.0.smithi066.stdout:9/513: mknod d0/cb5 0 2024-09-12T01:43:14.472 INFO:tasks.workunit.client.0.smithi066.stdout:9/514: truncate d0/d6/d17/d1b/f76 282333 0 2024-09-12T01:43:14.476 INFO:tasks.workunit.client.0.smithi066.stdout:4/518: dwrite d4/d6/d27/d66/d58/f8d [0,4194304] 0 2024-09-12T01:43:14.477 INFO:tasks.workunit.client.0.smithi066.stdout:8/542: dread d12/d21/d2f/d57/d43/d66/f68 [0,4194304] 0 2024-09-12T01:43:14.477 INFO:tasks.workunit.client.0.smithi066.stdout:8/543: read - d12/d21/d2f/d57/f8c zero size 2024-09-12T01:43:14.478 INFO:tasks.workunit.client.1.smithi153.stdout:5/911: dwrite d0/d43/dac/db0/d109/f116 [0,4194304] 0 2024-09-12T01:43:14.480 INFO:tasks.workunit.client.0.smithi066.stdout:5/477: dwrite d0/dd/d18/f3d [0,4194304] 0 2024-09-12T01:43:14.480 INFO:tasks.workunit.client.0.smithi066.stdout:5/478: truncate d0/d26/d2d/f96 834937 0 2024-09-12T01:43:14.481 INFO:tasks.workunit.client.1.smithi153.stdout:7/857: dwrite d12/f36 [0,4194304] 0 2024-09-12T01:43:14.481 INFO:tasks.workunit.client.0.smithi066.stdout:7/439: symlink d2/d5/d6/d22/d75/d1d/d6c/d8e/l96 0 2024-09-12T01:43:14.482 INFO:tasks.workunit.client.0.smithi066.stdout:0/585: truncate d1/d62/d9f/d4a/d67/f70 2674265 0 2024-09-12T01:43:14.483 INFO:tasks.workunit.client.1.smithi153.stdout:1/916: read d2/d9/d58/d74/d103/d89/fbe [2534859,97373] 0 2024-09-12T01:43:14.483 INFO:tasks.workunit.client.1.smithi153.stdout:1/917: read - d2/d9/d17/ff9 zero size 2024-09-12T01:43:14.484 INFO:tasks.workunit.client.0.smithi066.stdout:1/494: dread d5/dc/f34 [0,4194304] 0 2024-09-12T01:43:14.484 INFO:tasks.workunit.client.1.smithi153.stdout:3/962: dread d1/d1e/f80 [0,4194304] 0 2024-09-12T01:43:14.488 INFO:tasks.workunit.client.1.smithi153.stdout:5/912: readlink d0/d43/dac/db0/d109/d83/l33 0 2024-09-12T01:43:14.488 INFO:tasks.workunit.client.0.smithi066.stdout:9/515: write d0/d6/d17/d4f/d12/f27 [4052966,3509] 0 2024-09-12T01:43:14.489 INFO:tasks.workunit.client.1.smithi153.stdout:8/807: dwrite d17/d1f/d4f/d42/d79/f98 [0,4194304] 0 2024-09-12T01:43:14.489 INFO:tasks.workunit.client.1.smithi153.stdout:2/861: dwrite d7/f51 [4194304,4194304] 0 2024-09-12T01:43:14.489 INFO:tasks.workunit.client.1.smithi153.stdout:2/862: write d7/d4d/d70/f92 [1583166,14555] 0 2024-09-12T01:43:14.490 INFO:tasks.workunit.client.0.smithi066.stdout:8/544: symlink d12/d21/d2f/d57/d84/lad 0 2024-09-12T01:43:14.492 INFO:tasks.workunit.client.0.smithi066.stdout:5/479: dread d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:14.492 INFO:tasks.workunit.client.0.smithi066.stdout:5/480: write d0/dd/f8d [1933,90569] 0 2024-09-12T01:43:14.494 INFO:tasks.workunit.client.0.smithi066.stdout:5/481: write d0/dd/d18/f75 [815371,91035] 0 2024-09-12T01:43:14.494 INFO:tasks.workunit.client.0.smithi066.stdout:5/482: write d0/d26/d2d/d33/d55/d82/f72 [7996,21461] 0 2024-09-12T01:43:14.497 INFO:tasks.workunit.client.1.smithi153.stdout:0/976: sync 2024-09-12T01:43:14.497 INFO:tasks.workunit.client.1.smithi153.stdout:0/977: truncate d22/d79/dca/df2/f13e 780688 0 2024-09-12T01:43:14.498 INFO:tasks.workunit.client.1.smithi153.stdout:3/963: dread d1/d16/ff4 [0,4194304] 0 2024-09-12T01:43:14.500 INFO:tasks.workunit.client.0.smithi066.stdout:9/516: write d0/d6/d17/d1b/d4c/f2b [3491846,106750] 0 2024-09-12T01:43:14.505 INFO:tasks.workunit.client.1.smithi153.stdout:7/858: unlink d12/d21/d29/d35/d37/d58/f98 0 2024-09-12T01:43:14.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/495: link d5/d52/f66 d5/d15/d58/f93 0 2024-09-12T01:43:14.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/496: dread - d5/d52/f8c zero size 2024-09-12T01:43:14.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/497: fdatasync d5/dc/f34 0 2024-09-12T01:43:14.507 INFO:tasks.workunit.client.0.smithi066.stdout:1/498: truncate d5/dc/d4f/d8e/f91 977611 0 2024-09-12T01:43:14.507 INFO:tasks.workunit.client.0.smithi066.stdout:4/519: dwrite d4/f37 [0,4194304] 0 2024-09-12T01:43:14.508 INFO:tasks.workunit.client.0.smithi066.stdout:4/520: chown d4/l1b 871 1 2024-09-12T01:43:14.508 INFO:tasks.workunit.client.0.smithi066.stdout:4/521: getdents d4/d6/d27/d66/da1 0 2024-09-12T01:43:14.509 INFO:tasks.workunit.client.1.smithi153.stdout:9/929: dwrite d3/d35/f3f [0,4194304] 0 2024-09-12T01:43:14.509 INFO:tasks.workunit.client.1.smithi153.stdout:1/918: unlink d2/d9/c16 0 2024-09-12T01:43:14.509 INFO:tasks.workunit.client.1.smithi153.stdout:1/919: write d2/d9/d1d/f22 [5181429,55666] 0 2024-09-12T01:43:14.509 INFO:tasks.workunit.client.1.smithi153.stdout:1/920: chown d2/c5 45402 1 2024-09-12T01:43:14.509 INFO:tasks.workunit.client.1.smithi153.stdout:1/921: readlink d2/d9/d17/d69/led 0 2024-09-12T01:43:14.511 INFO:tasks.workunit.client.1.smithi153.stdout:5/913: rename d0/d43/dac/db0/d109/d83/f42 to d0/d43/dac/db0/d109/db8/d2f/d55/dd8/f11f 0 2024-09-12T01:43:14.511 INFO:tasks.workunit.client.1.smithi153.stdout:5/914: readlink d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/d71/db7/lc3 0 2024-09-12T01:43:14.517 INFO:tasks.workunit.client.1.smithi153.stdout:8/808: mkdir d17/d1f/d10c 0 2024-09-12T01:43:14.518 INFO:tasks.workunit.client.1.smithi153.stdout:1/922: write d2/d9/d17/d2f/d56/d97/fda [3204221,43340] 0 2024-09-12T01:43:14.518 INFO:tasks.workunit.client.1.smithi153.stdout:1/923: chown d2/d34/df5 12 1 2024-09-12T01:43:14.521 INFO:tasks.workunit.client.1.smithi153.stdout:2/863: mknod d7/db/c108 0 2024-09-12T01:43:14.521 INFO:tasks.workunit.client.1.smithi153.stdout:2/864: fsync d7/db/d27/d56/f5b 0 2024-09-12T01:43:14.525 INFO:tasks.workunit.client.1.smithi153.stdout:3/964: creat d1/d64/f11e x:0 0 0 2024-09-12T01:43:14.526 INFO:tasks.workunit.client.1.smithi153.stdout:2/865: dread d7/db/d6c/d7e/f66 [0,4194304] 0 2024-09-12T01:43:14.528 INFO:tasks.workunit.client.1.smithi153.stdout:9/930: creat d3/d5f/dbb/f11d x:0 0 0 2024-09-12T01:43:14.529 INFO:tasks.workunit.client.0.smithi066.stdout:8/545: creat d12/d21/d2f/d57/d43/d66/d98/fae x:0 0 0 2024-09-12T01:43:14.532 INFO:tasks.workunit.client.0.smithi066.stdout:5/483: mknod d0/d26/d2d/d42/d95/c97 0 2024-09-12T01:43:14.535 INFO:tasks.workunit.client.1.smithi153.stdout:7/859: rename d12/d7e/db2/fbf to d12/d21/d4d/dae/dc0/dc4/f112 0 2024-09-12T01:43:14.536 INFO:tasks.workunit.client.1.smithi153.stdout:9/931: dread d3/d3a/d42/f47 [0,4194304] 0 2024-09-12T01:43:14.539 INFO:tasks.workunit.client.1.smithi153.stdout:5/915: link d0/d43/fcd d0/d43/dac/db0/d109/db8/d2f/d55/dd8/f120 0 2024-09-12T01:43:14.540 INFO:tasks.workunit.client.0.smithi066.stdout:3/593: rmdir d5/d6/d1b/d45/d66/d67/d75 39 2024-09-12T01:43:14.543 INFO:tasks.workunit.client.0.smithi066.stdout:1/499: link d5/dc/d36/d57/f8a d5/dc/d53/f94 0 2024-09-12T01:43:14.545 INFO:tasks.workunit.client.0.smithi066.stdout:5/484: dread d0/dd/d18/d36/f5c [0,4194304] 0 2024-09-12T01:43:14.545 INFO:tasks.workunit.client.0.smithi066.stdout:5/485: chown d0/d26/d2d/l52 240 1 2024-09-12T01:43:14.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/924: creat d2/d34/d8a/f128 x:0 0 0 2024-09-12T01:43:14.547 INFO:tasks.workunit.client.1.smithi153.stdout:7/860: dread d12/d21/d29/d35/d37/d4c/d5c/f7f [0,4194304] 0 2024-09-12T01:43:14.551 INFO:tasks.workunit.client.1.smithi153.stdout:1/925: dread d2/d9/d28/d73/f78 [0,4194304] 0 2024-09-12T01:43:14.552 INFO:tasks.workunit.client.1.smithi153.stdout:1/926: read d2/d9/d17/fef [283122,64037] 0 2024-09-12T01:43:14.553 INFO:tasks.workunit.client.0.smithi066.stdout:1/500: dread d5/dc/d36/d4b/f2b [0,4194304] 0 2024-09-12T01:43:14.556 INFO:tasks.workunit.client.0.smithi066.stdout:4/522: mkdir d4/d6/d27/d66/d6c/d75/da4 0 2024-09-12T01:43:14.557 INFO:tasks.workunit.client.1.smithi153.stdout:0/978: getdents d22/d82/d10e 0 2024-09-12T01:43:14.557 INFO:tasks.workunit.client.1.smithi153.stdout:0/979: chown d22/d79/dca/dec/d136/dff/d147/f14a 53310 1 2024-09-12T01:43:14.557 INFO:tasks.workunit.client.1.smithi153.stdout:0/980: dread - d22/d79/dca/dec/d136/fc0 zero size 2024-09-12T01:43:14.558 INFO:tasks.workunit.client.1.smithi153.stdout:3/965: creat d1/d16/d17/f11f x:0 0 0 2024-09-12T01:43:14.558 INFO:tasks.workunit.client.1.smithi153.stdout:3/966: dread - d1/d11a/fd2 zero size 2024-09-12T01:43:14.558 INFO:tasks.workunit.client.1.smithi153.stdout:0/981: dread d22/f68 [4194304,4194304] 0 2024-09-12T01:43:14.559 INFO:tasks.workunit.client.1.smithi153.stdout:0/982: truncate d22/d30/fcb 267025 0 2024-09-12T01:43:14.559 INFO:tasks.workunit.client.0.smithi066.stdout:9/517: rmdir d0/d6/d17/d1b/d4c/d4b/d86 39 2024-09-12T01:43:14.561 INFO:tasks.workunit.client.1.smithi153.stdout:9/932: creat d3/d3a/d42/d72/dc3/dd9/f11e x:0 0 0 2024-09-12T01:43:14.561 INFO:tasks.workunit.client.1.smithi153.stdout:9/933: creat d3/d66/f11f x:0 0 0 2024-09-12T01:43:14.563 INFO:tasks.workunit.client.0.smithi066.stdout:3/594: rename d5/d6/d1b/d45/d66/d67/d75/d8e/fc8 to d5/d6/fce 0 2024-09-12T01:43:14.565 INFO:tasks.workunit.client.0.smithi066.stdout:4/523: unlink d4/d6/d8/d18/f76 0 2024-09-12T01:43:14.566 INFO:tasks.workunit.client.1.smithi153.stdout:6/964: sync 2024-09-12T01:43:14.566 INFO:tasks.workunit.client.1.smithi153.stdout:4/797: sync 2024-09-12T01:43:14.567 INFO:tasks.workunit.client.1.smithi153.stdout:5/916: creat d0/d43/dac/db0/d109/d99/df4/f121 x:0 0 0 2024-09-12T01:43:14.568 INFO:tasks.workunit.client.0.smithi066.stdout:9/518: creat d0/fb6 x:0 0 0 2024-09-12T01:43:14.570 INFO:tasks.workunit.client.1.smithi153.stdout:1/927: rename d2/d9/d17/f48 to d2/d9/d1d/d25/d127/f129 0 2024-09-12T01:43:14.570 INFO:tasks.workunit.client.1.smithi153.stdout:7/861: dread d12/d21/d29/d35/d37/f79 [0,4194304] 0 2024-09-12T01:43:14.573 INFO:tasks.workunit.client.0.smithi066.stdout:9/519: unlink d0/d6/d17/d4f/d12/f67 0 2024-09-12T01:43:14.574 INFO:tasks.workunit.client.1.smithi153.stdout:3/967: rmdir d1/d13/d23/d47/d71/d8e/d93/dd1 39 2024-09-12T01:43:14.575 INFO:tasks.workunit.client.0.smithi066.stdout:4/524: dread d4/d6/d48/d88/f6b [0,4194304] 0 2024-09-12T01:43:14.575 INFO:tasks.workunit.client.1.smithi153.stdout:0/983: link d22/d79/dca/dec/d136/dff/d11e/f119 d22/d79/d8e/f14d 0 2024-09-12T01:43:14.576 INFO:tasks.workunit.client.1.smithi153.stdout:0/984: truncate d22/d79/dca/dec/d136/f115 333486 0 2024-09-12T01:43:14.576 INFO:tasks.workunit.client.1.smithi153.stdout:0/985: chown d22/d30/d4c/d6f/d88/lb2 13010831 1 2024-09-12T01:43:14.576 INFO:tasks.workunit.client.1.smithi153.stdout:2/866: dwrite d7/d19/d40/f82 [0,4194304] 0 2024-09-12T01:43:14.579 INFO:tasks.workunit.client.0.smithi066.stdout:9/520: rename d0/d6/f20 to d0/d6/d17/d4f/d9/de/fb7 0 2024-09-12T01:43:14.583 INFO:tasks.workunit.client.1.smithi153.stdout:5/917: link d0/d43/dac/db0/d109/db8/l3c d0/d43/dac/db0/d109/d83/d36/d39/da4/l122 0 2024-09-12T01:43:14.584 INFO:tasks.workunit.client.1.smithi153.stdout:5/918: truncate d0/d43/d68/db2/f11a 626583 0 2024-09-12T01:43:14.587 INFO:tasks.workunit.client.1.smithi153.stdout:4/798: write d6/d15/db4/f68 [2684594,24422] 0 2024-09-12T01:43:14.587 INFO:tasks.workunit.client.1.smithi153.stdout:4/799: fdatasync d6/fe 0 2024-09-12T01:43:14.587 INFO:tasks.workunit.client.0.smithi066.stdout:8/546: dwrite d12/f5b [0,4194304] 0 2024-09-12T01:43:14.588 INFO:tasks.workunit.client.1.smithi153.stdout:9/934: rename d3/d5f/dc4/cfd to d3/d55/d30/d95/c120 0 2024-09-12T01:43:14.593 INFO:tasks.workunit.client.1.smithi153.stdout:3/968: mkdir d1/d13/d23/d47/d71/d8e/d93/dd1/d103/d120 0 2024-09-12T01:43:14.593 INFO:tasks.workunit.client.0.smithi066.stdout:1/501: dwrite d5/dc/d53/f8b [0,4194304] 0 2024-09-12T01:43:14.597 INFO:tasks.workunit.client.1.smithi153.stdout:4/800: read d6/d15/db4/fc0 [265834,47928] 0 2024-09-12T01:43:14.604 INFO:tasks.workunit.client.0.smithi066.stdout:5/486: dwrite d0/d26/d2f/d30/f65 [0,4194304] 0 2024-09-12T01:43:14.604 INFO:tasks.workunit.client.0.smithi066.stdout:9/521: dread d0/d6/d17/f71 [0,4194304] 0 2024-09-12T01:43:14.604 INFO:tasks.workunit.client.0.smithi066.stdout:8/547: mkdir d12/daf 0 2024-09-12T01:43:14.604 INFO:tasks.workunit.client.0.smithi066.stdout:8/548: truncate d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 88792 0 2024-09-12T01:43:14.607 INFO:tasks.workunit.client.1.smithi153.stdout:6/965: dwrite d1/d6/d39/d76/f79 [0,4194304] 0 2024-09-12T01:43:14.611 INFO:tasks.workunit.client.1.smithi153.stdout:5/919: dread d0/d43/f92 [0,4194304] 0 2024-09-12T01:43:14.616 INFO:tasks.workunit.client.1.smithi153.stdout:9/935: dread d3/d55/d30/d90/fd3 [0,4194304] 0 2024-09-12T01:43:14.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/487: mkdir d0/d26/d2f/d3b/d98 0 2024-09-12T01:43:14.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/488: chown d0/dd/l5d 21031552 1 2024-09-12T01:43:14.621 INFO:tasks.workunit.client.0.smithi066.stdout:5/489: write d0/dd/f8d [185130,67246] 0 2024-09-12T01:43:14.622 INFO:tasks.workunit.client.1.smithi153.stdout:3/969: rmdir d1/d13/d23/d47/d71/d8e/d93/dd1/d103 39 2024-09-12T01:43:14.623 INFO:tasks.workunit.client.1.smithi153.stdout:4/801: unlink d6/d9/dc/d31/d7d/d94/fe5 0 2024-09-12T01:43:14.629 INFO:tasks.workunit.client.1.smithi153.stdout:6/966: creat d1/d6/d39/dc4/dcb/f13a x:0 0 0 2024-09-12T01:43:14.629 INFO:tasks.workunit.client.1.smithi153.stdout:5/920: creat d0/d20/f123 x:0 0 0 2024-09-12T01:43:14.629 INFO:tasks.workunit.client.1.smithi153.stdout:5/921: dread d0/d43/d68/dcc/fe4 [0,4194304] 0 2024-09-12T01:43:14.629 INFO:tasks.workunit.client.1.smithi153.stdout:5/922: fsync d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/d71/f104 0 2024-09-12T01:43:14.630 INFO:tasks.workunit.client.0.smithi066.stdout:5/490: rename d0/d26/f70 to d0/d26/d2f/d3b/d98/f99 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:9/936: unlink d3/d55/d30/d90/ff2 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:9/937: fsync d3/d55/f6b 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:9/938: write d3/d55/d30/d95/d84/d8b/fcf [819365,87633] 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/970: symlink d1/d13/d23/d47/d71/d8e/d93/db1/l121 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/971: fsync d1/d64/f86 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/972: readlink d1/d13/d23/d47/d71/la0 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/973: creat d1/d16/d1c/f122 x:0 0 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/974: write d1/d59/fd6 [385521,5642] 0 2024-09-12T01:43:14.631 INFO:tasks.workunit.client.1.smithi153.stdout:3/975: creat d1/d16/f123 x:0 0 0 2024-09-12T01:43:14.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/967: mkdir d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/d13b 0 2024-09-12T01:43:14.632 INFO:tasks.workunit.client.1.smithi153.stdout:6/968: write d1/d6/d23/d98/ff1 [881707,77952] 0 2024-09-12T01:43:14.633 INFO:tasks.workunit.client.1.smithi153.stdout:5/923: creat d0/d43/d8d/d8e/dd7/ddd/f124 x:0 0 0 2024-09-12T01:43:14.633 INFO:tasks.workunit.client.1.smithi153.stdout:5/924: fdatasync d0/d43/dac/db0/d109/db8/d6e/ff5 0 2024-09-12T01:43:14.635 INFO:tasks.workunit.client.1.smithi153.stdout:5/925: truncate d0/d20/f41 4456631 0 2024-09-12T01:43:14.637 INFO:tasks.workunit.client.1.smithi153.stdout:5/926: rename d0/d43/dac/db0/d109/d1c/c10f to d0/d43/d8d/d8e/c125 0 2024-09-12T01:43:14.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/927: getdents d0/d43/dac 0 2024-09-12T01:43:14.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/928: write d0/d20/f26 [1610550,98290] 0 2024-09-12T01:43:14.638 INFO:tasks.workunit.client.1.smithi153.stdout:5/929: stat d0/d43/dac/db0/d109/db8 0 2024-09-12T01:43:14.639 INFO:tasks.workunit.client.1.smithi153.stdout:1/928: dwrite d2/d9/d1d/d25/d127/f129 [0,4194304] 0 2024-09-12T01:43:14.639 INFO:tasks.workunit.client.1.smithi153.stdout:1/929: fdatasync d2/d9/d58/d74/fbf 0 2024-09-12T01:43:14.640 INFO:tasks.workunit.client.1.smithi153.stdout:5/930: symlink d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/d70/l126 0 2024-09-12T01:43:14.640 INFO:tasks.workunit.client.1.smithi153.stdout:5/931: write d0/d43/dac/db0/d109/db8/d2f/d55/d9c/fa0 [154945,99476] 0 2024-09-12T01:43:14.640 INFO:tasks.workunit.client.1.smithi153.stdout:1/930: mkdir d2/d9/d17/d2f/d56/d12a 0 2024-09-12T01:43:14.641 INFO:tasks.workunit.client.1.smithi153.stdout:5/932: mknod d0/d43/dac/db0/d109/db8/d2f/d55/d9c/c127 0 2024-09-12T01:43:14.642 INFO:tasks.workunit.client.1.smithi153.stdout:1/931: creat d2/d34/f12b x:0 0 0 2024-09-12T01:43:14.642 INFO:tasks.workunit.client.1.smithi153.stdout:5/933: mknod d0/d43/d8d/d8e/dd7/ddd/c128 0 2024-09-12T01:43:14.644 INFO:tasks.workunit.client.1.smithi153.stdout:1/932: mkdir d2/d9/d17/d2c/d12c 0 2024-09-12T01:43:14.644 INFO:tasks.workunit.client.1.smithi153.stdout:1/933: getdents d2/d9/d17/d2f/d56/d12a 0 2024-09-12T01:43:14.644 INFO:tasks.workunit.client.1.smithi153.stdout:2/867: dwrite d7/db/d27/f31 [0,4194304] 0 2024-09-12T01:43:14.647 INFO:tasks.workunit.client.0.smithi066.stdout:1/502: dwrite d5/d15/f3a [0,4194304] 0 2024-09-12T01:43:14.647 INFO:tasks.workunit.client.0.smithi066.stdout:1/503: readlink d5/dc/d4f/l80 0 2024-09-12T01:43:14.647 INFO:tasks.workunit.client.0.smithi066.stdout:1/504: fdatasync d5/dc/d53/f35 0 2024-09-12T01:43:14.652 INFO:tasks.workunit.client.1.smithi153.stdout:4/802: dread d6/d9/d11/d13/dce/dd7/f3b [0,4194304] 0 2024-09-12T01:43:14.652 INFO:tasks.workunit.client.1.smithi153.stdout:4/803: chown d6/d9/dc/d31/d76/d99/f85 0 1 2024-09-12T01:43:14.652 INFO:tasks.workunit.client.1.smithi153.stdout:4/804: dread - d6/fe3 zero size 2024-09-12T01:43:14.652 INFO:tasks.workunit.client.1.smithi153.stdout:4/805: stat d6/d6a/cb8 0 2024-09-12T01:43:14.652 INFO:tasks.workunit.client.1.smithi153.stdout:9/939: read d3/d3a/d42/f58 [6065342,79367] 0 2024-09-12T01:43:14.652 INFO:tasks.workunit.client.1.smithi153.stdout:4/806: mkdir d6/da4/d112 0 2024-09-12T01:43:14.653 INFO:tasks.workunit.client.1.smithi153.stdout:9/940: truncate d3/d55/f22 3369270 0 2024-09-12T01:43:14.653 INFO:tasks.workunit.client.1.smithi153.stdout:9/941: chown d3/d3a/d42/d72/d98/l117 936664 1 2024-09-12T01:43:14.654 INFO:tasks.workunit.client.1.smithi153.stdout:4/807: mknod d6/d9/dc/d31/d7d/d94/df7/d108/c113 0 2024-09-12T01:43:14.655 INFO:tasks.workunit.client.0.smithi066.stdout:1/505: write d5/dc/f12 [3588709,79895] 0 2024-09-12T01:43:14.655 INFO:tasks.workunit.client.1.smithi153.stdout:9/942: mkdir d3/d3a/d42/d72/d107/d121 0 2024-09-12T01:43:14.655 INFO:tasks.workunit.client.1.smithi153.stdout:9/943: chown d3/d3a/d42/d72/dc3/cf8 11435695 1 2024-09-12T01:43:14.655 INFO:tasks.workunit.client.1.smithi153.stdout:9/944: chown d3/d3a/d42/l56 83760357 1 2024-09-12T01:43:14.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/862: dwrite d12/d21/d29/f3d [0,4194304] 0 2024-09-12T01:43:14.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/863: write d12/d7e/fe3 [635461,56505] 0 2024-09-12T01:43:14.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/864: chown d12/d4e 126024 1 2024-09-12T01:43:14.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/865: creat d12/d21/d29/d35/d37/d4c/f113 x:0 0 0 2024-09-12T01:43:14.657 INFO:tasks.workunit.client.1.smithi153.stdout:7/866: creat d12/d21/d29/d2d/f114 x:0 0 0 2024-09-12T01:43:14.658 INFO:tasks.workunit.client.0.smithi066.stdout:1/506: link d5/dc/d36/d57/l71 d5/dc/d36/l95 0 2024-09-12T01:43:14.658 INFO:tasks.workunit.client.0.smithi066.stdout:1/507: read - d5/dc/d36/f89 zero size 2024-09-12T01:43:14.658 INFO:tasks.workunit.client.0.smithi066.stdout:4/525: dwrite d4/d6/d48/d88/f6b [0,4194304] 0 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.0.smithi066.stdout:1/508: dread d5/f47 [4194304,4194304] 0 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.0.smithi066.stdout:1/509: dread - d5/dc/f29 zero size 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.1.smithi153.stdout:4/808: rmdir d6/d9/d11/d13 39 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.1.smithi153.stdout:4/809: chown d6/d15/c6d 31504876 1 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.1.smithi153.stdout:4/810: write d6/d9/dc/d98/f3f [4680821,37449] 0 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.1.smithi153.stdout:0/986: dwrite d22/f83 [0,4194304] 0 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.1.smithi153.stdout:5/934: dread d0/d43/dac/db0/d109/d83/d36/d39/f74 [0,4194304] 0 2024-09-12T01:43:14.659 INFO:tasks.workunit.client.1.smithi153.stdout:0/987: dread - d22/d79/d8e/dc6/f113 zero size 2024-09-12T01:43:14.660 INFO:tasks.workunit.client.0.smithi066.stdout:9/522: dwrite d0/d6/d37/d85/fa8 [0,4194304] 0 2024-09-12T01:43:14.661 INFO:tasks.workunit.client.0.smithi066.stdout:8/549: dwrite d12/d21/d2f/d57/d43/f46 [0,4194304] 0 2024-09-12T01:43:14.663 INFO:tasks.workunit.client.1.smithi153.stdout:2/868: write d7/d19/d83/d101/f8c [1217842,41975] 0 2024-09-12T01:43:14.663 INFO:tasks.workunit.client.1.smithi153.stdout:2/869: fdatasync d7/d19/d83/fa7 0 2024-09-12T01:43:14.663 INFO:tasks.workunit.client.1.smithi153.stdout:2/870: write d7/fce [403300,112735] 0 2024-09-12T01:43:14.663 INFO:tasks.workunit.client.1.smithi153.stdout:2/871: fsync d7/db/d6c/d76/fa8 0 2024-09-12T01:43:14.664 INFO:tasks.workunit.client.1.smithi153.stdout:2/872: chown d7/db/d27/f73 668 1 2024-09-12T01:43:14.664 INFO:tasks.workunit.client.1.smithi153.stdout:6/969: dwrite d1/d6/d46/d73/d8a/f89 [0,4194304] 0 2024-09-12T01:43:14.665 INFO:tasks.workunit.client.0.smithi066.stdout:4/526: rmdir d4/d6/d27/d66/d6c/d75/da4 0 2024-09-12T01:43:14.665 INFO:tasks.workunit.client.0.smithi066.stdout:4/527: creat d4/d6/d62/fa5 x:0 0 0 2024-09-12T01:43:14.667 INFO:tasks.workunit.client.0.smithi066.stdout:5/491: dwrite d0/dd/d18/f3d [0,4194304] 0 2024-09-12T01:43:14.667 INFO:tasks.workunit.client.0.smithi066.stdout:5/492: stat d0/d21/f44 0 2024-09-12T01:43:14.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/523: dread d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:14.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/524: write d0/d6/d17/f23 [1545374,92250] 0 2024-09-12T01:43:14.669 INFO:tasks.workunit.client.1.smithi153.stdout:9/945: write d3/f5 [7006185,120833] 0 2024-09-12T01:43:14.670 INFO:tasks.workunit.client.1.smithi153.stdout:7/867: mknod d12/c115 0 2024-09-12T01:43:14.674 INFO:tasks.workunit.client.1.smithi153.stdout:4/811: creat d6/d9/dc/d31/d76/f114 x:0 0 0 2024-09-12T01:43:14.674 INFO:tasks.workunit.client.1.smithi153.stdout:4/812: fsync d6/d9/dc/d98/f7e 0 2024-09-12T01:43:14.674 INFO:tasks.workunit.client.1.smithi153.stdout:4/813: write d6/d9/dc/d31/d7d/d94/fde [4353695,7024] 0 2024-09-12T01:43:14.675 INFO:tasks.workunit.client.1.smithi153.stdout:4/814: write d6/d9/dc/d31/d76/d99/f107 [697851,72758] 0 2024-09-12T01:43:14.676 INFO:tasks.workunit.client.0.smithi066.stdout:8/550: truncate d12/d21/d2f/d57/d84/d50/d56/f59 793543 0 2024-09-12T01:43:14.678 INFO:tasks.workunit.client.0.smithi066.stdout:1/510: dwrite d5/dc/f34 [0,4194304] 0 2024-09-12T01:43:14.680 INFO:tasks.workunit.client.0.smithi066.stdout:4/528: rename d4/f12 to d4/d6/d8/fa6 0 2024-09-12T01:43:14.682 INFO:tasks.workunit.client.0.smithi066.stdout:8/551: dread d12/f3d [0,4194304] 0 2024-09-12T01:43:14.683 INFO:tasks.workunit.client.0.smithi066.stdout:8/552: stat d12/daf 0 2024-09-12T01:43:14.684 INFO:tasks.workunit.client.0.smithi066.stdout:5/493: mkdir d0/d26/d2f/d9a 0 2024-09-12T01:43:14.684 INFO:tasks.workunit.client.0.smithi066.stdout:5/494: creat d0/dd/f9b x:0 0 0 2024-09-12T01:43:14.686 INFO:tasks.workunit.client.0.smithi066.stdout:9/525: unlink d0/d6/d17/d1b/c21 0 2024-09-12T01:43:14.689 INFO:tasks.workunit.client.0.smithi066.stdout:4/529: symlink d4/d6/d27/la7 0 2024-09-12T01:43:14.692 INFO:tasks.workunit.client.0.smithi066.stdout:8/553: symlink d12/d21/d2f/d57/lb0 0 2024-09-12T01:43:14.694 INFO:tasks.workunit.client.1.smithi153.stdout:5/935: rmdir d0/d43/d68/dcc 39 2024-09-12T01:43:14.694 INFO:tasks.workunit.client.1.smithi153.stdout:5/936: write d0/d43/dac/db0/d109/fca [4244598,108808] 0 2024-09-12T01:43:14.695 INFO:tasks.workunit.client.0.smithi066.stdout:1/511: dwrite d5/fa [0,4194304] 0 2024-09-12T01:43:14.695 INFO:tasks.workunit.client.0.smithi066.stdout:1/512: chown d5/d15/f6e 57 1 2024-09-12T01:43:14.695 INFO:tasks.workunit.client.0.smithi066.stdout:1/513: dread - d5/d15/f6e zero size 2024-09-12T01:43:14.696 INFO:tasks.workunit.client.0.smithi066.stdout:5/495: unlink d0/dd/d18/f23 0 2024-09-12T01:43:14.697 INFO:tasks.workunit.client.0.smithi066.stdout:6/584: sync 2024-09-12T01:43:14.697 INFO:tasks.workunit.client.0.smithi066.stdout:2/482: sync 2024-09-12T01:43:14.697 INFO:tasks.workunit.client.0.smithi066.stdout:9/526: symlink d0/d6/d17/d4f/d9/lb8 0 2024-09-12T01:43:14.700 INFO:tasks.workunit.client.0.smithi066.stdout:4/530: symlink d4/d6/d48/la8 0 2024-09-12T01:43:14.700 INFO:tasks.workunit.client.0.smithi066.stdout:4/531: readlink d4/d6/d8/lf 0 2024-09-12T01:43:14.700 INFO:tasks.workunit.client.0.smithi066.stdout:4/532: chown d4/d6/d8/d18/d45 410 1 2024-09-12T01:43:14.700 INFO:tasks.workunit.client.0.smithi066.stdout:4/533: truncate d4/d6/d27/d66/d6c/f97 951534 0 2024-09-12T01:43:14.702 INFO:tasks.workunit.client.0.smithi066.stdout:5/496: dread d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:14.702 INFO:tasks.workunit.client.0.smithi066.stdout:5/497: chown d0/f17 134070780 1 2024-09-12T01:43:14.702 INFO:tasks.workunit.client.0.smithi066.stdout:8/554: rename d12/d21/d2f/d53/f6b to d12/d21/d2f/d57/fb1 0 2024-09-12T01:43:14.704 INFO:tasks.workunit.client.1.smithi153.stdout:6/970: symlink d1/d6/d23/d98/d53/de0/l13c 0 2024-09-12T01:43:14.704 INFO:tasks.workunit.client.1.smithi153.stdout:6/971: chown d1/d6/d23/d98/d53/d69/c75 121054565 1 2024-09-12T01:43:14.706 INFO:tasks.workunit.client.0.smithi066.stdout:2/483: mkdir de/d13/d1e/d25/da2 0 2024-09-12T01:43:14.708 INFO:tasks.workunit.client.0.smithi066.stdout:9/527: symlink d0/d6/d17/d1b/d4c/d42/lb9 0 2024-09-12T01:43:14.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/528: creat d0/d6/d7f/d90/d9a/fba x:0 0 0 2024-09-12T01:43:14.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/529: write d0/d6/d17/d1b/d4c/f2b [4973040,85973] 0 2024-09-12T01:43:14.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/530: chown d0/d6/d17/d28/f5f 3 1 2024-09-12T01:43:14.715 INFO:tasks.workunit.client.1.smithi153.stdout:9/946: creat d3/d55/d30/d7b/f122 x:0 0 0 2024-09-12T01:43:14.717 INFO:tasks.workunit.client.1.smithi153.stdout:7/868: mkdir d12/d21/d29/d2d/d8b/d116 0 2024-09-12T01:43:14.717 INFO:tasks.workunit.client.0.smithi066.stdout:9/531: dread d0/d6/d17/f4d [0,4194304] 0 2024-09-12T01:43:14.721 INFO:tasks.workunit.client.1.smithi153.stdout:6/972: dwrite d1/d6/d23/d98/d53/f77 [0,4194304] 0 2024-09-12T01:43:14.721 INFO:tasks.workunit.client.1.smithi153.stdout:6/973: rename d1/d6 to d1/d6/d46/d73/d8a/d84/d13d 22 2024-09-12T01:43:14.727 INFO:tasks.workunit.client.1.smithi153.stdout:5/937: mkdir d0/d15/dae/d114/d129 0 2024-09-12T01:43:14.727 INFO:tasks.workunit.client.1.smithi153.stdout:5/938: chown d0/d43/dac/db0/d109/db8/f112 2 1 2024-09-12T01:43:14.730 INFO:tasks.workunit.client.0.smithi066.stdout:4/534: mknod d4/d6/d8/ca9 0 2024-09-12T01:43:14.732 INFO:tasks.workunit.client.0.smithi066.stdout:5/498: stat d0/dd/d18/d36/l63 0 2024-09-12T01:43:14.732 INFO:tasks.workunit.client.0.smithi066.stdout:5/499: fsync d0/d26/f34 0 2024-09-12T01:43:14.735 INFO:tasks.workunit.client.0.smithi066.stdout:9/532: dwrite d0/f7 [0,4194304] 0 2024-09-12T01:43:14.735 INFO:tasks.workunit.client.0.smithi066.stdout:1/514: rename d5/dc/d53/f8b to d5/dc/d36/f96 0 2024-09-12T01:43:14.737 INFO:tasks.workunit.client.0.smithi066.stdout:8/555: mkdir d12/db2 0 2024-09-12T01:43:14.738 INFO:tasks.workunit.client.1.smithi153.stdout:2/873: rmdir d7/db/d62 39 2024-09-12T01:43:14.740 INFO:tasks.workunit.client.0.smithi066.stdout:2/484: mkdir de/d13/d1e/da3 0 2024-09-12T01:43:14.741 INFO:tasks.workunit.client.1.smithi153.stdout:9/947: mkdir d3/d5f/d123 0 2024-09-12T01:43:14.744 INFO:tasks.workunit.client.1.smithi153.stdout:7/869: symlink d12/d21/d4d/l117 0 2024-09-12T01:43:14.744 INFO:tasks.workunit.client.1.smithi153.stdout:7/870: chown d12/d7e/c5b 1606544933 1 2024-09-12T01:43:14.744 INFO:tasks.workunit.client.1.smithi153.stdout:7/871: chown d12/d21/l89 198 1 2024-09-12T01:43:14.749 INFO:tasks.workunit.client.0.smithi066.stdout:6/585: rename d2/fa to d2/d31/d57/fc5 0 2024-09-12T01:43:14.749 INFO:tasks.workunit.client.0.smithi066.stdout:6/586: readlink d2/d99/d12/d49/l7a 0 2024-09-12T01:43:14.751 INFO:tasks.workunit.client.1.smithi153.stdout:6/974: symlink d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/d10f/d126/l13e 0 2024-09-12T01:43:14.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/515: truncate d5/dc/d36/f96 3600918 0 2024-09-12T01:43:14.753 INFO:tasks.workunit.client.1.smithi153.stdout:5/939: mkdir d0/d43/dac/db0/d12a 0 2024-09-12T01:43:14.753 INFO:tasks.workunit.client.0.smithi066.stdout:8/556: symlink d12/lb3 0 2024-09-12T01:43:14.754 INFO:tasks.workunit.client.1.smithi153.stdout:7/872: dread d12/d7e/f72 [0,4194304] 0 2024-09-12T01:43:14.755 INFO:tasks.workunit.client.0.smithi066.stdout:8/557: read d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 [54784,59124] 0 2024-09-12T01:43:14.755 INFO:tasks.workunit.client.1.smithi153.stdout:2/874: truncate d7/db/d1d/f5d 3010025 0 2024-09-12T01:43:14.755 INFO:tasks.workunit.client.1.smithi153.stdout:2/875: chown d7/db/d6c/d76/db8/de1/fe9 10327 1 2024-09-12T01:43:14.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/940: symlink d0/d43/dac/db0/d109/db8/d2f/d55/d113/l12b 0 2024-09-12T01:43:14.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/941: dread - d0/d43/dac/db0/d109/db8/d2f/ff7 zero size 2024-09-12T01:43:14.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/942: stat d0/d43/dac/db0/d109/db8/d2f/d55 0 2024-09-12T01:43:14.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/943: creat d0/d43/dac/db0/d109/f12c x:0 0 0 2024-09-12T01:43:14.763 INFO:tasks.workunit.client.1.smithi153.stdout:5/944: chown d0/d43/d8d/d8e/f11c 49 1 2024-09-12T01:43:14.765 INFO:tasks.workunit.client.0.smithi066.stdout:4/535: rename d4/f2b to d4/d6/d27/d66/faa 0 2024-09-12T01:43:14.771 INFO:tasks.workunit.client.1.smithi153.stdout:6/975: dwrite d1/d6/d23/f2b [4194304,4194304] 0 2024-09-12T01:43:14.771 INFO:tasks.workunit.client.1.smithi153.stdout:6/976: getdents d1/d6/da/d12c/d137 0 2024-09-12T01:43:14.772 INFO:tasks.workunit.client.0.smithi066.stdout:1/516: symlink d5/d52/l97 0 2024-09-12T01:43:14.774 INFO:tasks.workunit.client.1.smithi153.stdout:7/873: rename d12/d21/d4d/dae/dc0/dc4/fd5 to d12/d21/d29/d35/f118 0 2024-09-12T01:43:14.776 INFO:tasks.workunit.client.0.smithi066.stdout:8/558: symlink d12/d21/d2f/d57/d84/d89/d92/lb4 0 2024-09-12T01:43:14.779 INFO:tasks.workunit.client.0.smithi066.stdout:9/533: rename d0/d6/d17/d1b/d4c/c3f to d0/d6/d17/d4f/d9/cbb 0 2024-09-12T01:43:14.779 INFO:tasks.workunit.client.0.smithi066.stdout:9/534: read d0/d6/d17/d4f/d9/fa [3888395,25143] 0 2024-09-12T01:43:14.780 INFO:tasks.workunit.client.1.smithi153.stdout:6/977: mknod d1/d6/c13f 0 2024-09-12T01:43:14.780 INFO:tasks.workunit.client.1.smithi153.stdout:6/978: fdatasync d1/d6/d23/d98/d53/f104 0 2024-09-12T01:43:14.780 INFO:tasks.workunit.client.1.smithi153.stdout:8/809: sync 2024-09-12T01:43:14.780 INFO:tasks.workunit.client.1.smithi153.stdout:8/810: chown d17/d1f/d4f/d42 530424115 1 2024-09-12T01:43:14.781 INFO:tasks.workunit.client.0.smithi066.stdout:1/517: mknod d5/d15/d4d/d86/c98 0 2024-09-12T01:43:14.783 INFO:tasks.workunit.client.0.smithi066.stdout:5/500: getdents d0/dd 0 2024-09-12T01:43:14.786 INFO:tasks.workunit.client.1.smithi153.stdout:6/979: symlink d1/d6/d46/d73/d8a/d84/d96/l140 0 2024-09-12T01:43:14.790 INFO:tasks.workunit.client.0.smithi066.stdout:9/535: truncate d0/d6/d17/d1b/d4c/d42/f5a 179921 0 2024-09-12T01:43:14.790 INFO:tasks.workunit.client.0.smithi066.stdout:9/536: write d0/d6/d43/fa4 [1098999,69962] 0 2024-09-12T01:43:14.792 INFO:tasks.workunit.client.1.smithi153.stdout:6/980: creat d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb/d123/f141 x:0 0 0 2024-09-12T01:43:14.792 INFO:tasks.workunit.client.0.smithi066.stdout:1/518: write d5/dc/f34 [894599,77180] 0 2024-09-12T01:43:14.793 INFO:tasks.workunit.client.0.smithi066.stdout:8/559: getdents d12/d21/d2f/d57/d84/d89 0 2024-09-12T01:43:14.795 INFO:tasks.workunit.client.1.smithi153.stdout:7/874: rename d12/d21/d29/d2d/da6/dc8 to d12/d21/d29/d35/dcb/de9/d119 0 2024-09-12T01:43:14.795 INFO:tasks.workunit.client.1.smithi153.stdout:7/875: write d12/f1b [763091,5990] 0 2024-09-12T01:43:14.795 INFO:tasks.workunit.client.0.smithi066.stdout:5/501: rmdir d0/d26/d2f/d3b/d98 39 2024-09-12T01:43:14.795 INFO:tasks.workunit.client.0.smithi066.stdout:5/502: write d0/d26/d2f/d30/f66 [856770,75085] 0 2024-09-12T01:43:14.795 INFO:tasks.workunit.client.0.smithi066.stdout:5/503: chown d0/d26/d2f/d3b/c41 2966 1 2024-09-12T01:43:14.797 INFO:tasks.workunit.client.0.smithi066.stdout:2/485: rename de/c45 to de/d13/d1e/d22/d4f/ca4 0 2024-09-12T01:43:14.798 INFO:tasks.workunit.client.1.smithi153.stdout:6/981: rename d1/l9e to d1/d6/d23/d98/d53/de0/l142 0 2024-09-12T01:43:14.799 INFO:tasks.workunit.client.0.smithi066.stdout:9/537: mknod d0/d6/d17/d4f/d12/cbc 0 2024-09-12T01:43:14.801 INFO:tasks.workunit.client.1.smithi153.stdout:7/876: link d12/d21/d29/d2d/d8b/caf d12/d21/d29/d35/dcb/de9/c11a 0 2024-09-12T01:43:14.803 INFO:tasks.workunit.client.0.smithi066.stdout:4/536: dwrite d4/f16 [4194304,4194304] 0 2024-09-12T01:43:14.803 INFO:tasks.workunit.client.1.smithi153.stdout:5/945: dwrite d0/d43/dac/db0/d109/d83/f4c [4194304,4194304] 0 2024-09-12T01:43:14.803 INFO:tasks.workunit.client.1.smithi153.stdout:5/946: readlink d0/d43/dac/db0/d109/d83/d36/d39/da4/l122 0 2024-09-12T01:43:14.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/947: readlink d0/d43/dac/db0/d109/d102/le2 0 2024-09-12T01:43:14.804 INFO:tasks.workunit.client.1.smithi153.stdout:5/948: fsync d0/d43/dac/db0/d109/db8/f112 0 2024-09-12T01:43:14.804 INFO:tasks.workunit.client.1.smithi153.stdout:8/811: dwrite fd [0,4194304] 0 2024-09-12T01:43:14.804 INFO:tasks.workunit.client.1.smithi153.stdout:6/982: truncate d1/fff 13580 0 2024-09-12T01:43:14.804 INFO:tasks.workunit.client.1.smithi153.stdout:6/983: fdatasync d1/d6/d23/d98/d53/d69/d7c/d7f/f9c 0 2024-09-12T01:43:14.804 INFO:tasks.workunit.client.1.smithi153.stdout:8/812: write d17/d21/f88 [179541,563] 0 2024-09-12T01:43:14.805 INFO:tasks.workunit.client.1.smithi153.stdout:8/813: chown d17/d1f/dcf/d106/ddf 27960212 1 2024-09-12T01:43:14.805 INFO:tasks.workunit.client.0.smithi066.stdout:8/560: symlink d12/d21/d2f/d57/d84/d50/d56/lb5 0 2024-09-12T01:43:14.806 INFO:tasks.workunit.client.1.smithi153.stdout:7/877: stat d12/d21/d29/d35/d37/l61 0 2024-09-12T01:43:14.810 INFO:tasks.workunit.client.0.smithi066.stdout:9/538: creat d0/d6/d17/d4f/fbd x:0 0 0 2024-09-12T01:43:14.813 INFO:tasks.workunit.client.1.smithi153.stdout:5/949: creat d0/d43/dac/db0/d109/db8/d2f/d55/d113/f12d x:0 0 0 2024-09-12T01:43:14.816 INFO:tasks.workunit.client.0.smithi066.stdout:4/537: mknod d4/d15/d33/d5e/cab 0 2024-09-12T01:43:14.818 INFO:tasks.workunit.client.1.smithi153.stdout:8/814: link d17/d1d/d27/df1/cf8 d17/d21/c10d 0 2024-09-12T01:43:14.820 INFO:tasks.workunit.client.0.smithi066.stdout:8/561: rename d12/d21/d2f/d57/d84/d6f to d12/d21/d2f/d57/d84/d50/d56/db6 0 2024-09-12T01:43:14.822 INFO:tasks.workunit.client.1.smithi153.stdout:7/878: creat d12/d21/d29/d35/dcb/de9/d119/f11b x:0 0 0 2024-09-12T01:43:14.822 INFO:tasks.workunit.client.1.smithi153.stdout:7/879: write d12/f20 [2961189,58011] 0 2024-09-12T01:43:14.824 INFO:tasks.workunit.client.0.smithi066.stdout:5/504: getdents d0/d26/d2d/d33 0 2024-09-12T01:43:14.824 INFO:tasks.workunit.client.0.smithi066.stdout:5/505: chown d0/d26/d2f/d3b/d6b 0 1 2024-09-12T01:43:14.825 INFO:tasks.workunit.client.1.smithi153.stdout:5/950: mkdir d0/d43/d8d/d12e 0 2024-09-12T01:43:14.825 INFO:tasks.workunit.client.1.smithi153.stdout:5/951: write d0/d43/dac/db0/d109/db8/d2f/d55/fc7 [185127,48642] 0 2024-09-12T01:43:14.828 INFO:tasks.workunit.client.0.smithi066.stdout:8/562: rename d12/d21/d2f/c30 to d12/d21/d2f/d57/d43/d66/cb7 0 2024-09-12T01:43:14.828 INFO:tasks.workunit.client.0.smithi066.stdout:8/563: fdatasync d12/f5b 0 2024-09-12T01:43:14.828 INFO:tasks.workunit.client.0.smithi066.stdout:8/564: read - d12/d21/d2f/d57/d84/d89/f96 zero size 2024-09-12T01:43:14.828 INFO:tasks.workunit.client.0.smithi066.stdout:4/538: write d4/f29 [1628125,113182] 0 2024-09-12T01:43:14.829 INFO:tasks.workunit.client.1.smithi153.stdout:8/815: mkdir d17/d1f/d4f/d42/d79/d10e 0 2024-09-12T01:43:14.829 INFO:tasks.workunit.client.1.smithi153.stdout:8/816: write d17/f46 [528460,38932] 0 2024-09-12T01:43:14.831 INFO:tasks.workunit.client.1.smithi153.stdout:7/880: creat d12/f11c x:0 0 0 2024-09-12T01:43:14.834 INFO:tasks.workunit.client.0.smithi066.stdout:8/565: rename ff to d12/db2/fb8 0 2024-09-12T01:43:14.834 INFO:tasks.workunit.client.0.smithi066.stdout:8/566: creat d12/d21/d2f/d57/d43/d66/fb9 x:0 0 0 2024-09-12T01:43:14.834 INFO:tasks.workunit.client.0.smithi066.stdout:8/567: truncate d12/d21/d2f/d57/d43/fa9 807911 0 2024-09-12T01:43:14.835 INFO:tasks.workunit.client.1.smithi153.stdout:5/952: creat d0/d15/dae/d114/d129/f12f x:0 0 0 2024-09-12T01:43:14.835 INFO:tasks.workunit.client.1.smithi153.stdout:5/953: read - d0/d43/d8d/d8e/dd7/d11b/fdc zero size 2024-09-12T01:43:14.836 INFO:tasks.workunit.client.0.smithi066.stdout:2/486: dwrite de/d13/d28/f35 [0,4194304] 0 2024-09-12T01:43:14.836 INFO:tasks.workunit.client.0.smithi066.stdout:2/487: readlink de/d13/d1e/d92/l9e 0 2024-09-12T01:43:14.836 INFO:tasks.workunit.client.0.smithi066.stdout:2/488: truncate de/f21 2662013 0 2024-09-12T01:43:14.840 INFO:tasks.workunit.client.1.smithi153.stdout:8/817: getdents d17/d1f/d4f/d42/d79/dd4 0 2024-09-12T01:43:14.841 INFO:tasks.workunit.client.1.smithi153.stdout:8/818: fdatasync d17/d1f/d4f/d42/f10a 0 2024-09-12T01:43:14.841 INFO:tasks.workunit.client.0.smithi066.stdout:9/539: dwrite d0/d6/d17/d4f/d12/d46/fb3 [0,4194304] 0 2024-09-12T01:43:14.841 INFO:tasks.workunit.client.0.smithi066.stdout:9/540: fdatasync d0/d6/f8e 0 2024-09-12T01:43:14.842 INFO:tasks.workunit.client.0.smithi066.stdout:8/568: truncate d12/d21/d2f/d57/fb1 520602 0 2024-09-12T01:43:14.842 INFO:tasks.workunit.client.0.smithi066.stdout:8/569: write d12/d21/fac [5103294,81335] 0 2024-09-12T01:43:14.843 INFO:tasks.workunit.client.0.smithi066.stdout:8/570: read d12/d21/d2f/d57/d3c/f99 [75109,28137] 0 2024-09-12T01:43:14.843 INFO:tasks.workunit.client.0.smithi066.stdout:8/571: creat d12/d21/d2f/d57/d84/d50/d56/fba x:0 0 0 2024-09-12T01:43:14.844 INFO:tasks.workunit.client.0.smithi066.stdout:8/572: chown d12/l20 4616 1 2024-09-12T01:43:14.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/954: creat d0/d15/dae/dfb/f130 x:0 0 0 2024-09-12T01:43:14.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/955: creat d0/d15/dae/d114/d129/f131 x:0 0 0 2024-09-12T01:43:14.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/956: chown d0/d43/dac/db0/d109/db8/d2f/d55 4921879 1 2024-09-12T01:43:14.847 INFO:tasks.workunit.client.1.smithi153.stdout:5/957: truncate d0/d43/d8d/f90 868516 0 2024-09-12T01:43:14.849 INFO:tasks.workunit.client.1.smithi153.stdout:6/984: dwrite d1/d6/d23/f6e [0,4194304] 0 2024-09-12T01:43:14.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/541: mkdir d0/d6/d17/d4f/d12/dbe 0 2024-09-12T01:43:14.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/542: truncate d0/fb6 819335 0 2024-09-12T01:43:14.851 INFO:tasks.workunit.client.0.smithi066.stdout:5/506: dread d0/d26/d2d/d42/f80 [0,4194304] 0 2024-09-12T01:43:14.851 INFO:tasks.workunit.client.0.smithi066.stdout:1/519: dwrite d5/f6d [4194304,4194304] 0 2024-09-12T01:43:14.851 INFO:tasks.workunit.client.0.smithi066.stdout:5/507: fdatasync d0/f20 0 2024-09-12T01:43:14.851 INFO:tasks.workunit.client.0.smithi066.stdout:5/508: chown d0/d26/f34 32172 1 2024-09-12T01:43:14.857 INFO:tasks.workunit.client.1.smithi153.stdout:6/985: unlink d1/d6/d23/d98/d4f/d122/f135 0 2024-09-12T01:43:14.859 INFO:tasks.workunit.client.0.smithi066.stdout:8/573: mkdir d12/d21/d2f/d57/d43/d82/dbb 0 2024-09-12T01:43:14.860 INFO:tasks.workunit.client.1.smithi153.stdout:5/958: dread d0/d43/dac/db0/d109/f116 [0,4194304] 0 2024-09-12T01:43:14.862 INFO:tasks.workunit.client.1.smithi153.stdout:7/881: dwrite d12/d21/d29/d35/d37/d4c/d5c/f70 [0,4194304] 0 2024-09-12T01:43:14.862 INFO:tasks.workunit.client.0.smithi066.stdout:1/520: dread d5/dc/f33 [0,4194304] 0 2024-09-12T01:43:14.862 INFO:tasks.workunit.client.0.smithi066.stdout:1/521: dread - d5/dc/d36/f89 zero size 2024-09-12T01:43:14.862 INFO:tasks.workunit.client.0.smithi066.stdout:2/489: dwrite de/d13/d28/f35 [0,4194304] 0 2024-09-12T01:43:14.864 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:14 smithi153 ceph-mon[34713]: Standby manager daemon smithi066.qdwcrh started 2024-09-12T01:43:14.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:14 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/crt"}]: dispatch 2024-09-12T01:43:14.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:14 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:43:14.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:14 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/key"}]: dispatch 2024-09-12T01:43:14.865 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:14 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:43:14.865 INFO:tasks.workunit.client.1.smithi153.stdout:6/986: creat d1/d6/da/d19/d34/d10e/d112/f143 x:0 0 0 2024-09-12T01:43:14.865 INFO:tasks.workunit.client.1.smithi153.stdout:6/987: chown d1/d6/d23/d98/d53/d69/d7c/d7f/dd2/ddb 91898367 1 2024-09-12T01:43:14.866 INFO:tasks.workunit.client.0.smithi066.stdout:9/543: dread - d0/d6/d17/d4f/f97 zero size 2024-09-12T01:43:14.866 INFO:tasks.workunit.client.0.smithi066.stdout:5/509: dread d0/d26/f2e [0,4194304] 0 2024-09-12T01:43:14.871 INFO:tasks.workunit.client.0.smithi066.stdout:1/522: dread d5/dc/f33 [0,4194304] 0 2024-09-12T01:43:14.872 INFO:tasks.workunit.client.0.smithi066.stdout:1/523: dread - d5/dc/d53/f94 zero size 2024-09-12T01:43:14.873 INFO:tasks.workunit.client.0.smithi066.stdout:8/574: rmdir d12/d21/d2f/d57/d43 39 2024-09-12T01:43:14.876 INFO:tasks.workunit.client.0.smithi066.stdout:2/490: symlink de/d3c/la5 0 2024-09-12T01:43:14.879 INFO:tasks.workunit.client.0.smithi066.stdout:9/544: creat d0/d6/d17/d4f/d9/fbf x:0 0 0 2024-09-12T01:43:14.880 INFO:tasks.workunit.client.1.smithi153.stdout:6/988: dread d1/d6/d46/d73/d8a/d84/f8f [0,4194304] 0 2024-09-12T01:43:14.881 INFO:tasks.workunit.client.0.smithi066.stdout:1/524: creat d5/d15/d4d/d86/f99 x:0 0 0 2024-09-12T01:43:14.881 INFO:tasks.workunit.client.0.smithi066.stdout:1/525: dread - d5/f73 zero size 2024-09-12T01:43:14.883 INFO:tasks.workunit.client.0.smithi066.stdout:8/575: symlink d12/db2/lbc 0 2024-09-12T01:43:14.883 INFO:tasks.workunit.client.0.smithi066.stdout:8/576: readlink d12/d21/d2f/d53/la6 0 2024-09-12T01:43:14.884 INFO:tasks.workunit.client.0.smithi066.stdout:2/491: getdents de/d13/d1e 0 2024-09-12T01:43:14.884 INFO:tasks.workunit.client.0.smithi066.stdout:2/492: write de/d13/f9f [953026,65516] 0 2024-09-12T01:43:14.885 INFO:tasks.workunit.client.0.smithi066.stdout:9/545: rename d0/d6/d17/d1b/da2/lb0 to d0/d6/d17/d1b/d4c/d4b/d86/lc0 0 2024-09-12T01:43:14.885 INFO:tasks.workunit.client.0.smithi066.stdout:9/546: dread - d0/d6/d17/f74 zero size 2024-09-12T01:43:14.885 INFO:tasks.workunit.client.0.smithi066.stdout:9/547: creat d0/d6/d43/fc1 x:0 0 0 2024-09-12T01:43:14.885 INFO:tasks.workunit.client.0.smithi066.stdout:9/548: chown d0/d6/d17/d4f/l26 2473520 1 2024-09-12T01:43:14.886 INFO:tasks.workunit.client.0.smithi066.stdout:8/577: rmdir d12/db2 39 2024-09-12T01:43:14.886 INFO:tasks.workunit.client.0.smithi066.stdout:2/493: mknod de/d13/d1e/d25/da2/ca6 0 2024-09-12T01:43:14.888 INFO:tasks.workunit.client.0.smithi066.stdout:8/578: mknod d12/daf/cbd 0 2024-09-12T01:43:14.888 INFO:tasks.workunit.client.1.smithi153.stdout:8/819: dwrite d17/d1f/d4f/d34/d6f/f70 [0,4194304] 0 2024-09-12T01:43:14.889 INFO:tasks.workunit.client.0.smithi066.stdout:2/494: creat de/fa7 x:0 0 0 2024-09-12T01:43:14.890 INFO:tasks.workunit.client.0.smithi066.stdout:8/579: creat d12/d21/d2f/d57/d43/d82/fbe x:0 0 0 2024-09-12T01:43:14.890 INFO:tasks.workunit.client.0.smithi066.stdout:8/580: readlink d12/d21/d2f/d57/d84/d50/l94 0 2024-09-12T01:43:14.891 INFO:tasks.workunit.client.1.smithi153.stdout:8/820: creat d17/d1f/dcf/d106/ddf/f10f x:0 0 0 2024-09-12T01:43:14.892 INFO:tasks.workunit.client.0.smithi066.stdout:2/495: mkdir de/d13/d1e/d41/da8 0 2024-09-12T01:43:14.894 INFO:tasks.workunit.client.0.smithi066.stdout:5/510: dwrite d0/dd/f8d [0,4194304] 0 2024-09-12T01:43:14.894 INFO:tasks.workunit.client.1.smithi153.stdout:8/821: truncate d17/d1f/dcf/d106/d96/fa4 1100923 0 2024-09-12T01:43:14.894 INFO:tasks.workunit.client.1.smithi153.stdout:8/822: fsync d17/d1f/d4f/d42/d79/dac/dd3/ff6 0 2024-09-12T01:43:14.895 INFO:tasks.workunit.client.0.smithi066.stdout:1/526: write d5/dc/d36/d4b/f31 [3939578,90489] 0 2024-09-12T01:43:14.895 INFO:tasks.workunit.client.0.smithi066.stdout:1/527: creat d5/dc/d36/f9a x:0 0 0 2024-09-12T01:43:14.896 INFO:tasks.workunit.client.1.smithi153.stdout:5/959: dwrite d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/f6a [0,4194304] 0 2024-09-12T01:43:14.896 INFO:tasks.workunit.client.1.smithi153.stdout:5/960: read d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/d71/fbd [808983,95260] 0 2024-09-12T01:43:14.896 INFO:tasks.workunit.client.1.smithi153.stdout:5/961: write d0/d43/dac/db0/d109/db8/d88/fe0 [547055,6349] 0 2024-09-12T01:43:14.896 INFO:tasks.workunit.client.1.smithi153.stdout:7/882: dwrite d12/d21/d29/d35/d37/d58/f81 [0,4194304] 0 2024-09-12T01:43:14.897 INFO:tasks.workunit.client.1.smithi153.stdout:5/962: chown d0/d43/d8d/d8e/dd7/ddd 122715708 1 2024-09-12T01:43:14.897 INFO:tasks.workunit.client.0.smithi066.stdout:2/496: rename de/d13/d28/f77 to de/d13/d5c/fa9 0 2024-09-12T01:43:14.897 INFO:tasks.workunit.client.0.smithi066.stdout:2/497: read - de/d13/d1e/d41/d58/f60 zero size 2024-09-12T01:43:14.902 INFO:tasks.workunit.client.0.smithi066.stdout:9/549: dread d0/d6/d17/d4f/d9/de/f51 [0,4194304] 0 2024-09-12T01:43:14.902 INFO:tasks.workunit.client.0.smithi066.stdout:8/581: dread d12/d21/d2f/d57/f2e [0,4194304] 0 2024-09-12T01:43:14.903 INFO:tasks.workunit.client.0.smithi066.stdout:8/582: write d12/d21/d2f/d57/d84/d50/d56/f9d [475466,30418] 0 2024-09-12T01:43:14.903 INFO:tasks.workunit.client.0.smithi066.stdout:0/586: sync 2024-09-12T01:43:14.903 INFO:tasks.workunit.client.0.smithi066.stdout:3/595: sync 2024-09-12T01:43:14.903 INFO:tasks.workunit.client.0.smithi066.stdout:3/596: truncate d5/d35/fbf 974749 0 2024-09-12T01:43:14.903 INFO:tasks.workunit.client.0.smithi066.stdout:5/511: truncate d0/d26/d2d/d42/f89 1462094 0 2024-09-12T01:43:14.903 INFO:tasks.workunit.client.0.smithi066.stdout:7/440: sync 2024-09-12T01:43:14.906 INFO:tasks.workunit.client.1.smithi153.stdout:5/963: truncate d0/d43/dac/db0/d109/db8/ffa 2013323 0 2024-09-12T01:43:14.907 INFO:tasks.workunit.client.1.smithi153.stdout:7/883: read d12/d21/d29/d2d/d8b/fef [3306235,51853] 0 2024-09-12T01:43:14.907 INFO:tasks.workunit.client.1.smithi153.stdout:7/884: fdatasync d12/d21/d29/d2d/f55 0 2024-09-12T01:43:14.908 INFO:tasks.workunit.client.0.smithi066.stdout:1/528: truncate d5/dc/d36/d4b/f5f 1458704 0 2024-09-12T01:43:14.909 INFO:tasks.workunit.client.1.smithi153.stdout:5/964: creat d0/d43/dac/db0/d109/d83/d36/d39/f132 x:0 0 0 2024-09-12T01:43:14.911 INFO:tasks.workunit.client.1.smithi153.stdout:7/885: creat d12/d21/d29/d35/dcb/de9/d119/f11d x:0 0 0 2024-09-12T01:43:14.911 INFO:tasks.workunit.client.0.smithi066.stdout:9/550: mkdir d0/d6/d17/d1b/da2/dae/dc2 0 2024-09-12T01:43:14.913 INFO:tasks.workunit.client.0.smithi066.stdout:0/587: rename d1/d72/de/f1f to d1/d72/fd3 0 2024-09-12T01:43:14.914 INFO:tasks.workunit.client.0.smithi066.stdout:3/597: mkdir d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d9b/dcf 0 2024-09-12T01:43:14.914 INFO:tasks.workunit.client.0.smithi066.stdout:3/598: chown d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d9b/dcf 3942 1 2024-09-12T01:43:14.914 INFO:tasks.workunit.client.0.smithi066.stdout:3/599: chown d5/d6/d1b/d45 66932916 1 2024-09-12T01:43:14.915 INFO:tasks.workunit.client.0.smithi066.stdout:3/600: creat d5/d6/d1b/d45/fd0 x:0 0 0 2024-09-12T01:43:14.915 INFO:tasks.workunit.client.0.smithi066.stdout:7/441: link d2/d5/d6/d22/d75/d25/f49 d2/d5/d6/d22/d75/d1d/d6c/d80/d7c/f97 0 2024-09-12T01:43:14.915 INFO:tasks.workunit.client.0.smithi066.stdout:7/442: read d2/d5/d6/fe [679747,87630] 0 2024-09-12T01:43:14.917 INFO:tasks.workunit.client.0.smithi066.stdout:1/529: mkdir d5/dc/d53/d9b 0 2024-09-12T01:43:14.917 INFO:tasks.workunit.client.0.smithi066.stdout:1/530: readlink d5/d15/d58/l84 0 2024-09-12T01:43:14.918 INFO:tasks.workunit.client.0.smithi066.stdout:9/551: mknod d0/d6/d17/d4f/d12/d84/cc3 0 2024-09-12T01:43:14.919 INFO:tasks.workunit.client.1.smithi153.stdout:5/965: write d0/d43/dac/db0/d109/d83/d36/f7d [899484,40166] 0 2024-09-12T01:43:14.920 INFO:tasks.workunit.client.0.smithi066.stdout:5/512: rename d0/dd/d18/f75 to d0/d26/d2d/d33/d55/d73/f9c 0 2024-09-12T01:43:14.920 INFO:tasks.workunit.client.0.smithi066.stdout:5/513: fsync d0/f17 0 2024-09-12T01:43:14.920 INFO:tasks.workunit.client.1.smithi153.stdout:7/886: dread d12/d21/d4d/dae/dc0/dc4/f112 [0,4194304] 0 2024-09-12T01:43:14.920 INFO:tasks.workunit.client.1.smithi153.stdout:7/887: dread - d12/d21/d29/f8d zero size 2024-09-12T01:43:14.921 INFO:tasks.workunit.client.0.smithi066.stdout:0/588: symlink d1/d62/d9f/d4a/d67/d20/da8/ld4 0 2024-09-12T01:43:14.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/966: creat d0/d43/d68/dcc/f133 x:0 0 0 2024-09-12T01:43:14.923 INFO:tasks.workunit.client.1.smithi153.stdout:5/967: chown d0/d15/dae/d114/d129 4778716 1 2024-09-12T01:43:14.923 INFO:tasks.workunit.client.0.smithi066.stdout:3/601: creat d5/d6/d1b/d45/d66/d67/d7f/d84/fd1 x:0 0 0 2024-09-12T01:43:14.925 INFO:tasks.workunit.client.0.smithi066.stdout:8/583: dwrite d12/d21/fac [0,4194304] 0 2024-09-12T01:43:14.926 INFO:tasks.workunit.client.1.smithi153.stdout:5/968: rename d0/d43/dac/db0/d109/d99/df4/f121 to d0/d43/d68/db2/f134 0 2024-09-12T01:43:14.927 INFO:tasks.workunit.client.0.smithi066.stdout:7/443: symlink d2/d5/d6/d22/l98 0 2024-09-12T01:43:14.927 INFO:tasks.workunit.client.0.smithi066.stdout:7/444: read - d2/d5/d6/d22/d75/f8d zero size 2024-09-12T01:43:14.928 INFO:tasks.workunit.client.1.smithi153.stdout:7/888: getdents d12/d21/d29/d35/dcb/de9 0 2024-09-12T01:43:14.928 INFO:tasks.workunit.client.1.smithi153.stdout:7/889: stat d12/d21/c3a 0 2024-09-12T01:43:14.929 INFO:tasks.workunit.client.0.smithi066.stdout:9/552: symlink d0/d6/d7f/lc4 0 2024-09-12T01:43:14.929 INFO:tasks.workunit.client.1.smithi153.stdout:7/890: write d12/d4e/ffb [359825,69823] 0 2024-09-12T01:43:14.930 INFO:tasks.workunit.client.1.smithi153.stdout:7/891: chown d12/d21/d29/d2d/f55 464209 1 2024-09-12T01:43:14.930 INFO:tasks.workunit.client.1.smithi153.stdout:7/892: fsync d12/d21/d29/d35/d37/f79 0 2024-09-12T01:43:14.930 INFO:tasks.workunit.client.1.smithi153.stdout:7/893: write d12/d21/d29/ff8 [327719,124085] 0 2024-09-12T01:43:14.931 INFO:tasks.workunit.client.1.smithi153.stdout:5/969: link d0/d43/dac/db0/d109/db8/l3c d0/d43/dac/db0/d109/db8/d2f/dc6/l135 0 2024-09-12T01:43:14.932 INFO:tasks.workunit.client.0.smithi066.stdout:8/584: dread d12/d21/d2f/d57/d84/f60 [0,4194304] 0 2024-09-12T01:43:14.932 INFO:tasks.workunit.client.0.smithi066.stdout:8/585: dread - d12/f74 zero size 2024-09-12T01:43:14.932 INFO:tasks.workunit.client.0.smithi066.stdout:8/586: fsync d12/d21/d2f/d57/d43/d66/fb9 0 2024-09-12T01:43:14.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/514: symlink d0/d26/d2d/d33/d55/d84/l9d 0 2024-09-12T01:43:14.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/515: chown d0/dd/d18 1 1 2024-09-12T01:43:14.933 INFO:tasks.workunit.client.1.smithi153.stdout:7/894: getdents d12/d21/d29/d35/dc7 0 2024-09-12T01:43:14.935 INFO:tasks.workunit.client.0.smithi066.stdout:3/602: dread d5/d6/f96 [0,4194304] 0 2024-09-12T01:43:14.936 INFO:tasks.workunit.client.0.smithi066.stdout:0/589: rename d1/d62/d9f/d64/c7a to d1/d62/d9f/d4a/d67/dd0/cd5 0 2024-09-12T01:43:14.938 INFO:tasks.workunit.client.0.smithi066.stdout:9/553: mknod d0/d6/d17/d4f/d9/de/cc5 0 2024-09-12T01:43:14.939 INFO:tasks.workunit.client.1.smithi153.stdout:7/895: unlink d12/d21/d29/d2d/f55 0 2024-09-12T01:43:14.940 INFO:tasks.workunit.client.0.smithi066.stdout:8/587: creat d12/d21/d2f/d57/fbf x:0 0 0 2024-09-12T01:43:14.943 INFO:tasks.workunit.client.1.smithi153.stdout:7/896: creat d12/d21/d29/d35/f11e x:0 0 0 2024-09-12T01:43:14.944 INFO:tasks.workunit.client.0.smithi066.stdout:3/603: mkdir d5/d6/d1b/d45/d85/dd2 0 2024-09-12T01:43:14.947 INFO:tasks.workunit.client.1.smithi153.stdout:5/970: rename d0/d43/dac/db0/d109/db8/d2f/d55/d113 to d0/d43/dac/db0/d136 0 2024-09-12T01:43:14.950 INFO:tasks.workunit.client.0.smithi066.stdout:7/445: rename d2/d5/c45 to d2/d5/d6/d22/d75/d2f/c99 0 2024-09-12T01:43:14.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/590: creat d1/d62/d9f/db4/fd6 x:0 0 0 2024-09-12T01:43:14.951 INFO:tasks.workunit.client.0.smithi066.stdout:0/591: stat d1/f27 0 2024-09-12T01:43:14.954 INFO:tasks.workunit.client.0.smithi066.stdout:9/554: link d0/d6/d17/d4f/d9/fa d0/d6/d17/d28/d79/fc6 0 2024-09-12T01:43:14.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/588: truncate d12/f47 1168243 0 2024-09-12T01:43:14.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/589: dread - d12/d21/d2f/d57/f8c zero size 2024-09-12T01:43:14.957 INFO:tasks.workunit.client.1.smithi153.stdout:5/971: write d0/d15/f1a [3180161,5106] 0 2024-09-12T01:43:14.963 INFO:tasks.workunit.client.0.smithi066.stdout:2/498: truncate de/f21 1977878 0 2024-09-12T01:43:14.966 INFO:tasks.workunit.client.0.smithi066.stdout:2/499: mkdir de/d13/d1e/d41/da8/daa 0 2024-09-12T01:43:14.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/590: write d12/d21/d2f/f63 [174105,121268] 0 2024-09-12T01:43:14.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/591: chown d12/d21/d2f/d57/d84/d50/d56/d69/c80 61 1 2024-09-12T01:43:14.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/592: stat d12/d21/d2f/d57/d43/fa9 0 2024-09-12T01:43:14.969 INFO:tasks.workunit.client.0.smithi066.stdout:8/593: write d12/d21/f61 [918948,15756] 0 2024-09-12T01:43:14.972 INFO:tasks.workunit.client.0.smithi066.stdout:8/594: link d12/d21/d2f/d57/d84/d89/f96 d12/d21/d2f/fc0 0 2024-09-12T01:43:14.978 INFO:tasks.workunit.client.1.smithi153.stdout:7/897: dwrite d12/d21/d29/d35/d37/d4c/f73 [0,4194304] 0 2024-09-12T01:43:14.980 INFO:tasks.workunit.client.0.smithi066.stdout:3/604: dwrite f3 [0,4194304] 0 2024-09-12T01:43:14.980 INFO:tasks.workunit.client.0.smithi066.stdout:3/605: write d5/d6/d1b/d45/d66/d67/fb2 [758748,61361] 0 2024-09-12T01:43:14.982 INFO:tasks.workunit.client.0.smithi066.stdout:3/606: creat d5/d6/d48/d9c/fd3 x:0 0 0 2024-09-12T01:43:14.984 INFO:tasks.workunit.client.0.smithi066.stdout:1/531: dread d5/dc/d36/d4b/f5f [0,4194304] 0 2024-09-12T01:43:14.984 INFO:tasks.workunit.client.0.smithi066.stdout:1/532: chown d5/dc/d4f 10274 1 2024-09-12T01:43:14.984 INFO:tasks.workunit.client.0.smithi066.stdout:1/533: stat d5/dc/ce 0 2024-09-12T01:43:14.994 INFO:tasks.workunit.client.1.smithi153.stdout:7/898: write d12/d21/d29/d35/d95/f9c [1520068,61115] 0 2024-09-12T01:43:14.994 INFO:tasks.workunit.client.1.smithi153.stdout:7/899: chown d12/d21/d29/d35/f118 38207 1 2024-09-12T01:43:14.994 INFO:tasks.workunit.client.0.smithi066.stdout:1/534: getdents d5/dc/d53 0 2024-09-12T01:43:14.995 INFO:tasks.workunit.client.0.smithi066.stdout:1/535: write d5/d15/f43 [1606859,18069] 0 2024-09-12T01:43:14.995 INFO:tasks.workunit.client.0.smithi066.stdout:1/536: fdatasync d5/f87 0 2024-09-12T01:43:14.996 INFO:tasks.workunit.client.0.smithi066.stdout:9/555: fsync d0/d6/d17/d28/d79/fc6 0 2024-09-12T01:43:14.996 INFO:tasks.workunit.client.0.smithi066.stdout:9/556: creat d0/d6/d17/d4f/d9/fc7 x:0 0 0 2024-09-12T01:43:14.996 INFO:tasks.workunit.client.0.smithi066.stdout:9/557: readlink d0/d6/d7f/l88 0 2024-09-12T01:43:14.996 INFO:tasks.workunit.client.0.smithi066.stdout:9/558: chown d0/d6/d17/fa0 5 1 2024-09-12T01:43:14.997 INFO:tasks.workunit.client.0.smithi066.stdout:9/559: truncate d0/d6/d17/fa0 754353 0 2024-09-12T01:43:14.997 INFO:tasks.workunit.client.0.smithi066.stdout:9/560: dread - d0/d6/d17/f74 zero size 2024-09-12T01:43:14.998 INFO:tasks.workunit.client.0.smithi066.stdout:9/561: mknod d0/d6/d17/d1b/da2/dae/dc2/cc8 0 2024-09-12T01:43:14.999 INFO:tasks.workunit.client.1.smithi153.stdout:7/900: link d12/d21/d29/d2d/f114 d12/d21/d29/d35/d37/d4c/d8e/f11f 0 2024-09-12T01:43:15.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/562: link d0/d6/d17/d1b/d4c/d4b/d86/f91 d0/d6/d17/d1b/d4c/fc9 0 2024-09-12T01:43:15.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/563: chown d0/d6/d7f/d90/l93 112533 1 2024-09-12T01:43:15.002 INFO:tasks.workunit.client.1.smithi153.stdout:7/901: mkdir d12/d21/d29/d35/dcb/de9/d120 0 2024-09-12T01:43:15.003 INFO:tasks.workunit.client.0.smithi066.stdout:9/564: symlink d0/d6/d17/d1b/lca 0 2024-09-12T01:43:15.003 INFO:tasks.workunit.client.0.smithi066.stdout:9/565: write d0/d6/f10 [4768723,92475] 0 2024-09-12T01:43:15.004 INFO:tasks.workunit.client.0.smithi066.stdout:9/566: symlink d0/d6/lcb 0 2024-09-12T01:43:15.005 INFO:tasks.workunit.client.0.smithi066.stdout:9/567: unlink d0/d6/d7f/d90/d9a/f9e 0 2024-09-12T01:43:15.005 INFO:tasks.workunit.client.0.smithi066.stdout:9/568: write d0/d6/d17/d28/d79/fc6 [2301470,56969] 0 2024-09-12T01:43:15.005 INFO:tasks.workunit.client.0.smithi066.stdout:9/569: fdatasync d0/f7 0 2024-09-12T01:43:15.009 INFO:tasks.workunit.client.0.smithi066.stdout:1/537: dread d5/d15/f3a [0,4194304] 0 2024-09-12T01:43:15.010 INFO:tasks.workunit.client.1.smithi153.stdout:5/972: dwrite d0/d20/f65 [0,4194304] 0 2024-09-12T01:43:15.011 INFO:tasks.workunit.client.1.smithi153.stdout:5/973: fdatasync d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/f85 0 2024-09-12T01:43:15.011 INFO:tasks.workunit.client.1.smithi153.stdout:5/974: chown d0/d43/f92 86022 1 2024-09-12T01:43:15.011 INFO:tasks.workunit.client.0.smithi066.stdout:1/538: creat d5/dc/f9c x:0 0 0 2024-09-12T01:43:15.013 INFO:tasks.workunit.client.0.smithi066.stdout:1/539: rename d5/d15/f43 to d5/d15/f9d 0 2024-09-12T01:43:15.017 INFO:tasks.workunit.client.0.smithi066.stdout:0/592: dwrite d1/d72/f5c [4194304,4194304] 0 2024-09-12T01:43:15.017 INFO:tasks.workunit.client.0.smithi066.stdout:0/593: truncate d1/d62/d9f/d4a/d67/d1b/d26/d9c/fae 4863732 0 2024-09-12T01:43:15.017 INFO:tasks.workunit.client.0.smithi066.stdout:0/594: write d1/d62/d9f/d4a/d67/d6e/fa1 [699809,56513] 0 2024-09-12T01:43:15.019 INFO:tasks.workunit.client.0.smithi066.stdout:2/500: dwrite de/d13/d1e/d25/f32 [0,4194304] 0 2024-09-12T01:43:15.019 INFO:tasks.workunit.client.0.smithi066.stdout:2/501: stat de/f12 0 2024-09-12T01:43:15.020 INFO:tasks.workunit.client.0.smithi066.stdout:0/595: link d1/d62/d9f/d4a/d67/d20/d5e/c8d d1/d62/d9f/d4a/d67/d1b/d26/cd7 0 2024-09-12T01:43:15.021 INFO:tasks.workunit.client.0.smithi066.stdout:0/596: fdatasync d1/f2d 0 2024-09-12T01:43:15.021 INFO:tasks.workunit.client.0.smithi066.stdout:0/597: read d1/d62/d89/f9b [98433,70751] 0 2024-09-12T01:43:15.021 INFO:tasks.workunit.client.0.smithi066.stdout:0/598: stat d1/d62/d9f/d4a/d67/l22 0 2024-09-12T01:43:15.023 INFO:tasks.workunit.client.0.smithi066.stdout:2/502: creat de/d13/d1e/d84/fab x:0 0 0 2024-09-12T01:43:15.024 INFO:tasks.workunit.client.0.smithi066.stdout:0/599: link d1/d72/f5c d1/d62/d9f/d4a/d67/d1b/d26/d5b/fd8 0 2024-09-12T01:43:15.024 INFO:tasks.workunit.client.0.smithi066.stdout:0/600: write d1/d62/f94 [1011403,75983] 0 2024-09-12T01:43:15.024 INFO:tasks.workunit.client.0.smithi066.stdout:0/601: creat d1/d72/fd9 x:0 0 0 2024-09-12T01:43:15.024 INFO:tasks.workunit.client.0.smithi066.stdout:0/602: creat d1/d62/d89/d83/fda x:0 0 0 2024-09-12T01:43:15.026 INFO:tasks.workunit.client.0.smithi066.stdout:3/607: dwrite d5/d6/d1b/d45/d66/d67/d6d/dc7/fb5 [0,4194304] 0 2024-09-12T01:43:15.026 INFO:tasks.workunit.client.0.smithi066.stdout:2/503: creat de/d13/d7f/fac x:0 0 0 2024-09-12T01:43:15.030 INFO:tasks.workunit.client.0.smithi066.stdout:0/603: unlink d1/d62/d9f/d4a/d67/d1b/d3b/c40 0 2024-09-12T01:43:15.030 INFO:tasks.workunit.client.0.smithi066.stdout:0/604: read - d1/d62/d9f/d4a/dba/fc4 zero size 2024-09-12T01:43:15.030 INFO:tasks.workunit.client.0.smithi066.stdout:0/605: chown d1/d62/d9f/d4a/d67/d1b/c23 7610 1 2024-09-12T01:43:15.031 INFO:tasks.workunit.client.0.smithi066.stdout:3/608: symlink d5/d6/d48/d9c/ld4 0 2024-09-12T01:43:15.031 INFO:tasks.workunit.client.0.smithi066.stdout:2/504: mknod de/d13/d5c/cad 0 2024-09-12T01:43:15.033 INFO:tasks.workunit.client.0.smithi066.stdout:0/606: creat d1/d62/d9f/d92/d95/dcd/fdb x:0 0 0 2024-09-12T01:43:15.033 INFO:tasks.workunit.client.0.smithi066.stdout:3/609: truncate d5/d6/d1b/d45/d66/d67/d6d/dc7/f2b 633569 0 2024-09-12T01:43:15.037 INFO:tasks.workunit.client.1.smithi153.stdout:7/902: dwrite d12/d21/d29/d35/d37/fce [0,4194304] 0 2024-09-12T01:43:15.038 INFO:tasks.workunit.client.0.smithi066.stdout:8/595: dwrite d12/f19 [4194304,4194304] 0 2024-09-12T01:43:15.043 INFO:tasks.workunit.client.0.smithi066.stdout:8/596: creat d12/d21/d2f/d57/d3c/fc1 x:0 0 0 2024-09-12T01:43:15.044 INFO:tasks.workunit.client.0.smithi066.stdout:9/570: dwrite d0/d6/d43/fc1 [0,4194304] 0 2024-09-12T01:43:15.045 INFO:tasks.workunit.client.0.smithi066.stdout:8/597: read d12/d21/d2f/d57/d84/d50/d56/f59 [395373,43124] 0 2024-09-12T01:43:15.045 INFO:tasks.workunit.client.0.smithi066.stdout:8/598: truncate d12/d21/d2f/d57/d84/d89/d92/fa0 977852 0 2024-09-12T01:43:15.048 INFO:tasks.workunit.client.0.smithi066.stdout:9/571: rename d0/d6/d17/d1b/d4c/d42/f5e to d0/d6/d7f/d90/fcc 0 2024-09-12T01:43:15.049 INFO:tasks.workunit.client.0.smithi066.stdout:9/572: chown d0/d6/d17/d1b/d4c/d4b/d86/lc0 3 1 2024-09-12T01:43:15.049 INFO:tasks.workunit.client.0.smithi066.stdout:9/573: stat d0/d6/d17/d1b/f61 0 2024-09-12T01:43:15.049 INFO:tasks.workunit.client.0.smithi066.stdout:8/599: mknod d12/d21/d2f/d53/cc2 0 2024-09-12T01:43:15.058 INFO:tasks.workunit.client.0.smithi066.stdout:8/600: read d12/f31 [2318951,37307] 0 2024-09-12T01:43:15.058 INFO:tasks.workunit.client.0.smithi066.stdout:8/601: getdents d12/daf 0 2024-09-12T01:43:15.060 INFO:tasks.workunit.client.0.smithi066.stdout:8/602: symlink d12/d21/d2f/d57/d84/d50/d56/d69/lc3 0 2024-09-12T01:43:15.060 INFO:tasks.workunit.client.0.smithi066.stdout:8/603: dread - d12/d21/fa5 zero size 2024-09-12T01:43:15.060 INFO:tasks.workunit.client.0.smithi066.stdout:8/604: creat d12/d21/d2f/d53/fc4 x:0 0 0 2024-09-12T01:43:15.060 INFO:tasks.workunit.client.0.smithi066.stdout:8/605: dread - d12/d21/d2f/f9a zero size 2024-09-12T01:43:15.069 INFO:tasks.workunit.client.1.smithi153.stdout:5/975: dwrite d0/d20/f65 [0,4194304] 0 2024-09-12T01:43:15.069 INFO:tasks.workunit.client.1.smithi153.stdout:5/976: getdents d0/d43/dac/db0/d109/db8/d6e/d111 0 2024-09-12T01:43:15.069 INFO:tasks.workunit.client.0.smithi066.stdout:2/505: dwrite de/fa7 [0,4194304] 0 2024-09-12T01:43:15.069 INFO:tasks.workunit.client.0.smithi066.stdout:0/607: dwrite d1/d62/d89/f71 [0,4194304] 0 2024-09-12T01:43:15.070 INFO:tasks.workunit.client.0.smithi066.stdout:0/608: fsync d1/d62/d9f/d4a/d67/d1b/f7d 0 2024-09-12T01:43:15.070 INFO:tasks.workunit.client.0.smithi066.stdout:3/610: dwrite d5/d6/d1b/d45/d66/d67/d6d/dc7/fb8 [0,4194304] 0 2024-09-12T01:43:15.074 INFO:tasks.workunit.client.0.smithi066.stdout:9/574: dread d0/d6/d17/d4f/f81 [0,4194304] 0 2024-09-12T01:43:15.074 INFO:tasks.workunit.client.0.smithi066.stdout:1/540: dwrite d5/dc/f8f [0,4194304] 0 2024-09-12T01:43:15.074 INFO:tasks.workunit.client.0.smithi066.stdout:9/575: creat d0/d6/d37/d85/fcd x:0 0 0 2024-09-12T01:43:15.075 INFO:tasks.workunit.client.0.smithi066.stdout:8/606: read d12/f5b [1296878,114136] 0 2024-09-12T01:43:15.075 INFO:tasks.workunit.client.0.smithi066.stdout:8/607: fdatasync d12/d21/f33 0 2024-09-12T01:43:15.078 INFO:tasks.workunit.client.0.smithi066.stdout:2/506: mknod de/d13/d1e/d22/d4f/cae 0 2024-09-12T01:43:15.081 INFO:tasks.workunit.client.0.smithi066.stdout:1/541: dread d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:15.081 INFO:tasks.workunit.client.0.smithi066.stdout:1/542: creat d5/f9e x:0 0 0 2024-09-12T01:43:15.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/611: getdents d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f 0 2024-09-12T01:43:15.091 INFO:tasks.workunit.client.0.smithi066.stdout:3/612: chown d5/d35/l39 65012 1 2024-09-12T01:43:15.091 INFO:tasks.workunit.client.0.smithi066.stdout:3/613: chown d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f 10627 1 2024-09-12T01:43:15.091 INFO:tasks.workunit.client.0.smithi066.stdout:3/614: dread - d5/d6/d48/fa9 zero size 2024-09-12T01:43:15.091 INFO:tasks.workunit.client.0.smithi066.stdout:1/543: dread d5/f7 [0,4194304] 0 2024-09-12T01:43:15.091 INFO:tasks.workunit.client.0.smithi066.stdout:1/544: dread - d5/f73 zero size 2024-09-12T01:43:15.096 INFO:tasks.workunit.client.0.smithi066.stdout:0/609: dwrite d1/d62/d9f/d4a/d67/d6e/d80/fa6 [0,4194304] 0 2024-09-12T01:43:15.104 INFO:tasks.workunit.client.0.smithi066.stdout:8/608: dwrite d12/d21/d2f/f45 [0,4194304] 0 2024-09-12T01:43:15.104 INFO:tasks.workunit.client.0.smithi066.stdout:8/609: read d12/d21/d2f/d57/fb1 [317929,30403] 0 2024-09-12T01:43:15.104 INFO:tasks.workunit.client.0.smithi066.stdout:8/610: creat d12/d21/d2f/d57/d43/d82/fc5 x:0 0 0 2024-09-12T01:43:15.104 INFO:tasks.workunit.client.0.smithi066.stdout:8/611: write d12/d21/fa5 [510404,52610] 0 2024-09-12T01:43:15.104 INFO:tasks.workunit.client.0.smithi066.stdout:9/576: mknod d0/d6/d17/d1b/d4c/d4b/d86/cce 0 2024-09-12T01:43:15.105 INFO:tasks.workunit.client.0.smithi066.stdout:2/507: mkdir de/d13/d28/d3d/daf 0 2024-09-12T01:43:15.105 INFO:tasks.workunit.client.0.smithi066.stdout:2/508: chown de/d13/d28/f2f 262 1 2024-09-12T01:43:15.105 INFO:tasks.workunit.client.0.smithi066.stdout:2/509: write de/d13/f1f [3901986,122509] 0 2024-09-12T01:43:15.105 INFO:tasks.workunit.client.0.smithi066.stdout:2/510: write de/d13/d1e/d22/f74 [606678,19321] 0 2024-09-12T01:43:15.107 INFO:tasks.workunit.client.0.smithi066.stdout:3/615: rename d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d9b to d5/d6/d1b/d77/dd5 0 2024-09-12T01:43:15.107 INFO:tasks.workunit.client.0.smithi066.stdout:3/616: truncate d5/d6/d1b/d45/d85/fc3 1856055 0 2024-09-12T01:43:15.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/545: getdents d5/dc/d36/d4b 0 2024-09-12T01:43:15.108 INFO:tasks.workunit.client.0.smithi066.stdout:1/546: chown d5/dc/d36/d57/f8a 1180 1 2024-09-12T01:43:15.110 INFO:tasks.workunit.client.0.smithi066.stdout:0/610: link d1/d62/d9f/d4a/d67/d20/l32 d1/d62/d6c/dad/ldc 0 2024-09-12T01:43:15.112 INFO:tasks.workunit.client.0.smithi066.stdout:2/511: link de/d13/d28/f56 de/d13/d1e/fb0 0 2024-09-12T01:43:15.115 INFO:tasks.workunit.client.0.smithi066.stdout:3/617: creat d5/d6/d1b/d65/d89/fd6 x:0 0 0 2024-09-12T01:43:15.116 INFO:tasks.workunit.client.0.smithi066.stdout:1/547: truncate d5/dc/d53/f35 3439123 0 2024-09-12T01:43:15.116 INFO:tasks.workunit.client.0.smithi066.stdout:1/548: fsync d5/f7 0 2024-09-12T01:43:15.117 INFO:tasks.workunit.client.0.smithi066.stdout:0/611: mknod d1/d62/d89/cdd 0 2024-09-12T01:43:15.119 INFO:tasks.workunit.client.1.smithi153.stdout:1/934: sync 2024-09-12T01:43:15.119 INFO:tasks.workunit.client.1.smithi153.stdout:1/935: chown d2/d9/d17/fe7 24072808 1 2024-09-12T01:43:15.120 INFO:tasks.workunit.client.0.smithi066.stdout:8/612: rename d12/d21/d2f/d57/d43/d82/fc5 to d12/d21/d2f/d57/fc6 0 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:3/976: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:4/815: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:8/823: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:2/876: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:0/988: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:9/948: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:0/989: chown d22/d79/dca/c127 3229 1 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:0/990: write d22/d79/d8e/dc6/f113 [589931,43334] 0 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:6/989: sync 2024-09-12T01:43:15.122 INFO:tasks.workunit.client.1.smithi153.stdout:0/991: fdatasync d22/d79/dca/dec/d136/dff/d11e/f119 0 2024-09-12T01:43:15.123 INFO:tasks.workunit.client.0.smithi066.stdout:3/618: mkdir d5/d6/d1b/d45/d66/dae/dd7 0 2024-09-12T01:43:15.125 INFO:tasks.workunit.client.0.smithi066.stdout:2/512: rename de/d3c/la5 to de/d13/d1e/d25/lb1 0 2024-09-12T01:43:15.125 INFO:tasks.workunit.client.0.smithi066.stdout:2/513: dread - de/d13/d7f/fac zero size 2024-09-12T01:43:15.126 INFO:tasks.workunit.client.0.smithi066.stdout:8/613: mkdir d12/d21/d2f/d57/d84/d50/d56/d69/d7d/dc7 0 2024-09-12T01:43:15.131 INFO:tasks.workunit.client.1.smithi153.stdout:3/977: rename d1/d13/d23/d47/d71/d8e/d93/db1/fbf to d1/d13/f124 0 2024-09-12T01:43:15.133 INFO:tasks.workunit.client.0.smithi066.stdout:3/619: creat d5/d6/d1b/d45/d66/fd8 x:0 0 0 2024-09-12T01:43:15.133 INFO:tasks.workunit.client.0.smithi066.stdout:1/549: dread d5/dc/f8f [0,4194304] 0 2024-09-12T01:43:15.133 INFO:tasks.workunit.client.0.smithi066.stdout:1/550: creat d5/d52/d5d/f9f x:0 0 0 2024-09-12T01:43:15.134 INFO:tasks.workunit.client.1.smithi153.stdout:0/992: dread d22/d30/d4c/fd4 [0,4194304] 0 2024-09-12T01:43:15.134 INFO:tasks.workunit.client.1.smithi153.stdout:9/949: truncate d3/d35/f5d 3080763 0 2024-09-12T01:43:15.136 INFO:tasks.workunit.client.1.smithi153.stdout:1/936: read d2/d9/d17/d2f/fb6 [3539549,70518] 0 2024-09-12T01:43:15.136 INFO:tasks.workunit.client.0.smithi066.stdout:8/614: mkdir d12/d21/d2f/d57/d84/d50/d56/db6/dc8 0 2024-09-12T01:43:15.138 INFO:tasks.workunit.client.1.smithi153.stdout:8/824: creat d17/d1f/dcf/d106/d96/d6c/d89/d9c/f110 x:0 0 0 2024-09-12T01:43:15.138 INFO:tasks.workunit.client.1.smithi153.stdout:8/825: chown d17/d1f/d4f/d42/d79/dac 109885 1 2024-09-12T01:43:15.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:14 smithi066 ceph-mon[27875]: Standby manager daemon smithi066.qdwcrh started 2024-09-12T01:43:15.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:14 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/crt"}]: dispatch 2024-09-12T01:43:15.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:14 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:43:15.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:14 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/key"}]: dispatch 2024-09-12T01:43:15.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:14 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/3420366101' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:43:15.140 INFO:tasks.workunit.client.0.smithi066.stdout:3/620: creat d5/d6/d1b/d45/d66/d67/d7f/da8/fd9 x:0 0 0 2024-09-12T01:43:15.140 INFO:tasks.workunit.client.0.smithi066.stdout:3/621: chown d5/l6e 14481286 1 2024-09-12T01:43:15.143 INFO:tasks.workunit.client.0.smithi066.stdout:3/622: link d5/d6/d1b/d77/dd5/fba d5/d6/d1b/d45/d66/d67/d6d/dc7/fda 0 2024-09-12T01:43:15.145 INFO:tasks.workunit.client.1.smithi153.stdout:0/993: symlink d22/d79/dca/dec/d136/dff/l14e 0 2024-09-12T01:43:15.145 INFO:tasks.workunit.client.1.smithi153.stdout:2/877: dread d7/db/d62/d87/fb9 [0,4194304] 0 2024-09-12T01:43:15.145 INFO:tasks.workunit.client.1.smithi153.stdout:9/950: rmdir d3/d3a/d42/d72/d98 39 2024-09-12T01:43:15.145 INFO:tasks.workunit.client.1.smithi153.stdout:1/937: truncate d2/d9/d17/d2f/d56/f5c 1691934 0 2024-09-12T01:43:15.146 INFO:tasks.workunit.client.1.smithi153.stdout:8/826: truncate d17/d1f/dcf/d106/d95/dbc/fcd 243090 0 2024-09-12T01:43:15.148 INFO:tasks.workunit.client.1.smithi153.stdout:5/977: dwrite d0/d43/f6b [0,4194304] 0 2024-09-12T01:43:15.148 INFO:tasks.workunit.client.1.smithi153.stdout:5/978: read - d0/d15/dae/d114/d129/f12f zero size 2024-09-12T01:43:15.148 INFO:tasks.workunit.client.1.smithi153.stdout:3/978: getdents d1/d1e 0 2024-09-12T01:43:15.148 INFO:tasks.workunit.client.1.smithi153.stdout:3/979: truncate d1/d16/d17/d82/d92/fd5 1514941 0 2024-09-12T01:43:15.148 INFO:tasks.workunit.client.1.smithi153.stdout:3/980: stat d1/d59 0 2024-09-12T01:43:15.148 INFO:tasks.workunit.client.1.smithi153.stdout:3/981: write d1/d13/d23/d47/d71/d8e/fca [4984219,31996] 0 2024-09-12T01:43:15.149 INFO:tasks.workunit.client.1.smithi153.stdout:3/982: dread d1/d13/f83 [0,4194304] 0 2024-09-12T01:43:15.149 INFO:tasks.workunit.client.1.smithi153.stdout:3/983: creat d1/d59/f125 x:0 0 0 2024-09-12T01:43:15.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/994: symlink d22/d30/d4c/d6e/d7f/l14f 0 2024-09-12T01:43:15.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/995: truncate d22/f65 4993189 0 2024-09-12T01:43:15.149 INFO:tasks.workunit.client.1.smithi153.stdout:0/996: fdatasync d22/d30/d4c/d6f/d88/fc3 0 2024-09-12T01:43:15.150 INFO:tasks.workunit.client.1.smithi153.stdout:0/997: creat d22/d30/d4c/d6e/d7f/f150 x:0 0 0 2024-09-12T01:43:15.150 INFO:tasks.workunit.client.1.smithi153.stdout:0/998: stat d22/d30/fcb 0 2024-09-12T01:43:15.150 INFO:tasks.workunit.client.1.smithi153.stdout:2/878: symlink d7/db/d1d/d1e/l109 0 2024-09-12T01:43:15.150 INFO:tasks.workunit.client.1.smithi153.stdout:2/879: stat d7/d19/d40/f37 0 2024-09-12T01:43:15.151 INFO:tasks.workunit.client.1.smithi153.stdout:4/816: dread d6/d15/db4/ff0 [0,4194304] 0 2024-09-12T01:43:15.151 INFO:tasks.workunit.client.1.smithi153.stdout:4/817: dread - d6/d9/dc/d31/d76/f114 zero size 2024-09-12T01:43:15.151 INFO:tasks.workunit.client.1.smithi153.stdout:4/818: fdatasync d6/d9/dc/d31/d7d/d94/fde 0 2024-09-12T01:43:15.151 INFO:tasks.workunit.client.1.smithi153.stdout:9/951: creat d3/d5f/d62/d118/f124 x:0 0 0 2024-09-12T01:43:15.152 INFO:tasks.workunit.client.1.smithi153.stdout:1/938: mkdir d2/d9/d28/d73/d76/d12d 0 2024-09-12T01:43:15.156 INFO:tasks.workunit.client.1.smithi153.stdout:5/979: mknod d0/c137 0 2024-09-12T01:43:15.158 INFO:tasks.workunit.client.1.smithi153.stdout:3/984: mknod d1/d13/d23/d47/d71/c126 0 2024-09-12T01:43:15.159 INFO:tasks.workunit.client.1.smithi153.stdout:0/999: creat d22/d79/dca/df2/f151 x:0 0 0 2024-09-12T01:43:15.160 INFO:tasks.workunit.client.1.smithi153.stdout:2/880: creat d7/db/f10a x:0 0 0 2024-09-12T01:43:15.160 INFO:tasks.workunit.client.1.smithi153.stdout:2/881: readlink d7/d19/d83/d101/laa 0 2024-09-12T01:43:15.160 INFO:tasks.workunit.client.1.smithi153.stdout:9/952: creat d3/d55/de3/f125 x:0 0 0 2024-09-12T01:43:15.161 INFO:tasks.workunit.client.1.smithi153.stdout:1/939: truncate d2/d34/f50 2376713 0 2024-09-12T01:43:15.161 INFO:tasks.workunit.client.1.smithi153.stdout:1/940: fsync d2/d9/d17/d69/d95/ffe 0 2024-09-12T01:43:15.161 INFO:tasks.workunit.client.1.smithi153.stdout:1/941: write d2/d34/d8a/ff3 [734308,120327] 0 2024-09-12T01:43:15.162 INFO:tasks.workunit.client.1.smithi153.stdout:3/985: mknod d1/d13/d23/d47/d6c/c127 0 2024-09-12T01:43:15.162 INFO:tasks.workunit.client.1.smithi153.stdout:3/986: write d1/d13/d23/d47/d6c/fb9 [938093,18630] 0 2024-09-12T01:43:15.162 INFO:tasks.workunit.client.1.smithi153.stdout:2/882: mknod d7/db/d62/dbb/c10b 0 2024-09-12T01:43:15.163 INFO:tasks.workunit.client.1.smithi153.stdout:1/942: mkdir d2/d9/d17/d2c/d12e 0 2024-09-12T01:43:15.163 INFO:tasks.workunit.client.1.smithi153.stdout:1/943: truncate d2/d9/d28/f9d 593657 0 2024-09-12T01:43:15.165 INFO:tasks.workunit.client.1.smithi153.stdout:2/883: rename d7/d19/d83/d101/da9/ce5 to d7/db/d6c/d76/db8/dcf/c10c 0 2024-09-12T01:43:15.165 INFO:tasks.workunit.client.1.smithi153.stdout:2/884: chown d7 19 1 2024-09-12T01:43:15.166 INFO:tasks.workunit.client.1.smithi153.stdout:2/885: mkdir d7/db/d6c/d76/db8/d10d 0 2024-09-12T01:43:15.169 INFO:tasks.workunit.client.1.smithi153.stdout:9/953: dread d3/d55/f32 [0,4194304] 0 2024-09-12T01:43:15.170 INFO:tasks.workunit.client.1.smithi153.stdout:9/954: creat d3/d5f/d123/f126 x:0 0 0 2024-09-12T01:43:15.170 INFO:tasks.workunit.client.1.smithi153.stdout:2/886: dread d7/d4d/d70/f92 [0,4194304] 0 2024-09-12T01:43:15.171 INFO:tasks.workunit.client.1.smithi153.stdout:9/955: mkdir d3/d3a/d42/d72/dc3/d127 0 2024-09-12T01:43:15.172 INFO:tasks.workunit.client.1.smithi153.stdout:2/887: mkdir d7/db/d27/d10e 0 2024-09-12T01:43:15.173 INFO:tasks.workunit.client.1.smithi153.stdout:3/987: write d1/d13/d23/f2b [2423061,29220] 0 2024-09-12T01:43:15.173 INFO:tasks.workunit.client.1.smithi153.stdout:3/988: stat d1/ce 0 2024-09-12T01:43:15.173 INFO:tasks.workunit.client.1.smithi153.stdout:9/956: rmdir d3/d3a/d42/d72/d98/d9a/da0 39 2024-09-12T01:43:15.173 INFO:tasks.workunit.client.1.smithi153.stdout:9/957: readlink d3/d55/d30/lc5 0 2024-09-12T01:43:15.174 INFO:tasks.workunit.client.1.smithi153.stdout:3/989: getdents d1/d13/d23/d47/d71/d8e/d93/d79 0 2024-09-12T01:43:15.174 INFO:tasks.workunit.client.1.smithi153.stdout:3/990: truncate d1/d11a/fc7 521772 0 2024-09-12T01:43:15.176 INFO:tasks.workunit.client.1.smithi153.stdout:3/991: rename d1/d13/d25/da6/f9e to d1/d59/de4/f128 0 2024-09-12T01:43:15.177 INFO:tasks.workunit.client.1.smithi153.stdout:3/992: mkdir d1/d13/d23/d47/d6c/d9c/d107/d10d/d129 0 2024-09-12T01:43:15.180 INFO:tasks.workunit.client.0.smithi066.stdout:0/612: dwrite d1/d62/d9f/d4a/d67/d1b/d61/f7f [0,4194304] 0 2024-09-12T01:43:15.181 INFO:tasks.workunit.client.0.smithi066.stdout:0/613: dread d1/d72/f6f [0,4194304] 0 2024-09-12T01:43:15.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/614: link d1/d62/d9f/fcf d1/d62/d89/fde 0 2024-09-12T01:43:15.183 INFO:tasks.workunit.client.0.smithi066.stdout:0/615: symlink d1/d62/d9f/d7e/ldf 0 2024-09-12T01:43:15.183 INFO:tasks.workunit.client.1.smithi153.stdout:9/958: dread d3/d3a/f5a [0,4194304] 0 2024-09-12T01:43:15.184 INFO:tasks.workunit.client.1.smithi153.stdout:9/959: symlink d3/d55/d30/d88/dc6/l128 0 2024-09-12T01:43:15.185 INFO:tasks.workunit.client.0.smithi066.stdout:0/616: rmdir d1/d62/d9f/d92/d95/dcd 39 2024-09-12T01:43:15.185 INFO:tasks.workunit.client.0.smithi066.stdout:0/617: dread - d1/d62/d9f/d4a/d67/d1b/d3b/f86 zero size 2024-09-12T01:43:15.187 INFO:tasks.workunit.client.1.smithi153.stdout:8/827: dread d17/d1f/d4f/d42/f10a [0,4194304] 0 2024-09-12T01:43:15.189 INFO:tasks.workunit.client.1.smithi153.stdout:8/828: unlink d17/f1b 0 2024-09-12T01:43:15.192 INFO:tasks.workunit.client.1.smithi153.stdout:8/829: rmdir d17/d1f/d4f/d42/d79/dac/dd3 39 2024-09-12T01:43:15.192 INFO:tasks.workunit.client.1.smithi153.stdout:8/830: truncate d17/d1f/d4f/f71 873560 0 2024-09-12T01:43:15.192 INFO:tasks.workunit.client.1.smithi153.stdout:8/831: mkdir d17/d21/d111 0 2024-09-12T01:43:15.193 INFO:tasks.workunit.client.1.smithi153.stdout:8/832: unlink d17/d21/f30 0 2024-09-12T01:43:15.206 INFO:tasks.workunit.client.0.smithi066.stdout:2/514: dwrite de/d13/d1e/d22/f44 [0,4194304] 0 2024-09-12T01:43:15.207 INFO:tasks.workunit.client.1.smithi153.stdout:6/990: dwrite d1/f4 [0,4194304] 0 2024-09-12T01:43:15.207 INFO:tasks.workunit.client.1.smithi153.stdout:6/991: creat d1/d6/d23/d98/d53/d69/d7c/f144 x:0 0 0 2024-09-12T01:43:15.207 INFO:tasks.workunit.client.1.smithi153.stdout:6/992: chown d1/df/f51 19992 1 2024-09-12T01:43:15.207 INFO:tasks.workunit.client.0.smithi066.stdout:8/615: dwrite d12/d21/d2f/d57/fbf [0,4194304] 0 2024-09-12T01:43:15.210 INFO:tasks.workunit.client.0.smithi066.stdout:2/515: mknod de/d13/d1e/d25/da2/cb2 0 2024-09-12T01:43:15.214 INFO:tasks.workunit.client.1.smithi153.stdout:6/993: creat d1/d6/da/f145 x:0 0 0 2024-09-12T01:43:15.223 INFO:tasks.workunit.client.1.smithi153.stdout:5/980: dwrite d0/d43/dac/db0/d109/d1c/fc8 [0,4194304] 0 2024-09-12T01:43:15.223 INFO:tasks.workunit.client.0.smithi066.stdout:8/616: rename d12/d21/d2f/d57/d43/d66/f8a to d12/d21/d2f/d57/d43/d66/d98/fc9 0 2024-09-12T01:43:15.225 INFO:tasks.workunit.client.1.smithi153.stdout:9/960: dwrite d3/d3a/d42/d72/dc3/dd9/f10a [4194304,4194304] 0 2024-09-12T01:43:15.225 INFO:tasks.workunit.client.1.smithi153.stdout:9/961: creat d3/d55/d30/d88/f129 x:0 0 0 2024-09-12T01:43:15.225 INFO:tasks.workunit.client.1.smithi153.stdout:9/962: chown d3/d35/l50 6443 1 2024-09-12T01:43:15.225 INFO:tasks.workunit.client.1.smithi153.stdout:9/963: creat d3/d3a/d42/f12a x:0 0 0 2024-09-12T01:43:15.225 INFO:tasks.workunit.client.1.smithi153.stdout:8/833: dwrite d17/d1f/dcf/d106/ddf/f10f [0,4194304] 0 2024-09-12T01:43:15.226 INFO:tasks.workunit.client.0.smithi066.stdout:0/618: dwrite d1/d62/d89/fde [0,4194304] 0 2024-09-12T01:43:15.226 INFO:tasks.workunit.client.0.smithi066.stdout:2/516: link de/d13/d5c/c86 de/d13/d1e/d41/cb3 0 2024-09-12T01:43:15.228 INFO:tasks.workunit.client.0.smithi066.stdout:8/617: rmdir d12/daf 39 2024-09-12T01:43:15.232 INFO:tasks.workunit.client.1.smithi153.stdout:5/981: creat d0/d43/d8d/d12e/f138 x:0 0 0 2024-09-12T01:43:15.237 INFO:tasks.workunit.client.0.smithi066.stdout:8/618: creat d12/d21/d2f/d57/d84/d50/fca x:0 0 0 2024-09-12T01:43:15.238 INFO:tasks.workunit.client.1.smithi153.stdout:9/964: write d3/f8 [2691354,40347] 0 2024-09-12T01:43:15.238 INFO:tasks.workunit.client.1.smithi153.stdout:9/965: dread - d3/d3a/d42/d72/dc3/f111 zero size 2024-09-12T01:43:15.240 INFO:tasks.workunit.client.0.smithi066.stdout:8/619: creat d12/d21/d2f/d57/d43/d82/dbb/fcb x:0 0 0 2024-09-12T01:43:15.241 INFO:tasks.workunit.client.0.smithi066.stdout:8/620: readlink d12/d21/d2f/d53/la1 0 2024-09-12T01:43:15.241 INFO:tasks.workunit.client.0.smithi066.stdout:0/619: dread d1/d72/de/f3c [0,4194304] 0 2024-09-12T01:43:15.249 INFO:tasks.workunit.client.1.smithi153.stdout:8/834: rename d17/l44 to d17/d1f/dcf/l112 0 2024-09-12T01:43:15.249 INFO:tasks.workunit.client.1.smithi153.stdout:8/835: dread - d17/d1f/d4f/d42/d79/dac/dce/ddc/fde zero size 2024-09-12T01:43:15.249 INFO:tasks.workunit.client.1.smithi153.stdout:8/836: chown d17/d1f/d4f/d42/d79/dac/dce/ddc 1145089 1 2024-09-12T01:43:15.249 INFO:tasks.workunit.client.1.smithi153.stdout:8/837: stat d17/d1f/dcf/d106/ce0 0 2024-09-12T01:43:15.256 INFO:tasks.workunit.client.1.smithi153.stdout:8/838: unlink d17/d1f/dcf/d106/d96/d6c/d89/ded/fff 0 2024-09-12T01:43:15.259 INFO:tasks.workunit.client.1.smithi153.stdout:5/982: rename d0/d15/dae to d0/d43/d8d/d8e/dd7/ddd/d139 0 2024-09-12T01:43:15.261 INFO:tasks.workunit.client.1.smithi153.stdout:3/993: rmdir d1/d59 39 2024-09-12T01:43:15.261 INFO:tasks.workunit.client.1.smithi153.stdout:5/983: rmdir d0/d43/dac/db0/d109/d83/d36 39 2024-09-12T01:43:15.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/620: write d1/d72/f5c [7547969,9937] 0 2024-09-12T01:43:15.273 INFO:tasks.workunit.client.0.smithi066.stdout:0/621: mknod d1/d62/d9f/d4a/d67/d20/dc9/ce0 0 2024-09-12T01:43:15.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/622: symlink d1/d62/d9f/d4a/d67/d1b/d3b/le1 0 2024-09-12T01:43:15.274 INFO:tasks.workunit.client.0.smithi066.stdout:0/623: dread - d1/d72/fb7 zero size 2024-09-12T01:43:15.282 INFO:tasks.workunit.client.0.smithi066.stdout:8/621: dwrite d12/f47 [0,4194304] 0 2024-09-12T01:43:15.305 INFO:tasks.workunit.client.1.smithi153.stdout:6/994: dwrite d1/d6/d23/d98/d53/da0/fad [0,4194304] 0 2024-09-12T01:43:15.306 INFO:tasks.workunit.client.1.smithi153.stdout:3/994: read d1/f54 [3433943,95249] 0 2024-09-12T01:43:15.308 INFO:tasks.workunit.client.1.smithi153.stdout:6/995: rmdir d1/d6/da 39 2024-09-12T01:43:15.319 INFO:tasks.workunit.client.1.smithi153.stdout:6/996: dread d1/d6/d46/d73/d8a/f89 [0,4194304] 0 2024-09-12T01:43:15.319 INFO:tasks.workunit.client.1.smithi153.stdout:6/997: fsync d1/d6/d23/d98/d53/d8d/fa9 0 2024-09-12T01:43:15.319 INFO:tasks.workunit.client.1.smithi153.stdout:6/998: write d1/d6/d39/dc4/f10b [804582,14927] 0 2024-09-12T01:43:15.320 INFO:tasks.workunit.client.1.smithi153.stdout:6/999: getdents d1/d6/da/d19/d3a 0 2024-09-12T01:43:15.325 INFO:tasks.workunit.client.1.smithi153.stdout:8/839: dwrite d17/d1f/d4f/d34/db4/fcc [0,4194304] 0 2024-09-12T01:43:15.325 INFO:tasks.workunit.client.1.smithi153.stdout:8/840: fdatasync d17/d21/f92 0 2024-09-12T01:43:15.326 INFO:tasks.workunit.client.0.smithi066.stdout:2/517: dwrite fd [0,4194304] 0 2024-09-12T01:43:15.326 INFO:tasks.workunit.client.0.smithi066.stdout:2/518: write de/d13/f87 [213396,18905] 0 2024-09-12T01:43:15.326 INFO:tasks.workunit.client.0.smithi066.stdout:2/519: write de/f15 [1504783,111475] 0 2024-09-12T01:43:15.327 INFO:tasks.workunit.client.1.smithi153.stdout:5/984: dwrite d0/d43/dac/db0/d109/d83/d36/fa8 [0,4194304] 0 2024-09-12T01:43:15.327 INFO:tasks.workunit.client.0.smithi066.stdout:0/624: dwrite d1/d72/de/f7b [0,4194304] 0 2024-09-12T01:43:15.328 INFO:tasks.workunit.client.1.smithi153.stdout:9/966: dwrite d3/f4 [0,4194304] 0 2024-09-12T01:43:15.328 INFO:tasks.workunit.client.1.smithi153.stdout:8/841: link d17/d1f/d4f/d42/f101 d17/d1f/dcf/d106/d96/d6c/d89/d9c/f113 0 2024-09-12T01:43:15.328 INFO:tasks.workunit.client.1.smithi153.stdout:8/842: fsync d17/d1f/dcf/d106/d96/d6c/d89/f8e 0 2024-09-12T01:43:15.331 INFO:tasks.workunit.client.1.smithi153.stdout:3/995: write d1/d59/f66 [7075950,71509] 0 2024-09-12T01:43:15.334 INFO:tasks.workunit.client.1.smithi153.stdout:8/843: unlink d17/d21/cae 0 2024-09-12T01:43:15.337 INFO:tasks.workunit.client.1.smithi153.stdout:3/996: rmdir d1/d1e/d9a 39 2024-09-12T01:43:15.337 INFO:tasks.workunit.client.1.smithi153.stdout:3/997: chown d1/d13/d25/d26/c81 0 1 2024-09-12T01:43:15.337 INFO:tasks.workunit.client.1.smithi153.stdout:5/985: write d0/f2 [6827523,79607] 0 2024-09-12T01:43:15.338 INFO:tasks.workunit.client.1.smithi153.stdout:9/967: truncate d3/d55/d30/d95/d84/d8b/de2/f112 1806591 0 2024-09-12T01:43:15.338 INFO:tasks.workunit.client.1.smithi153.stdout:9/968: chown d3/d3a/d42/f48 679219 1 2024-09-12T01:43:15.338 INFO:tasks.workunit.client.1.smithi153.stdout:9/969: fdatasync d3/d3a/f8e 0 2024-09-12T01:43:15.338 INFO:tasks.workunit.client.0.smithi066.stdout:2/520: write de/d13/d1e/d41/d58/f73 [2403133,18666] 0 2024-09-12T01:43:15.341 INFO:tasks.workunit.client.1.smithi153.stdout:3/998: rename d1/d64/cb7 to d1/d13/d25/d26/d4b/c12a 0 2024-09-12T01:43:15.342 INFO:tasks.workunit.client.0.smithi066.stdout:0/625: write d1/d62/d9f/d4a/d67/f52 [3221252,28601] 0 2024-09-12T01:43:15.345 INFO:tasks.workunit.client.1.smithi153.stdout:5/986: creat d0/d43/dac/db0/d109/d83/f13a x:0 0 0 2024-09-12T01:43:15.347 INFO:tasks.workunit.client.0.smithi066.stdout:0/626: mkdir d1/d62/d89/da3/dc1/de2 0 2024-09-12T01:43:15.349 INFO:tasks.workunit.client.1.smithi153.stdout:3/999: truncate d1/d59/de4/f128 3708310 0 2024-09-12T01:43:15.349 INFO:tasks.workunit.client.0.smithi066.stdout:2/521: write de/d13/d28/f38 [391551,52244] 0 2024-09-12T01:43:15.351 INFO:tasks.workunit.client.1.smithi153.stdout:8/844: dread d17/d1f/d4f/d34/db4/fa8 [0,4194304] 0 2024-09-12T01:43:15.352 INFO:tasks.workunit.client.1.smithi153.stdout:5/987: creat d0/d43/dac/db0/d109/db8/d2f/d55/d9c/d75/d58/d71/f13b x:0 0 0 2024-09-12T01:43:15.354 INFO:tasks.workunit.client.1.smithi153.stdout:9/970: dread d3/d5f/d62/d118/f9c [0,4194304] 0 2024-09-12T01:43:15.355 INFO:tasks.workunit.client.1.smithi153.stdout:9/971: dread d3/d55/fb4 [0,4194304] 0 2024-09-12T01:43:15.358 INFO:tasks.workunit.client.1.smithi153.stdout:9/972: mkdir d3/d3a/d42/d72/d12b 0 2024-09-12T01:43:15.359 INFO:tasks.workunit.client.1.smithi153.stdout:9/973: mknod d3/d5f/dbb/c12c 0 2024-09-12T01:43:15.359 INFO:tasks.workunit.client.1.smithi153.stdout:9/974: dread - d3/d55/d30/d88/f129 zero size 2024-09-12T01:43:15.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/988: dread d0/d43/dac/db0/d109/f116 [0,4194304] 0 2024-09-12T01:43:15.363 INFO:tasks.workunit.client.1.smithi153.stdout:5/989: fsync d0/d43/d8d/d8e/dd7/ddd/d139/fc5 0 2024-09-12T01:43:15.364 INFO:tasks.workunit.client.1.smithi153.stdout:5/990: creat d0/d43/d8d/f13c x:0 0 0 2024-09-12T01:43:15.365 INFO:tasks.workunit.client.1.smithi153.stdout:5/991: mkdir d0/d43/dac/db0/d109/d99/d13d 0 2024-09-12T01:43:15.366 INFO:tasks.workunit.client.1.smithi153.stdout:5/992: chown d0/d43/dac/db0/d109/d83/d36/d39/f74 22 1 2024-09-12T01:43:15.366 INFO:tasks.workunit.client.1.smithi153.stdout:7/903: sync 2024-09-12T01:43:15.366 INFO:tasks.workunit.client.1.smithi153.stdout:4/819: sync 2024-09-12T01:43:15.366 INFO:tasks.workunit.client.1.smithi153.stdout:4/820: creat d6/d9/d11/d90/f115 x:0 0 0 2024-09-12T01:43:15.366 INFO:tasks.workunit.client.1.smithi153.stdout:4/821: write d6/d15/f22 [2595181,7837] 0 2024-09-12T01:43:15.367 INFO:tasks.workunit.client.1.smithi153.stdout:5/993: mknod d0/d43/dac/db0/d109/db8/d6e/d111/c13e 0 2024-09-12T01:43:15.371 INFO:tasks.workunit.client.1.smithi153.stdout:9/975: write d3/d55/d30/d7b/f89 [1634937,43503] 0 2024-09-12T01:43:15.371 INFO:tasks.workunit.client.1.smithi153.stdout:9/976: write d3/d66/ffe [220970,1629] 0 2024-09-12T01:43:15.373 INFO:tasks.workunit.client.1.smithi153.stdout:9/977: creat d3/d55/d30/d95/d84/d115/f12d x:0 0 0 2024-09-12T01:43:15.385 INFO:tasks.workunit.client.1.smithi153.stdout:9/978: read d3/f11 [3447041,2651] 0 2024-09-12T01:43:15.385 INFO:tasks.workunit.client.1.smithi153.stdout:9/979: dread - d3/d3a/d42/f12a zero size 2024-09-12T01:43:15.392 INFO:tasks.workunit.client.1.smithi153.stdout:5/994: dread d0/d20/f26 [0,4194304] 0 2024-09-12T01:43:15.393 INFO:tasks.workunit.client.1.smithi153.stdout:8/845: dwrite d17/d1d/f73 [0,4194304] 0 2024-09-12T01:43:15.394 INFO:tasks.workunit.client.0.smithi066.stdout:0/627: dwrite d1/d62/f94 [0,4194304] 0 2024-09-12T01:43:15.395 INFO:tasks.workunit.client.1.smithi153.stdout:5/995: mkdir d0/d43/dac/db0/d109/d83/d13f 0 2024-09-12T01:43:15.397 INFO:tasks.workunit.client.1.smithi153.stdout:7/904: write d12/d21/d29/d35/d37/f6c [1479920,123906] 0 2024-09-12T01:43:15.400 INFO:tasks.workunit.client.1.smithi153.stdout:7/905: truncate d12/d21/d29/d35/fb6 4684056 0 2024-09-12T01:43:15.408 INFO:tasks.workunit.client.1.smithi153.stdout:8/846: write d17/d1d/f73 [1905448,99059] 0 2024-09-12T01:43:15.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/847: symlink d17/d1f/dcf/d106/d96/d6c/d6e/d7f/l114 0 2024-09-12T01:43:15.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/848: write d17/d1f/d4f/d34/f40 [2459120,23822] 0 2024-09-12T01:43:15.410 INFO:tasks.workunit.client.1.smithi153.stdout:8/849: symlink d17/d1f/d4f/d34/dee/l115 0 2024-09-12T01:43:15.410 INFO:tasks.workunit.client.1.smithi153.stdout:8/850: fsync f16 0 2024-09-12T01:43:15.410 INFO:tasks.workunit.client.1.smithi153.stdout:8/851: truncate d17/d1f/d4f/d42/fdd 215870 0 2024-09-12T01:43:15.410 INFO:tasks.workunit.client.1.smithi153.stdout:8/852: readlink d17/d1f/d4f/d42/l76 0 2024-09-12T01:43:15.410 INFO:tasks.workunit.client.1.smithi153.stdout:5/996: dread d0/d43/dac/db0/d109/d83/d36/d39/da4/fba [0,4194304] 0 2024-09-12T01:43:15.411 INFO:tasks.workunit.client.1.smithi153.stdout:8/853: truncate d17/d1f/dcf/d106/d99/ffd 2654311 0 2024-09-12T01:43:15.412 INFO:tasks.workunit.client.1.smithi153.stdout:5/997: rename d0/d43/dac/db0/d109/d83/d36/d39/f74 to d0/d43/d68/dcc/f140 0 2024-09-12T01:43:15.412 INFO:tasks.workunit.client.1.smithi153.stdout:5/998: creat d0/d43/dac/db0/d109/d99/f141 x:0 0 0 2024-09-12T01:43:15.412 INFO:tasks.workunit.client.1.smithi153.stdout:5/999: write d0/d43/dac/db0/d109/db8/d6e/ff5 [546961,112906] 0 2024-09-12T01:43:15.412 INFO:tasks.workunit.client.1.smithi153.stdout:8/854: creat d17/d1f/d4f/d42/d79/dac/d108/f116 x:0 0 0 2024-09-12T01:43:15.413 INFO:tasks.workunit.client.1.smithi153.stdout:8/855: link d17/d75/fe6 d17/d1f/d4f/d42/d79/dd4/f117 0 2024-09-12T01:43:15.431 INFO:tasks.workunit.client.1.smithi153.stdout:7/906: dread d12/d21/f45 [0,4194304] 0 2024-09-12T01:43:15.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/888: sync 2024-09-12T01:43:15.437 INFO:tasks.workunit.client.1.smithi153.stdout:1/944: sync 2024-09-12T01:43:15.438 INFO:tasks.workunit.client.1.smithi153.stdout:9/980: dwrite d3/d55/d30/d88/dc6/f11b [0,4194304] 0 2024-09-12T01:43:15.438 INFO:tasks.workunit.client.1.smithi153.stdout:9/981: write d3/d3a/d42/d72/d98/d9a/da0/fc1 [688376,47849] 0 2024-09-12T01:43:15.438 INFO:tasks.workunit.client.1.smithi153.stdout:9/982: write d3/d3a/d42/d72/f96 [488881,49734] 0 2024-09-12T01:43:15.440 INFO:tasks.workunit.client.1.smithi153.stdout:9/983: symlink d3/d55/d30/d88/l12e 0 2024-09-12T01:43:15.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/984: fdatasync d3/d55/d30/d7b/f89 0 2024-09-12T01:43:15.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/985: write d3/d55/d30/f73 [346239,2781] 0 2024-09-12T01:43:15.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/986: truncate d3/d5f/d62/d118/f9c 3768756 0 2024-09-12T01:43:15.441 INFO:tasks.workunit.client.1.smithi153.stdout:9/987: chown d3/d55/d30/d88/cfc 6 1 2024-09-12T01:43:15.442 INFO:tasks.workunit.client.1.smithi153.stdout:9/988: truncate d3/f11 1035688 0 2024-09-12T01:43:15.444 INFO:tasks.workunit.client.1.smithi153.stdout:9/989: unlink d3/d66/fc0 0 2024-09-12T01:43:15.449 INFO:tasks.workunit.client.1.smithi153.stdout:9/990: dread d3/d55/f1e [0,4194304] 0 2024-09-12T01:43:15.449 INFO:tasks.workunit.client.1.smithi153.stdout:9/991: stat d3/d3a 0 2024-09-12T01:43:15.449 INFO:tasks.workunit.client.1.smithi153.stdout:9/992: fdatasync d3/d3a/d42/d72/dc3/dd9/f10a 0 2024-09-12T01:43:15.449 INFO:tasks.workunit.client.0.smithi066.stdout:6/587: sync 2024-09-12T01:43:15.450 INFO:tasks.workunit.client.0.smithi066.stdout:4/539: sync 2024-09-12T01:43:15.450 INFO:tasks.workunit.client.0.smithi066.stdout:0/628: dwrite d1/d72/de/f1d [4194304,4194304] 0 2024-09-12T01:43:15.450 INFO:tasks.workunit.client.0.smithi066.stdout:4/540: write d4/d6/d8/f3b [1267947,17793] 0 2024-09-12T01:43:15.450 INFO:tasks.workunit.client.0.smithi066.stdout:4/541: chown d4/d6/d8/d18/c3d 5094634 1 2024-09-12T01:43:15.454 INFO:tasks.workunit.client.1.smithi153.stdout:2/889: write d7/d19/d83/d101/da4/fd9 [1885789,87003] 0 2024-09-12T01:43:15.454 INFO:tasks.workunit.client.1.smithi153.stdout:2/890: write d7/db/d36/f84 [2483829,119630] 0 2024-09-12T01:43:15.454 INFO:tasks.workunit.client.0.smithi066.stdout:4/542: unlink d4/d6/d27/l50 0 2024-09-12T01:43:15.457 INFO:tasks.workunit.client.0.smithi066.stdout:4/543: rmdir d4/d5f 39 2024-09-12T01:43:15.459 INFO:tasks.workunit.client.0.smithi066.stdout:4/544: mkdir d4/d15/d33/d5e/dac 0 2024-09-12T01:43:15.461 INFO:tasks.workunit.client.0.smithi066.stdout:4/545: creat d4/d6/d27/d66/da1/fad x:0 0 0 2024-09-12T01:43:15.461 INFO:tasks.workunit.client.0.smithi066.stdout:4/546: creat d4/d6/fae x:0 0 0 2024-09-12T01:43:15.461 INFO:tasks.workunit.client.0.smithi066.stdout:4/547: fsync d4/d6/d27/d66/d6c/f97 0 2024-09-12T01:43:15.464 INFO:tasks.workunit.client.1.smithi153.stdout:8/856: dwrite d17/d1d/f94 [4194304,4194304] 0 2024-09-12T01:43:15.467 INFO:tasks.workunit.client.0.smithi066.stdout:0/629: dread d1/d72/de/f1d [4194304,4194304] 0 2024-09-12T01:43:15.469 INFO:tasks.workunit.client.1.smithi153.stdout:8/857: link d17/f46 d17/d1f/dcf/d106/d95/dd6/ddb/f118 0 2024-09-12T01:43:15.475 INFO:tasks.workunit.client.1.smithi153.stdout:1/945: dwrite d2/d34/d8a/f128 [0,4194304] 0 2024-09-12T01:43:15.478 INFO:tasks.workunit.client.1.smithi153.stdout:1/946: getdents d2/d9/d17 0 2024-09-12T01:43:15.506 INFO:tasks.workunit.client.0.smithi066.stdout:6/588: dwrite d2/d21/f30 [0,4194304] 0 2024-09-12T01:43:15.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/630: dwrite d1/d72/f5c [4194304,4194304] 0 2024-09-12T01:43:15.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/631: dread - d1/d62/d9f/d7c/fa2 zero size 2024-09-12T01:43:15.506 INFO:tasks.workunit.client.0.smithi066.stdout:4/548: dwrite d4/d6/d27/d66/da1/fad [0,4194304] 0 2024-09-12T01:43:15.507 INFO:tasks.workunit.client.1.smithi153.stdout:2/891: dwrite d7/db/d1d/f28 [4194304,4194304] 0 2024-09-12T01:43:15.507 INFO:tasks.workunit.client.1.smithi153.stdout:9/993: dwrite d3/d66/d80/faa [0,4194304] 0 2024-09-12T01:43:15.507 INFO:tasks.workunit.client.1.smithi153.stdout:9/994: truncate d3/d66/f10f 953779 0 2024-09-12T01:43:15.507 INFO:tasks.workunit.client.1.smithi153.stdout:9/995: creat d3/d66/ddc/f12f x:0 0 0 2024-09-12T01:43:15.507 INFO:tasks.workunit.client.1.smithi153.stdout:9/996: fdatasync d3/d55/d30/f5e 0 2024-09-12T01:43:15.511 INFO:tasks.workunit.client.1.smithi153.stdout:2/892: rename d7/d19/d83/d101/f8c to d7/d19/d83/d101/f10f 0 2024-09-12T01:43:15.511 INFO:tasks.workunit.client.1.smithi153.stdout:2/893: fdatasync d7/fce 0 2024-09-12T01:43:15.516 INFO:tasks.workunit.client.0.smithi066.stdout:4/549: truncate d4/d6/d48/f8b 5720344 0 2024-09-12T01:43:15.516 INFO:tasks.workunit.client.0.smithi066.stdout:4/550: stat d4/d6/d8/d4a/c60 0 2024-09-12T01:43:15.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/551: symlink d4/d6/d27/laf 0 2024-09-12T01:43:15.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/552: chown d4/d15/d33/l40 1593 1 2024-09-12T01:43:15.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/553: truncate d4/d6/d8/d18/f74 968486 0 2024-09-12T01:43:15.520 INFO:tasks.workunit.client.1.smithi153.stdout:1/947: write d2/d9/d17/d2f/d56/fc9 [428594,49166] 0 2024-09-12T01:43:15.520 INFO:tasks.workunit.client.0.smithi066.stdout:0/632: dread d1/d62/f94 [0,4194304] 0 2024-09-12T01:43:15.522 INFO:tasks.workunit.client.0.smithi066.stdout:4/554: unlink d4/d6/f81 0 2024-09-12T01:43:15.522 INFO:tasks.workunit.client.0.smithi066.stdout:6/589: dwrite d2/d99/f82 [4194304,4194304] 0 2024-09-12T01:43:15.524 INFO:tasks.workunit.client.0.smithi066.stdout:0/633: dread d1/d62/d9f/d4a/d67/d1b/d26/d5b/f73 [0,4194304] 0 2024-09-12T01:43:15.525 INFO:tasks.workunit.client.1.smithi153.stdout:9/997: rename d3/d55/f77 to d3/d5f/d62/d118/f130 0 2024-09-12T01:43:15.525 INFO:tasks.workunit.client.0.smithi066.stdout:0/634: dread d1/d62/d9f/f5a [0,4194304] 0 2024-09-12T01:43:15.526 INFO:tasks.workunit.client.0.smithi066.stdout:0/635: write d1/f2d [219027,1031] 0 2024-09-12T01:43:15.526 INFO:tasks.workunit.client.1.smithi153.stdout:2/894: dread d7/d19/f4b [0,4194304] 0 2024-09-12T01:43:15.527 INFO:tasks.workunit.client.0.smithi066.stdout:0/636: dread d1/f9 [0,4194304] 0 2024-09-12T01:43:15.528 INFO:tasks.workunit.client.1.smithi153.stdout:1/948: truncate d2/d9/d28/d73/fb7 2668682 0 2024-09-12T01:43:15.528 INFO:tasks.workunit.client.1.smithi153.stdout:1/949: readlink d2/d68/ld0 0 2024-09-12T01:43:15.531 INFO:tasks.workunit.client.1.smithi153.stdout:9/998: mkdir d3/d55/d30/d95/d84/d115/d131 0 2024-09-12T01:43:15.533 INFO:tasks.workunit.client.0.smithi066.stdout:6/590: mkdir d2/d99/d12/d1d/d6b/dc6 0 2024-09-12T01:43:15.535 INFO:tasks.workunit.client.0.smithi066.stdout:0/637: getdents d1/d62/d9f/d4a/d67/d3e 0 2024-09-12T01:43:15.537 INFO:tasks.workunit.client.0.smithi066.stdout:6/591: unlink d2/d99/d12/d1d/d6b/fbf 0 2024-09-12T01:43:15.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/638: truncate d1/d62/f8e 143376 0 2024-09-12T01:43:15.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/639: write d1/d62/d9f/d4a/d67/d1b/f33 [2782791,129068] 0 2024-09-12T01:43:15.540 INFO:tasks.workunit.client.0.smithi066.stdout:0/640: truncate d1/d72/fd9 680968 0 2024-09-12T01:43:15.542 INFO:tasks.workunit.client.0.smithi066.stdout:6/592: rename d2/d31/d57/db4 to d2/d99/d12/d1d/dc7 0 2024-09-12T01:43:15.542 INFO:tasks.workunit.client.0.smithi066.stdout:6/593: chown d2/d31/d5e/ca0 10645217 1 2024-09-12T01:43:15.544 INFO:tasks.workunit.client.0.smithi066.stdout:0/641: mknod d1/d62/d9f/d7e/ce3 0 2024-09-12T01:43:15.545 INFO:tasks.workunit.client.0.smithi066.stdout:6/594: symlink d2/d99/d12/d1d/d6b/dc6/lc8 0 2024-09-12T01:43:15.545 INFO:tasks.workunit.client.0.smithi066.stdout:6/595: fsync d2/d31/fa8 0 2024-09-12T01:43:15.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/950: write d2/d34/d3d/d80/fea [3880678,5690] 0 2024-09-12T01:43:15.546 INFO:tasks.workunit.client.1.smithi153.stdout:1/951: write d2/d9/d58/d74/f102 [729963,17011] 0 2024-09-12T01:43:15.546 INFO:tasks.workunit.client.0.smithi066.stdout:0/642: symlink d1/le4 0 2024-09-12T01:43:15.547 INFO:tasks.workunit.client.0.smithi066.stdout:6/596: truncate d2/d21/f52 5002975 0 2024-09-12T01:43:15.547 INFO:tasks.workunit.client.0.smithi066.stdout:6/597: read - d2/d99/f6a zero size 2024-09-12T01:43:15.550 INFO:tasks.workunit.client.0.smithi066.stdout:0/643: creat d1/d62/d9f/d7c/fe5 x:0 0 0 2024-09-12T01:43:15.551 INFO:tasks.workunit.client.0.smithi066.stdout:0/644: mkdir d1/d62/d9f/de6 0 2024-09-12T01:43:15.552 INFO:tasks.workunit.client.1.smithi153.stdout:1/952: symlink d2/d9/l12f 0 2024-09-12T01:43:15.552 INFO:tasks.workunit.client.0.smithi066.stdout:0/645: symlink d1/d62/d9f/d4a/dba/le7 0 2024-09-12T01:43:15.552 INFO:tasks.workunit.client.0.smithi066.stdout:0/646: write d1/d62/d89/d83/fda [716667,57942] 0 2024-09-12T01:43:15.553 INFO:tasks.workunit.client.1.smithi153.stdout:1/953: creat d2/d9/d17/d2f/d56/d97/f130 x:0 0 0 2024-09-12T01:43:15.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/647: mkdir d1/d62/d9f/d7e/de8 0 2024-09-12T01:43:15.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/648: readlink d1/d62/d9f/d7e/ldf 0 2024-09-12T01:43:15.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/649: fsync d1/d62/d9f/d4a/d67/f1a 0 2024-09-12T01:43:15.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/650: write d1/d62/d9f/d4a/dba/fc4 [418381,25948] 0 2024-09-12T01:43:15.563 INFO:tasks.workunit.client.1.smithi153.stdout:2/895: dwrite d7/fe [0,4194304] 0 2024-09-12T01:43:15.564 INFO:tasks.workunit.client.1.smithi153.stdout:2/896: creat d7/d4d/f110 x:0 0 0 2024-09-12T01:43:15.565 INFO:tasks.workunit.client.1.smithi153.stdout:2/897: creat d7/d4d/d70/f111 x:0 0 0 2024-09-12T01:43:15.567 INFO:tasks.workunit.client.1.smithi153.stdout:2/898: creat d7/db/d1d/f112 x:0 0 0 2024-09-12T01:43:15.568 INFO:tasks.workunit.client.1.smithi153.stdout:9/999: dwrite d3/f49 [4194304,4194304] 0 2024-09-12T01:43:15.569 INFO:tasks.workunit.client.0.smithi066.stdout:4/555: dwrite d4/d15/f7d [4194304,4194304] 0 2024-09-12T01:43:15.571 INFO:tasks.workunit.client.0.smithi066.stdout:0/651: dread d1/d62/d9f/d4a/d67/f91 [0,4194304] 0 2024-09-12T01:43:15.572 INFO:tasks.workunit.client.1.smithi153.stdout:1/954: dread d2/d9/d17/d2f/fb6 [4194304,4194304] 0 2024-09-12T01:43:15.584 INFO:tasks.workunit.client.1.smithi153.stdout:1/955: rename d2/d9/d17/f4e to d2/d9/d17/d69/d107/d117/f131 0 2024-09-12T01:43:15.585 INFO:tasks.workunit.client.1.smithi153.stdout:1/956: truncate d2/d34/f50 3073886 0 2024-09-12T01:43:15.585 INFO:tasks.workunit.client.1.smithi153.stdout:1/957: dread d2/d34/d3d/d80/fd8 [0,4194304] 0 2024-09-12T01:43:15.586 INFO:tasks.workunit.client.1.smithi153.stdout:1/958: creat d2/d9/d17/d2c/f132 x:0 0 0 2024-09-12T01:43:15.595 INFO:tasks.workunit.client.1.smithi153.stdout:1/959: dread d2/d9/d28/d73/fb7 [0,4194304] 0 2024-09-12T01:43:15.595 INFO:tasks.workunit.client.1.smithi153.stdout:1/960: write d2/f6 [3042100,113900] 0 2024-09-12T01:43:15.595 INFO:tasks.workunit.client.1.smithi153.stdout:1/961: truncate d2/d34/d8a/da7/ff2 4450 0 2024-09-12T01:43:15.596 INFO:tasks.workunit.client.1.smithi153.stdout:1/962: link d2/d34/f55 d2/d9/d28/d73/d76/d12d/f133 0 2024-09-12T01:43:15.597 INFO:tasks.workunit.client.1.smithi153.stdout:1/963: creat d2/d68/d6b/f134 x:0 0 0 2024-09-12T01:43:15.597 INFO:tasks.workunit.client.1.smithi153.stdout:1/964: chown d2/d9/d17/d69/d95/fc1 528 1 2024-09-12T01:43:15.597 INFO:tasks.workunit.client.1.smithi153.stdout:1/965: chown d2/d9/d1d/d25/d127/f129 7 1 2024-09-12T01:43:15.597 INFO:tasks.workunit.client.1.smithi153.stdout:2/899: dwrite d7/d19/d40/fd7 [0,4194304] 0 2024-09-12T01:43:15.598 INFO:tasks.workunit.client.0.smithi066.stdout:4/556: dwrite d4/d6/d8/d18/f74 [0,4194304] 0 2024-09-12T01:43:15.598 INFO:tasks.workunit.client.0.smithi066.stdout:4/557: write d4/d6/d8/f32 [4234897,75294] 0 2024-09-12T01:43:15.598 INFO:tasks.workunit.client.0.smithi066.stdout:4/558: truncate d4/d6/d27/d66/d58/f8d 4668405 0 2024-09-12T01:43:15.598 INFO:tasks.workunit.client.0.smithi066.stdout:4/559: fsync d4/d6/d27/f98 0 2024-09-12T01:43:15.600 INFO:tasks.workunit.client.0.smithi066.stdout:4/560: rename d4/d6/d8/d80 to d4/d6/d62/db0 0 2024-09-12T01:43:15.603 INFO:tasks.workunit.client.1.smithi153.stdout:2/900: mkdir d7/d19/d83/d113 0 2024-09-12T01:43:15.608 INFO:tasks.workunit.client.0.smithi066.stdout:9/577: sync 2024-09-12T01:43:15.608 INFO:tasks.workunit.client.0.smithi066.stdout:7/446: sync 2024-09-12T01:43:15.608 INFO:tasks.workunit.client.0.smithi066.stdout:5/516: sync 2024-09-12T01:43:15.608 INFO:tasks.workunit.client.0.smithi066.stdout:9/578: creat d0/d6/d37/d85/fcf x:0 0 0 2024-09-12T01:43:15.612 INFO:tasks.workunit.client.0.smithi066.stdout:4/561: dread d4/d6/d27/d66/d58/f77 [0,4194304] 0 2024-09-12T01:43:15.613 INFO:tasks.workunit.client.0.smithi066.stdout:4/562: symlink d4/d5f/d9a/lb1 0 2024-09-12T01:43:15.613 INFO:tasks.workunit.client.1.smithi153.stdout:2/901: write d7/db/d62/f72 [1858294,128938] 0 2024-09-12T01:43:15.616 INFO:tasks.workunit.client.0.smithi066.stdout:4/563: getdents d4/d6/d48/d88 0 2024-09-12T01:43:15.616 INFO:tasks.workunit.client.0.smithi066.stdout:4/564: truncate d4/d6/d62/f9e 502540 0 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:4/822: sync 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:7/907: sync 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:8/858: sync 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:8/859: chown d17/d1f/d4f/d42/d79/dac/fe9 0 1 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:2/902: symlink d7/db/l114 0 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:2/903: chown d7/db/d6c/d76/db8/dcf/cbd 317303097 1 2024-09-12T01:43:15.618 INFO:tasks.workunit.client.1.smithi153.stdout:2/904: chown d7/fe 518415 1 2024-09-12T01:43:15.619 INFO:tasks.workunit.client.1.smithi153.stdout:7/908: creat d12/d21/d29/d35/dcb/de9/d120/f121 x:0 0 0 2024-09-12T01:43:15.620 INFO:tasks.workunit.client.1.smithi153.stdout:2/905: symlink d7/db/d1d/d1e/l115 0 2024-09-12T01:43:15.621 INFO:tasks.workunit.client.1.smithi153.stdout:1/966: dwrite d2/d34/f53 [0,4194304] 0 2024-09-12T01:43:15.621 INFO:tasks.workunit.client.1.smithi153.stdout:8/860: rmdir d17/d1f/dcf/d106/ddf 39 2024-09-12T01:43:15.623 INFO:tasks.workunit.client.0.smithi066.stdout:7/447: write d2/d5/d6/d22/f30 [3204014,39577] 0 2024-09-12T01:43:15.623 INFO:tasks.workunit.client.1.smithi153.stdout:1/967: rmdir d2/d9/d17/d100/d116 39 2024-09-12T01:43:15.623 INFO:tasks.workunit.client.1.smithi153.stdout:1/968: chown d2/d9/d17/d2f/d56/d83/l8d 61 1 2024-09-12T01:43:15.623 INFO:tasks.workunit.client.0.smithi066.stdout:7/448: dread d2/d5/d6/d40/d51/f72 [0,4194304] 0 2024-09-12T01:43:15.623 INFO:tasks.workunit.client.0.smithi066.stdout:7/449: write d2/d5/d6/d22/d75/d1d/f61 [852131,89623] 0 2024-09-12T01:43:15.624 INFO:tasks.workunit.client.1.smithi153.stdout:7/909: symlink d12/d21/d29/d2d/da6/l122 0 2024-09-12T01:43:15.624 INFO:tasks.workunit.client.1.smithi153.stdout:7/910: creat d12/d21/d29/d35/d37/d4c/d8e/f123 x:0 0 0 2024-09-12T01:43:15.626 INFO:tasks.workunit.client.1.smithi153.stdout:8/861: creat d17/d1f/dcf/d106/d96/d6c/d89/ded/f119 x:0 0 0 2024-09-12T01:43:15.626 INFO:tasks.workunit.client.1.smithi153.stdout:8/862: write d17/d1f/dcf/d106/d96/d6c/d89/f8e [4870146,99685] 0 2024-09-12T01:43:15.626 INFO:tasks.workunit.client.0.smithi066.stdout:9/579: write d0/d6/d17/d1b/d4c/d42/f5d [768992,87844] 0 2024-09-12T01:43:15.626 INFO:tasks.workunit.client.0.smithi066.stdout:7/450: chown d2/d5/cc 158 1 2024-09-12T01:43:15.627 INFO:tasks.workunit.client.1.smithi153.stdout:1/969: symlink d2/d9/d17/dab/l135 0 2024-09-12T01:43:15.629 INFO:tasks.workunit.client.0.smithi066.stdout:9/580: getdents d0/d6/d17/d4f/d12 0 2024-09-12T01:43:15.629 INFO:tasks.workunit.client.0.smithi066.stdout:9/581: rename d0 to d0/d6/d17/d1b/da2/dd0 22 2024-09-12T01:43:15.634 INFO:tasks.workunit.client.1.smithi153.stdout:7/911: rename d12/f33 to d12/d21/d29/d35/d37/f124 0 2024-09-12T01:43:15.635 INFO:tasks.workunit.client.1.smithi153.stdout:7/912: fsync d12/d21/d29/d35/d37/d4c/d8e/fe7 0 2024-09-12T01:43:15.635 INFO:tasks.workunit.client.1.smithi153.stdout:4/823: dread d6/d9/dc/d31/d76/d99/f107 [0,4194304] 0 2024-09-12T01:43:15.635 INFO:tasks.workunit.client.1.smithi153.stdout:4/824: creat d6/d9/d20/f116 x:0 0 0 2024-09-12T01:43:15.636 INFO:tasks.workunit.client.1.smithi153.stdout:4/825: chown d6/d9/dc/d98/f88 25822633 1 2024-09-12T01:43:15.636 INFO:tasks.workunit.client.0.smithi066.stdout:7/451: dread d2/d5/d6/d22/d75/d1d/d84/f8a [0,4194304] 0 2024-09-12T01:43:15.637 INFO:tasks.workunit.client.1.smithi153.stdout:7/913: symlink d12/d21/d29/d2d/da6/l125 0 2024-09-12T01:43:15.637 INFO:tasks.workunit.client.1.smithi153.stdout:7/914: fsync d12/d21/d4d/f7d 0 2024-09-12T01:43:15.639 INFO:tasks.workunit.client.1.smithi153.stdout:4/826: symlink d6/d15/db4/dbd/l117 0 2024-09-12T01:43:15.639 INFO:tasks.workunit.client.1.smithi153.stdout:7/915: truncate d12/d21/f49 1040818 0 2024-09-12T01:43:15.643 INFO:tasks.workunit.client.1.smithi153.stdout:8/863: write d17/d75/f8d [6593723,109376] 0 2024-09-12T01:43:15.644 INFO:tasks.workunit.client.1.smithi153.stdout:4/827: rename d6/d9/dc/f64 to d6/d9/d11/d13/f118 0 2024-09-12T01:43:15.645 INFO:tasks.workunit.client.1.smithi153.stdout:8/864: creat d17/d1f/dcf/d106/d96/d6c/d6e/d7f/f11a x:0 0 0 2024-09-12T01:43:15.647 INFO:tasks.workunit.client.1.smithi153.stdout:7/916: symlink d12/d21/d29/d35/l126 0 2024-09-12T01:43:15.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/865: rename d17/d1f/dcf/d106/d96/d6c/d89/ded/f107 to d17/d1d/f11b 0 2024-09-12T01:43:15.649 INFO:tasks.workunit.client.1.smithi153.stdout:7/917: write d12/d21/d29/d2d/f80 [1378352,75860] 0 2024-09-12T01:43:15.652 INFO:tasks.workunit.client.1.smithi153.stdout:8/866: mknod d17/d1f/dcf/d106/ddf/c11c 0 2024-09-12T01:43:15.652 INFO:tasks.workunit.client.1.smithi153.stdout:8/867: write d17/d1f/d4f/d34/db4/dda/fea [5018794,86842] 0 2024-09-12T01:43:15.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/517: dwrite d0/d26/f86 [0,4194304] 0 2024-09-12T01:43:15.655 INFO:tasks.workunit.client.0.smithi066.stdout:5/518: mknod d0/dd/d18/d8c/c9e 0 2024-09-12T01:43:15.655 INFO:tasks.workunit.client.0.smithi066.stdout:5/519: fdatasync d0/d26/d2d/d33/d55/d73/f9c 0 2024-09-12T01:43:15.656 INFO:tasks.workunit.client.0.smithi066.stdout:5/520: link d0/d21/f44 d0/d26/d2f/d9a/f9f 0 2024-09-12T01:43:15.656 INFO:tasks.workunit.client.0.smithi066.stdout:5/521: creat d0/d26/d2d/d31/fa0 x:0 0 0 2024-09-12T01:43:15.660 INFO:tasks.workunit.client.0.smithi066.stdout:9/582: dread d0/d6/d17/f18 [4194304,4194304] 0 2024-09-12T01:43:15.660 INFO:tasks.workunit.client.0.smithi066.stdout:9/583: truncate d0/d6/d17/d1b/f1c 4388397 0 2024-09-12T01:43:15.660 INFO:tasks.workunit.client.0.smithi066.stdout:9/584: symlink d0/d6/d17/ld1 0 2024-09-12T01:43:15.661 INFO:tasks.workunit.client.0.smithi066.stdout:9/585: dread - d0/d6/d37/d85/fcf zero size 2024-09-12T01:43:15.691 INFO:tasks.workunit.client.1.smithi153.stdout:4/828: dwrite d6/d9/dc/d98/d3e/f50 [0,4194304] 0 2024-09-12T01:43:15.691 INFO:tasks.workunit.client.1.smithi153.stdout:4/829: truncate d6/d9/dc/f3a 1587421 0 2024-09-12T01:43:15.693 INFO:tasks.workunit.client.1.smithi153.stdout:4/830: fdatasync d6/d9/dc/d98/d3e/ffd 0 2024-09-12T01:43:15.698 INFO:tasks.workunit.client.1.smithi153.stdout:2/906: dwrite d7/d19/d40/fac [0,4194304] 0 2024-09-12T01:43:15.698 INFO:tasks.workunit.client.1.smithi153.stdout:2/907: truncate d7/db/d1d/d1e/f26 1352201 0 2024-09-12T01:43:15.699 INFO:tasks.workunit.client.0.smithi066.stdout:4/565: dwrite d4/d6/d62/f65 [0,4194304] 0 2024-09-12T01:43:15.699 INFO:tasks.workunit.client.0.smithi066.stdout:4/566: stat d4/d6/d27/d2f/f91 0 2024-09-12T01:43:15.701 INFO:tasks.workunit.client.1.smithi153.stdout:2/908: creat d7/d19/d83/d101/da4/dca/f116 x:0 0 0 2024-09-12T01:43:15.702 INFO:tasks.workunit.client.1.smithi153.stdout:2/909: creat d7/db/d6c/d76/db8/de1/f117 x:0 0 0 2024-09-12T01:43:15.703 INFO:tasks.workunit.client.0.smithi066.stdout:4/567: truncate d4/d6/d27/d2f/f54 1370662 0 2024-09-12T01:43:15.703 INFO:tasks.workunit.client.0.smithi066.stdout:4/568: dread - d4/d6/d27/f98 zero size 2024-09-12T01:43:15.703 INFO:tasks.workunit.client.0.smithi066.stdout:4/569: fdatasync d4/d6/d8/d18/d45/f95 0 2024-09-12T01:43:15.705 INFO:tasks.workunit.client.0.smithi066.stdout:9/586: dread d0/d6/d17/d1b/da2/dae/f70 [0,4194304] 0 2024-09-12T01:43:15.709 INFO:tasks.workunit.client.0.smithi066.stdout:7/452: dwrite d2/d5/d6/d40/d63/f86 [0,4194304] 0 2024-09-12T01:43:15.709 INFO:tasks.workunit.client.1.smithi153.stdout:1/970: dwrite d2/d9/f1a [0,4194304] 0 2024-09-12T01:43:15.711 INFO:tasks.workunit.client.1.smithi153.stdout:7/918: rename d12/d21/d29/d35/d37/f124 to d12/d7e/f127 0 2024-09-12T01:43:15.712 INFO:tasks.workunit.client.1.smithi153.stdout:7/919: write d12/d21/d4d/dae/dc0/dc4/d101/f102 [905690,19562] 0 2024-09-12T01:43:15.712 INFO:tasks.workunit.client.1.smithi153.stdout:7/920: creat d12/d21/d29/d35/d37/d4c/f128 x:0 0 0 2024-09-12T01:43:15.713 INFO:tasks.workunit.client.1.smithi153.stdout:1/971: creat d2/d9/d17/d69/d95/f136 x:0 0 0 2024-09-12T01:43:15.715 INFO:tasks.workunit.client.1.smithi153.stdout:8/868: rename d17/d1f/d4f/d42/d79/d10e to d17/d1f/dcf/d106/d96/d6c/d89/d9c/d11d 0 2024-09-12T01:43:15.717 INFO:tasks.workunit.client.0.smithi066.stdout:7/453: symlink d2/d5/d6/d40/d63/l9a 0 2024-09-12T01:43:15.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/570: write d4/d6/d8/f43 [1456933,7168] 0 2024-09-12T01:43:15.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/571: readlink d4/d6/d27/d66/d6c/l6d 0 2024-09-12T01:43:15.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/572: creat d4/d6/d62/fb2 x:0 0 0 2024-09-12T01:43:15.719 INFO:tasks.workunit.client.1.smithi153.stdout:1/972: truncate d2/d9/d17/f46 387139 0 2024-09-12T01:43:15.720 INFO:tasks.workunit.client.0.smithi066.stdout:7/454: truncate d2/d5/d6/fe 562758 0 2024-09-12T01:43:15.722 INFO:tasks.workunit.client.0.smithi066.stdout:5/522: dwrite d0/d26/d2d/d31/f6a [0,4194304] 0 2024-09-12T01:43:15.722 INFO:tasks.workunit.client.1.smithi153.stdout:4/831: dwrite d6/d9/dc/d98/f3f [8388608,4194304] 0 2024-09-12T01:43:15.723 INFO:tasks.workunit.client.1.smithi153.stdout:2/910: rename d7/db/d6c/lfe to d7/db/d62/l118 0 2024-09-12T01:43:15.724 INFO:tasks.workunit.client.1.smithi153.stdout:8/869: creat d17/d1f/d4f/d34/db4/f11e x:0 0 0 2024-09-12T01:43:15.724 INFO:tasks.workunit.client.1.smithi153.stdout:8/870: dread - d17/d1f/dcf/d106/d96/d6c/d89/ded/f100 zero size 2024-09-12T01:43:15.725 INFO:tasks.workunit.client.1.smithi153.stdout:7/921: dread d12/d21/d4d/f59 [0,4194304] 0 2024-09-12T01:43:15.727 INFO:tasks.workunit.client.1.smithi153.stdout:1/973: unlink d2/d9/d17/f23 0 2024-09-12T01:43:15.730 INFO:tasks.workunit.client.1.smithi153.stdout:4/832: symlink d6/d15/l119 0 2024-09-12T01:43:15.732 INFO:tasks.workunit.client.1.smithi153.stdout:2/911: creat d7/db/d7c/f119 x:0 0 0 2024-09-12T01:43:15.733 INFO:tasks.workunit.client.0.smithi066.stdout:5/523: link d0/la d0/d26/d2d/d42/la1 0 2024-09-12T01:43:15.733 INFO:tasks.workunit.client.0.smithi066.stdout:5/524: write d0/d26/d2f/d9a/f9f [540100,103727] 0 2024-09-12T01:43:15.733 INFO:tasks.workunit.client.0.smithi066.stdout:5/525: chown d0/d26/d2d/d31/d77 250 1 2024-09-12T01:43:15.734 INFO:tasks.workunit.client.0.smithi066.stdout:7/455: rename d2/d5/d6/d22/d75/d25 to d2/d5/da/d3f/d9b 0 2024-09-12T01:43:15.735 INFO:tasks.workunit.client.1.smithi153.stdout:4/833: mknod d6/d6a/c11a 0 2024-09-12T01:43:15.736 INFO:tasks.workunit.client.1.smithi153.stdout:2/912: mknod d7/db/d6c/d76/db8/dcf/dae/c11a 0 2024-09-12T01:43:15.736 INFO:tasks.workunit.client.0.smithi066.stdout:5/526: mkdir d0/d26/d2d/d33/da2 0 2024-09-12T01:43:15.738 INFO:tasks.workunit.client.1.smithi153.stdout:8/871: link d17/d1d/f73 d17/d1f/d4f/d34/f11f 0 2024-09-12T01:43:15.738 INFO:tasks.workunit.client.1.smithi153.stdout:8/872: fdatasync d17/d1d/d27/f7e 0 2024-09-12T01:43:15.738 INFO:tasks.workunit.client.1.smithi153.stdout:8/873: write d17/d1f/d4f/d42/d79/dac/dd3/ff6 [4769407,47815] 0 2024-09-12T01:43:15.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/834: dread d6/d6a/fc5 [0,4194304] 0 2024-09-12T01:43:15.739 INFO:tasks.workunit.client.1.smithi153.stdout:4/835: fsync d6/d9/d11/d13/f118 0 2024-09-12T01:43:15.739 INFO:tasks.workunit.client.0.smithi066.stdout:5/527: symlink d0/d26/d2d/d42/la3 0 2024-09-12T01:43:15.739 INFO:tasks.workunit.client.0.smithi066.stdout:5/528: chown d0/d26/d2f/d9a 121 1 2024-09-12T01:43:15.739 INFO:tasks.workunit.client.0.smithi066.stdout:5/529: chown d0/d21/f91 3 1 2024-09-12T01:43:15.739 INFO:tasks.workunit.client.0.smithi066.stdout:5/530: truncate d0/d26/d2f/d3b/d6b/f8a 1032954 0 2024-09-12T01:43:15.740 INFO:tasks.workunit.client.0.smithi066.stdout:5/531: chown d0/dd/d18/d36/d4c 1011 1 2024-09-12T01:43:15.740 INFO:tasks.workunit.client.0.smithi066.stdout:5/532: chown d0/d26/d2d/d42/l6c 1005246 1 2024-09-12T01:43:15.740 INFO:tasks.workunit.client.0.smithi066.stdout:5/533: chown d0/l3 6970 1 2024-09-12T01:43:15.740 INFO:tasks.workunit.client.1.smithi153.stdout:8/874: unlink d17/d1f/d4f/d34/lba 0 2024-09-12T01:43:15.740 INFO:tasks.workunit.client.1.smithi153.stdout:8/875: stat d17/d1d/c25 0 2024-09-12T01:43:15.741 INFO:tasks.workunit.client.0.smithi066.stdout:5/534: unlink d0/d26/d2d/d42/l6c 0 2024-09-12T01:43:15.742 INFO:tasks.workunit.client.0.smithi066.stdout:4/573: dread d4/d15/d33/f5d [0,4194304] 0 2024-09-12T01:43:15.744 INFO:tasks.workunit.client.0.smithi066.stdout:5/535: mkdir d0/d26/d2f/da4 0 2024-09-12T01:43:15.745 INFO:tasks.workunit.client.0.smithi066.stdout:5/536: truncate d0/d26/d2d/d33/d55/d82/f28 191620 0 2024-09-12T01:43:15.746 INFO:tasks.workunit.client.1.smithi153.stdout:8/876: creat d17/d1f/dcf/d106/d95/dd6/ddb/f120 x:0 0 0 2024-09-12T01:43:15.748 INFO:tasks.workunit.client.1.smithi153.stdout:8/877: symlink d17/d1f/d4f/d42/d79/dd4/l121 0 2024-09-12T01:43:15.750 INFO:tasks.workunit.client.0.smithi066.stdout:5/537: dread d0/d26/f2e [0,4194304] 0 2024-09-12T01:43:15.750 INFO:tasks.workunit.client.1.smithi153.stdout:8/878: rename d17/d1f/dcf/ff2 to d17/d1f/d4f/d42/f122 0 2024-09-12T01:43:15.750 INFO:tasks.workunit.client.1.smithi153.stdout:8/879: write d17/d1f/d4f/d42/fdd [1096984,26238] 0 2024-09-12T01:43:15.751 INFO:tasks.workunit.client.1.smithi153.stdout:7/922: dread d12/d21/d29/d35/d95/fcd [0,4194304] 0 2024-09-12T01:43:15.751 INFO:tasks.workunit.client.0.smithi066.stdout:5/538: mkdir d0/d26/d2f/da5 0 2024-09-12T01:43:15.752 INFO:tasks.workunit.client.1.smithi153.stdout:7/923: unlink d12/d21/d29/d35/d37/d4c/fc2 0 2024-09-12T01:43:15.754 INFO:tasks.workunit.client.0.smithi066.stdout:5/539: creat d0/dd/fa6 x:0 0 0 2024-09-12T01:43:15.784 INFO:tasks.workunit.client.1.smithi153.stdout:7/924: dwrite d12/d21/d29/d35/f7c [0,4194304] 0 2024-09-12T01:43:15.784 INFO:tasks.workunit.client.1.smithi153.stdout:7/925: chown d12/d21/d29/d35/d37/d4c/f128 65860128 1 2024-09-12T01:43:15.784 INFO:tasks.workunit.client.1.smithi153.stdout:7/926: chown d12/d21/d29/ff7 260044840 1 2024-09-12T01:43:15.790 INFO:tasks.workunit.client.1.smithi153.stdout:1/974: dwrite d2/d34/f12b [0,4194304] 0 2024-09-12T01:43:15.790 INFO:tasks.workunit.client.0.smithi066.stdout:9/587: dwrite d0/d6/d17/f4d [4194304,4194304] 0 2024-09-12T01:43:15.790 INFO:tasks.workunit.client.0.smithi066.stdout:9/588: write d0/d6/d17/d1b/d4c/d42/fa1 [813972,111086] 0 2024-09-12T01:43:15.804 INFO:tasks.workunit.client.1.smithi153.stdout:1/975: rmdir d2/d9/d17 39 2024-09-12T01:43:15.805 INFO:tasks.workunit.client.1.smithi153.stdout:1/976: chown d2/d34/d3d/lb9 568571398 1 2024-09-12T01:43:15.805 INFO:tasks.workunit.client.1.smithi153.stdout:1/977: chown d2/d9/d17/dab/c11a 1 1 2024-09-12T01:43:15.822 INFO:tasks.workunit.client.0.smithi066.stdout:7/456: dwrite d2/d5/d6/d40/d63/f86 [0,4194304] 0 2024-09-12T01:43:15.827 INFO:tasks.workunit.client.0.smithi066.stdout:7/457: link d2/d41/c83 d2/d5/c9c 0 2024-09-12T01:43:15.828 INFO:tasks.workunit.client.0.smithi066.stdout:7/458: unlink d2/d5/d6/d22/d75/d1d/d6c/d80/f62 0 2024-09-12T01:43:15.829 INFO:tasks.workunit.client.0.smithi066.stdout:7/459: stat d2/d5/d6/d22/c91 0 2024-09-12T01:43:15.830 INFO:tasks.workunit.client.0.smithi066.stdout:7/460: creat d2/d5/d6/d22/d75/d1d/d6c/f9d x:0 0 0 2024-09-12T01:43:15.830 INFO:tasks.workunit.client.0.smithi066.stdout:7/461: readlink d2/d5/d6/l44 0 2024-09-12T01:43:15.830 INFO:tasks.workunit.client.1.smithi153.stdout:4/836: dwrite d6/d15/f4c [0,4194304] 0 2024-09-12T01:43:15.830 INFO:tasks.workunit.client.1.smithi153.stdout:2/913: dwrite d7/db/d1d/d1e/d6d/ffd [0,4194304] 0 2024-09-12T01:43:15.831 INFO:tasks.workunit.client.0.smithi066.stdout:9/589: dwrite d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:15.831 INFO:tasks.workunit.client.0.smithi066.stdout:7/462: link d2/d41/d53/l6b d2/d5/d6/d40/d51/l9e 0 2024-09-12T01:43:15.831 INFO:tasks.workunit.client.0.smithi066.stdout:5/540: dwrite d0/d26/f86 [0,4194304] 0 2024-09-12T01:43:15.832 INFO:tasks.workunit.client.1.smithi153.stdout:8/880: dwrite d17/d1f/d4f/d42/d79/f98 [0,4194304] 0 2024-09-12T01:43:15.833 INFO:tasks.workunit.client.0.smithi066.stdout:9/590: mkdir d0/d6/d7f/dd2 0 2024-09-12T01:43:15.835 INFO:tasks.workunit.client.0.smithi066.stdout:7/463: creat d2/d5/d6/d22/d75/d1d/d70/f9f x:0 0 0 2024-09-12T01:43:15.838 INFO:tasks.workunit.client.1.smithi153.stdout:1/978: dread d2/d9/d1d/f30 [0,4194304] 0 2024-09-12T01:43:15.838 INFO:tasks.workunit.client.1.smithi153.stdout:2/914: creat d7/db/d27/d10e/f11b x:0 0 0 2024-09-12T01:43:15.842 INFO:tasks.workunit.client.0.smithi066.stdout:5/541: rename d0/d21/l5f to d0/d26/d2d/la7 0 2024-09-12T01:43:15.842 INFO:tasks.workunit.client.0.smithi066.stdout:1/551: sync 2024-09-12T01:43:15.844 INFO:tasks.workunit.client.0.smithi066.stdout:9/591: symlink d0/d6/d17/d1b/da2/ld3 0 2024-09-12T01:43:15.845 INFO:tasks.workunit.client.0.smithi066.stdout:7/464: getdents d2/d41 0 2024-09-12T01:43:15.847 INFO:tasks.workunit.client.0.smithi066.stdout:5/542: mkdir d0/d26/d2f/d30/da8 0 2024-09-12T01:43:15.848 INFO:tasks.workunit.client.1.smithi153.stdout:4/837: rmdir d6/d9/dc/d31/d7d/d94/df7 39 2024-09-12T01:43:15.849 INFO:tasks.workunit.client.0.smithi066.stdout:1/552: rmdir d5/dc/d36/d4b 39 2024-09-12T01:43:15.851 INFO:tasks.workunit.client.0.smithi066.stdout:9/592: mkdir d0/d6/d17/d4f/d12/d84/dd4 0 2024-09-12T01:43:15.851 INFO:tasks.workunit.client.0.smithi066.stdout:9/593: write d0/d6/d17/d28/f77 [248918,95869] 0 2024-09-12T01:43:15.851 INFO:tasks.workunit.client.0.smithi066.stdout:9/594: dread - d0/d6/d17/f74 zero size 2024-09-12T01:43:15.851 INFO:tasks.workunit.client.0.smithi066.stdout:9/595: write d0/d6/d17/d4f/d12/d84/fac [668467,124776] 0 2024-09-12T01:43:15.852 INFO:tasks.workunit.client.1.smithi153.stdout:1/979: symlink d2/d9/d17/d100/d116/l137 0 2024-09-12T01:43:15.853 INFO:tasks.workunit.client.0.smithi066.stdout:5/543: getdents d0/d26/d2d/d33 0 2024-09-12T01:43:15.853 INFO:tasks.workunit.client.0.smithi066.stdout:5/544: creat d0/d26/d2f/d3b/fa9 x:0 0 0 2024-09-12T01:43:15.857 INFO:tasks.workunit.client.0.smithi066.stdout:1/553: rename d5/dc/d4f/f69 to d5/d52/d5d/fa0 0 2024-09-12T01:43:15.857 INFO:tasks.workunit.client.0.smithi066.stdout:1/554: chown d5/dc/d36/d57/l71 2 1 2024-09-12T01:43:15.859 INFO:tasks.workunit.client.0.smithi066.stdout:9/596: mknod d0/d6/d17/d4f/d12/cd5 0 2024-09-12T01:43:15.862 INFO:tasks.workunit.client.1.smithi153.stdout:2/915: unlink d7/db/d27/lad 0 2024-09-12T01:43:15.863 INFO:tasks.workunit.client.0.smithi066.stdout:5/545: mknod d0/d26/d2f/d30/da8/caa 0 2024-09-12T01:43:15.864 INFO:tasks.workunit.client.0.smithi066.stdout:3/623: sync 2024-09-12T01:43:15.864 INFO:tasks.workunit.client.0.smithi066.stdout:3/624: write d5/d6/d1b/d45/d66/d67/d6d/dc7/d86/f9a [60001,49974] 0 2024-09-12T01:43:15.864 INFO:tasks.workunit.client.1.smithi153.stdout:4/838: creat d6/d9/d11/d13/dce/f11b x:0 0 0 2024-09-12T01:43:15.865 INFO:tasks.workunit.client.0.smithi066.stdout:1/555: mkdir d5/d15/d58/da1 0 2024-09-12T01:43:15.866 INFO:tasks.workunit.client.1.smithi153.stdout:1/980: truncate d2/d9/d17/d2f/d56/d97/fda 2546428 0 2024-09-12T01:43:15.867 INFO:tasks.workunit.client.0.smithi066.stdout:9/597: unlink d0/d6/d17/d4f/d12/c48 0 2024-09-12T01:43:15.869 INFO:tasks.workunit.client.1.smithi153.stdout:2/916: creat d7/f11c x:0 0 0 2024-09-12T01:43:15.869 INFO:tasks.workunit.client.1.smithi153.stdout:2/917: write d7/f11c [638875,47505] 0 2024-09-12T01:43:15.869 INFO:tasks.workunit.client.1.smithi153.stdout:2/918: stat d7/db/d62/d87 0 2024-09-12T01:43:15.871 INFO:tasks.workunit.client.0.smithi066.stdout:5/546: rename d0/dd/fa6 to d0/d26/d2f/d30/da8/fab 0 2024-09-12T01:43:15.872 INFO:tasks.workunit.client.0.smithi066.stdout:6/598: sync 2024-09-12T01:43:15.872 INFO:tasks.workunit.client.0.smithi066.stdout:0/652: sync 2024-09-12T01:43:15.872 INFO:tasks.workunit.client.0.smithi066.stdout:2/522: sync 2024-09-12T01:43:15.872 INFO:tasks.workunit.client.0.smithi066.stdout:8/622: sync 2024-09-12T01:43:15.872 INFO:tasks.workunit.client.0.smithi066.stdout:2/523: creat de/d13/d1e/d22/d4f/fb4 x:0 0 0 2024-09-12T01:43:15.873 INFO:tasks.workunit.client.0.smithi066.stdout:2/524: read de/d13/d1e/d25/f2b [643920,105978] 0 2024-09-12T01:43:15.873 INFO:tasks.workunit.client.0.smithi066.stdout:2/525: chown de/d13/d28/d3d/f3f 0 1 2024-09-12T01:43:15.873 INFO:tasks.workunit.client.1.smithi153.stdout:1/981: rename d2/d9/c26 to d2/d9/d58/c138 0 2024-09-12T01:43:15.875 INFO:tasks.workunit.client.0.smithi066.stdout:3/625: mknod d5/d35/cdb 0 2024-09-12T01:43:15.875 INFO:tasks.workunit.client.0.smithi066.stdout:3/626: chown d5/d6/d1b/f88 1010919 1 2024-09-12T01:43:15.878 INFO:tasks.workunit.client.0.smithi066.stdout:1/556: mkdir d5/dc/d53/d9b/da2 0 2024-09-12T01:43:15.879 INFO:tasks.workunit.client.1.smithi153.stdout:8/881: dwrite d17/d1d/fa2 [0,4194304] 0 2024-09-12T01:43:15.880 INFO:tasks.workunit.client.0.smithi066.stdout:9/598: dread d0/d6/d17/d1b/d4c/d42/f5a [0,4194304] 0 2024-09-12T01:43:15.881 INFO:tasks.workunit.client.1.smithi153.stdout:1/982: symlink d2/d68/d6b/l139 0 2024-09-12T01:43:15.881 INFO:tasks.workunit.client.1.smithi153.stdout:1/983: fdatasync d2/d68/d6b/f125 0 2024-09-12T01:43:15.881 INFO:tasks.workunit.client.1.smithi153.stdout:1/984: dread - d2/d68/d6b/f125 zero size 2024-09-12T01:43:15.883 INFO:tasks.workunit.client.0.smithi066.stdout:6/599: rename d2/d99/d72/d87/lb9 to d2/d99/d12/d1d/d6b/dc6/lc9 0 2024-09-12T01:43:15.883 INFO:tasks.workunit.client.0.smithi066.stdout:6/600: readlink d2/d99/d12/d1d/d6b/dc6/lc8 0 2024-09-12T01:43:15.887 INFO:tasks.workunit.client.1.smithi153.stdout:2/919: getdents d7/db/d36 0 2024-09-12T01:43:15.887 INFO:tasks.workunit.client.1.smithi153.stdout:1/985: creat d2/dd7/f13a x:0 0 0 2024-09-12T01:43:15.888 INFO:tasks.workunit.client.0.smithi066.stdout:2/526: mknod de/d13/d1e/d92/cb5 0 2024-09-12T01:43:15.892 INFO:tasks.workunit.client.0.smithi066.stdout:3/627: dread f4 [0,4194304] 0 2024-09-12T01:43:15.892 INFO:tasks.workunit.client.0.smithi066.stdout:3/628: readlink d5/d6/d1b/d45/d85/l98 0 2024-09-12T01:43:15.893 INFO:tasks.workunit.client.0.smithi066.stdout:2/527: unlink de/d13/d1e/d22/d4f/cae 0 2024-09-12T01:43:15.893 INFO:tasks.workunit.client.0.smithi066.stdout:2/528: write de/d13/d28/f91 [893914,127034] 0 2024-09-12T01:43:15.894 INFO:tasks.workunit.client.0.smithi066.stdout:3/629: getdents d5/d6/d1b/d77/d8b 0 2024-09-12T01:43:15.894 INFO:tasks.workunit.client.1.smithi153.stdout:2/920: getdents d7/db/d6c/d9f 0 2024-09-12T01:43:15.894 INFO:tasks.workunit.client.1.smithi153.stdout:2/921: read - d7/db/d62/f105 zero size 2024-09-12T01:43:15.894 INFO:tasks.workunit.client.0.smithi066.stdout:3/630: mkdir d5/d6/d1b/d45/d66/dae/ddc 0 2024-09-12T01:43:15.895 INFO:tasks.workunit.client.0.smithi066.stdout:3/631: fdatasync d5/d6/d1b/d45/d66/fd8 0 2024-09-12T01:43:15.906 INFO:tasks.workunit.client.0.smithi066.stdout:5/547: dwrite d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:15.906 INFO:tasks.workunit.client.0.smithi066.stdout:5/548: read d0/d26/d2d/d33/d55/d73/f9c [684535,16746] 0 2024-09-12T01:43:15.920 INFO:tasks.workunit.client.1.smithi153.stdout:2/922: dread d7/db/d1d/d1e/f26 [0,4194304] 0 2024-09-12T01:43:15.920 INFO:tasks.workunit.client.1.smithi153.stdout:2/923: read d7/db/d27/f7d [532493,20450] 0 2024-09-12T01:43:15.920 INFO:tasks.workunit.client.1.smithi153.stdout:2/924: fsync d7/db/d27/f73 0 2024-09-12T01:43:15.921 INFO:tasks.workunit.client.0.smithi066.stdout:2/529: dread de/f21 [0,4194304] 0 2024-09-12T01:43:15.921 INFO:tasks.workunit.client.1.smithi153.stdout:2/925: symlink d7/db/d62/d87/l11d 0 2024-09-12T01:43:15.922 INFO:tasks.workunit.client.0.smithi066.stdout:2/530: mkdir de/d13/d1e/d22/db6 0 2024-09-12T01:43:15.923 INFO:tasks.workunit.client.0.smithi066.stdout:2/531: rmdir de/d13/d28/d3d/daf 0 2024-09-12T01:43:15.923 INFO:tasks.workunit.client.0.smithi066.stdout:2/532: chown de/d13/d28/d3d/l68 292907 1 2024-09-12T01:43:15.924 INFO:tasks.workunit.client.0.smithi066.stdout:2/533: link de/d13/d28/f56 de/d13/d1e/d22/db6/fb7 0 2024-09-12T01:43:15.925 INFO:tasks.workunit.client.0.smithi066.stdout:2/534: creat de/d13/d1e/d41/d81/fb8 x:0 0 0 2024-09-12T01:43:15.926 INFO:tasks.workunit.client.1.smithi153.stdout:8/882: dwrite d17/d1f/d4f/d34/f11f [0,4194304] 0 2024-09-12T01:43:15.930 INFO:tasks.workunit.client.0.smithi066.stdout:8/623: dwrite d12/d21/d2f/d57/f3b [0,4194304] 0 2024-09-12T01:43:15.930 INFO:tasks.workunit.client.0.smithi066.stdout:5/549: dwrite d0/d26/d2d/d33/f4f [0,4194304] 0 2024-09-12T01:43:15.931 INFO:tasks.workunit.client.0.smithi066.stdout:5/550: readlink d0/dd/d18/l2a 0 2024-09-12T01:43:15.933 INFO:tasks.workunit.client.1.smithi153.stdout:4/839: dwrite d6/d15/db4/fea [0,4194304] 0 2024-09-12T01:43:15.935 INFO:tasks.workunit.client.0.smithi066.stdout:8/624: symlink d12/d21/d2f/d57/d43/d82/dbb/lcc 0 2024-09-12T01:43:15.936 INFO:tasks.workunit.client.0.smithi066.stdout:3/632: dread d5/f8a [0,4194304] 0 2024-09-12T01:43:15.936 INFO:tasks.workunit.client.0.smithi066.stdout:7/465: dwrite d2/d5/da/f11 [4194304,4194304] 0 2024-09-12T01:43:15.936 INFO:tasks.workunit.client.0.smithi066.stdout:7/466: fsync d2/d5/da/f36 0 2024-09-12T01:43:15.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/625: symlink d12/lcd 0 2024-09-12T01:43:15.940 INFO:tasks.workunit.client.0.smithi066.stdout:5/551: link d0/d26/d2d/d33/d55/d73/d74/f93 d0/dd/d18/fac 0 2024-09-12T01:43:15.944 INFO:tasks.workunit.client.0.smithi066.stdout:3/633: mknod d5/d6/d1b/d77/cdd 0 2024-09-12T01:43:15.946 INFO:tasks.workunit.client.0.smithi066.stdout:7/467: mknod d2/d5/d6/d22/d75/d1d/d70/ca0 0 2024-09-12T01:43:15.947 INFO:tasks.workunit.client.0.smithi066.stdout:8/626: truncate d12/d21/d2f/d57/d3c/f6d 3601996 0 2024-09-12T01:43:15.948 INFO:tasks.workunit.client.0.smithi066.stdout:8/627: chown d12/d21/d2f/d57/d84/d89/fa4 24487591 1 2024-09-12T01:43:15.949 INFO:tasks.workunit.client.0.smithi066.stdout:3/634: mknod d5/d6/d48/cde 0 2024-09-12T01:43:15.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/468: getdents d2/d5/d6/d40/d51 0 2024-09-12T01:43:15.963 INFO:tasks.workunit.client.1.smithi153.stdout:2/926: dwrite d7/d19/d83/d101/f3c [0,4194304] 0 2024-09-12T01:43:15.963 INFO:tasks.workunit.client.1.smithi153.stdout:2/927: fsync d7/f11c 0 2024-09-12T01:43:15.963 INFO:tasks.workunit.client.1.smithi153.stdout:2/928: fsync d7/db/d7c/f119 0 2024-09-12T01:43:15.964 INFO:tasks.workunit.client.1.smithi153.stdout:2/929: fdatasync f1 0 2024-09-12T01:43:15.971 INFO:tasks.workunit.client.1.smithi153.stdout:8/883: dwrite d17/d1f/d4f/f57 [4194304,4194304] 0 2024-09-12T01:43:15.971 INFO:tasks.workunit.client.1.smithi153.stdout:4/840: dwrite d6/d9/dc/d31/f24 [4194304,4194304] 0 2024-09-12T01:43:15.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/841: creat d6/d6a/df9/f11c x:0 0 0 2024-09-12T01:43:15.974 INFO:tasks.workunit.client.1.smithi153.stdout:4/842: write d6/d9/dc/d98/d3e/d66/f102 [1046434,74501] 0 2024-09-12T01:43:15.975 INFO:tasks.workunit.client.1.smithi153.stdout:7/927: sync 2024-09-12T01:43:15.977 INFO:tasks.workunit.client.0.smithi066.stdout:5/552: write d0/d26/d2f/d3b/d98/f99 [351157,19122] 0 2024-09-12T01:43:15.981 INFO:tasks.workunit.client.1.smithi153.stdout:4/843: dread d6/d9/dc/ff1 [0,4194304] 0 2024-09-12T01:43:15.981 INFO:tasks.workunit.client.1.smithi153.stdout:4/844: fsync d6/d9/d11/d13/dce/dd7/fe9 0 2024-09-12T01:43:15.981 INFO:tasks.workunit.client.1.smithi153.stdout:7/928: getdents d12/d21/d5f 0 2024-09-12T01:43:15.981 INFO:tasks.workunit.client.1.smithi153.stdout:7/929: readlink d12/l52 0 2024-09-12T01:43:15.982 INFO:tasks.workunit.client.1.smithi153.stdout:8/884: read d17/fec [2091341,108665] 0 2024-09-12T01:43:15.985 INFO:tasks.workunit.client.1.smithi153.stdout:8/885: creat d17/d1f/dcf/d106/f123 x:0 0 0 2024-09-12T01:43:15.985 INFO:tasks.workunit.client.0.smithi066.stdout:3/635: dwrite d5/d6/d1b/d65/d89/fd6 [0,4194304] 0 2024-09-12T01:43:15.986 INFO:tasks.workunit.client.0.smithi066.stdout:7/469: dwrite d2/d5/d6/d22/d75/d1d/d6c/d80/f58 [0,4194304] 0 2024-09-12T01:43:15.986 INFO:tasks.workunit.client.0.smithi066.stdout:7/470: stat d2/d5/d6/d22/d75/c2d 0 2024-09-12T01:43:15.986 INFO:tasks.workunit.client.0.smithi066.stdout:7/471: creat d2/d5/d6/d40/d63/fa1 x:0 0 0 2024-09-12T01:43:15.987 INFO:tasks.workunit.client.1.smithi153.stdout:7/930: getdents d12/d21/d29/d35/d37/d58 0 2024-09-12T01:43:15.987 INFO:tasks.workunit.client.1.smithi153.stdout:7/931: read d12/d21/d29/d2d/da6/fcf [1092871,25949] 0 2024-09-12T01:43:15.989 INFO:tasks.workunit.client.1.smithi153.stdout:7/932: link d12/d21/d29/d35/d37/d4c/d5c/lab d12/d21/d4d/ddc/l129 0 2024-09-12T01:43:15.990 INFO:tasks.workunit.client.0.smithi066.stdout:3/636: creat d5/d6/d48/fdf x:0 0 0 2024-09-12T01:43:15.992 INFO:tasks.workunit.client.0.smithi066.stdout:7/472: link d2/d5/d6/d22/d75/d1d/f61 d2/d5/d6/d81/fa2 0 2024-09-12T01:43:15.993 INFO:tasks.workunit.client.0.smithi066.stdout:3/637: rename d5/d6/d1b/d65/d89/f81 to d5/d6/d1b/d45/d85/dd2/fe0 0 2024-09-12T01:43:15.995 INFO:tasks.workunit.client.0.smithi066.stdout:7/473: unlink d2/d5/d6/d22/d75/d1d/d70/ca0 0 2024-09-12T01:43:15.995 INFO:tasks.workunit.client.0.smithi066.stdout:3/638: symlink d5/d6/d1b/d77/dd5/le1 0 2024-09-12T01:43:15.998 INFO:tasks.workunit.client.0.smithi066.stdout:7/474: rename d2/d5/d6/d22/d75/c2d to d2/d5/d6/ca3 0 2024-09-12T01:43:15.998 INFO:tasks.workunit.client.0.smithi066.stdout:7/475: write d2/d41/d53/f85 [811632,43674] 0 2024-09-12T01:43:15.998 INFO:tasks.workunit.client.0.smithi066.stdout:7/476: chown d2/d41/c83 71 1 2024-09-12T01:43:15.998 INFO:tasks.workunit.client.0.smithi066.stdout:3/639: creat d5/d6/d1b/d45/d66/d5c/fe2 x:0 0 0 2024-09-12T01:43:15.998 INFO:tasks.workunit.client.0.smithi066.stdout:3/640: write d5/d6/d1b/d45/d66/f3b [606856,85410] 0 2024-09-12T01:43:15.999 INFO:tasks.workunit.client.1.smithi153.stdout:4/845: write d6/d15/f4c [911741,37015] 0 2024-09-12T01:43:15.999 INFO:tasks.workunit.client.1.smithi153.stdout:4/846: truncate d6/d9/dc/d31/d7d/d94/df7/ffc 464835 0 2024-09-12T01:43:16.000 INFO:tasks.workunit.client.1.smithi153.stdout:8/886: dread d17/d1f/d4f/d42/f86 [0,4194304] 0 2024-09-12T01:43:16.001 INFO:tasks.workunit.client.1.smithi153.stdout:2/930: dwrite d7/db/d1d/f5d [0,4194304] 0 2024-09-12T01:43:16.001 INFO:tasks.workunit.client.1.smithi153.stdout:4/847: rename d6/d9/dc/d98/f88 to d6/d6a/df9/f11d 0 2024-09-12T01:43:16.001 INFO:tasks.workunit.client.0.smithi066.stdout:9/599: dwrite d0/d6/d17/d1b/f76 [0,4194304] 0 2024-09-12T01:43:16.006 INFO:tasks.workunit.client.1.smithi153.stdout:8/887: creat d17/d1d/d27/df1/f124 x:0 0 0 2024-09-12T01:43:16.007 INFO:tasks.workunit.client.1.smithi153.stdout:2/931: creat d7/db/d27/d56/f11e x:0 0 0 2024-09-12T01:43:16.008 INFO:tasks.workunit.client.0.smithi066.stdout:5/553: dwrite d0/dd/d18/f3d [0,4194304] 0 2024-09-12T01:43:16.009 INFO:tasks.workunit.client.1.smithi153.stdout:4/848: rename d6/d15/db4/fc0 to d6/d9/d11/d90/db7/df3/d10f/f11e 0 2024-09-12T01:43:16.011 INFO:tasks.workunit.client.1.smithi153.stdout:2/932: mknod d7/db/d6c/d76/db8/dcf/dae/c11f 0 2024-09-12T01:43:16.015 INFO:tasks.workunit.client.1.smithi153.stdout:2/933: rename d7/d19/d40/c54 to d7/db/d1d/d1e/c120 0 2024-09-12T01:43:16.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/888: write d17/d1d/f73 [3630712,121439] 0 2024-09-12T01:43:16.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/889: chown d17/d1f/dcf/d106/d96/l49 1939 1 2024-09-12T01:43:16.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/890: creat d17/d1f/dcf/d106/d96/d6c/d6e/d7f/f125 x:0 0 0 2024-09-12T01:43:16.018 INFO:tasks.workunit.client.1.smithi153.stdout:8/891: write d17/fec [3122167,22261] 0 2024-09-12T01:43:16.018 INFO:tasks.workunit.client.1.smithi153.stdout:4/849: dread d6/d15/db4/fea [0,4194304] 0 2024-09-12T01:43:16.018 INFO:tasks.workunit.client.1.smithi153.stdout:2/934: mkdir d7/d4d/d121 0 2024-09-12T01:43:16.020 INFO:tasks.workunit.client.1.smithi153.stdout:8/892: rmdir d17/d1f/d4f/d42/d79/dac/dd3 39 2024-09-12T01:43:16.022 INFO:tasks.workunit.client.0.smithi066.stdout:5/554: write d0/d26/d2f/d30/f65 [2921491,126259] 0 2024-09-12T01:43:16.022 INFO:tasks.workunit.client.1.smithi153.stdout:2/935: mkdir d7/db/d6c/d76/db8/dcf/dae/d122 0 2024-09-12T01:43:16.022 INFO:tasks.workunit.client.1.smithi153.stdout:7/933: dwrite d12/d21/d29/d35/d37/d4c/d8e/fd3 [0,4194304] 0 2024-09-12T01:43:16.023 INFO:tasks.workunit.client.0.smithi066.stdout:3/641: dwrite d5/d6/d1b/d65/f7e [0,4194304] 0 2024-09-12T01:43:16.024 INFO:tasks.workunit.client.1.smithi153.stdout:8/893: mkdir d17/d75/d126 0 2024-09-12T01:43:16.029 INFO:tasks.workunit.client.1.smithi153.stdout:2/936: mkdir d7/db/d27/d56/da3/d123 0 2024-09-12T01:43:16.029 INFO:tasks.workunit.client.1.smithi153.stdout:2/937: fsync d7/db/d27/d56/f5b 0 2024-09-12T01:43:16.029 INFO:tasks.workunit.client.1.smithi153.stdout:2/938: creat d7/db/f124 x:0 0 0 2024-09-12T01:43:16.030 INFO:tasks.workunit.client.0.smithi066.stdout:5/555: stat d0/d26/d2d/d42/la1 0 2024-09-12T01:43:16.030 INFO:tasks.workunit.client.0.smithi066.stdout:5/556: truncate d0/d26/d2d/d33/d55/d73/f9c 1143306 0 2024-09-12T01:43:16.030 INFO:tasks.workunit.client.0.smithi066.stdout:5/557: write d0/dd/f6d [671939,48435] 0 2024-09-12T01:43:16.030 INFO:tasks.workunit.client.0.smithi066.stdout:5/558: readlink d0/d26/d2d/d31/d77/l78 0 2024-09-12T01:43:16.034 INFO:tasks.workunit.client.0.smithi066.stdout:7/477: rename d2/d5/d6/d22/d75/d1d to d2/d5/da/d3f/da4 0 2024-09-12T01:43:16.036 INFO:tasks.workunit.client.0.smithi066.stdout:5/559: mkdir d0/d26/d2f/d9a/dad 0 2024-09-12T01:43:16.038 INFO:tasks.workunit.client.0.smithi066.stdout:7/478: creat d2/d5/d6/d40/fa5 x:0 0 0 2024-09-12T01:43:16.038 INFO:tasks.workunit.client.0.smithi066.stdout:7/479: readlink d2/d5/d6/d22/d75/d2f/l64 0 2024-09-12T01:43:16.041 INFO:tasks.workunit.client.1.smithi153.stdout:8/894: truncate d17/d21/faf 313445 0 2024-09-12T01:43:16.046 INFO:tasks.workunit.client.1.smithi153.stdout:2/939: dread d7/db/d62/d87/fb9 [0,4194304] 0 2024-09-12T01:43:16.047 INFO:tasks.workunit.client.0.smithi066.stdout:3/642: dwrite d5/d6/d48/d9c/fd3 [0,4194304] 0 2024-09-12T01:43:16.051 INFO:tasks.workunit.client.1.smithi153.stdout:7/934: mknod d12/d21/d29/d2d/d8b/d116/c12a 0 2024-09-12T01:43:16.053 INFO:tasks.workunit.client.1.smithi153.stdout:8/895: rmdir d17/d1f/dcf/d106/ddf/de3 39 2024-09-12T01:43:16.053 INFO:tasks.workunit.client.1.smithi153.stdout:8/896: write d17/d21/f88 [1639634,102063] 0 2024-09-12T01:43:16.056 INFO:tasks.workunit.client.1.smithi153.stdout:8/897: link d17/d1d/f73 d17/d1f/dcf/d106/d95/dd6/f127 0 2024-09-12T01:43:16.060 INFO:tasks.workunit.client.1.smithi153.stdout:7/935: link d12/d21/d29/d35/d37/d4c/d5c/f70 d12/d21/d29/d35/f12b 0 2024-09-12T01:43:16.060 INFO:tasks.workunit.client.1.smithi153.stdout:7/936: truncate d12/d21/d29/d35/f118 4776289 0 2024-09-12T01:43:16.060 INFO:tasks.workunit.client.1.smithi153.stdout:7/937: read - d12/d4e/f86 zero size 2024-09-12T01:43:16.060 INFO:tasks.workunit.client.1.smithi153.stdout:8/898: unlink d17/d1f/f2a 0 2024-09-12T01:43:16.062 INFO:tasks.workunit.client.1.smithi153.stdout:7/938: symlink d12/d21/d29/d35/dcb/de9/d120/l12c 0 2024-09-12T01:43:16.063 INFO:tasks.workunit.client.1.smithi153.stdout:8/899: mkdir d17/d1f/d4f/d42/d79/dac/dce/ddc/d128 0 2024-09-12T01:43:16.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/900: symlink d17/d1f/dcf/d106/d96/d6c/d6e/d7f/l129 0 2024-09-12T01:43:16.065 INFO:tasks.workunit.client.1.smithi153.stdout:8/901: write d17/fc7 [5035809,49638] 0 2024-09-12T01:43:16.068 INFO:tasks.workunit.client.1.smithi153.stdout:8/902: creat d17/d1f/d4f/d42/d79/f12a x:0 0 0 2024-09-12T01:43:16.069 INFO:tasks.workunit.client.1.smithi153.stdout:8/903: mknod d17/d1f/dcf/d106/d96/d6c/d6e/c12b 0 2024-09-12T01:43:16.070 INFO:tasks.workunit.client.1.smithi153.stdout:1/986: sync 2024-09-12T01:43:16.071 INFO:tasks.workunit.client.0.smithi066.stdout:5/560: dwrite d0/dd/d18/d36/f67 [0,4194304] 0 2024-09-12T01:43:16.071 INFO:tasks.workunit.client.0.smithi066.stdout:7/480: dwrite d2/d5/da/d3f/f57 [0,4194304] 0 2024-09-12T01:43:16.072 INFO:tasks.workunit.client.1.smithi153.stdout:1/987: rmdir d2/d9/d17/dab 39 2024-09-12T01:43:16.072 INFO:tasks.workunit.client.1.smithi153.stdout:1/988: fsync d2/d9/d17/d2f/d56/d71/f7a 0 2024-09-12T01:43:16.074 INFO:tasks.workunit.client.1.smithi153.stdout:1/989: creat d2/d9/d1d/d25/d108/f13b x:0 0 0 2024-09-12T01:43:16.076 INFO:tasks.workunit.client.0.smithi066.stdout:5/561: link d0/d26/f86 d0/d26/d2f/d3b/d98/fae 0 2024-09-12T01:43:16.076 INFO:tasks.workunit.client.0.smithi066.stdout:5/562: fdatasync d0/d26/d2d/d33/d55/d73/f8f 0 2024-09-12T01:43:16.076 INFO:tasks.workunit.client.0.smithi066.stdout:5/563: fsync d0/d26/d2d/f49 0 2024-09-12T01:43:16.076 INFO:tasks.workunit.client.0.smithi066.stdout:5/564: creat d0/d26/faf x:0 0 0 2024-09-12T01:43:16.077 INFO:tasks.workunit.client.0.smithi066.stdout:7/481: mknod d2/d41/ca6 0 2024-09-12T01:43:16.079 INFO:tasks.workunit.client.0.smithi066.stdout:5/565: truncate d0/dd/d18/f7c 1765047 0 2024-09-12T01:43:16.079 INFO:tasks.workunit.client.1.smithi153.stdout:2/940: dwrite d7/db/d27/d56/f9a [0,4194304] 0 2024-09-12T01:43:16.081 INFO:tasks.workunit.client.0.smithi066.stdout:7/482: mkdir d2/d5/da/d3f/da4/d6c/d8e/da7 0 2024-09-12T01:43:16.081 INFO:tasks.workunit.client.1.smithi153.stdout:7/939: dwrite d12/d21/d29/d35/d37/d58/f81 [0,4194304] 0 2024-09-12T01:43:16.081 INFO:tasks.workunit.client.0.smithi066.stdout:5/566: mkdir d0/d26/d2d/d33/db0 0 2024-09-12T01:43:16.083 INFO:tasks.workunit.client.0.smithi066.stdout:7/483: link d2/d5/d6/c68 d2/d71/ca8 0 2024-09-12T01:43:16.083 INFO:tasks.workunit.client.1.smithi153.stdout:8/904: dread d17/d1f/d4f/d34/db4/dda/fea [0,4194304] 0 2024-09-12T01:43:16.085 INFO:tasks.workunit.client.0.smithi066.stdout:5/567: creat d0/d26/d2f/da5/fb1 x:0 0 0 2024-09-12T01:43:16.086 INFO:tasks.workunit.client.1.smithi153.stdout:7/940: rename d12/d21/d29/d2d/d8b/caf to d12/d21/d29/d35/d95/dea/c12d 0 2024-09-12T01:43:16.087 INFO:tasks.workunit.client.0.smithi066.stdout:7/484: creat d2/d5/d6/d22/fa9 x:0 0 0 2024-09-12T01:43:16.088 INFO:tasks.workunit.client.1.smithi153.stdout:8/905: symlink d17/d1f/dcf/d106/d95/db7/l12c 0 2024-09-12T01:43:16.089 INFO:tasks.workunit.client.1.smithi153.stdout:2/941: read d7/db/f50 [648948,42257] 0 2024-09-12T01:43:16.089 INFO:tasks.workunit.client.0.smithi066.stdout:5/568: creat d0/d26/d2d/d33/db0/fb2 x:0 0 0 2024-09-12T01:43:16.089 INFO:tasks.workunit.client.0.smithi066.stdout:5/569: creat d0/d26/d2f/d3b/d6b/fb3 x:0 0 0 2024-09-12T01:43:16.090 INFO:tasks.workunit.client.1.smithi153.stdout:7/941: mknod d12/d21/d29/d35/d95/c12e 0 2024-09-12T01:43:16.091 INFO:tasks.workunit.client.1.smithi153.stdout:1/990: fsync d2/d9/d1d/d25/d108/f13b 0 2024-09-12T01:43:16.091 INFO:tasks.workunit.client.1.smithi153.stdout:1/991: dread - d2/d9/d17/d2c/f132 zero size 2024-09-12T01:43:16.092 INFO:tasks.workunit.client.1.smithi153.stdout:8/906: rename d17/d1f/dcf/fe4 to d17/d1f/dcf/d106/d96/d6c/d89/ded/f12d 0 2024-09-12T01:43:16.094 INFO:tasks.workunit.client.0.smithi066.stdout:5/570: truncate d0/d26/d2d/d33/d55/f6e 2124695 0 2024-09-12T01:43:16.094 INFO:tasks.workunit.client.0.smithi066.stdout:7/485: read d2/d5/da/d3f/d9b/d4d/f60 [2922153,110882] 0 2024-09-12T01:43:16.095 INFO:tasks.workunit.client.1.smithi153.stdout:2/942: mkdir d7/d4d/d125 0 2024-09-12T01:43:16.095 INFO:tasks.workunit.client.0.smithi066.stdout:5/571: write d0/d26/d2f/d30/f66 [743077,123895] 0 2024-09-12T01:43:16.095 INFO:tasks.workunit.client.1.smithi153.stdout:2/943: write d7/d19/d83/d101/f48 [420648,65585] 0 2024-09-12T01:43:16.096 INFO:tasks.workunit.client.1.smithi153.stdout:7/942: symlink d12/d21/d4d/l12f 0 2024-09-12T01:43:16.100 INFO:tasks.workunit.client.0.smithi066.stdout:7/486: link d2/d5/d6/c77 d2/caa 0 2024-09-12T01:43:16.100 INFO:tasks.workunit.client.0.smithi066.stdout:7/487: chown d2/d5/da/d3f/d5e 1483067 1 2024-09-12T01:43:16.102 INFO:tasks.workunit.client.0.smithi066.stdout:5/572: creat d0/d26/d2d/d33/d55/d82/d87/fb4 x:0 0 0 2024-09-12T01:43:16.104 INFO:tasks.workunit.client.1.smithi153.stdout:8/907: creat d17/d1f/dcf/d106/d95/db7/f12e x:0 0 0 2024-09-12T01:43:16.104 INFO:tasks.workunit.client.1.smithi153.stdout:2/944: mkdir d7/db/d36/d126 0 2024-09-12T01:43:16.106 INFO:tasks.workunit.client.0.smithi066.stdout:5/573: creat d0/d26/d2d/d33/d55/d84/fb5 x:0 0 0 2024-09-12T01:43:16.106 INFO:tasks.workunit.client.0.smithi066.stdout:5/574: chown d0/dd/c4e 28572 1 2024-09-12T01:43:16.106 INFO:tasks.workunit.client.1.smithi153.stdout:7/943: truncate d12/d21/d29/d35/d37/d4c/d8e/fb5 253928 0 2024-09-12T01:43:16.107 INFO:tasks.workunit.client.1.smithi153.stdout:1/992: getdents d2/d9/d58/d74 0 2024-09-12T01:43:16.114 INFO:tasks.workunit.client.1.smithi153.stdout:8/908: rename d17/d1f/l20 to d17/d1f/d4f/d42/d79/dac/dce/ddc/d128/l12f 0 2024-09-12T01:43:16.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/944: creat d12/d21/d29/d35/d95/dff/f130 x:0 0 0 2024-09-12T01:43:16.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/945: fsync d12/d21/d29/d35/d37/d4c/f73 0 2024-09-12T01:43:16.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/946: write d12/d21/d29/d35/dcb/de9/d119/fc9 [159979,61345] 0 2024-09-12T01:43:16.116 INFO:tasks.workunit.client.1.smithi153.stdout:7/947: write d12/d21/d29/d35/dcb/f10b [49707,81440] 0 2024-09-12T01:43:16.117 INFO:tasks.workunit.client.1.smithi153.stdout:7/948: fsync d12/d21/d29/d35/d37/d4c/d5c/fa3 0 2024-09-12T01:43:16.117 INFO:tasks.workunit.client.0.smithi066.stdout:5/575: dread d0/d26/d2d/d31/f6a [0,4194304] 0 2024-09-12T01:43:16.118 INFO:tasks.workunit.client.1.smithi153.stdout:1/993: mknod d2/d9/d17/d100/d116/c13c 0 2024-09-12T01:43:16.121 INFO:tasks.workunit.client.1.smithi153.stdout:8/909: creat d17/d1f/dcf/d106/ddf/de3/dd9/f130 x:0 0 0 2024-09-12T01:43:16.123 INFO:tasks.workunit.client.1.smithi153.stdout:1/994: creat d2/d9/d17/d2f/d56/d71/db8/de1/f13d x:0 0 0 2024-09-12T01:43:16.124 INFO:tasks.workunit.client.1.smithi153.stdout:8/910: mknod d17/d1f/d4f/d34/db4/dda/c131 0 2024-09-12T01:43:16.125 INFO:tasks.workunit.client.1.smithi153.stdout:1/995: rename d2/d9/d17/d2f/d56/d83/fd5 to d2/d9/d28/d73/d76/f13e 0 2024-09-12T01:43:16.126 INFO:tasks.workunit.client.1.smithi153.stdout:1/996: unlink d2/d9/d1d/d25/f4a 0 2024-09-12T01:43:16.127 INFO:tasks.workunit.client.1.smithi153.stdout:1/997: mknod d2/dd7/c13f 0 2024-09-12T01:43:16.137 INFO:tasks.workunit.client.1.smithi153.stdout:8/911: write d17/d1f/d4f/d42/d79/f98 [493304,129898] 0 2024-09-12T01:43:16.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:15 smithi066 ceph-mon[27875]: pgmap v7: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 170 MiB/s rd, 233 MiB/s wr, 337 op/s 2024-09-12T01:43:16.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:15 smithi066 ceph-mon[27875]: mgrmap e25: smithi153.jpnqza(active, since 8s), standbys: smithi066.qdwcrh 2024-09-12T01:43:16.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:15 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:43:16.141 INFO:tasks.workunit.client.0.smithi066.stdout:7/488: dwrite d2/d5/d6/d40/d63/f86 [4194304,4194304] 0 2024-09-12T01:43:16.141 INFO:tasks.workunit.client.0.smithi066.stdout:7/489: chown d2/l37 1930418949 1 2024-09-12T01:43:16.142 INFO:tasks.workunit.client.0.smithi066.stdout:7/490: rmdir d2/d5/da/d3f/da4/d6c/d80 39 2024-09-12T01:43:16.145 INFO:tasks.workunit.client.1.smithi153.stdout:2/945: dwrite d7/d4d/d70/f92 [0,4194304] 0 2024-09-12T01:43:16.147 INFO:tasks.workunit.client.1.smithi153.stdout:7/949: dwrite d12/f26 [0,4194304] 0 2024-09-12T01:43:16.149 INFO:tasks.workunit.client.1.smithi153.stdout:7/950: creat d12/d21/d29/d35/f131 x:0 0 0 2024-09-12T01:43:16.149 INFO:tasks.workunit.client.0.smithi066.stdout:5/576: dwrite d0/f4 [0,4194304] 0 2024-09-12T01:43:16.150 INFO:tasks.workunit.client.0.smithi066.stdout:5/577: mkdir d0/dd/d18/d36/d4c/db6 0 2024-09-12T01:43:16.150 INFO:tasks.workunit.client.0.smithi066.stdout:7/491: dread d2/d5/da/d3f/da4/d84/f87 [0,4194304] 0 2024-09-12T01:43:16.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/578: creat d0/dd/d18/d36/d4c/db6/fb7 x:0 0 0 2024-09-12T01:43:16.151 INFO:tasks.workunit.client.0.smithi066.stdout:5/579: chown d0/d26/d2d/d42/f92 122554 1 2024-09-12T01:43:16.152 INFO:tasks.workunit.client.1.smithi153.stdout:1/998: dwrite d2/dd7/f13a [0,4194304] 0 2024-09-12T01:43:16.152 INFO:tasks.workunit.client.1.smithi153.stdout:1/999: write d2/d9/d17/d69/f7e [477105,113210] 0 2024-09-12T01:43:16.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:15 smithi153 ceph-mon[34713]: pgmap v7: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 170 MiB/s rd, 233 MiB/s wr, 337 op/s 2024-09-12T01:43:16.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:15 smithi153 ceph-mon[34713]: mgrmap e25: smithi153.jpnqza(active, since 8s), standbys: smithi066.qdwcrh 2024-09-12T01:43:16.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:15 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:43:16.155 INFO:tasks.workunit.client.1.smithi153.stdout:4/850: sync 2024-09-12T01:43:16.155 INFO:tasks.workunit.client.1.smithi153.stdout:4/851: creat d6/d9/dc/d98/d3e/d66/f11f x:0 0 0 2024-09-12T01:43:16.155 INFO:tasks.workunit.client.1.smithi153.stdout:4/852: chown d6/d9/f10 7877 1 2024-09-12T01:43:16.160 INFO:tasks.workunit.client.1.smithi153.stdout:4/853: creat d6/d15/db4/dbd/f120 x:0 0 0 2024-09-12T01:43:16.162 INFO:tasks.workunit.client.1.smithi153.stdout:4/854: unlink d6/ldb 0 2024-09-12T01:43:16.163 INFO:tasks.workunit.client.1.smithi153.stdout:4/855: creat d6/d9/dc/f121 x:0 0 0 2024-09-12T01:43:16.163 INFO:tasks.workunit.client.1.smithi153.stdout:8/912: rename d17/d1f/dcf/d106/ddf/de3/dd9 to d17/d1f/dcf/d106/ddf/d132 0 2024-09-12T01:43:16.174 INFO:tasks.workunit.client.1.smithi153.stdout:4/856: dread d6/d9/f10 [4194304,4194304] 0 2024-09-12T01:43:16.175 INFO:tasks.workunit.client.1.smithi153.stdout:7/951: dwrite d12/d7e/f127 [4194304,4194304] 0 2024-09-12T01:43:16.176 INFO:tasks.workunit.client.1.smithi153.stdout:7/952: mknod d12/d21/d4d/dae/dc0/c132 0 2024-09-12T01:43:16.176 INFO:tasks.workunit.client.1.smithi153.stdout:7/953: fdatasync d12/d21/d5f/f8c 0 2024-09-12T01:43:16.176 INFO:tasks.workunit.client.1.smithi153.stdout:7/954: chown d12/d21/d29/d2d/d8b/lfd 19746 1 2024-09-12T01:43:16.176 INFO:tasks.workunit.client.1.smithi153.stdout:7/955: truncate d12/d7e/f127 8931893 0 2024-09-12T01:43:16.177 INFO:tasks.workunit.client.1.smithi153.stdout:7/956: creat d12/d21/d29/d35/d37/f133 x:0 0 0 2024-09-12T01:43:16.177 INFO:tasks.workunit.client.1.smithi153.stdout:7/957: fsync d12/d21/d4d/ddc/fe6 0 2024-09-12T01:43:16.177 INFO:tasks.workunit.client.1.smithi153.stdout:4/857: rmdir d6/da4 39 2024-09-12T01:43:16.177 INFO:tasks.workunit.client.1.smithi153.stdout:4/858: stat d6/d9/d11/d13/dce 0 2024-09-12T01:43:16.178 INFO:tasks.workunit.client.0.smithi066.stdout:5/580: dwrite d0/d26/d2d/d42/f89 [0,4194304] 0 2024-09-12T01:43:16.178 INFO:tasks.workunit.client.0.smithi066.stdout:5/581: dread - d0/d26/d2d/d33/f88 zero size 2024-09-12T01:43:16.178 INFO:tasks.workunit.client.0.smithi066.stdout:5/582: write d0/d26/d2f/d30/f66 [444953,24983] 0 2024-09-12T01:43:16.178 INFO:tasks.workunit.client.1.smithi153.stdout:4/859: rename d6/d9/dc/d98/d3e/d66/lf8 to d6/d6a/l122 0 2024-09-12T01:43:16.179 INFO:tasks.workunit.client.1.smithi153.stdout:8/913: dread d17/d1f/d4f/f57 [0,4194304] 0 2024-09-12T01:43:16.180 INFO:tasks.workunit.client.0.smithi066.stdout:5/583: mknod d0/d26/d2f/d30/d8b/cb8 0 2024-09-12T01:43:16.181 INFO:tasks.workunit.client.0.smithi066.stdout:5/584: dread d0/d26/d2d/d33/d55/d82/f72 [0,4194304] 0 2024-09-12T01:43:16.181 INFO:tasks.workunit.client.0.smithi066.stdout:5/585: fsync d0/d26/d2d/d33/d55/d73/d74/f93 0 2024-09-12T01:43:16.182 INFO:tasks.workunit.client.0.smithi066.stdout:5/586: getdents d0/dd/d18/d36/d4c 0 2024-09-12T01:43:16.182 INFO:tasks.workunit.client.0.smithi066.stdout:5/587: read d0/f2 [1063316,87155] 0 2024-09-12T01:43:16.182 INFO:tasks.workunit.client.0.smithi066.stdout:5/588: readlink d0/d26/d2d/d33/d55/d84/l9d 0 2024-09-12T01:43:16.183 INFO:tasks.workunit.client.0.smithi066.stdout:7/492: dwrite d2/d5/d6/d22/d75/d2f/f34 [0,4194304] 0 2024-09-12T01:43:16.184 INFO:tasks.workunit.client.1.smithi153.stdout:8/914: write f10 [433685,123157] 0 2024-09-12T01:43:16.184 INFO:tasks.workunit.client.1.smithi153.stdout:7/958: dread d12/f1b [0,4194304] 0 2024-09-12T01:43:16.186 INFO:tasks.workunit.client.0.smithi066.stdout:5/589: dread d0/d26/f34 [4194304,4194304] 0 2024-09-12T01:43:16.187 INFO:tasks.workunit.client.0.smithi066.stdout:5/590: write d0/d26/d2d/d33/d55/d73/d74/f93 [1032902,82724] 0 2024-09-12T01:43:16.187 INFO:tasks.workunit.client.0.smithi066.stdout:5/591: read - d0/d26/d2f/d3b/d6b/fb3 zero size 2024-09-12T01:43:16.187 INFO:tasks.workunit.client.1.smithi153.stdout:8/915: link d17/d75/cc8 d17/d1f/dcf/d106/d96/d6c/c133 0 2024-09-12T01:43:16.189 INFO:tasks.workunit.client.1.smithi153.stdout:4/860: write d6/d9/d11/d13/dce/dd7/f74 [4021025,73444] 0 2024-09-12T01:43:16.189 INFO:tasks.workunit.client.1.smithi153.stdout:8/916: symlink d17/d1f/dcf/d106/d96/d6c/d89/d9c/d11d/l134 0 2024-09-12T01:43:16.190 INFO:tasks.workunit.client.1.smithi153.stdout:8/917: getdents d17/d1f/d4f/d42/d79/dac/dce/ddc/d128 0 2024-09-12T01:43:16.190 INFO:tasks.workunit.client.0.smithi066.stdout:7/493: symlink d2/lab 0 2024-09-12T01:43:16.190 INFO:tasks.workunit.client.0.smithi066.stdout:7/494: write d2/d5/da/d3f/d9b/f49 [227043,46594] 0 2024-09-12T01:43:16.191 INFO:tasks.workunit.client.1.smithi153.stdout:8/918: truncate d17/d1f/d4f/d34/db4/fcc 3763444 0 2024-09-12T01:43:16.202 INFO:tasks.workunit.client.1.smithi153.stdout:4/861: write d6/d9/d11/f1e [2075842,79585] 0 2024-09-12T01:43:16.206 INFO:tasks.workunit.client.1.smithi153.stdout:4/862: mkdir d6/d9/d11/d90/db7/df3/d123 0 2024-09-12T01:43:16.207 INFO:tasks.workunit.client.1.smithi153.stdout:4/863: mknod d6/d9/dc/d31/d76/d99/c124 0 2024-09-12T01:43:16.207 INFO:tasks.workunit.client.1.smithi153.stdout:4/864: creat d6/d9/d11/d13/dce/f125 x:0 0 0 2024-09-12T01:43:16.213 INFO:tasks.workunit.client.1.smithi153.stdout:4/865: dread d6/d15/f4c [0,4194304] 0 2024-09-12T01:43:16.215 INFO:tasks.workunit.client.1.smithi153.stdout:7/959: dwrite d12/d4e/f74 [0,4194304] 0 2024-09-12T01:43:16.215 INFO:tasks.workunit.client.1.smithi153.stdout:7/960: creat d12/d7e/db2/f134 x:0 0 0 2024-09-12T01:43:16.216 INFO:tasks.workunit.client.0.smithi066.stdout:5/592: dwrite d0/d26/faf [0,4194304] 0 2024-09-12T01:43:16.222 INFO:tasks.workunit.client.0.smithi066.stdout:5/593: unlink d0/d26/d2f/d3b/c7f 0 2024-09-12T01:43:16.222 INFO:tasks.workunit.client.0.smithi066.stdout:5/594: creat d0/dd/d18/d36/d4c/db6/fb9 x:0 0 0 2024-09-12T01:43:16.223 INFO:tasks.workunit.client.1.smithi153.stdout:7/961: rmdir d12/d21/d29/d2d/d8b 39 2024-09-12T01:43:16.223 INFO:tasks.workunit.client.1.smithi153.stdout:7/962: truncate d12/d7e/fe3 1281005 0 2024-09-12T01:43:16.223 INFO:tasks.workunit.client.1.smithi153.stdout:7/963: read - d12/d21/d29/d35/d37/d4c/d8e/fe7 zero size 2024-09-12T01:43:16.225 INFO:tasks.workunit.client.1.smithi153.stdout:4/866: dread d6/d9/d11/d90/f95 [0,4194304] 0 2024-09-12T01:43:16.230 INFO:tasks.workunit.client.1.smithi153.stdout:4/867: getdents d6/d9/dc 0 2024-09-12T01:43:16.230 INFO:tasks.workunit.client.1.smithi153.stdout:4/868: chown d6/d9/dc/d98/c30 5 1 2024-09-12T01:43:16.230 INFO:tasks.workunit.client.1.smithi153.stdout:4/869: readlink d6/d6a/d9c/l10b 0 2024-09-12T01:43:16.231 INFO:tasks.workunit.client.1.smithi153.stdout:4/870: symlink d6/d9/dc/d31/d76/d99/dd2/l126 0 2024-09-12T01:43:16.231 INFO:tasks.workunit.client.1.smithi153.stdout:4/871: write d6/d9/dc/d31/d76/fc2 [1361658,90934] 0 2024-09-12T01:43:16.233 INFO:tasks.workunit.client.1.smithi153.stdout:4/872: link d6/d9/dc/c1a d6/d9/d11/d13/c127 0 2024-09-12T01:43:16.234 INFO:tasks.workunit.client.1.smithi153.stdout:4/873: mknod d6/d9/d11/d90/db7/df3/d10f/c128 0 2024-09-12T01:43:16.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/874: creat d6/d15/db4/f129 x:0 0 0 2024-09-12T01:43:16.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/875: write d6/d9/dc/d31/d76/d99/f85 [1620921,94911] 0 2024-09-12T01:43:16.237 INFO:tasks.workunit.client.1.smithi153.stdout:4/876: chown d6/d15/db4/dbd/d106 90374225 1 2024-09-12T01:43:16.239 INFO:tasks.workunit.client.1.smithi153.stdout:4/877: unlink d6/d9/ca2 0 2024-09-12T01:43:16.248 INFO:tasks.workunit.client.0.smithi066.stdout:5/595: dwrite d0/dd/f8d [4194304,4194304] 0 2024-09-12T01:43:16.253 INFO:tasks.workunit.client.0.smithi066.stdout:5/596: dread d0/d26/d2d/d33/f4f [0,4194304] 0 2024-09-12T01:43:16.261 INFO:tasks.workunit.client.1.smithi153.stdout:4/878: dwrite f0 [0,4194304] 0 2024-09-12T01:43:16.261 INFO:tasks.workunit.client.1.smithi153.stdout:4/879: dread - d6/d15/db4/dbd/f101 zero size 2024-09-12T01:43:16.266 INFO:tasks.workunit.client.0.smithi066.stdout:5/597: read d0/dd/d18/d36/d4c/f61 [334122,106511] 0 2024-09-12T01:43:16.273 INFO:tasks.workunit.client.1.smithi153.stdout:4/880: dread d6/d9/dc/d31/d7d/d94/fde [0,4194304] 0 2024-09-12T01:43:16.273 INFO:tasks.workunit.client.1.smithi153.stdout:4/881: dread - d6/d15/db4/f129 zero size 2024-09-12T01:43:16.274 INFO:tasks.workunit.client.1.smithi153.stdout:4/882: creat d6/d15/db4/dbd/dfe/f12a x:0 0 0 2024-09-12T01:43:16.276 INFO:tasks.workunit.client.0.smithi066.stdout:5/598: dread d0/d26/f34 [0,4194304] 0 2024-09-12T01:43:16.276 INFO:tasks.workunit.client.0.smithi066.stdout:5/599: stat d0/c60 0 2024-09-12T01:43:16.281 INFO:tasks.workunit.client.0.smithi066.stdout:0/653: sync 2024-09-12T01:43:16.281 INFO:tasks.workunit.client.0.smithi066.stdout:1/557: sync 2024-09-12T01:43:16.281 INFO:tasks.workunit.client.0.smithi066.stdout:6/601: sync 2024-09-12T01:43:16.281 INFO:tasks.workunit.client.0.smithi066.stdout:4/574: sync 2024-09-12T01:43:16.281 INFO:tasks.workunit.client.1.smithi153.stdout:2/946: sync 2024-09-12T01:43:16.282 INFO:tasks.workunit.client.1.smithi153.stdout:2/947: readlink d7/db/d6c/d76/db8/dcf/l97 0 2024-09-12T01:43:16.283 INFO:tasks.workunit.client.0.smithi066.stdout:0/654: link d1/d62/d9f/f5a d1/d62/d9f/d4a/d67/d6e/d80/fe9 0 2024-09-12T01:43:16.283 INFO:tasks.workunit.client.0.smithi066.stdout:0/655: write d1/d62/d9f/d4a/d67/d20/fa9 [38184,112718] 0 2024-09-12T01:43:16.283 INFO:tasks.workunit.client.0.smithi066.stdout:0/656: creat d1/d62/d9f/fea x:0 0 0 2024-09-12T01:43:16.283 INFO:tasks.workunit.client.0.smithi066.stdout:0/657: truncate d1/d62/d9f/d7c/f9e 647586 0 2024-09-12T01:43:16.283 INFO:tasks.workunit.client.0.smithi066.stdout:1/558: symlink d5/d52/d60/la3 0 2024-09-12T01:43:16.283 INFO:tasks.workunit.client.0.smithi066.stdout:1/559: fdatasync d5/f6d 0 2024-09-12T01:43:16.285 INFO:tasks.workunit.client.1.smithi153.stdout:4/883: dread d6/d9/dc/d98/d3e/f61 [0,4194304] 0 2024-09-12T01:43:16.285 INFO:tasks.workunit.client.1.smithi153.stdout:4/884: truncate d6/d9/dc/d31/d76/d99/f85 2731029 0 2024-09-12T01:43:16.285 INFO:tasks.workunit.client.1.smithi153.stdout:2/948: rename d7/db/d62/d87/ddd/f107 to d7/db/d1d/d1e/f127 0 2024-09-12T01:43:16.285 INFO:tasks.workunit.client.1.smithi153.stdout:2/949: chown d7/db/d27/l3b 36 1 2024-09-12T01:43:16.305 INFO:tasks.workunit.client.0.smithi066.stdout:5/600: dwrite d0/f2 [4194304,4194304] 0 2024-09-12T01:43:16.306 INFO:tasks.workunit.client.0.smithi066.stdout:5/601: chown d0/dd/d18/fac 3652 1 2024-09-12T01:43:16.312 INFO:tasks.workunit.client.0.smithi066.stdout:1/560: dwrite d5/d15/f56 [8388608,4194304] 0 2024-09-12T01:43:16.312 INFO:tasks.workunit.client.0.smithi066.stdout:0/658: dwrite d1/d72/fd3 [0,4194304] 0 2024-09-12T01:43:16.385 INFO:tasks.workunit.client.0.smithi066.stdout:6/602: rename d2/d31/d5e/f8a to d2/d99/d12/d1d/d6b/fca 0 2024-09-12T01:43:16.385 INFO:tasks.workunit.client.0.smithi066.stdout:6/603: stat d2/f97 0 2024-09-12T01:43:16.386 INFO:tasks.workunit.client.1.smithi153.stdout:4/885: link d6/d9/dc/d98/f3f d6/d15/db4/dbd/dec/f12b 0 2024-09-12T01:43:16.387 INFO:tasks.workunit.client.1.smithi153.stdout:4/886: write d6/d9/f10 [8468810,87223] 0 2024-09-12T01:43:16.387 INFO:tasks.workunit.client.0.smithi066.stdout:4/575: mkdir d4/d6/d62/db0/db3 0 2024-09-12T01:43:16.387 INFO:tasks.workunit.client.1.smithi153.stdout:2/950: mknod d7/db/d6c/d76/db8/dcf/dae/d122/c128 0 2024-09-12T01:43:16.390 INFO:tasks.workunit.client.1.smithi153.stdout:4/887: mkdir d6/d9/d11/d12c 0 2024-09-12T01:43:16.390 INFO:tasks.workunit.client.1.smithi153.stdout:4/888: fdatasync d6/d9/dc/d31/d7d/d94/f97 0 2024-09-12T01:43:16.390 INFO:tasks.workunit.client.1.smithi153.stdout:4/889: creat d6/d9/d20/f12d x:0 0 0 2024-09-12T01:43:16.390 INFO:tasks.workunit.client.0.smithi066.stdout:5/602: unlink d0/d26/d2d/d33/d55/d84/c85 0 2024-09-12T01:43:16.391 INFO:tasks.workunit.client.1.smithi153.stdout:2/951: getdents d7/d19/d83/d101 0 2024-09-12T01:43:16.393 INFO:tasks.workunit.client.0.smithi066.stdout:1/561: unlink d5/d15/f3a 0 2024-09-12T01:43:16.397 INFO:tasks.workunit.client.1.smithi153.stdout:2/952: link d7/d19/d83/d101/da4/lc7 d7/d19/d83/d113/l129 0 2024-09-12T01:43:16.398 INFO:tasks.workunit.client.1.smithi153.stdout:2/953: creat d7/db/d1d/f12a x:0 0 0 2024-09-12T01:43:16.399 INFO:tasks.workunit.client.0.smithi066.stdout:5/603: dread d0/d26/f86 [0,4194304] 0 2024-09-12T01:43:16.400 INFO:tasks.workunit.client.1.smithi153.stdout:4/890: write d6/d9/fc9 [1797529,32578] 0 2024-09-12T01:43:16.401 INFO:tasks.workunit.client.1.smithi153.stdout:8/919: sync 2024-09-12T01:43:16.401 INFO:tasks.workunit.client.1.smithi153.stdout:7/964: sync 2024-09-12T01:43:16.401 INFO:tasks.workunit.client.1.smithi153.stdout:8/920: write d17/d75/fab [627296,99062] 0 2024-09-12T01:43:16.402 INFO:tasks.workunit.client.1.smithi153.stdout:2/954: mknod d7/db/d27/d56/da3/c12b 0 2024-09-12T01:43:16.407 INFO:tasks.workunit.client.1.smithi153.stdout:4/891: mkdir d6/d9/d11/d90/db7/d12e 0 2024-09-12T01:43:16.408 INFO:tasks.workunit.client.1.smithi153.stdout:4/892: read d6/fe [1198698,3646] 0 2024-09-12T01:43:16.408 INFO:tasks.workunit.client.1.smithi153.stdout:4/893: dread - d6/d6a/df9/f11c zero size 2024-09-12T01:43:16.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/921: truncate d17/d1f/d4f/d42/d79/f98 3385093 0 2024-09-12T01:43:16.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/922: creat d17/d1f/dcf/d106/f135 x:0 0 0 2024-09-12T01:43:16.411 INFO:tasks.workunit.client.0.smithi066.stdout:6/604: unlink d2/d99/d12/d1d/c88 0 2024-09-12T01:43:16.411 INFO:tasks.workunit.client.0.smithi066.stdout:6/605: write d2/d99/f6a [423419,70371] 0 2024-09-12T01:43:16.411 INFO:tasks.workunit.client.0.smithi066.stdout:6/606: chown d2/d99/f6a 29 1 2024-09-12T01:43:16.412 INFO:tasks.workunit.client.1.smithi153.stdout:2/955: mkdir d7/db/d36/d12c 0 2024-09-12T01:43:16.413 INFO:tasks.workunit.client.0.smithi066.stdout:4/576: mknod d4/d6/cb4 0 2024-09-12T01:43:16.413 INFO:tasks.workunit.client.0.smithi066.stdout:4/577: truncate d4/d15/d33/f5d 1851258 0 2024-09-12T01:43:16.414 INFO:tasks.workunit.client.1.smithi153.stdout:4/894: creat d6/f12f x:0 0 0 2024-09-12T01:43:16.415 INFO:tasks.workunit.client.0.smithi066.stdout:1/562: symlink d5/dc/d36/la4 0 2024-09-12T01:43:16.417 INFO:tasks.workunit.client.0.smithi066.stdout:6/607: symlink d2/d99/d12/lcb 0 2024-09-12T01:43:16.417 INFO:tasks.workunit.client.1.smithi153.stdout:8/923: mknod d17/d1f/dcf/d106/d95/dd6/c136 0 2024-09-12T01:43:16.418 INFO:tasks.workunit.client.0.smithi066.stdout:4/578: truncate d4/d15/f79 1184702 0 2024-09-12T01:43:16.418 INFO:tasks.workunit.client.0.smithi066.stdout:4/579: creat d4/d6/d27/d66/d6c/fb5 x:0 0 0 2024-09-12T01:43:16.418 INFO:tasks.workunit.client.0.smithi066.stdout:4/580: creat d4/d15/d33/d5e/fb6 x:0 0 0 2024-09-12T01:43:16.418 INFO:tasks.workunit.client.0.smithi066.stdout:4/581: fsync d4/d6/d8/f13 0 2024-09-12T01:43:16.418 INFO:tasks.workunit.client.0.smithi066.stdout:1/563: creat d5/dc/d53/d9b/da2/fa5 x:0 0 0 2024-09-12T01:43:16.419 INFO:tasks.workunit.client.0.smithi066.stdout:1/564: read d5/d52/d60/f79 [312695,2118] 0 2024-09-12T01:43:16.419 INFO:tasks.workunit.client.1.smithi153.stdout:8/924: mknod d17/d21/d111/c137 0 2024-09-12T01:43:16.421 INFO:tasks.workunit.client.1.smithi153.stdout:8/925: mknod d17/d1f/d4f/d34/db4/c138 0 2024-09-12T01:43:16.422 INFO:tasks.workunit.client.0.smithi066.stdout:4/582: creat d4/d6/d8/d18/fb7 x:0 0 0 2024-09-12T01:43:16.422 INFO:tasks.workunit.client.0.smithi066.stdout:6/608: getdents d2/d99/d72/d87 0 2024-09-12T01:43:16.426 INFO:tasks.workunit.client.1.smithi153.stdout:2/956: dread d7/fe0 [0,4194304] 0 2024-09-12T01:43:16.426 INFO:tasks.workunit.client.1.smithi153.stdout:2/957: stat d7/db/d27/lcc 0 2024-09-12T01:43:16.427 INFO:tasks.workunit.client.1.smithi153.stdout:2/958: chown d7/d19/d83/d101/c18 1709153 1 2024-09-12T01:43:16.427 INFO:tasks.workunit.client.1.smithi153.stdout:8/926: dread d17/d1f/d4f/d42/fdd [0,4194304] 0 2024-09-12T01:43:16.428 INFO:tasks.workunit.client.1.smithi153.stdout:2/959: mknod d7/db/d6c/d76/db8/dcf/dae/c12d 0 2024-09-12T01:43:16.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/960: rename d7/db/d6c/d76/db8/de1/fe9 to d7/db/d6c/d76/db8/dcf/dae/d122/f12e 0 2024-09-12T01:43:16.429 INFO:tasks.workunit.client.1.smithi153.stdout:2/961: fsync d7/db/d27/d56/da3/fb3 0 2024-09-12T01:43:16.430 INFO:tasks.workunit.client.1.smithi153.stdout:7/965: dwrite d12/d21/d29/f8d [0,4194304] 0 2024-09-12T01:43:16.431 INFO:tasks.workunit.client.0.smithi066.stdout:6/609: write d2/d31/fa8 [8598,78493] 0 2024-09-12T01:43:16.431 INFO:tasks.workunit.client.0.smithi066.stdout:5/604: dwrite d0/f4 [8388608,4194304] 0 2024-09-12T01:43:16.431 INFO:tasks.workunit.client.0.smithi066.stdout:5/605: creat d0/d26/d2d/d33/d55/d84/fba x:0 0 0 2024-09-12T01:43:16.431 INFO:tasks.workunit.client.1.smithi153.stdout:2/962: read d7/f9b [600577,79452] 0 2024-09-12T01:43:16.431 INFO:tasks.workunit.client.1.smithi153.stdout:2/963: truncate d7/db/d36/fc6 353525 0 2024-09-12T01:43:16.434 INFO:tasks.workunit.client.0.smithi066.stdout:6/610: symlink d2/d99/d72/d87/lcc 0 2024-09-12T01:43:16.434 INFO:tasks.workunit.client.1.smithi153.stdout:4/895: dwrite d6/d9/dc/d31/d76/fc2 [0,4194304] 0 2024-09-12T01:43:16.434 INFO:tasks.workunit.client.1.smithi153.stdout:4/896: chown d6/d9/d11/d13/dce/dd7/c103 1 1 2024-09-12T01:43:16.435 INFO:tasks.workunit.client.1.smithi153.stdout:7/966: rmdir d12/d21/d29/d35/d95/dea 39 2024-09-12T01:43:16.437 INFO:tasks.workunit.client.1.smithi153.stdout:2/964: link d7/d19/d83/d101/f3c d7/d19/d40/f12f 0 2024-09-12T01:43:16.438 INFO:tasks.workunit.client.1.smithi153.stdout:2/965: creat d7/d4d/f130 x:0 0 0 2024-09-12T01:43:16.439 INFO:tasks.workunit.client.0.smithi066.stdout:4/583: write d4/d6/d8/d18/d45/f95 [1924832,33232] 0 2024-09-12T01:43:16.439 INFO:tasks.workunit.client.0.smithi066.stdout:5/606: write d0/dd/f13 [364052,55073] 0 2024-09-12T01:43:16.440 INFO:tasks.workunit.client.1.smithi153.stdout:8/927: dread d17/d1f/d4f/d42/d79/dac/dd3/ff6 [0,4194304] 0 2024-09-12T01:43:16.441 INFO:tasks.workunit.client.0.smithi066.stdout:2/535: sync 2024-09-12T01:43:16.441 INFO:tasks.workunit.client.0.smithi066.stdout:8/628: sync 2024-09-12T01:43:16.441 INFO:tasks.workunit.client.1.smithi153.stdout:4/897: chown d6/d9/dc/d98/d3e/lcd 7343432 1 2024-09-12T01:43:16.441 INFO:tasks.workunit.client.1.smithi153.stdout:4/898: readlink d6/d15/l119 0 2024-09-12T01:43:16.443 INFO:tasks.workunit.client.0.smithi066.stdout:5/607: dread d0/d26/d2d/d33/d55/d73/d74/f93 [0,4194304] 0 2024-09-12T01:43:16.443 INFO:tasks.workunit.client.1.smithi153.stdout:7/967: mknod d12/d21/d29/d35/d37/d4c/c135 0 2024-09-12T01:43:16.450 INFO:tasks.workunit.client.1.smithi153.stdout:2/966: unlink d7/db/f50 0 2024-09-12T01:43:16.451 INFO:tasks.workunit.client.0.smithi066.stdout:1/565: getdents d5/dc/d53/d9b/da2 0 2024-09-12T01:43:16.454 INFO:tasks.workunit.client.0.smithi066.stdout:8/629: symlink d12/d21/d2f/d57/d84/d50/d56/db6/lce 0 2024-09-12T01:43:16.454 INFO:tasks.workunit.client.0.smithi066.stdout:8/630: chown d12/f70 605 1 2024-09-12T01:43:16.455 INFO:tasks.workunit.client.1.smithi153.stdout:4/899: link d6/d6a/d9c/l10b d6/d9/d11/l130 0 2024-09-12T01:43:16.457 INFO:tasks.workunit.client.1.smithi153.stdout:7/968: mknod d12/d21/d29/d35/dc7/c136 0 2024-09-12T01:43:16.457 INFO:tasks.workunit.client.1.smithi153.stdout:7/969: fdatasync d12/d21/d29/f5a 0 2024-09-12T01:43:16.460 INFO:tasks.workunit.client.0.smithi066.stdout:2/536: rmdir de/d13/d1e/d22/d4f 39 2024-09-12T01:43:16.461 INFO:tasks.workunit.client.1.smithi153.stdout:2/967: creat d7/db/d62/f131 x:0 0 0 2024-09-12T01:43:16.468 INFO:tasks.workunit.client.0.smithi066.stdout:1/566: truncate d5/dc/d36/d4b/f11 3286758 0 2024-09-12T01:43:16.468 INFO:tasks.workunit.client.0.smithi066.stdout:1/567: readlink d5/dc/d36/l82 0 2024-09-12T01:43:16.469 INFO:tasks.workunit.client.0.smithi066.stdout:6/611: dwrite d2/d99/d72/d87/fc3 [0,4194304] 0 2024-09-12T01:43:16.469 INFO:tasks.workunit.client.0.smithi066.stdout:8/631: mknod d12/d21/d2f/d57/d84/d89/ccf 0 2024-09-12T01:43:16.469 INFO:tasks.workunit.client.1.smithi153.stdout:4/900: mkdir d6/d9/d11/d13/d131 0 2024-09-12T01:43:16.469 INFO:tasks.workunit.client.1.smithi153.stdout:4/901: fsync d6/d9/dc/d98/d3e/d66/fb9 0 2024-09-12T01:43:16.469 INFO:tasks.workunit.client.1.smithi153.stdout:2/968: mkdir d7/db/d36/d12c/d132 0 2024-09-12T01:43:16.470 INFO:tasks.workunit.client.0.smithi066.stdout:1/568: creat d5/d52/d60/fa6 x:0 0 0 2024-09-12T01:43:16.470 INFO:tasks.workunit.client.0.smithi066.stdout:4/584: dwrite d4/d6/d8/f13 [0,4194304] 0 2024-09-12T01:43:16.470 INFO:tasks.workunit.client.0.smithi066.stdout:4/585: write d4/d6/d8/d18/fb7 [536712,52113] 0 2024-09-12T01:43:16.470 INFO:tasks.workunit.client.0.smithi066.stdout:4/586: chown d4/d6/f30 3 1 2024-09-12T01:43:16.471 INFO:tasks.workunit.client.1.smithi153.stdout:4/902: symlink d6/d15/db4/dbd/l132 0 2024-09-12T01:43:16.472 INFO:tasks.workunit.client.1.smithi153.stdout:4/903: chown d6/d9/dc/d31/d76/f114 19798212 1 2024-09-12T01:43:16.472 INFO:tasks.workunit.client.1.smithi153.stdout:4/904: chown d6/d15/db4/dbd/l132 375659109 1 2024-09-12T01:43:16.473 INFO:tasks.workunit.client.1.smithi153.stdout:2/969: truncate f1 3303130 0 2024-09-12T01:43:16.473 INFO:tasks.workunit.client.1.smithi153.stdout:2/970: chown d7/d19/d40/l2d 26192595 1 2024-09-12T01:43:16.473 INFO:tasks.workunit.client.0.smithi066.stdout:1/569: mkdir d5/dc/d36/d4b/da7 0 2024-09-12T01:43:16.474 INFO:tasks.workunit.client.0.smithi066.stdout:4/587: creat d4/d6/d27/d66/fb8 x:0 0 0 2024-09-12T01:43:16.475 INFO:tasks.workunit.client.0.smithi066.stdout:8/632: getdents d12/d21/d2f/d53 0 2024-09-12T01:43:16.479 INFO:tasks.workunit.client.1.smithi153.stdout:4/905: dread d6/d6a/df9/f11d [0,4194304] 0 2024-09-12T01:43:16.479 INFO:tasks.workunit.client.0.smithi066.stdout:6/612: dread d2/d31/f70 [0,4194304] 0 2024-09-12T01:43:16.479 INFO:tasks.workunit.client.0.smithi066.stdout:6/613: creat d2/d99/d12/fcd x:0 0 0 2024-09-12T01:43:16.481 INFO:tasks.workunit.client.0.smithi066.stdout:5/608: dwrite d0/d26/f2e [0,4194304] 0 2024-09-12T01:43:16.481 INFO:tasks.workunit.client.1.smithi153.stdout:4/906: write d6/d9/dc/d98/d3e/f9b [807762,58503] 0 2024-09-12T01:43:16.482 INFO:tasks.workunit.client.1.smithi153.stdout:4/907: dread - d6/d6a/df9/f11c zero size 2024-09-12T01:43:16.482 INFO:tasks.workunit.client.0.smithi066.stdout:2/537: write de/d13/d28/f8e [1410106,128327] 0 2024-09-12T01:43:16.483 INFO:tasks.workunit.client.0.smithi066.stdout:8/633: write d12/d21/f32 [1003290,33981] 0 2024-09-12T01:43:16.484 INFO:tasks.workunit.client.0.smithi066.stdout:8/634: chown d12/d21/f32 23091008 1 2024-09-12T01:43:16.484 INFO:tasks.workunit.client.0.smithi066.stdout:8/635: dread - d12/d21/d2f/d57/d43/d82/dbb/fcb zero size 2024-09-12T01:43:16.484 INFO:tasks.workunit.client.0.smithi066.stdout:8/636: chown d12/c15 3 1 2024-09-12T01:43:16.485 INFO:tasks.workunit.client.0.smithi066.stdout:5/609: truncate d0/d26/d2d/d42/f92 3569238 0 2024-09-12T01:43:16.485 INFO:tasks.workunit.client.0.smithi066.stdout:5/610: fdatasync d0/dd/d18/d36/d4c/db6/fb9 0 2024-09-12T01:43:16.485 INFO:tasks.workunit.client.0.smithi066.stdout:5/611: read d0/dd/d18/f53 [1475993,12006] 0 2024-09-12T01:43:16.485 INFO:tasks.workunit.client.0.smithi066.stdout:5/612: creat d0/d26/d2d/fbb x:0 0 0 2024-09-12T01:43:16.488 INFO:tasks.workunit.client.1.smithi153.stdout:7/970: dwrite d12/d21/f6b [0,4194304] 0 2024-09-12T01:43:16.491 INFO:tasks.workunit.client.0.smithi066.stdout:4/588: write d4/d6/d8/f13 [472601,63142] 0 2024-09-12T01:43:16.491 INFO:tasks.workunit.client.0.smithi066.stdout:4/589: chown l1 25 1 2024-09-12T01:43:16.491 INFO:tasks.workunit.client.0.smithi066.stdout:4/590: creat d4/d6/d8/d18/fb9 x:0 0 0 2024-09-12T01:43:16.491 INFO:tasks.workunit.client.0.smithi066.stdout:8/637: creat d12/d21/d2f/fd0 x:0 0 0 2024-09-12T01:43:16.492 INFO:tasks.workunit.client.1.smithi153.stdout:2/971: dwrite d7/d19/d40/f12f [4194304,4194304] 0 2024-09-12T01:43:16.492 INFO:tasks.workunit.client.1.smithi153.stdout:7/971: mknod d12/d21/d29/d35/d95/c137 0 2024-09-12T01:43:16.492 INFO:tasks.workunit.client.1.smithi153.stdout:7/972: write d12/d21/d4d/f59 [2019800,56475] 0 2024-09-12T01:43:16.493 INFO:tasks.workunit.client.0.smithi066.stdout:8/638: dread d12/d21/d2f/d57/d3c/f99 [0,4194304] 0 2024-09-12T01:43:16.493 INFO:tasks.workunit.client.0.smithi066.stdout:8/639: truncate d12/d21/d2f/d57/d84/d89/fa4 487179 0 2024-09-12T01:43:16.496 INFO:tasks.workunit.client.1.smithi153.stdout:4/908: rename d6/d9/dc/d98/d3e/c9d to d6/d9/dc/d98/d3e/c133 0 2024-09-12T01:43:16.497 INFO:tasks.workunit.client.0.smithi066.stdout:2/538: write de/d3c/f4a [1796073,57807] 0 2024-09-12T01:43:16.497 INFO:tasks.workunit.client.0.smithi066.stdout:2/539: write de/d13/d1e/fb0 [115400,14148] 0 2024-09-12T01:43:16.499 INFO:tasks.workunit.client.1.smithi153.stdout:4/909: read d6/d9/dc/d31/f34 [662301,4952] 0 2024-09-12T01:43:16.500 INFO:tasks.workunit.client.0.smithi066.stdout:6/614: dwrite d2/d99/f73 [4194304,4194304] 0 2024-09-12T01:43:16.500 INFO:tasks.workunit.client.0.smithi066.stdout:6/615: write d2/d99/f2d [1295963,112655] 0 2024-09-12T01:43:16.500 INFO:tasks.workunit.client.0.smithi066.stdout:6/616: chown d2/d99/l9d 22 1 2024-09-12T01:43:16.500 INFO:tasks.workunit.client.0.smithi066.stdout:6/617: readlink d2/d31/d57/l65 0 2024-09-12T01:43:16.501 INFO:tasks.workunit.client.1.smithi153.stdout:4/910: write d6/d6a/fc5 [457129,22207] 0 2024-09-12T01:43:16.503 INFO:tasks.workunit.client.1.smithi153.stdout:7/973: creat d12/d21/d29/d2d/f138 x:0 0 0 2024-09-12T01:43:16.507 INFO:tasks.workunit.client.0.smithi066.stdout:4/591: mkdir d4/d84/dba 0 2024-09-12T01:43:16.509 INFO:tasks.workunit.client.0.smithi066.stdout:8/640: symlink d12/daf/ld1 0 2024-09-12T01:43:16.510 INFO:tasks.workunit.client.0.smithi066.stdout:8/641: write d12/d21/d2f/d57/d43/d82/dbb/fcb [817659,26303] 0 2024-09-12T01:43:16.513 INFO:tasks.workunit.client.1.smithi153.stdout:7/974: mknod d12/d21/d29/d35/c139 0 2024-09-12T01:43:16.517 INFO:tasks.workunit.client.0.smithi066.stdout:5/613: rename d0/d21/f91 to d0/dd/d18/fbc 0 2024-09-12T01:43:16.519 INFO:tasks.workunit.client.1.smithi153.stdout:7/975: write d12/d21/d29/d2d/fac [583085,88517] 0 2024-09-12T01:43:16.520 INFO:tasks.workunit.client.0.smithi066.stdout:8/642: mknod d12/d21/d2f/d57/d84/d50/d56/d69/d7d/cd2 0 2024-09-12T01:43:16.536 INFO:tasks.workunit.client.1.smithi153.stdout:2/972: dwrite d7/db/f64 [0,4194304] 0 2024-09-12T01:43:16.536 INFO:tasks.workunit.client.1.smithi153.stdout:2/973: readlink d7/db/d27/d56/ld2 0 2024-09-12T01:43:16.536 INFO:tasks.workunit.client.1.smithi153.stdout:2/974: write d7/d4d/d70/f92 [4432636,32442] 0 2024-09-12T01:43:16.536 INFO:tasks.workunit.client.1.smithi153.stdout:2/975: write d7/db/d6c/d76/fc0 [475507,14089] 0 2024-09-12T01:43:16.545 INFO:tasks.workunit.client.0.smithi066.stdout:2/540: dwrite de/d13/d1e/f69 [0,4194304] 0 2024-09-12T01:43:16.545 INFO:tasks.workunit.client.0.smithi066.stdout:2/541: fdatasync de/d13/d1e/f36 0 2024-09-12T01:43:16.549 INFO:tasks.workunit.client.0.smithi066.stdout:2/542: symlink de/d13/d1e/d22/db6/lb9 0 2024-09-12T01:43:16.549 INFO:tasks.workunit.client.0.smithi066.stdout:2/543: mknod de/d13/d7f/cba 0 2024-09-12T01:43:16.550 INFO:tasks.workunit.client.0.smithi066.stdout:2/544: readlink de/l97 0 2024-09-12T01:43:16.562 INFO:tasks.workunit.client.0.smithi066.stdout:6/618: dwrite d2/f77 [0,4194304] 0 2024-09-12T01:43:16.562 INFO:tasks.workunit.client.1.smithi153.stdout:4/911: dwrite d6/d9/d11/d13/dce/f11b [0,4194304] 0 2024-09-12T01:43:16.563 INFO:tasks.workunit.client.0.smithi066.stdout:4/592: dwrite d4/d5f/f85 [0,4194304] 0 2024-09-12T01:43:16.563 INFO:tasks.workunit.client.0.smithi066.stdout:5/614: dwrite d0/f4 [4194304,4194304] 0 2024-09-12T01:43:16.564 INFO:tasks.workunit.client.0.smithi066.stdout:6/619: creat d2/d99/d12/d1d/fce x:0 0 0 2024-09-12T01:43:16.568 INFO:tasks.workunit.client.0.smithi066.stdout:6/620: mknod d2/d31/d57/ccf 0 2024-09-12T01:43:16.568 INFO:tasks.workunit.client.0.smithi066.stdout:6/621: chown d2/d31/f93 6 1 2024-09-12T01:43:16.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/622: chown d2/d99/d12/d1d/dc7/lb3 40775 1 2024-09-12T01:43:16.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/623: readlink d2/lab 0 2024-09-12T01:43:16.570 INFO:tasks.workunit.client.1.smithi153.stdout:4/912: rmdir d6/d9/d11/d13/dce/dd7 39 2024-09-12T01:43:16.571 INFO:tasks.workunit.client.1.smithi153.stdout:4/913: mkdir d6/d9/dc/d31/d76/d99/d134 0 2024-09-12T01:43:16.594 INFO:tasks.workunit.client.1.smithi153.stdout:7/976: dwrite d12/d21/d4d/dae/dc0/dc4/fca [0,4194304] 0 2024-09-12T01:43:16.596 INFO:tasks.workunit.client.1.smithi153.stdout:7/977: getdents d12/d21/d29 0 2024-09-12T01:43:16.599 INFO:tasks.workunit.client.0.smithi066.stdout:9/600: sync 2024-09-12T01:43:16.600 INFO:tasks.workunit.client.0.smithi066.stdout:2/545: dwrite f8 [0,4194304] 0 2024-09-12T01:43:16.600 INFO:tasks.workunit.client.1.smithi153.stdout:2/976: dwrite d7/db/d6c/fec [0,4194304] 0 2024-09-12T01:43:16.601 INFO:tasks.workunit.client.0.smithi066.stdout:4/593: dwrite d4/d15/d33/f90 [0,4194304] 0 2024-09-12T01:43:16.602 INFO:tasks.workunit.client.1.smithi153.stdout:4/914: dwrite d6/d9/dc/d98/d3e/ffd [0,4194304] 0 2024-09-12T01:43:16.604 INFO:tasks.workunit.client.0.smithi066.stdout:6/624: dwrite d2/d31/d5e/f71 [0,4194304] 0 2024-09-12T01:43:16.605 INFO:tasks.workunit.client.1.smithi153.stdout:2/977: creat d7/db/d62/d87/ddd/f133 x:0 0 0 2024-09-12T01:43:16.607 INFO:tasks.workunit.client.1.smithi153.stdout:7/978: write d12/d21/d29/d35/d37/f79 [3385165,13491] 0 2024-09-12T01:43:16.607 INFO:tasks.workunit.client.1.smithi153.stdout:7/979: fdatasync f7 0 2024-09-12T01:43:16.610 INFO:tasks.workunit.client.1.smithi153.stdout:4/915: rmdir d6/d9/d11/d90/db7/df3/d123 0 2024-09-12T01:43:16.612 INFO:tasks.workunit.client.0.smithi066.stdout:4/594: dread d4/d6/d8/d18/d45/f57 [0,4194304] 0 2024-09-12T01:43:16.612 INFO:tasks.workunit.client.0.smithi066.stdout:4/595: truncate d4/d6/d8/d4a/f7e 1816677 0 2024-09-12T01:43:16.612 INFO:tasks.workunit.client.0.smithi066.stdout:4/596: dread - d4/d15/d33/d5e/fb6 zero size 2024-09-12T01:43:16.614 INFO:tasks.workunit.client.1.smithi153.stdout:8/928: sync 2024-09-12T01:43:16.614 INFO:tasks.workunit.client.1.smithi153.stdout:7/980: creat d12/d21/d4d/dae/f13a x:0 0 0 2024-09-12T01:43:16.614 INFO:tasks.workunit.client.0.smithi066.stdout:2/546: symlink de/d13/d28/d3a/lbb 0 2024-09-12T01:43:16.616 INFO:tasks.workunit.client.1.smithi153.stdout:4/916: truncate d6/d9/dc/d98/f7e 361373 0 2024-09-12T01:43:16.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/597: rename d4/d15/d33/d5e/l96 to d4/d6/d62/lbb 0 2024-09-12T01:43:16.618 INFO:tasks.workunit.client.0.smithi066.stdout:4/598: chown d4/d6/d27/d2f/d72/l82 390 1 2024-09-12T01:43:16.620 INFO:tasks.workunit.client.1.smithi153.stdout:4/917: mknod d6/da4/d112/c135 0 2024-09-12T01:43:16.622 INFO:tasks.workunit.client.0.smithi066.stdout:4/599: rename d4/d6/c3f to d4/d6/d8/d18/d45/cbc 0 2024-09-12T01:43:16.625 INFO:tasks.workunit.client.0.smithi066.stdout:9/601: dwrite d0/d6/d43/fc1 [4194304,4194304] 0 2024-09-12T01:43:16.625 INFO:tasks.workunit.client.0.smithi066.stdout:9/602: fdatasync d0/d6/d17/f98 0 2024-09-12T01:43:16.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/600: rename d4/d6/d62/db0/db3 to d4/d15/dbd 0 2024-09-12T01:43:16.626 INFO:tasks.workunit.client.0.smithi066.stdout:6/625: dwrite d2/d99/d12/d1d/fce [0,4194304] 0 2024-09-12T01:43:16.628 INFO:tasks.workunit.client.0.smithi066.stdout:2/547: dread f2 [0,4194304] 0 2024-09-12T01:43:16.628 INFO:tasks.workunit.client.1.smithi153.stdout:8/929: write d17/d1f/d4f/d42/f86 [356077,28340] 0 2024-09-12T01:43:16.628 INFO:tasks.workunit.client.1.smithi153.stdout:4/918: rename d6/d6a/d9c/ldc to d6/d15/db4/dbd/l136 0 2024-09-12T01:43:16.631 INFO:tasks.workunit.client.0.smithi066.stdout:9/603: symlink d0/d6/d17/d1b/ld6 0 2024-09-12T01:43:16.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/604: fdatasync d0/d6/d17/d1b/d4c/f2a 0 2024-09-12T01:43:16.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/605: creat d0/d6/d17/d28/fd7 x:0 0 0 2024-09-12T01:43:16.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/606: stat d0/d6/d17/d4f/f97 0 2024-09-12T01:43:16.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/607: chown d0/d6/lcb 3185 1 2024-09-12T01:43:16.632 INFO:tasks.workunit.client.0.smithi066.stdout:9/608: fsync d0/d6/d17/d1b/d4c/f2b 0 2024-09-12T01:43:16.632 INFO:tasks.workunit.client.1.smithi153.stdout:8/930: mkdir d17/d1f/dcf/d106/d96/d6c/d139 0 2024-09-12T01:43:16.634 INFO:tasks.workunit.client.0.smithi066.stdout:4/601: mknod d4/d6/d27/cbe 0 2024-09-12T01:43:16.634 INFO:tasks.workunit.client.1.smithi153.stdout:7/981: rmdir d12/d21/d4d 39 2024-09-12T01:43:16.635 INFO:tasks.workunit.client.1.smithi153.stdout:7/982: write d12/f100 [142599,47257] 0 2024-09-12T01:43:16.635 INFO:tasks.workunit.client.1.smithi153.stdout:7/983: chown d12/d21/d29/f2c 7450 1 2024-09-12T01:43:16.636 INFO:tasks.workunit.client.0.smithi066.stdout:4/602: dread d4/d6/d27/d66/d58/f77 [0,4194304] 0 2024-09-12T01:43:16.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/919: rename d6/d6a/df9/f11d to d6/d6a/dcb/f137 0 2024-09-12T01:43:16.637 INFO:tasks.workunit.client.1.smithi153.stdout:4/920: chown d6/d9/dc 3 1 2024-09-12T01:43:16.638 INFO:tasks.workunit.client.0.smithi066.stdout:2/548: dread de/f1d [0,4194304] 0 2024-09-12T01:43:16.638 INFO:tasks.workunit.client.0.smithi066.stdout:6/626: write d2/d99/f73 [4231835,73867] 0 2024-09-12T01:43:16.639 INFO:tasks.workunit.client.1.smithi153.stdout:8/931: truncate d17/d1d/f73 2245929 0 2024-09-12T01:43:16.641 INFO:tasks.workunit.client.1.smithi153.stdout:4/921: creat d6/d9/d11/d13/d131/f138 x:0 0 0 2024-09-12T01:43:16.641 INFO:tasks.workunit.client.1.smithi153.stdout:8/932: mknod d17/d1f/dcf/d106/d96/d6c/d89/d9c/d11d/c13a 0 2024-09-12T01:43:16.642 INFO:tasks.workunit.client.1.smithi153.stdout:8/933: creat d17/d1f/d4f/d34/d6f/f13b x:0 0 0 2024-09-12T01:43:16.642 INFO:tasks.workunit.client.1.smithi153.stdout:8/934: creat d17/d1f/dcf/d106/f13c x:0 0 0 2024-09-12T01:43:16.644 INFO:tasks.workunit.client.0.smithi066.stdout:9/609: creat d0/d6/d7f/d90/fd8 x:0 0 0 2024-09-12T01:43:16.645 INFO:tasks.workunit.client.1.smithi153.stdout:2/978: dwrite d7/d4d/d70/f92 [0,4194304] 0 2024-09-12T01:43:16.646 INFO:tasks.workunit.client.0.smithi066.stdout:2/549: symlink de/d13/d1e/lbc 0 2024-09-12T01:43:16.649 INFO:tasks.workunit.client.1.smithi153.stdout:8/935: unlink d17/d1d/ca0 0 2024-09-12T01:43:16.651 INFO:tasks.workunit.client.0.smithi066.stdout:4/603: dread d4/d6/f30 [0,4194304] 0 2024-09-12T01:43:16.651 INFO:tasks.workunit.client.0.smithi066.stdout:4/604: fsync d4/d6/d27/d66/d58/f8d 0 2024-09-12T01:43:16.651 INFO:tasks.workunit.client.0.smithi066.stdout:6/627: symlink d2/d99/d12/d1d/dc7/ld0 0 2024-09-12T01:43:16.652 INFO:tasks.workunit.client.1.smithi153.stdout:2/979: truncate d7/d19/d83/fa7 235102 0 2024-09-12T01:43:16.654 INFO:tasks.workunit.client.0.smithi066.stdout:9/610: symlink d0/ld9 0 2024-09-12T01:43:16.654 INFO:tasks.workunit.client.0.smithi066.stdout:9/611: read - d0/d6/d17/d28/f6f zero size 2024-09-12T01:43:16.655 INFO:tasks.workunit.client.1.smithi153.stdout:8/936: unlink d17/d1d/d27/ld7 0 2024-09-12T01:43:16.657 INFO:tasks.workunit.client.0.smithi066.stdout:4/605: creat d4/d6/d8/fbf x:0 0 0 2024-09-12T01:43:16.658 INFO:tasks.workunit.client.1.smithi153.stdout:2/980: rename d7/db/d62/dbb to d7/db/d62/d87/ddd/d134 0 2024-09-12T01:43:16.659 INFO:tasks.workunit.client.1.smithi153.stdout:2/981: dread - d7/db/d62/d87/ddd/d134/dd3/fe8 zero size 2024-09-12T01:43:16.659 INFO:tasks.workunit.client.1.smithi153.stdout:7/984: dwrite d12/d21/f6b [0,4194304] 0 2024-09-12T01:43:16.660 INFO:tasks.workunit.client.0.smithi066.stdout:6/628: unlink d2/d31/c59 0 2024-09-12T01:43:16.660 INFO:tasks.workunit.client.0.smithi066.stdout:6/629: fdatasync d2/d99/d12/d1d/d6b/fca 0 2024-09-12T01:43:16.660 INFO:tasks.workunit.client.0.smithi066.stdout:6/630: dread - d2/d31/f81 zero size 2024-09-12T01:43:16.662 INFO:tasks.workunit.client.0.smithi066.stdout:3/643: sync 2024-09-12T01:43:16.662 INFO:tasks.workunit.client.0.smithi066.stdout:7/495: sync 2024-09-12T01:43:16.662 INFO:tasks.workunit.client.0.smithi066.stdout:0/659: sync 2024-09-12T01:43:16.663 INFO:tasks.workunit.client.0.smithi066.stdout:9/612: rename d0/d6/d37/l53 to d0/d6/d17/d1b/da2/lda 0 2024-09-12T01:43:16.663 INFO:tasks.workunit.client.1.smithi153.stdout:4/922: dwrite d6/d9/dc/d98/d3e/f50 [0,4194304] 0 2024-09-12T01:43:16.663 INFO:tasks.workunit.client.1.smithi153.stdout:4/923: creat d6/d15/db4/dbd/dfe/f139 x:0 0 0 2024-09-12T01:43:16.664 INFO:tasks.workunit.client.1.smithi153.stdout:2/982: getdents d7/db/d36 0 2024-09-12T01:43:16.664 INFO:tasks.workunit.client.1.smithi153.stdout:2/983: fsync d7/db/d36/fc6 0 2024-09-12T01:43:16.665 INFO:tasks.workunit.client.0.smithi066.stdout:4/606: getdents d4/d84 0 2024-09-12T01:43:16.667 INFO:tasks.workunit.client.1.smithi153.stdout:7/985: mknod d12/d21/d29/d35/dcb/de9/c13b 0 2024-09-12T01:43:16.667 INFO:tasks.workunit.client.1.smithi153.stdout:7/986: dread - d12/d21/d29/d35/dcb/de9/d119/f11b zero size 2024-09-12T01:43:16.673 INFO:tasks.workunit.client.1.smithi153.stdout:8/937: getdents d17/d1f/dcf/d106/d96/d6c/d6e/d7f 0 2024-09-12T01:43:16.673 INFO:tasks.workunit.client.1.smithi153.stdout:8/938: read d17/d1d/f36 [1541311,37341] 0 2024-09-12T01:43:16.674 INFO:tasks.workunit.client.0.smithi066.stdout:3/644: symlink d5/d6/d1b/d45/d66/d67/d7f/da8/le3 0 2024-09-12T01:43:16.676 INFO:tasks.workunit.client.0.smithi066.stdout:7/496: mkdir d2/d5/d6/d22/dac 0 2024-09-12T01:43:16.678 INFO:tasks.workunit.client.1.smithi153.stdout:2/984: mkdir d7/db/d27/d10e/d135 0 2024-09-12T01:43:16.678 INFO:tasks.workunit.client.1.smithi153.stdout:2/985: fdatasync d7/d4d/d7b/fb6 0 2024-09-12T01:43:16.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/631: dwrite d2/d99/d12/d49/f55 [0,4194304] 0 2024-09-12T01:43:16.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/632: creat d2/d99/d12/d49/d9e/fd1 x:0 0 0 2024-09-12T01:43:16.679 INFO:tasks.workunit.client.0.smithi066.stdout:0/660: truncate d1/d62/d9f/d4a/d67/d6e/d80/fa6 885133 0 2024-09-12T01:43:16.679 INFO:tasks.workunit.client.0.smithi066.stdout:0/661: dread - d1/d62/d9f/d4a/f68 zero size 2024-09-12T01:43:16.681 INFO:tasks.workunit.client.1.smithi153.stdout:7/987: unlink d12/d4e/le0 0 2024-09-12T01:43:16.681 INFO:tasks.workunit.client.0.smithi066.stdout:9/613: rmdir d0/d6/d17/d1b/d4c/d4b/d7d 39 2024-09-12T01:43:16.682 INFO:tasks.workunit.client.0.smithi066.stdout:9/614: chown d0/d6/d7f/lc4 3504067 1 2024-09-12T01:43:16.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/939: symlink d17/d1f/dcf/d106/d96/d6c/d6e/d7f/l13d 0 2024-09-12T01:43:16.683 INFO:tasks.workunit.client.1.smithi153.stdout:8/940: stat d17/d21/fb5 0 2024-09-12T01:43:16.684 INFO:tasks.workunit.client.1.smithi153.stdout:8/941: fdatasync d17/d1f/d4f/d34/db4/fa7 0 2024-09-12T01:43:16.684 INFO:tasks.workunit.client.1.smithi153.stdout:8/942: write d17/d1f/d4f/d34/db4/fa8 [4347321,41243] 0 2024-09-12T01:43:16.684 INFO:tasks.workunit.client.0.smithi066.stdout:4/607: mknod d4/d84/dba/cc0 0 2024-09-12T01:43:16.684 INFO:tasks.workunit.client.0.smithi066.stdout:3/645: write d5/d6/d1b/d65/f7e [204253,121205] 0 2024-09-12T01:43:16.685 INFO:tasks.workunit.client.1.smithi153.stdout:2/986: mkdir d7/db/d27/d56/da3/d136 0 2024-09-12T01:43:16.685 INFO:tasks.workunit.client.1.smithi153.stdout:2/987: write d7/db/d62/fff [326804,21112] 0 2024-09-12T01:43:16.686 INFO:tasks.workunit.client.1.smithi153.stdout:2/988: chown d7/db/d27/d56/da3/d123 96251 1 2024-09-12T01:43:16.686 INFO:tasks.workunit.client.1.smithi153.stdout:2/989: truncate d7/db/d27/d56/fb4 4697232 0 2024-09-12T01:43:16.687 INFO:tasks.workunit.client.1.smithi153.stdout:4/924: dwrite d6/d9/dc/d98/d3e/fdf [0,4194304] 0 2024-09-12T01:43:16.687 INFO:tasks.workunit.client.1.smithi153.stdout:4/925: fsync d6/d9/dc/d31/d7d/d94/f97 0 2024-09-12T01:43:16.687 INFO:tasks.workunit.client.1.smithi153.stdout:4/926: chown d6/c12 23421263 1 2024-09-12T01:43:16.688 INFO:tasks.workunit.client.1.smithi153.stdout:7/988: mkdir d12/d21/d4d/dae/d10a/d13c 0 2024-09-12T01:43:16.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/633: creat d2/d21/fd2 x:0 0 0 2024-09-12T01:43:16.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/634: fdatasync d2/d99/d12/f90 0 2024-09-12T01:43:16.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/635: fdatasync d2/d31/f69 0 2024-09-12T01:43:16.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/636: stat d2/lab 0 2024-09-12T01:43:16.692 INFO:tasks.workunit.client.0.smithi066.stdout:6/637: read d2/d99/d12/d1d/d6b/fca [408521,42765] 0 2024-09-12T01:43:16.692 INFO:tasks.workunit.client.1.smithi153.stdout:8/943: truncate f10 1639706 0 2024-09-12T01:43:16.692 INFO:tasks.workunit.client.1.smithi153.stdout:8/944: creat d17/d1f/d4f/d42/f13e x:0 0 0 2024-09-12T01:43:16.692 INFO:tasks.workunit.client.1.smithi153.stdout:8/945: dread - d17/d21/f10b zero size 2024-09-12T01:43:16.693 INFO:tasks.workunit.client.0.smithi066.stdout:0/662: creat d1/d62/d89/da3/feb x:0 0 0 2024-09-12T01:43:16.695 INFO:tasks.workunit.client.1.smithi153.stdout:2/990: mknod d7/db/d6c/c137 0 2024-09-12T01:43:16.696 INFO:tasks.workunit.client.0.smithi066.stdout:7/497: dwrite d2/d5/d6/d40/d51/f72 [0,4194304] 0 2024-09-12T01:43:16.697 INFO:tasks.workunit.client.0.smithi066.stdout:7/498: write d2/d5/da/d3f/da4/f3b [11067,14401] 0 2024-09-12T01:43:16.697 INFO:tasks.workunit.client.0.smithi066.stdout:7/499: stat d2/d5/d6/d22/d75/d2f/f34 0 2024-09-12T01:43:16.697 INFO:tasks.workunit.client.0.smithi066.stdout:9/615: link d0/d6/d37/d85/fa8 d0/d6/d17/d28/d79/fdb 0 2024-09-12T01:43:16.699 INFO:tasks.workunit.client.0.smithi066.stdout:4/608: creat d4/d5f/fc1 x:0 0 0 2024-09-12T01:43:16.703 INFO:tasks.workunit.client.1.smithi153.stdout:4/927: dwrite d6/d9/dc/d31/f9a [4194304,4194304] 0 2024-09-12T01:43:16.703 INFO:tasks.workunit.client.1.smithi153.stdout:4/928: read - d6/d9/dc/d31/d76/f114 zero size 2024-09-12T01:43:16.704 INFO:tasks.workunit.client.1.smithi153.stdout:4/929: chown d6/d9/d11/d90/db7/df3/d10f 126129065 1 2024-09-12T01:43:16.704 INFO:tasks.workunit.client.1.smithi153.stdout:7/989: rename d12/d7e/f8f to d12/d21/d29/d35/d37/f13d 0 2024-09-12T01:43:16.705 INFO:tasks.workunit.client.0.smithi066.stdout:3/646: mkdir d5/d6/d1b/d45/d66/d67/d75/d8e/db4/de4 0 2024-09-12T01:43:16.706 INFO:tasks.workunit.client.0.smithi066.stdout:6/638: mkdir d2/d99/d12/d1d/dc7/dd3 0 2024-09-12T01:43:16.707 INFO:tasks.workunit.client.1.smithi153.stdout:4/930: dread d6/d15/f4c [0,4194304] 0 2024-09-12T01:43:16.707 INFO:tasks.workunit.client.1.smithi153.stdout:4/931: chown d6/d9/d20/lcc 251318593 1 2024-09-12T01:43:16.708 INFO:tasks.workunit.client.1.smithi153.stdout:2/991: creat d7/db/d62/d87/f138 x:0 0 0 2024-09-12T01:43:16.708 INFO:tasks.workunit.client.1.smithi153.stdout:8/946: dread d17/d1f/d4f/d34/db4/fa8 [0,4194304] 0 2024-09-12T01:43:16.710 INFO:tasks.workunit.client.1.smithi153.stdout:7/990: symlink d12/d21/d4d/dae/dc0/dc4/d101/l13e 0 2024-09-12T01:43:16.710 INFO:tasks.workunit.client.0.smithi066.stdout:7/500: mkdir d2/d71/dad 0 2024-09-12T01:43:16.711 INFO:tasks.workunit.client.1.smithi153.stdout:4/932: mknod d6/d9/dc/d31/d7d/c13a 0 2024-09-12T01:43:16.713 INFO:tasks.workunit.client.0.smithi066.stdout:9/616: mknod d0/d6/d7f/d90/cdc 0 2024-09-12T01:43:16.715 INFO:tasks.workunit.client.1.smithi153.stdout:2/992: link d7/db/d1d/d1e/l53 d7/db/d27/d56/da3/d123/l139 0 2024-09-12T01:43:16.716 INFO:tasks.workunit.client.1.smithi153.stdout:2/993: truncate d7/db/d27/f7d 1727514 0 2024-09-12T01:43:16.716 INFO:tasks.workunit.client.1.smithi153.stdout:2/994: write d7/db/d36/fc6 [1077234,103653] 0 2024-09-12T01:43:16.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/609: symlink d4/d6/d27/d66/d6c/lc2 0 2024-09-12T01:43:16.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/610: dread - d4/d6/d8/d18/fb9 zero size 2024-09-12T01:43:16.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/611: dread - d4/d6/d62/fb2 zero size 2024-09-12T01:43:16.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/612: creat d4/d15/d33/d5e/fc3 x:0 0 0 2024-09-12T01:43:16.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/613: fdatasync d4/f37 0 2024-09-12T01:43:16.717 INFO:tasks.workunit.client.0.smithi066.stdout:4/614: fdatasync d4/d15/d33/f5d 0 2024-09-12T01:43:16.718 INFO:tasks.workunit.client.1.smithi153.stdout:8/947: write d17/d1f/dcf/d106/d96/fc3 [2306116,98585] 0 2024-09-12T01:43:16.718 INFO:tasks.workunit.client.1.smithi153.stdout:7/991: getdents d12/d21/d4d/dae 0 2024-09-12T01:43:16.721 INFO:tasks.workunit.client.1.smithi153.stdout:4/933: rename d6/d9/d11/d90/fda to d6/d9/dc/d31/d76/d99/d134/f13b 0 2024-09-12T01:43:16.722 INFO:tasks.workunit.client.0.smithi066.stdout:6/639: mknod d2/d99/d12/cd4 0 2024-09-12T01:43:16.724 INFO:tasks.workunit.client.0.smithi066.stdout:9/617: mknod d0/d6/d17/d1b/d4c/d4b/d86/cdd 0 2024-09-12T01:43:16.725 INFO:tasks.workunit.client.1.smithi153.stdout:2/995: symlink d7/db/d6c/d7e/l13a 0 2024-09-12T01:43:16.732 INFO:tasks.workunit.client.0.smithi066.stdout:7/501: dwrite d2/d5/d6/d40/d51/f8b [0,4194304] 0 2024-09-12T01:43:16.733 INFO:tasks.workunit.client.1.smithi153.stdout:4/934: symlink d6/d9/d11/d13/dce/l13c 0 2024-09-12T01:43:16.735 INFO:tasks.workunit.client.0.smithi066.stdout:4/615: truncate d4/d6/d8/d18/f74 5162 0 2024-09-12T01:43:16.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/647: getdents d5/d6/d1b/d77 0 2024-09-12T01:43:16.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/648: write d5/d6/d1b/f88 [1730455,4131] 0 2024-09-12T01:43:16.735 INFO:tasks.workunit.client.0.smithi066.stdout:3/649: readlink d5/d6/d1b/d77/dd5/le1 0 2024-09-12T01:43:16.737 INFO:tasks.workunit.client.1.smithi153.stdout:4/935: dread d6/d9/dc/d98/fee [0,4194304] 0 2024-09-12T01:43:16.737 INFO:tasks.workunit.client.1.smithi153.stdout:4/936: fsync d6/d15/db4/dbd/fd6 0 2024-09-12T01:43:16.737 INFO:tasks.workunit.client.1.smithi153.stdout:4/937: fdatasync d6/d9/d11/d90/db7/ff6 0 2024-09-12T01:43:16.738 INFO:tasks.workunit.client.0.smithi066.stdout:6/640: rename d2/d99/d12/d49/l7a to d2/d99/d12/d1d/dc7/dd3/ld5 0 2024-09-12T01:43:16.742 INFO:tasks.workunit.client.1.smithi153.stdout:4/938: getdents d6/d9/dc/d31/d76 0 2024-09-12T01:43:16.742 INFO:tasks.workunit.client.1.smithi153.stdout:4/939: creat d6/f13d x:0 0 0 2024-09-12T01:43:16.744 INFO:tasks.workunit.client.1.smithi153.stdout:4/940: mkdir d6/d6a/d13e 0 2024-09-12T01:43:16.744 INFO:tasks.workunit.client.1.smithi153.stdout:4/941: truncate d6/d6a/fc5 1109157 0 2024-09-12T01:43:16.745 INFO:tasks.workunit.client.0.smithi066.stdout:7/502: unlink d2/d5/d6/d22/l98 0 2024-09-12T01:43:16.746 INFO:tasks.workunit.client.0.smithi066.stdout:4/616: truncate d4/d6/d27/d66/da1/fad 2520062 0 2024-09-12T01:43:16.748 INFO:tasks.workunit.client.1.smithi153.stdout:4/942: rename d6/d9/d11/d13/f118 to d6/d15/db4/dbd/dfe/f13f 0 2024-09-12T01:43:16.748 INFO:tasks.workunit.client.1.smithi153.stdout:4/943: dread - d6/d15/db4/dbd/f120 zero size 2024-09-12T01:43:16.749 INFO:tasks.workunit.client.0.smithi066.stdout:6/641: symlink d2/d99/d72/db7/ld6 0 2024-09-12T01:43:16.751 INFO:tasks.workunit.client.0.smithi066.stdout:6/642: unlink d2/d31/d5e/l64 0 2024-09-12T01:43:16.778 INFO:tasks.workunit.client.1.smithi153.stdout:4/944: dread d6/da4/fd0 [0,4194304] 0 2024-09-12T01:43:16.780 INFO:tasks.workunit.client.1.smithi153.stdout:4/945: mknod d6/da4/d112/c140 0 2024-09-12T01:43:16.780 INFO:tasks.workunit.client.1.smithi153.stdout:8/948: dwrite d17/d1f/dcf/d106/d95/dd6/ddb/f120 [0,4194304] 0 2024-09-12T01:43:16.780 INFO:tasks.workunit.client.1.smithi153.stdout:8/949: truncate d17/d1f/dcf/d106/d96/d6c/d6e/d7f/f11a 868944 0 2024-09-12T01:43:16.781 INFO:tasks.workunit.client.1.smithi153.stdout:8/950: truncate d17/d1f/f39 3395570 0 2024-09-12T01:43:16.782 INFO:tasks.workunit.client.1.smithi153.stdout:4/946: dread d6/d9/dc/d98/f7e [0,4194304] 0 2024-09-12T01:43:16.782 INFO:tasks.workunit.client.1.smithi153.stdout:4/947: readlink d6/l49 0 2024-09-12T01:43:16.782 INFO:tasks.workunit.client.1.smithi153.stdout:7/992: dwrite d12/d21/d29/d35/d37/d4c/d8e/fa1 [0,4194304] 0 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:7/993: chown d12/d21/d29/d35/d37/d4c/d5c/f70 151396 1 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:7/994: fsync d12/d21/d29/d35/f6e 0 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:7/995: creat d12/d21/d29/d35/dcb/f13f x:0 0 0 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:4/948: write d6/d9/dc/d31/d7d/d94/df7/ffc [332970,53243] 0 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:4/949: creat d6/d15/db4/f141 x:0 0 0 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:2/996: dwrite d7/db/d1d/d1e/d6d/ffd [4194304,4194304] 0 2024-09-12T01:43:16.783 INFO:tasks.workunit.client.1.smithi153.stdout:2/997: write d7/db/d27/d56/f9e [5141206,17995] 0 2024-09-12T01:43:16.784 INFO:tasks.workunit.client.1.smithi153.stdout:8/951: rename d17/d1f/d4f/d42/d79/dac/fe9 to d17/d21/d111/f13f 0 2024-09-12T01:43:16.784 INFO:tasks.workunit.client.0.smithi066.stdout:3/650: dwrite d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f7d [0,4194304] 0 2024-09-12T01:43:16.784 INFO:tasks.workunit.client.0.smithi066.stdout:3/651: creat d5/d6/d1b/d45/fe5 x:0 0 0 2024-09-12T01:43:16.784 INFO:tasks.workunit.client.0.smithi066.stdout:3/652: read - d5/d6/d48/fa9 zero size 2024-09-12T01:43:16.784 INFO:tasks.workunit.client.0.smithi066.stdout:7/503: dwrite d2/d5/da/d3f/da4/f7e [0,4194304] 0 2024-09-12T01:43:16.785 INFO:tasks.workunit.client.0.smithi066.stdout:7/504: chown d2/d71/c7b 673933732 1 2024-09-12T01:43:16.786 INFO:tasks.workunit.client.0.smithi066.stdout:6/643: dwrite d2/d99/d12/d1d/f2b [0,4194304] 0 2024-09-12T01:43:16.790 INFO:tasks.workunit.client.0.smithi066.stdout:3/653: mkdir d5/d6/d1b/d45/d66/d67/d6d/de6 0 2024-09-12T01:43:16.794 INFO:tasks.workunit.client.1.smithi153.stdout:7/996: creat d12/d21/d29/d35/d95/f140 x:0 0 0 2024-09-12T01:43:16.799 INFO:tasks.workunit.client.0.smithi066.stdout:7/505: mknod d2/d71/d93/cae 0 2024-09-12T01:43:16.799 INFO:tasks.workunit.client.0.smithi066.stdout:7/506: fdatasync d2/d5/da/d3f/d9b/f67 0 2024-09-12T01:43:16.799 INFO:tasks.workunit.client.0.smithi066.stdout:7/507: getdents d2/d5/d6/d40/d51 0 2024-09-12T01:43:16.799 INFO:tasks.workunit.client.0.smithi066.stdout:1/570: sync 2024-09-12T01:43:16.800 INFO:tasks.workunit.client.1.smithi153.stdout:4/950: mknod d6/d9/dc/d31/d76/d99/dd2/c142 0 2024-09-12T01:43:16.800 INFO:tasks.workunit.client.1.smithi153.stdout:4/951: fsync d6/d15/f22 0 2024-09-12T01:43:16.800 INFO:tasks.workunit.client.1.smithi153.stdout:4/952: fdatasync d6/d9/dc/d31/f9a 0 2024-09-12T01:43:16.801 INFO:tasks.workunit.client.0.smithi066.stdout:8/643: sync 2024-09-12T01:43:16.801 INFO:tasks.workunit.client.0.smithi066.stdout:3/654: truncate d5/d6/d1b/d65/d89/f1a 1025362 0 2024-09-12T01:43:16.801 INFO:tasks.workunit.client.0.smithi066.stdout:8/644: readlink d12/d21/d2f/d57/d3c/l4d 0 2024-09-12T01:43:16.801 INFO:tasks.workunit.client.0.smithi066.stdout:3/655: write f4 [4528394,16561] 0 2024-09-12T01:43:16.803 INFO:tasks.workunit.client.0.smithi066.stdout:1/571: mknod d5/d15/d58/ca8 0 2024-09-12T01:43:16.805 INFO:tasks.workunit.client.1.smithi153.stdout:8/952: symlink d17/d1f/d4f/d42/d79/dd4/l140 0 2024-09-12T01:43:16.807 INFO:tasks.workunit.client.0.smithi066.stdout:6/644: dwrite d2/d99/d12/d1d/d6b/f86 [0,4194304] 0 2024-09-12T01:43:16.820 INFO:tasks.workunit.client.0.smithi066.stdout:1/572: mknod d5/d52/ca9 0 2024-09-12T01:43:16.821 INFO:tasks.workunit.client.1.smithi153.stdout:7/997: symlink d12/d21/d29/d2d/d8b/d116/l141 0 2024-09-12T01:43:16.823 INFO:tasks.workunit.client.1.smithi153.stdout:8/953: write d17/d1d/fa2 [3934195,30923] 0 2024-09-12T01:43:16.829 INFO:tasks.workunit.client.1.smithi153.stdout:8/954: dread d17/d1f/dcf/d106/ddf/de3/fa5 [0,4194304] 0 2024-09-12T01:43:16.833 INFO:tasks.workunit.client.1.smithi153.stdout:7/998: creat d12/d21/d29/d2d/d8b/d116/f142 x:0 0 0 2024-09-12T01:43:16.834 INFO:tasks.workunit.client.1.smithi153.stdout:7/999: symlink d12/d21/d29/d35/d37/d4c/l143 0 2024-09-12T01:43:16.843 INFO:tasks.workunit.client.0.smithi066.stdout:7/508: dwrite d2/d5/da/f50 [0,4194304] 0 2024-09-12T01:43:16.844 INFO:tasks.workunit.client.0.smithi066.stdout:3/656: dwrite d5/d6/d1b/f2e [0,4194304] 0 2024-09-12T01:43:16.845 INFO:tasks.workunit.client.0.smithi066.stdout:7/509: truncate d2/d5/d6/d81/fa2 567371 0 2024-09-12T01:43:16.847 INFO:tasks.workunit.client.0.smithi066.stdout:6/645: dwrite d2/f77 [4194304,4194304] 0 2024-09-12T01:43:16.848 INFO:tasks.workunit.client.0.smithi066.stdout:1/573: dwrite d5/f3b [0,4194304] 0 2024-09-12T01:43:16.849 INFO:tasks.workunit.client.0.smithi066.stdout:3/657: mkdir d5/d6/d1b/d45/d66/de7 0 2024-09-12T01:43:16.849 INFO:tasks.workunit.client.0.smithi066.stdout:8/645: dwrite d12/d21/d2f/f45 [4194304,4194304] 0 2024-09-12T01:43:16.849 INFO:tasks.workunit.client.1.smithi153.stdout:4/953: dwrite d6/d9/d11/d90/f115 [0,4194304] 0 2024-09-12T01:43:16.850 INFO:tasks.workunit.client.0.smithi066.stdout:7/510: mknod d2/d5/da/d3f/da4/d6c/d8e/caf 0 2024-09-12T01:43:16.854 INFO:tasks.workunit.client.1.smithi153.stdout:4/954: mknod d6/d9/dc/d31/c143 0 2024-09-12T01:43:16.858 INFO:tasks.workunit.client.1.smithi153.stdout:4/955: truncate d6/d9/dc/f3a 1738048 0 2024-09-12T01:43:16.858 INFO:tasks.workunit.client.1.smithi153.stdout:4/956: readlink d6/d9/d11/d13/dce/dd7/l82 0 2024-09-12T01:43:16.858 INFO:tasks.workunit.client.1.smithi153.stdout:4/957: read d6/d15/f22 [6515119,1732] 0 2024-09-12T01:43:16.858 INFO:tasks.workunit.client.0.smithi066.stdout:6/646: write d2/fa3 [123654,21000] 0 2024-09-12T01:43:16.859 INFO:tasks.workunit.client.0.smithi066.stdout:6/647: creat d2/d99/d7b/fd7 x:0 0 0 2024-09-12T01:43:16.860 INFO:tasks.workunit.client.0.smithi066.stdout:3/658: unlink d5/d6/d1b/d45/d66/d67/d6d/dc7/fb5 0 2024-09-12T01:43:16.860 INFO:tasks.workunit.client.0.smithi066.stdout:3/659: write d5/d6/d1b/d45/d66/d67/d6d/fa5 [876423,858] 0 2024-09-12T01:43:16.862 INFO:tasks.workunit.client.0.smithi066.stdout:7/511: symlink d2/d5/d6/d40/d51/lb0 0 2024-09-12T01:43:16.865 INFO:tasks.workunit.client.0.smithi066.stdout:6/648: symlink d2/d99/d7b/ld8 0 2024-09-12T01:43:16.866 INFO:tasks.workunit.client.0.smithi066.stdout:1/574: mkdir d5/d15/daa 0 2024-09-12T01:43:16.867 INFO:tasks.workunit.client.0.smithi066.stdout:6/649: write d2/f1a [4500796,95626] 0 2024-09-12T01:43:16.867 INFO:tasks.workunit.client.0.smithi066.stdout:3/660: mkdir d5/d6/d1b/d45/d66/dae/dd7/de8 0 2024-09-12T01:43:16.868 INFO:tasks.workunit.client.0.smithi066.stdout:8/646: getdents d12/d21/d2f/d57/d84/d89/d92 0 2024-09-12T01:43:16.869 INFO:tasks.workunit.client.0.smithi066.stdout:6/650: truncate d2/f4e 601188 0 2024-09-12T01:43:16.870 INFO:tasks.workunit.client.0.smithi066.stdout:1/575: mknod d5/d52/d60/cab 0 2024-09-12T01:43:16.870 INFO:tasks.workunit.client.1.smithi153.stdout:8/955: write d17/d1f/d4f/f71 [1905097,20885] 0 2024-09-12T01:43:16.871 INFO:tasks.workunit.client.1.smithi153.stdout:8/956: truncate d17/d1f/d4f/d42/d79/dac/d108/f116 111804 0 2024-09-12T01:43:16.871 INFO:tasks.workunit.client.1.smithi153.stdout:4/958: dread d6/d9/dc/d31/f100 [0,4194304] 0 2024-09-12T01:43:16.871 INFO:tasks.workunit.client.0.smithi066.stdout:3/661: rename d5/d6/d1b/d45/d66/d67/d75/d8e/fcd to d5/d6/d1b/d45/d66/d67/d7f/fe9 0 2024-09-12T01:43:16.871 INFO:tasks.workunit.client.0.smithi066.stdout:3/662: write d5/d6/d1b/d45/d66/d67/d7f/da8/fd9 [976061,90410] 0 2024-09-12T01:43:16.871 INFO:tasks.workunit.client.0.smithi066.stdout:3/663: write d5/f17 [2168027,20458] 0 2024-09-12T01:43:16.872 INFO:tasks.workunit.client.0.smithi066.stdout:8/647: link d12/lb3 d12/d21/d2f/d57/ld3 0 2024-09-12T01:43:16.872 INFO:tasks.workunit.client.0.smithi066.stdout:8/648: chown d12/d21/d2f/d57/d84/d89/f96 1889661 1 2024-09-12T01:43:16.873 INFO:tasks.workunit.client.0.smithi066.stdout:8/649: stat d12/d21/d2f/d57/d84/d50/d56/d69/c77 0 2024-09-12T01:43:16.874 INFO:tasks.workunit.client.1.smithi153.stdout:8/957: rmdir d17/d1f/dcf/d106/d96/d6c 39 2024-09-12T01:43:16.874 INFO:tasks.workunit.client.1.smithi153.stdout:4/959: creat d6/d9/dc/d98/d3e/f144 x:0 0 0 2024-09-12T01:43:16.875 INFO:tasks.workunit.client.0.smithi066.stdout:6/651: mkdir d2/d99/d12/d1d/d6b/dc6/dd9 0 2024-09-12T01:43:16.880 INFO:tasks.workunit.client.1.smithi153.stdout:4/960: mkdir d6/d9/d11/d90/db7/d145 0 2024-09-12T01:43:16.882 INFO:tasks.workunit.client.0.smithi066.stdout:8/650: rename d12/d21/d2f/d57/d84/d50/d56/db6/l8d to d12/d21/d2f/d57/d84/ld4 0 2024-09-12T01:43:16.882 INFO:tasks.workunit.client.0.smithi066.stdout:8/651: write d12/d21/d2f/f95 [425217,25011] 0 2024-09-12T01:43:16.883 INFO:tasks.workunit.client.0.smithi066.stdout:3/664: write d5/d6/d1b/d45/d66/d67/d6d/dc7/f46 [1145007,1501] 0 2024-09-12T01:43:16.885 INFO:tasks.workunit.client.0.smithi066.stdout:6/652: dread d2/d99/d12/d1d/f96 [0,4194304] 0 2024-09-12T01:43:16.887 INFO:tasks.workunit.client.0.smithi066.stdout:7/512: dwrite d2/d41/d53/f85 [0,4194304] 0 2024-09-12T01:43:16.887 INFO:tasks.workunit.client.0.smithi066.stdout:7/513: readlink d2/d5/da/d3f/da4/l4a 0 2024-09-12T01:43:16.888 INFO:tasks.workunit.client.1.smithi153.stdout:4/961: mknod d6/d9/d20/c146 0 2024-09-12T01:43:16.888 INFO:tasks.workunit.client.1.smithi153.stdout:4/962: write d6/da4/fd0 [4957438,74637] 0 2024-09-12T01:43:16.888 INFO:tasks.workunit.client.0.smithi066.stdout:8/652: symlink d12/d21/d2f/d57/d84/d89/ld5 0 2024-09-12T01:43:16.888 INFO:tasks.workunit.client.0.smithi066.stdout:8/653: dread - d12/f74 zero size 2024-09-12T01:43:16.889 INFO:tasks.workunit.client.0.smithi066.stdout:8/654: chown d12/d21/d2f/f9a 247839311 1 2024-09-12T01:43:16.892 INFO:tasks.workunit.client.0.smithi066.stdout:6/653: dread d2/d99/f2d [0,4194304] 0 2024-09-12T01:43:16.894 INFO:tasks.workunit.client.1.smithi153.stdout:8/958: dwrite d17/d1f/dcf/d106/d99/ffc [0,4194304] 0 2024-09-12T01:43:16.898 INFO:tasks.workunit.client.0.smithi066.stdout:3/665: write d5/d6/d1b/d45/d66/d67/d6d/dc7/fb8 [3633633,31319] 0 2024-09-12T01:43:16.898 INFO:tasks.workunit.client.0.smithi066.stdout:3/666: creat d5/d6/d1b/d65/d89/fea x:0 0 0 2024-09-12T01:43:16.898 INFO:tasks.workunit.client.0.smithi066.stdout:2/550: sync 2024-09-12T01:43:16.898 INFO:tasks.workunit.client.0.smithi066.stdout:5/615: sync 2024-09-12T01:43:16.899 INFO:tasks.workunit.client.0.smithi066.stdout:1/576: rmdir d5/d52 39 2024-09-12T01:43:16.899 INFO:tasks.workunit.client.0.smithi066.stdout:2/551: dread de/d13/f87 [0,4194304] 0 2024-09-12T01:43:16.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/959: creat d17/d1d/f141 x:0 0 0 2024-09-12T01:43:16.901 INFO:tasks.workunit.client.1.smithi153.stdout:8/960: readlink d17/d1f/dcf/d106/d95/db7/l12c 0 2024-09-12T01:43:16.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/963: dwrite d6/d6a/f8c [0,4194304] 0 2024-09-12T01:43:16.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/964: write d6/d9/d11/d13/dce/dd7/f62 [4564321,15454] 0 2024-09-12T01:43:16.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/965: chown d6/d9/dc/d31/d76/d99/l5d 10475169 1 2024-09-12T01:43:16.904 INFO:tasks.workunit.client.1.smithi153.stdout:4/966: chown d6/d15/db4/c83 250947011 1 2024-09-12T01:43:16.905 INFO:tasks.workunit.client.0.smithi066.stdout:7/514: rename d2/d5/da/d3f/da4/d6c/d8e/caf to d2/d5/d6/d22/d75/d2f/cb1 0 2024-09-12T01:43:16.905 INFO:tasks.workunit.client.0.smithi066.stdout:7/515: readlink d2/d5/da/d3f/da4/d6c/d8e/l96 0 2024-09-12T01:43:16.906 INFO:tasks.workunit.client.0.smithi066.stdout:8/655: symlink d12/d21/d2f/d57/d84/d50/d56/d69/ld6 0 2024-09-12T01:43:16.910 INFO:tasks.workunit.client.0.smithi066.stdout:6/654: symlink d2/d99/d12/d1d/dc7/lda 0 2024-09-12T01:43:16.911 INFO:tasks.workunit.client.0.smithi066.stdout:8/656: dread d12/d21/d2f/d57/d43/d82/dbb/fcb [0,4194304] 0 2024-09-12T01:43:16.917 INFO:tasks.workunit.client.1.smithi153.stdout:4/967: dread d6/d9/dc/d31/d7d/d94/fde [0,4194304] 0 2024-09-12T01:43:16.917 INFO:tasks.workunit.client.1.smithi153.stdout:4/968: chown d6/d9/d11/d13/dce/dd7/f47 1403 1 2024-09-12T01:43:16.917 INFO:tasks.workunit.client.1.smithi153.stdout:4/969: read d6/d9/fc9 [335703,85762] 0 2024-09-12T01:43:16.917 INFO:tasks.workunit.client.1.smithi153.stdout:2/998: sync 2024-09-12T01:43:16.941 INFO:tasks.workunit.client.1.smithi153.stdout:8/961: dwrite d17/d75/fe7 [0,4194304] 0 2024-09-12T01:43:16.942 INFO:tasks.workunit.client.0.smithi066.stdout:7/516: dwrite d2/d5/d6/d22/f30 [4194304,4194304] 0 2024-09-12T01:43:16.942 INFO:tasks.workunit.client.0.smithi066.stdout:7/517: dread - d2/d5/da/d3f/da4/d6c/f9d zero size 2024-09-12T01:43:16.943 INFO:tasks.workunit.client.1.smithi153.stdout:4/970: dwrite d6/d9/dc/d31/f24 [4194304,4194304] 0 2024-09-12T01:43:16.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/577: dwrite d5/dc/d53/d9b/da2/fa5 [0,4194304] 0 2024-09-12T01:43:16.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/578: write d5/dc/d36/f9a [952693,76614] 0 2024-09-12T01:43:16.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/579: stat d5/d15/l25 0 2024-09-12T01:43:16.943 INFO:tasks.workunit.client.0.smithi066.stdout:1/580: dread - d5/d52/d60/fa6 zero size 2024-09-12T01:43:16.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/581: dread d5/dc/d53/f35 [0,4194304] 0 2024-09-12T01:43:16.948 INFO:tasks.workunit.client.0.smithi066.stdout:1/582: dread d5/f7f [0,4194304] 0 2024-09-12T01:43:16.948 INFO:tasks.workunit.client.0.smithi066.stdout:1/583: truncate d5/d52/d5d/f9f 1038876 0 2024-09-12T01:43:16.964 INFO:tasks.workunit.client.0.smithi066.stdout:3/667: creat d5/d6/d1b/d45/d66/dae/feb x:0 0 0 2024-09-12T01:43:16.967 INFO:tasks.workunit.client.0.smithi066.stdout:5/616: symlink d0/d26/d2d/d33/d55/d84/lbd 0 2024-09-12T01:43:16.969 INFO:tasks.workunit.client.0.smithi066.stdout:1/584: dwrite d5/dc/d53/f35 [0,4194304] 0 2024-09-12T01:43:16.971 INFO:tasks.workunit.client.0.smithi066.stdout:6/655: mkdir d2/d99/d7b/ddb 0 2024-09-12T01:43:16.972 INFO:tasks.workunit.client.0.smithi066.stdout:8/657: rmdir d12/d21/d2f/d53 39 2024-09-12T01:43:16.982 INFO:tasks.workunit.client.0.smithi066.stdout:0/663: sync 2024-09-12T01:43:16.982 INFO:tasks.workunit.client.0.smithi066.stdout:4/617: sync 2024-09-12T01:43:16.983 INFO:tasks.workunit.client.0.smithi066.stdout:9/618: sync 2024-09-12T01:43:16.983 INFO:tasks.workunit.client.0.smithi066.stdout:9/619: fsync d0/d6/d17/d1b/d4c/f2a 0 2024-09-12T01:43:16.984 INFO:tasks.workunit.client.0.smithi066.stdout:4/618: write d4/d15/f94 [607916,90826] 0 2024-09-12T01:43:16.984 INFO:tasks.workunit.client.0.smithi066.stdout:4/619: write d4/d15/f94 [359789,28917] 0 2024-09-12T01:43:16.996 INFO:tasks.workunit.client.0.smithi066.stdout:8/658: dwrite d12/d21/d2f/fc0 [0,4194304] 0 2024-09-12T01:43:17.037 INFO:tasks.workunit.client.1.smithi153.stdout:4/971: creat d6/d6a/d9c/f147 x:0 0 0 2024-09-12T01:43:17.066 INFO:tasks.workunit.client.0.smithi066.stdout:3/668: mknod d5/d6/d1b/d45/d66/d67/d7f/da8/cec 0 2024-09-12T01:43:17.067 INFO:tasks.workunit.client.0.smithi066.stdout:3/669: dread d5/f92 [0,4194304] 0 2024-09-12T01:43:17.067 INFO:tasks.workunit.client.0.smithi066.stdout:3/670: chown d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f7d 456275841 1 2024-09-12T01:43:17.070 INFO:tasks.workunit.client.0.smithi066.stdout:5/617: creat d0/d26/d2d/d33/d55/d82/d87/d8e/fbe x:0 0 0 2024-09-12T01:43:17.072 INFO:tasks.workunit.client.0.smithi066.stdout:2/552: mknod de/cbd 0 2024-09-12T01:43:17.074 INFO:tasks.workunit.client.0.smithi066.stdout:1/585: mkdir d5/dc/d36/d57/dac 0 2024-09-12T01:43:17.074 INFO:tasks.workunit.client.0.smithi066.stdout:3/671: dread d5/d6/d1b/d45/d66/d67/d6d/dc7/fb8 [0,4194304] 0 2024-09-12T01:43:17.076 INFO:tasks.workunit.client.1.smithi153.stdout:8/962: symlink d17/d21/l142 0 2024-09-12T01:43:17.076 INFO:tasks.workunit.client.1.smithi153.stdout:8/963: dread - d17/d1f/d4f/d34/db4/fa7 zero size 2024-09-12T01:43:17.077 INFO:tasks.workunit.client.1.smithi153.stdout:8/964: chown d17/d1f/dcf/d106/l68 4156 1 2024-09-12T01:43:17.078 INFO:tasks.workunit.client.0.smithi066.stdout:6/656: truncate d2/f2a 2282040 0 2024-09-12T01:43:17.078 INFO:tasks.workunit.client.1.smithi153.stdout:8/965: dread d17/d1f/dcf/d106/ddf/de3/fa5 [0,4194304] 0 2024-09-12T01:43:17.080 INFO:tasks.workunit.client.0.smithi066.stdout:0/664: mkdir d1/d62/d9f/d4a/d67/d1b/d61/dec 0 2024-09-12T01:43:17.081 INFO:tasks.workunit.client.0.smithi066.stdout:0/665: read d1/d62/d9f/d4a/d67/d20/f35 [2257557,122493] 0 2024-09-12T01:43:17.082 INFO:tasks.workunit.client.0.smithi066.stdout:0/666: write d1/d62/d9f/d4a/d67/d20/d5e/fa7 [660453,56010] 0 2024-09-12T01:43:17.082 INFO:tasks.workunit.client.0.smithi066.stdout:0/667: write d1/d62/d9f/d7c/fe5 [336099,4975] 0 2024-09-12T01:43:17.083 INFO:tasks.workunit.client.0.smithi066.stdout:9/620: creat d0/d6/d17/d4f/d12/dbe/fde x:0 0 0 2024-09-12T01:43:17.094 INFO:tasks.workunit.client.0.smithi066.stdout:8/659: link d12/d21/d2f/d57/d43/d66/d98/fc9 d12/d21/d2f/d57/d84/d50/d56/db6/fd7 0 2024-09-12T01:43:17.096 INFO:tasks.workunit.client.0.smithi066.stdout:7/518: symlink d2/d5/lb2 0 2024-09-12T01:43:17.098 INFO:tasks.workunit.client.1.smithi153.stdout:8/966: dwrite f16 [0,4194304] 0 2024-09-12T01:43:17.098 INFO:tasks.workunit.client.1.smithi153.stdout:8/967: write d17/d1f/dcf/d106/ddf/de3/fa5 [2099363,67998] 0 2024-09-12T01:43:17.098 INFO:tasks.workunit.client.1.smithi153.stdout:8/968: write d17/d1f/dcf/d106/d96/d6c/d89/d9c/f113 [2389658,105741] 0 2024-09-12T01:43:17.101 INFO:tasks.workunit.client.1.smithi153.stdout:4/972: unlink d6/da4/d112/c140 0 2024-09-12T01:43:17.101 INFO:tasks.workunit.client.0.smithi066.stdout:2/553: symlink de/d13/d7f/lbe 0 2024-09-12T01:43:17.104 INFO:tasks.workunit.client.0.smithi066.stdout:1/586: truncate d5/dc/d4f/d8e/f91 574296 0 2024-09-12T01:43:17.108 INFO:tasks.workunit.client.0.smithi066.stdout:3/672: creat d5/d6/d1b/fed x:0 0 0 2024-09-12T01:43:17.111 INFO:tasks.workunit.client.1.smithi153.stdout:8/969: rename d17/d1f/d4f/d34/db4/c138 to d17/d1f/d4f/d42/d79/dd4/c143 0 2024-09-12T01:43:17.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/660: dwrite d12/d21/d2f/d57/d3c/f76 [0,4194304] 0 2024-09-12T01:43:17.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/661: write d12/d21/d2f/d57/fb1 [1389373,125904] 0 2024-09-12T01:43:17.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/662: chown d12/l5c 1612 1 2024-09-12T01:43:17.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/663: chown d12/c15 1890 1 2024-09-12T01:43:17.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/664: stat d12/f23 0 2024-09-12T01:43:17.113 INFO:tasks.workunit.client.0.smithi066.stdout:6/657: unlink d2/d99/d7b/cbb 0 2024-09-12T01:43:17.115 INFO:tasks.workunit.client.0.smithi066.stdout:0/668: mkdir d1/d62/d9f/d92/db9/ded 0 2024-09-12T01:43:17.115 INFO:tasks.workunit.client.0.smithi066.stdout:0/669: chown d1/d62/d9f/d4a/d67/dd0 260975580 1 2024-09-12T01:43:17.116 INFO:tasks.workunit.client.0.smithi066.stdout:0/670: write d1/d62/d9f/d4a/d67/d1b/f7d [855678,33772] 0 2024-09-12T01:43:17.116 INFO:tasks.workunit.client.1.smithi153.stdout:4/973: mkdir d6/d9/dc/d31/d148 0 2024-09-12T01:43:17.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/621: truncate d0/f7 1655752 0 2024-09-12T01:43:17.120 INFO:tasks.workunit.client.0.smithi066.stdout:7/519: mknod d2/d5/da/d3f/da4/d6c/d8e/da7/cb3 0 2024-09-12T01:43:17.122 INFO:tasks.workunit.client.0.smithi066.stdout:3/673: mkdir d5/d6/d1b/d45/d66/d5c/dee 0 2024-09-12T01:43:17.128 INFO:tasks.workunit.client.0.smithi066.stdout:7/520: mkdir d2/d5/d6/d40/d63/db4 0 2024-09-12T01:43:17.131 INFO:tasks.workunit.client.0.smithi066.stdout:3/674: unlink d5/d6/d1b/d65/d89/d50/fc5 0 2024-09-12T01:43:17.131 INFO:tasks.workunit.client.0.smithi066.stdout:3/675: truncate d5/d6/d1b/d65/d89/d50/fa4 743848 0 2024-09-12T01:43:17.132 INFO:tasks.workunit.client.0.smithi066.stdout:4/620: rmdir d4/d5f 39 2024-09-12T01:43:17.134 INFO:tasks.workunit.client.0.smithi066.stdout:7/521: rmdir d2/d5/da/d3f 39 2024-09-12T01:43:17.136 INFO:tasks.workunit.client.0.smithi066.stdout:3/676: truncate d5/d6/d1b/d45/d85/dd2/fe0 729702 0 2024-09-12T01:43:17.136 INFO:tasks.workunit.client.0.smithi066.stdout:3/677: truncate d5/d6/d1b/d45/d66/d67/d75/d8e/fad 176359 0 2024-09-12T01:43:17.137 INFO:tasks.workunit.client.0.smithi066.stdout:4/621: creat d4/d84/dba/fc4 x:0 0 0 2024-09-12T01:43:17.137 INFO:tasks.workunit.client.0.smithi066.stdout:4/622: dread - d4/d6/d62/fa5 zero size 2024-09-12T01:43:17.138 INFO:tasks.workunit.client.0.smithi066.stdout:2/554: dwrite de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:17.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:17 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:17 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:17 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:17 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.142 INFO:tasks.workunit.client.0.smithi066.stdout:4/623: creat d4/d5f/d9a/fc5 x:0 0 0 2024-09-12T01:43:17.145 INFO:tasks.workunit.client.0.smithi066.stdout:3/678: symlink d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/lef 0 2024-09-12T01:43:17.146 INFO:tasks.workunit.client.0.smithi066.stdout:4/624: mknod d4/d15/d33/d5e/dac/cc6 0 2024-09-12T01:43:17.147 INFO:tasks.workunit.client.0.smithi066.stdout:3/679: creat d5/d6/d1b/d45/d66/d5c/dee/ff0 x:0 0 0 2024-09-12T01:43:17.148 INFO:tasks.workunit.client.0.smithi066.stdout:4/625: link d4/d6/f9d d4/d6/d48/d88/fc7 0 2024-09-12T01:43:17.149 INFO:tasks.workunit.client.0.smithi066.stdout:3/680: mkdir d5/d6/d1b/d45/d66/d67/d6d/dc7/df1 0 2024-09-12T01:43:17.151 INFO:tasks.workunit.client.0.smithi066.stdout:3/681: creat d5/d6/d1b/d45/d66/d67/d75/ff2 x:0 0 0 2024-09-12T01:43:17.152 INFO:tasks.workunit.client.0.smithi066.stdout:3/682: symlink d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/lf3 0 2024-09-12T01:43:17.155 INFO:tasks.workunit.client.0.smithi066.stdout:1/587: dwrite d5/d52/d60/f79 [0,4194304] 0 2024-09-12T01:43:17.160 INFO:tasks.workunit.client.0.smithi066.stdout:4/626: dread d4/d6/d8/f32 [0,4194304] 0 2024-09-12T01:43:17.162 INFO:tasks.workunit.client.0.smithi066.stdout:1/588: creat d5/d15/fad x:0 0 0 2024-09-12T01:43:17.164 INFO:tasks.workunit.client.0.smithi066.stdout:1/589: rmdir d5/d15/daa 0 2024-09-12T01:43:17.166 INFO:tasks.workunit.client.0.smithi066.stdout:1/590: mkdir d5/dc/d53/dae 0 2024-09-12T01:43:17.166 INFO:tasks.workunit.client.0.smithi066.stdout:5/618: mkdir d0/dd/d18/d36/dbf 0 2024-09-12T01:43:17.168 INFO:tasks.workunit.client.0.smithi066.stdout:5/619: mkdir d0/d26/d2d/d42/d95/dc0 0 2024-09-12T01:43:17.175 INFO:tasks.workunit.client.1.smithi153.stdout:4/974: dwrite d6/f53 [0,4194304] 0 2024-09-12T01:43:17.175 INFO:tasks.workunit.client.0.smithi066.stdout:9/622: dwrite d0/d6/d7f/d90/d9a/fba [0,4194304] 0 2024-09-12T01:43:17.176 INFO:tasks.workunit.client.0.smithi066.stdout:8/665: dwrite d12/d21/d2f/d57/d43/d66/d98/fc9 [0,4194304] 0 2024-09-12T01:43:17.176 INFO:tasks.workunit.client.0.smithi066.stdout:8/666: chown d12/d21/d2f/d53 14201 1 2024-09-12T01:43:17.176 INFO:tasks.workunit.client.0.smithi066.stdout:8/667: fsync d12/d21/d2f/d57/d84/d50/d56/f97 0 2024-09-12T01:43:17.180 INFO:tasks.workunit.client.1.smithi153.stdout:2/999: mknod d7/db/d27/c13b 0 2024-09-12T01:43:17.182 INFO:tasks.workunit.client.0.smithi066.stdout:7/522: dwrite d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:17.185 INFO:tasks.workunit.client.0.smithi066.stdout:8/668: mkdir d12/d21/d2f/d57/d84/d89/dd8 0 2024-09-12T01:43:17.186 INFO:tasks.workunit.client.0.smithi066.stdout:7/523: truncate d2/d5/da/d3f/da4/f4b 3927901 0 2024-09-12T01:43:17.186 INFO:tasks.workunit.client.0.smithi066.stdout:8/669: dread d12/d21/d2f/d57/d84/d89/d92/fa0 [0,4194304] 0 2024-09-12T01:43:17.186 INFO:tasks.workunit.client.0.smithi066.stdout:8/670: write d12/d21/fa5 [765828,71728] 0 2024-09-12T01:43:17.187 INFO:tasks.workunit.client.0.smithi066.stdout:7/524: creat d2/d5/da/d3f/da4/d70/fb5 x:0 0 0 2024-09-12T01:43:17.188 INFO:tasks.workunit.client.0.smithi066.stdout:8/671: mknod d12/d21/d2f/d57/d84/d50/d56/d69/cd9 0 2024-09-12T01:43:17.191 INFO:tasks.workunit.client.0.smithi066.stdout:3/683: dwrite d5/d6/d1b/d45/d66/d67/d6d/f7a [0,4194304] 0 2024-09-12T01:43:17.194 INFO:tasks.workunit.client.0.smithi066.stdout:2/555: dwrite f5 [0,4194304] 0 2024-09-12T01:43:17.200 INFO:tasks.workunit.client.0.smithi066.stdout:4/627: dwrite d4/f37 [0,4194304] 0 2024-09-12T01:43:17.200 INFO:tasks.workunit.client.0.smithi066.stdout:6/658: rmdir d2/d21 39 2024-09-12T01:43:17.200 INFO:tasks.workunit.client.0.smithi066.stdout:6/659: readlink d2/d99/d12/l8f 0 2024-09-12T01:43:17.202 INFO:tasks.workunit.client.0.smithi066.stdout:4/628: symlink d4/d6/d48/lc8 0 2024-09-12T01:43:17.206 INFO:tasks.workunit.client.0.smithi066.stdout:6/660: creat d2/d99/fdc x:0 0 0 2024-09-12T01:43:17.207 INFO:tasks.workunit.client.0.smithi066.stdout:9/623: read d0/d6/d17/d4f/f36 [2908381,6131] 0 2024-09-12T01:43:17.209 INFO:tasks.workunit.client.0.smithi066.stdout:8/672: write d12/d21/d2f/d57/d3c/f76 [1268608,27484] 0 2024-09-12T01:43:17.209 INFO:tasks.workunit.client.0.smithi066.stdout:1/591: dwrite d5/dc/d36/d4b/f5f [0,4194304] 0 2024-09-12T01:43:17.210 INFO:tasks.workunit.client.0.smithi066.stdout:6/661: creat d2/d99/d12/d1d/d6b/dc6/dd9/fdd x:0 0 0 2024-09-12T01:43:17.212 INFO:tasks.workunit.client.0.smithi066.stdout:8/673: symlink d12/d21/d2f/d57/d3c/lda 0 2024-09-12T01:43:17.213 INFO:tasks.workunit.client.0.smithi066.stdout:2/556: dread de/d13/d1e/d22/f54 [0,4194304] 0 2024-09-12T01:43:17.213 INFO:tasks.workunit.client.0.smithi066.stdout:2/557: dread - de/d13/d1e/d25/d5e/fa1 zero size 2024-09-12T01:43:17.214 INFO:tasks.workunit.client.0.smithi066.stdout:8/674: symlink d12/d21/d2f/d57/d43/ldb 0 2024-09-12T01:43:17.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/662: dread d2/d99/d72/d76/f83 [0,4194304] 0 2024-09-12T01:43:17.216 INFO:tasks.workunit.client.0.smithi066.stdout:6/663: readlink d2/d99/l1b 0 2024-09-12T01:43:17.217 INFO:tasks.workunit.client.0.smithi066.stdout:1/592: mkdir d5/dc/daf 0 2024-09-12T01:43:17.218 INFO:tasks.workunit.client.0.smithi066.stdout:8/675: symlink d12/d21/d2f/d57/d43/ldc 0 2024-09-12T01:43:17.219 INFO:tasks.workunit.client.0.smithi066.stdout:8/676: write d12/f5b [1435960,100085] 0 2024-09-12T01:43:17.219 INFO:tasks.workunit.client.0.smithi066.stdout:8/677: stat d12/d21/d2f/d57/d84/d50/d56 0 2024-09-12T01:43:17.220 INFO:tasks.workunit.client.0.smithi066.stdout:8/678: write d12/d21/d2f/d57/d43/fa9 [693999,115504] 0 2024-09-12T01:43:17.221 INFO:tasks.workunit.client.0.smithi066.stdout:6/664: link d2/d99/d12/d1d/d6b/dbc/cb6 d2/d99/d12/d1d/d6b/cde 0 2024-09-12T01:43:17.226 INFO:tasks.workunit.client.0.smithi066.stdout:8/679: rmdir d12/d21/d2f/d57/d43/d82/dbb 39 2024-09-12T01:43:17.226 INFO:tasks.workunit.client.0.smithi066.stdout:8/680: readlink d12/d21/d2f/d57/d84/d89/ld5 0 2024-09-12T01:43:17.226 INFO:tasks.workunit.client.0.smithi066.stdout:8/681: write d12/d21/d2f/d53/fa8 [567365,92373] 0 2024-09-12T01:43:17.226 INFO:tasks.workunit.client.0.smithi066.stdout:3/684: dwrite d5/d6/d1b/d45/d66/d5c/fe2 [0,4194304] 0 2024-09-12T01:43:17.227 INFO:tasks.workunit.client.0.smithi066.stdout:6/665: getdents d2/d31 0 2024-09-12T01:43:17.228 INFO:tasks.workunit.client.0.smithi066.stdout:6/666: fdatasync d2/f4e 0 2024-09-12T01:43:17.228 INFO:tasks.workunit.client.0.smithi066.stdout:6/667: chown d2/d21/f41 0 1 2024-09-12T01:43:17.229 INFO:tasks.workunit.client.0.smithi066.stdout:1/593: rmdir d5/dc/d53/d7a 0 2024-09-12T01:43:17.230 INFO:tasks.workunit.client.0.smithi066.stdout:7/525: dwrite d2/d5/da/f36 [0,4194304] 0 2024-09-12T01:43:17.234 INFO:tasks.workunit.client.0.smithi066.stdout:9/624: dwrite d0/d6/d17/d28/d79/fdb [4194304,4194304] 0 2024-09-12T01:43:17.236 INFO:tasks.workunit.client.0.smithi066.stdout:3/685: unlink d5/l19 0 2024-09-12T01:43:17.236 INFO:tasks.workunit.client.0.smithi066.stdout:3/686: write d5/d6/d48/fdf [649722,74085] 0 2024-09-12T01:43:17.236 INFO:tasks.workunit.client.0.smithi066.stdout:2/558: dwrite de/d13/d1e/d84/fab [0,4194304] 0 2024-09-12T01:43:17.238 INFO:tasks.workunit.client.0.smithi066.stdout:1/594: creat d5/dc/d36/d4b/fb0 x:0 0 0 2024-09-12T01:43:17.239 INFO:tasks.workunit.client.0.smithi066.stdout:7/526: mkdir d2/d5/d6/d22/d75/db6 0 2024-09-12T01:43:17.242 INFO:tasks.workunit.client.0.smithi066.stdout:9/625: creat d0/d6/d17/d28/fdf x:0 0 0 2024-09-12T01:43:17.243 INFO:tasks.workunit.client.0.smithi066.stdout:3/687: unlink d5/d6/d48/fab 0 2024-09-12T01:43:17.243 INFO:tasks.workunit.client.0.smithi066.stdout:3/688: chown d5/d6/c15 27218 1 2024-09-12T01:43:17.243 INFO:tasks.workunit.client.0.smithi066.stdout:3/689: truncate d5/d6/d1b/d45/d66/d67/d7f/fcc 764632 0 2024-09-12T01:43:17.247 INFO:tasks.workunit.client.0.smithi066.stdout:9/626: mkdir d0/d6/d17/d1b/d4c/d4b/d86/de0 0 2024-09-12T01:43:17.248 INFO:tasks.workunit.client.0.smithi066.stdout:3/690: creat d5/d6/d1b/d45/d66/dae/dd7/de8/ff4 x:0 0 0 2024-09-12T01:43:17.251 INFO:tasks.workunit.client.0.smithi066.stdout:3/691: dread d5/d6/d1b/f83 [0,4194304] 0 2024-09-12T01:43:17.251 INFO:tasks.workunit.client.0.smithi066.stdout:6/668: dwrite d2/d99/f3d [0,4194304] 0 2024-09-12T01:43:17.253 INFO:tasks.workunit.client.0.smithi066.stdout:2/559: dread de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:17.254 INFO:tasks.workunit.client.0.smithi066.stdout:3/692: creat d5/d6/d1b/d45/d66/d67/d6d/de6/ff5 x:0 0 0 2024-09-12T01:43:17.255 INFO:tasks.workunit.client.0.smithi066.stdout:1/595: read d5/fa [585304,29768] 0 2024-09-12T01:43:17.256 INFO:tasks.workunit.client.0.smithi066.stdout:6/669: getdents d2/d99/d12/d1d/d6b/dc6 0 2024-09-12T01:43:17.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/596: write d5/d52/d60/fa6 [585318,77549] 0 2024-09-12T01:43:17.256 INFO:tasks.workunit.client.0.smithi066.stdout:1/597: chown d5/dc/ce 118525866 1 2024-09-12T01:43:17.256 INFO:tasks.workunit.client.0.smithi066.stdout:8/682: dwrite d12/d21/d2f/d57/f8c [0,4194304] 0 2024-09-12T01:43:17.257 INFO:tasks.workunit.client.0.smithi066.stdout:3/693: mkdir d5/d6/d1b/d45/d66/d67/d7f/da8/df6 0 2024-09-12T01:43:17.258 INFO:tasks.workunit.client.0.smithi066.stdout:6/670: mkdir d2/d99/d7b/ddf 0 2024-09-12T01:43:17.259 INFO:tasks.workunit.client.0.smithi066.stdout:2/560: dread de/d13/d1e/d22/f89 [0,4194304] 0 2024-09-12T01:43:17.259 INFO:tasks.workunit.client.0.smithi066.stdout:7/527: dwrite d2/d5/da/d3f/d9b/d4d/f60 [0,4194304] 0 2024-09-12T01:43:17.259 INFO:tasks.workunit.client.0.smithi066.stdout:7/528: truncate d2/d5/d6/d40/fa5 227761 0 2024-09-12T01:43:17.261 INFO:tasks.workunit.client.0.smithi066.stdout:1/598: symlink d5/dc/d53/dae/lb1 0 2024-09-12T01:43:17.261 INFO:tasks.workunit.client.0.smithi066.stdout:7/529: dread d2/d5/da/d3f/da4/d6c/d80/d7c/f97 [0,4194304] 0 2024-09-12T01:43:17.261 INFO:tasks.workunit.client.0.smithi066.stdout:7/530: fsync d2/d5/f39 0 2024-09-12T01:43:17.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/694: mkdir d5/d6/d1b/d45/d66/d67/d6d/dc7/df1/df7 0 2024-09-12T01:43:17.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/695: creat d5/d6/d1b/d65/d89/d50/ff8 x:0 0 0 2024-09-12T01:43:17.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/696: getdents d5/d6/d1b/d45/d66/d67/d75/d8e/db4/de4 0 2024-09-12T01:43:17.263 INFO:tasks.workunit.client.0.smithi066.stdout:3/697: chown d5/d6/d1b/d45/d66/d67/d7f/da8/df6 20789 1 2024-09-12T01:43:17.264 INFO:tasks.workunit.client.0.smithi066.stdout:6/671: getdents d2 0 2024-09-12T01:43:17.264 INFO:tasks.workunit.client.0.smithi066.stdout:6/672: truncate d2/d99/d12/d49/d9e/fd1 315594 0 2024-09-12T01:43:17.265 INFO:tasks.workunit.client.0.smithi066.stdout:2/561: creat de/d13/d1e/fbf x:0 0 0 2024-09-12T01:43:17.265 INFO:tasks.workunit.client.0.smithi066.stdout:2/562: fsync de/d13/d1e/d84/f8a 0 2024-09-12T01:43:17.266 INFO:tasks.workunit.client.0.smithi066.stdout:1/599: creat d5/d15/d58/da1/fb2 x:0 0 0 2024-09-12T01:43:17.267 INFO:tasks.workunit.client.0.smithi066.stdout:1/600: write d5/d52/d5d/f9f [466994,85287] 0 2024-09-12T01:43:17.267 INFO:tasks.workunit.client.0.smithi066.stdout:1/601: creat d5/d15/d58/da1/fb3 x:0 0 0 2024-09-12T01:43:17.275 INFO:tasks.workunit.client.0.smithi066.stdout:3/698: mknod d5/d6/d1b/d45/d66/d67/d6d/de6/cf9 0 2024-09-12T01:43:17.275 INFO:tasks.workunit.client.0.smithi066.stdout:3/699: creat d5/d6/d48/ffa x:0 0 0 2024-09-12T01:43:17.276 INFO:tasks.workunit.client.0.smithi066.stdout:0/671: rename d1/d62/d9f/d4a/d67/d1b/l36 to d1/d62/lee 0 2024-09-12T01:43:17.276 INFO:tasks.workunit.client.0.smithi066.stdout:0/672: write d1/d62/d89/da3/feb [520123,64846] 0 2024-09-12T01:43:17.277 INFO:tasks.workunit.client.0.smithi066.stdout:0/673: fsync d1/d62/d89/f82 0 2024-09-12T01:43:17.277 INFO:tasks.workunit.client.0.smithi066.stdout:6/673: symlink d2/d31/le0 0 2024-09-12T01:43:17.277 INFO:tasks.workunit.client.0.smithi066.stdout:6/674: creat d2/d99/fe1 x:0 0 0 2024-09-12T01:43:17.278 INFO:tasks.workunit.client.0.smithi066.stdout:2/563: creat de/d3c/d8f/fc0 x:0 0 0 2024-09-12T01:43:17.279 INFO:tasks.workunit.client.0.smithi066.stdout:6/675: fsync d2/fa3 0 2024-09-12T01:43:17.281 INFO:tasks.workunit.client.0.smithi066.stdout:7/531: mknod d2/d5/cb7 0 2024-09-12T01:43:17.281 INFO:tasks.workunit.client.0.smithi066.stdout:7/532: chown d2/d5/da/c21 572948663 1 2024-09-12T01:43:17.284 INFO:tasks.workunit.client.0.smithi066.stdout:5/620: rename d0/d26/d2f/l45 to d0/dd/d18/d36/dbf/lc1 0 2024-09-12T01:43:17.284 INFO:tasks.workunit.client.0.smithi066.stdout:5/621: chown d0/d26/f34 3 1 2024-09-12T01:43:17.284 INFO:tasks.workunit.client.0.smithi066.stdout:5/622: chown d0/d26/d2d/d33/d55/d82/l29 1 1 2024-09-12T01:43:17.289 INFO:tasks.workunit.client.0.smithi066.stdout:0/674: truncate d1/d62/d9f/d4a/d67/d1b/d26/d5b/fd8 5369256 0 2024-09-12T01:43:17.289 INFO:tasks.workunit.client.0.smithi066.stdout:6/676: unlink d2/d99/d12/d49/c54 0 2024-09-12T01:43:17.289 INFO:tasks.workunit.client.0.smithi066.stdout:6/677: getdents d2/d99/d12/d1d/d6b/dc6 0 2024-09-12T01:43:17.289 INFO:tasks.workunit.client.0.smithi066.stdout:2/564: dread de/d13/d1e/d25/f5b [0,4194304] 0 2024-09-12T01:43:17.290 INFO:tasks.workunit.client.0.smithi066.stdout:1/602: symlink d5/d15/d4d/lb4 0 2024-09-12T01:43:17.290 INFO:tasks.workunit.client.1.smithi153.stdout:8/970: rename d17/d1f/d4f/d34/f11f to d17/d1f/dcf/d106/d95/dd6/f144 0 2024-09-12T01:43:17.290 INFO:tasks.workunit.client.0.smithi066.stdout:7/533: getdents d2/d5/da/d3f/da4/d6c/d80/d5f 0 2024-09-12T01:43:17.292 INFO:tasks.workunit.client.1.smithi153.stdout:8/971: creat d17/d1f/d4f/f145 x:0 0 0 2024-09-12T01:43:17.293 INFO:tasks.workunit.client.0.smithi066.stdout:3/700: getdents d5/d6/d1b/d45/d66/d5c 0 2024-09-12T01:43:17.296 INFO:tasks.workunit.client.1.smithi153.stdout:8/972: creat d17/d1f/dcf/d106/d99/f146 x:0 0 0 2024-09-12T01:43:17.298 INFO:tasks.workunit.client.0.smithi066.stdout:4/629: rename d4/d6/d27/d66/d6c/f97 to d4/d6/d14/fc9 0 2024-09-12T01:43:17.298 INFO:tasks.workunit.client.0.smithi066.stdout:4/630: creat d4/d6/d14/fca x:0 0 0 2024-09-12T01:43:17.300 INFO:tasks.workunit.client.0.smithi066.stdout:5/623: link d0/l3 d0/d26/d2d/d33/da2/lc2 0 2024-09-12T01:43:17.300 INFO:tasks.workunit.client.0.smithi066.stdout:5/624: write d0/dd/d18/f53 [3812492,93430] 0 2024-09-12T01:43:17.300 INFO:tasks.workunit.client.0.smithi066.stdout:1/603: write f4 [159672,66466] 0 2024-09-12T01:43:17.302 INFO:tasks.workunit.client.1.smithi153.stdout:8/973: link d17/d1f/d4f/d42/f13e d17/d1f/d4f/d42/d79/dac/dce/ddc/d128/f147 0 2024-09-12T01:43:17.302 INFO:tasks.workunit.client.1.smithi153.stdout:8/974: chown d17/d1f/dcf/d106/f8f 103010012 1 2024-09-12T01:43:17.302 INFO:tasks.workunit.client.1.smithi153.stdout:8/975: stat d17/d21/l77 0 2024-09-12T01:43:17.302 INFO:tasks.workunit.client.1.smithi153.stdout:8/976: truncate d17/d1f/d4f/d42/f13e 993317 0 2024-09-12T01:43:17.303 INFO:tasks.workunit.client.0.smithi066.stdout:0/675: truncate d1/d72/fd9 611449 0 2024-09-12T01:43:17.303 INFO:tasks.workunit.client.0.smithi066.stdout:0/676: fsync d1/d62/d9f/d4a/d67/f91 0 2024-09-12T01:43:17.304 INFO:tasks.workunit.client.0.smithi066.stdout:4/631: write d4/d6/d27/d66/da1/fad [1839702,2637] 0 2024-09-12T01:43:17.304 INFO:tasks.workunit.client.0.smithi066.stdout:4/632: write d4/d15/d33/d5e/fc3 [339636,69132] 0 2024-09-12T01:43:17.306 INFO:tasks.workunit.client.0.smithi066.stdout:6/678: mknod d2/d31/d5e/ce2 0 2024-09-12T01:43:17.308 INFO:tasks.workunit.client.1.smithi153.stdout:8/977: unlink d17/d1f/dcf/d106/d96/c53 0 2024-09-12T01:43:17.311 INFO:tasks.workunit.client.0.smithi066.stdout:3/701: creat d5/d6/ffb x:0 0 0 2024-09-12T01:43:17.312 INFO:tasks.workunit.client.0.smithi066.stdout:3/702: read d5/d6/d1b/d45/d66/d67/d7f/da8/fd9 [852836,22354] 0 2024-09-12T01:43:17.312 INFO:tasks.workunit.client.0.smithi066.stdout:2/565: creat de/d13/d1e/d25/fc1 x:0 0 0 2024-09-12T01:43:17.312 INFO:tasks.workunit.client.0.smithi066.stdout:7/534: dwrite d2/d5/da/d3f/da4/d6c/d80/f66 [0,4194304] 0 2024-09-12T01:43:17.313 INFO:tasks.workunit.client.1.smithi153.stdout:8/978: symlink d17/d1f/dcf/d106/d95/dd6/ddb/l148 0 2024-09-12T01:43:17.321 INFO:tasks.workunit.client.0.smithi066.stdout:5/625: mknod d0/d26/d2d/d33/db0/cc3 0 2024-09-12T01:43:17.324 INFO:tasks.workunit.client.0.smithi066.stdout:1/604: unlink d5/dc/d36/d4b/c49 0 2024-09-12T01:43:17.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/677: mkdir d1/d62/d9f/d4a/d67/d20/dc9/def 0 2024-09-12T01:43:17.325 INFO:tasks.workunit.client.0.smithi066.stdout:0/678: stat d1/d62/d89/f71 0 2024-09-12T01:43:17.325 INFO:tasks.workunit.client.0.smithi066.stdout:4/633: dwrite d4/d6/d48/f8b [8388608,4194304] 0 2024-09-12T01:43:17.327 INFO:tasks.workunit.client.0.smithi066.stdout:6/679: unlink d2/d31/d5e/ca0 0 2024-09-12T01:43:17.327 INFO:tasks.workunit.client.0.smithi066.stdout:3/703: rmdir d5/d6/d1b/d45/d66/d5c 39 2024-09-12T01:43:17.329 INFO:tasks.workunit.client.0.smithi066.stdout:7/535: creat d2/d5/da/d3f/fb8 x:0 0 0 2024-09-12T01:43:17.330 INFO:tasks.workunit.client.0.smithi066.stdout:5/626: unlink d0/dd/d18/d36/d4c/f61 0 2024-09-12T01:43:17.330 INFO:tasks.workunit.client.0.smithi066.stdout:5/627: creat d0/d26/d2f/d3b/fc4 x:0 0 0 2024-09-12T01:43:17.330 INFO:tasks.workunit.client.0.smithi066.stdout:5/628: dread - d0/dd/d18/d36/f79 zero size 2024-09-12T01:43:17.331 INFO:tasks.workunit.client.0.smithi066.stdout:5/629: dread - d0/dd/d18/fbc zero size 2024-09-12T01:43:17.331 INFO:tasks.workunit.client.0.smithi066.stdout:1/605: rmdir d5/dc/daf 0 2024-09-12T01:43:17.331 INFO:tasks.workunit.client.0.smithi066.stdout:1/606: chown d5/dc/d36/d4b/c6f 1 1 2024-09-12T01:43:17.335 INFO:tasks.workunit.client.0.smithi066.stdout:4/634: mkdir d4/d15/d33/d5e/dac/dcb 0 2024-09-12T01:43:17.335 INFO:tasks.workunit.client.0.smithi066.stdout:4/635: stat d4/d6/d8/d18/d4d 0 2024-09-12T01:43:17.336 INFO:tasks.workunit.client.0.smithi066.stdout:6/680: truncate d2/d31/f85 1963035 0 2024-09-12T01:43:17.336 INFO:tasks.workunit.client.0.smithi066.stdout:6/681: write d2/d99/d12/d1d/d6b/dc6/dd9/fdd [573609,113864] 0 2024-09-12T01:43:17.336 INFO:tasks.workunit.client.0.smithi066.stdout:3/704: rmdir d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f 39 2024-09-12T01:43:17.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/683: rmdir d12/d21/d2f/d57 39 2024-09-12T01:43:17.338 INFO:tasks.workunit.client.0.smithi066.stdout:8/684: readlink d12/d21/d2f/d57/d3c/l4d 0 2024-09-12T01:43:17.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/566: dwrite de/d13/d1e/d22/f74 [0,4194304] 0 2024-09-12T01:43:17.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/567: chown de/d13/d1e/d41/l75 19 1 2024-09-12T01:43:17.340 INFO:tasks.workunit.client.0.smithi066.stdout:5/630: fdatasync d0/dd/d18/f53 0 2024-09-12T01:43:17.341 INFO:tasks.workunit.client.0.smithi066.stdout:5/631: creat d0/d26/d2d/d33/d55/d82/d87/d8e/fc5 x:0 0 0 2024-09-12T01:43:17.342 INFO:tasks.workunit.client.0.smithi066.stdout:4/636: symlink d4/d6/d8/d4a/lcc 0 2024-09-12T01:43:17.342 INFO:tasks.workunit.client.1.smithi153.stdout:8/979: dwrite d17/d1f/d4f/d42/d79/dac/fc9 [0,4194304] 0 2024-09-12T01:43:17.342 INFO:tasks.workunit.client.1.smithi153.stdout:8/980: fsync fd 0 2024-09-12T01:43:17.343 INFO:tasks.workunit.client.0.smithi066.stdout:6/682: symlink d2/d31/d5e/le3 0 2024-09-12T01:43:17.344 INFO:tasks.workunit.client.1.smithi153.stdout:8/981: link d17/d21/c37 d17/d1f/d4f/d34/db4/c149 0 2024-09-12T01:43:17.344 INFO:tasks.workunit.client.1.smithi153.stdout:8/982: write d17/d1f/d4f/d34/db4/fa7 [426219,4599] 0 2024-09-12T01:43:17.346 INFO:tasks.workunit.client.0.smithi066.stdout:3/705: creat d5/d6/d1b/d45/d66/dae/dd7/ffc x:0 0 0 2024-09-12T01:43:17.346 INFO:tasks.workunit.client.0.smithi066.stdout:3/706: fsync d5/d6/d1b/d77/dd5/fba 0 2024-09-12T01:43:17.347 INFO:tasks.workunit.client.0.smithi066.stdout:8/685: mknod d12/db2/cdd 0 2024-09-12T01:43:17.350 INFO:tasks.workunit.client.1.smithi153.stdout:8/983: mkdir d17/d1f/dcf/d106/ddf/de3/d14a 0 2024-09-12T01:43:17.350 INFO:tasks.workunit.client.1.smithi153.stdout:8/984: dread - d17/d21/f10b zero size 2024-09-12T01:43:17.351 INFO:tasks.workunit.client.0.smithi066.stdout:1/607: symlink d5/d15/lb5 0 2024-09-12T01:43:17.356 INFO:tasks.workunit.client.0.smithi066.stdout:2/568: truncate de/d13/d28/f8e 746380 0 2024-09-12T01:43:17.356 INFO:tasks.workunit.client.0.smithi066.stdout:2/569: stat de/l97 0 2024-09-12T01:43:17.358 INFO:tasks.workunit.client.0.smithi066.stdout:0/679: rename d1/d62/d9f/d4a/dba to d1/d62/d6c/dad/df0 0 2024-09-12T01:43:17.359 INFO:tasks.workunit.client.0.smithi066.stdout:9/627: truncate d0/d6/d37/d85/fa8 4783022 0 2024-09-12T01:43:17.364 INFO:tasks.workunit.client.0.smithi066.stdout:5/632: mknod d0/d21/cc6 0 2024-09-12T01:43:17.365 INFO:tasks.workunit.client.0.smithi066.stdout:4/637: mknod d4/d6/d8/d18/d45/ccd 0 2024-09-12T01:43:17.366 INFO:tasks.workunit.client.0.smithi066.stdout:4/638: read d4/d6/d8/f13 [3010126,36433] 0 2024-09-12T01:43:17.366 INFO:tasks.workunit.client.0.smithi066.stdout:4/639: write d4/d6/d27/d66/da1/fad [2827497,90529] 0 2024-09-12T01:43:17.366 INFO:tasks.workunit.client.0.smithi066.stdout:3/707: symlink d5/d6/d1b/d45/d66/de7/lfd 0 2024-09-12T01:43:17.367 INFO:tasks.workunit.client.0.smithi066.stdout:6/683: dwrite d2/d31/d57/f67 [0,4194304] 0 2024-09-12T01:43:17.367 INFO:tasks.workunit.client.0.smithi066.stdout:6/684: dread - d2/d99/d7b/fbd zero size 2024-09-12T01:43:17.367 INFO:tasks.workunit.client.0.smithi066.stdout:6/685: creat d2/d99/d12/d1d/d6b/dc6/dd9/fe4 x:0 0 0 2024-09-12T01:43:17.368 INFO:tasks.workunit.client.1.smithi153.stdout:8/985: dread d17/d75/fe7 [0,4194304] 0 2024-09-12T01:43:17.368 INFO:tasks.workunit.client.0.smithi066.stdout:8/686: mkdir d12/d21/d2f/d53/dde 0 2024-09-12T01:43:17.370 INFO:tasks.workunit.client.0.smithi066.stdout:1/608: mkdir d5/d52/d5d/db6 0 2024-09-12T01:43:17.377 INFO:tasks.workunit.client.0.smithi066.stdout:7/536: rename d2/d71/l89 to d2/lb9 0 2024-09-12T01:43:17.380 INFO:tasks.workunit.client.0.smithi066.stdout:0/680: symlink d1/d62/d9f/d4a/d67/d1b/d26/d9c/lf1 0 2024-09-12T01:43:17.380 INFO:tasks.workunit.client.0.smithi066.stdout:0/681: chown d1/d62/d9f/d4a/d67/d20/f30 122412 1 2024-09-12T01:43:17.380 INFO:tasks.workunit.client.0.smithi066.stdout:0/682: creat d1/d62/d9f/d7c/ff2 x:0 0 0 2024-09-12T01:43:17.382 INFO:tasks.workunit.client.1.smithi153.stdout:8/986: rename d17/d1d/d27/f7e to d17/d1f/d4f/d34/f14b 0 2024-09-12T01:43:17.383 INFO:tasks.workunit.client.0.smithi066.stdout:4/640: symlink d4/d6/d27/d2f/d72/lce 0 2024-09-12T01:43:17.383 INFO:tasks.workunit.client.0.smithi066.stdout:9/628: dwrite d0/d6/f8e [0,4194304] 0 2024-09-12T01:43:17.383 INFO:tasks.workunit.client.0.smithi066.stdout:9/629: write d0/f2 [2926733,90814] 0 2024-09-12T01:43:17.385 INFO:tasks.workunit.client.0.smithi066.stdout:3/708: unlink d5/d6/d1b/d45/d66/d67/d7f/da8/faf 0 2024-09-12T01:43:17.386 INFO:tasks.workunit.client.1.smithi153.stdout:8/987: mkdir d17/d1f/dcf/d106/d96/d6c/d6e/d14c 0 2024-09-12T01:43:17.389 INFO:tasks.workunit.client.0.smithi066.stdout:8/687: symlink d12/d21/d2f/ldf 0 2024-09-12T01:43:17.389 INFO:tasks.workunit.client.0.smithi066.stdout:8/688: fdatasync d12/d21/d2f/d57/d43/d82/fbe 0 2024-09-12T01:43:17.389 INFO:tasks.workunit.client.0.smithi066.stdout:8/689: truncate d12/d21/d2f/d57/d84/d50/d56/f97 897537 0 2024-09-12T01:43:17.389 INFO:tasks.workunit.client.0.smithi066.stdout:7/537: dread d2/d5/da/d3f/da4/d6c/d80/f58 [0,4194304] 0 2024-09-12T01:43:17.390 INFO:tasks.workunit.client.0.smithi066.stdout:2/570: getdents de/d13/d28 0 2024-09-12T01:43:17.391 INFO:tasks.workunit.client.0.smithi066.stdout:2/571: fsync de/d13/d1e/d41/d81/fb8 0 2024-09-12T01:43:17.393 INFO:tasks.workunit.client.0.smithi066.stdout:5/633: rename d0/d26/d2d/d33/d55/d82/l29 to d0/d21/lc7 0 2024-09-12T01:43:17.396 INFO:tasks.workunit.client.0.smithi066.stdout:9/630: dread d0/d6/d43/fc1 [0,4194304] 0 2024-09-12T01:43:17.402 INFO:tasks.workunit.client.1.smithi153.stdout:8/988: dwrite d17/d1f/dcf/d106/ddf/de3/fa5 [0,4194304] 0 2024-09-12T01:43:17.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:17 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:17 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:17 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:17 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:17.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/989: mknod d17/d1f/dcf/d106/d95/dbc/c14d 0 2024-09-12T01:43:17.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/990: chown d17/d21/c32 26 1 2024-09-12T01:43:17.409 INFO:tasks.workunit.client.1.smithi153.stdout:8/991: creat d17/d1f/dcf/d106/f14e x:0 0 0 2024-09-12T01:43:17.414 INFO:tasks.workunit.client.0.smithi066.stdout:4/641: mkdir d4/d6/d62/dcf 0 2024-09-12T01:43:17.416 INFO:tasks.workunit.client.1.smithi153.stdout:8/992: creat d17/d1f/d4f/d42/d79/dac/dce/ddc/d128/f14f x:0 0 0 2024-09-12T01:43:17.423 INFO:tasks.workunit.client.1.smithi153.stdout:8/993: dread d17/d1f/d4f/d34/f14b [0,4194304] 0 2024-09-12T01:43:17.426 INFO:tasks.workunit.client.1.smithi153.stdout:8/994: creat d17/d1f/d4f/d34/dee/f150 x:0 0 0 2024-09-12T01:43:17.426 INFO:tasks.workunit.client.1.smithi153.stdout:8/995: stat d17/d1d/d27 0 2024-09-12T01:43:17.426 INFO:tasks.workunit.client.1.smithi153.stdout:8/996: chown d17/d1f/d4f/f145 11 1 2024-09-12T01:43:17.432 INFO:tasks.workunit.client.0.smithi066.stdout:3/709: link d5/d6/d1b/d45/d66/d67/d6d/dc7/f2b d5/d6/d1b/d45/d66/d67/d7f/da8/df6/ffe 0 2024-09-12T01:43:17.435 INFO:tasks.workunit.client.0.smithi066.stdout:5/634: rename d0/d21/cc6 to d0/d26/cc8 0 2024-09-12T01:43:17.438 INFO:tasks.workunit.client.0.smithi066.stdout:9/631: creat d0/d6/d17/d4f/d9/fe1 x:0 0 0 2024-09-12T01:43:17.438 INFO:tasks.workunit.client.0.smithi066.stdout:9/632: chown d0/d6/d7f/d90/fd8 1465228 1 2024-09-12T01:43:17.439 INFO:tasks.workunit.client.0.smithi066.stdout:4/642: mknod d4/d6/d27/d66/d6c/cd0 0 2024-09-12T01:43:17.441 INFO:tasks.workunit.client.0.smithi066.stdout:3/710: symlink d5/d6/d1b/d45/d66/d67/d7f/d84/dc6/lff 0 2024-09-12T01:43:17.441 INFO:tasks.workunit.client.0.smithi066.stdout:3/711: chown d5/d6/d1b/d45/d66/d67/d6d/fa5 7239 1 2024-09-12T01:43:17.441 INFO:tasks.workunit.client.0.smithi066.stdout:3/712: write d5/d6/d1b/d45/d66/d67/d6d/dc7/fda [988578,82379] 0 2024-09-12T01:43:17.445 INFO:tasks.workunit.client.0.smithi066.stdout:5/635: mkdir d0/d26/d2f/d30/da8/dc9 0 2024-09-12T01:43:17.445 INFO:tasks.workunit.client.0.smithi066.stdout:5/636: write d0/dd/d18/d36/f79 [311384,113180] 0 2024-09-12T01:43:17.445 INFO:tasks.workunit.client.0.smithi066.stdout:5/637: chown d0/d26/d2f/d3b/d6b 13564 1 2024-09-12T01:43:17.446 INFO:tasks.workunit.client.0.smithi066.stdout:3/713: dread d5/d6/d1b/f88 [0,4194304] 0 2024-09-12T01:43:17.446 INFO:tasks.workunit.client.0.smithi066.stdout:3/714: fdatasync d5/d6/d1b/d45/d85/f9e 0 2024-09-12T01:43:17.446 INFO:tasks.workunit.client.0.smithi066.stdout:3/715: chown d5/f92 96 1 2024-09-12T01:43:17.446 INFO:tasks.workunit.client.1.smithi153.stdout:8/997: dwrite d17/d1f/dcf/d106/d96/d6c/d89/ded/f12d [0,4194304] 0 2024-09-12T01:43:17.447 INFO:tasks.workunit.client.0.smithi066.stdout:1/609: rename d5/fa to d5/d15/d58/fb7 0 2024-09-12T01:43:17.449 INFO:tasks.workunit.client.0.smithi066.stdout:4/643: link d4/d6/d27/cbe d4/d6/d27/d66/d6c/d75/cd1 0 2024-09-12T01:43:17.449 INFO:tasks.workunit.client.0.smithi066.stdout:4/644: truncate d4/d6/d27/d66/d58/f78 817792 0 2024-09-12T01:43:17.451 INFO:tasks.workunit.client.0.smithi066.stdout:5/638: mknod d0/d26/d2d/d33/d55/d82/cca 0 2024-09-12T01:43:17.454 INFO:tasks.workunit.client.0.smithi066.stdout:3/716: rmdir d5/d6/d1b/d45/d66/d67/d6d/dc7/df1/df7 0 2024-09-12T01:43:17.455 INFO:tasks.workunit.client.1.smithi153.stdout:8/998: getdents d17/d1f/d4f/d42/d79 0 2024-09-12T01:43:17.456 INFO:tasks.workunit.client.0.smithi066.stdout:2/572: rename de/d13/d1e/d25/c34 to de/d13/cc2 0 2024-09-12T01:43:17.456 INFO:tasks.workunit.client.0.smithi066.stdout:2/573: stat de/d13/d1e/d25/da2/cb2 0 2024-09-12T01:43:17.456 INFO:tasks.workunit.client.0.smithi066.stdout:9/633: dwrite d0/d6/d17/d4f/d12/f25 [0,4194304] 0 2024-09-12T01:43:17.457 INFO:tasks.workunit.client.0.smithi066.stdout:9/634: write d0/d6/d17/d4f/d9/fbf [482052,8197] 0 2024-09-12T01:43:17.457 INFO:tasks.workunit.client.0.smithi066.stdout:9/635: write d0/d6/d17/f71 [5719692,63252] 0 2024-09-12T01:43:17.458 INFO:tasks.workunit.client.1.smithi153.stdout:8/999: truncate f14 1579589 0 2024-09-12T01:43:17.459 INFO:tasks.workunit.client.0.smithi066.stdout:4/645: mkdir d4/d6/d48/dd2 0 2024-09-12T01:43:17.462 INFO:tasks.workunit.client.0.smithi066.stdout:5/639: write d0/dd/d18/f3d [3675105,11920] 0 2024-09-12T01:43:17.463 INFO:tasks.workunit.client.0.smithi066.stdout:3/717: mknod d5/d6/d1b/d77/d8b/c100 0 2024-09-12T01:43:17.466 INFO:tasks.workunit.client.0.smithi066.stdout:0/683: getdents d1/d62/d6c/dad 0 2024-09-12T01:43:17.468 INFO:tasks.workunit.client.1.smithi153.stdout:4/975: sync 2024-09-12T01:43:17.468 INFO:tasks.workunit.client.1.smithi153.stdout:4/976: write d6/d15/fd9 [954298,62783] 0 2024-09-12T01:43:17.469 INFO:tasks.workunit.client.0.smithi066.stdout:4/646: read d4/d6/d48/d88/f6b [2223880,20874] 0 2024-09-12T01:43:17.469 INFO:tasks.workunit.client.0.smithi066.stdout:4/647: chown d4/d6/d8/d18 239 1 2024-09-12T01:43:17.470 INFO:tasks.workunit.client.0.smithi066.stdout:4/648: rename d4 to d4/d15/d33/d5e/dac/dcb/dd3 22 2024-09-12T01:43:17.472 INFO:tasks.workunit.client.0.smithi066.stdout:5/640: dread d0/d26/d2d/f90 [0,4194304] 0 2024-09-12T01:43:17.473 INFO:tasks.workunit.client.0.smithi066.stdout:1/610: mknod d5/d15/cb8 0 2024-09-12T01:43:17.474 INFO:tasks.workunit.client.1.smithi153.stdout:4/977: truncate d6/d9/dc/d98/f7e 35345 0 2024-09-12T01:43:17.476 INFO:tasks.workunit.client.0.smithi066.stdout:3/718: mkdir d5/d6/d1b/d45/d66/d5c/d101 0 2024-09-12T01:43:17.477 INFO:tasks.workunit.client.0.smithi066.stdout:3/719: dread d5/d6/d1b/d45/d66/d67/d7f/fcc [0,4194304] 0 2024-09-12T01:43:17.478 INFO:tasks.workunit.client.1.smithi153.stdout:4/978: mkdir d6/d9/dc/d98/d149 0 2024-09-12T01:43:17.481 INFO:tasks.workunit.client.0.smithi066.stdout:9/636: dwrite d0/d6/d17/d28/f77 [0,4194304] 0 2024-09-12T01:43:17.498 INFO:tasks.workunit.client.0.smithi066.stdout:2/574: dwrite de/d13/d28/d3a/f6b [0,4194304] 0 2024-09-12T01:43:17.501 INFO:tasks.workunit.client.0.smithi066.stdout:0/684: dwrite d1/d72/de/f3c [0,4194304] 0 2024-09-12T01:43:17.502 INFO:tasks.workunit.client.0.smithi066.stdout:3/720: dwrite d5/d6/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f7d [0,4194304] 0 2024-09-12T01:43:17.503 INFO:tasks.workunit.client.0.smithi066.stdout:3/721: dread d5/d6/d1b/d45/d66/d67/d75/d8e/fad [0,4194304] 0 2024-09-12T01:43:17.504 INFO:tasks.workunit.client.0.smithi066.stdout:3/722: fsync d5/d6/d1b/d77/dd5/fa7 0 2024-09-12T01:43:17.511 INFO:tasks.workunit.client.0.smithi066.stdout:2/575: read de/d13/d1e/f69 [3078970,27861] 0 2024-09-12T01:43:17.526 INFO:tasks.workunit.client.0.smithi066.stdout:0/685: dwrite d1/d62/d9f/d4a/f68 [0,4194304] 0 2024-09-12T01:43:17.526 INFO:tasks.workunit.client.0.smithi066.stdout:0/686: creat d1/d62/d9f/d64/ff3 x:0 0 0 2024-09-12T01:43:17.527 INFO:tasks.workunit.client.0.smithi066.stdout:0/687: write d1/f9 [375103,86603] 0 2024-09-12T01:43:17.527 INFO:tasks.workunit.client.0.smithi066.stdout:3/723: dwrite d5/d6/d1b/d45/d66/d67/d6d/f7a [0,4194304] 0 2024-09-12T01:43:17.527 INFO:tasks.workunit.client.0.smithi066.stdout:3/724: fsync d5/d6/d1b/d45/d66/dae/dd7/ffc 0 2024-09-12T01:43:17.681 INFO:tasks.workunit.client.0.smithi066.stdout:4/649: mknod d4/d6/d27/d2f/d72/cd4 0 2024-09-12T01:43:17.684 INFO:tasks.workunit.client.1.smithi153.stdout:4/979: symlink d6/d9/d11/d90/db7/d145/l14a 0 2024-09-12T01:43:17.684 INFO:tasks.workunit.client.1.smithi153.stdout:4/980: fdatasync d6/d9/dc/d31/f9a 0 2024-09-12T01:43:17.685 INFO:tasks.workunit.client.0.smithi066.stdout:1/611: rmdir d5/dc/d53/dae 39 2024-09-12T01:43:17.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/637: getdents d0/d6/d7f 0 2024-09-12T01:43:17.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/638: stat d0/d6/d7f/d90/fcc 0 2024-09-12T01:43:17.696 INFO:tasks.workunit.client.0.smithi066.stdout:2/576: rmdir de/d13/d28 39 2024-09-12T01:43:17.697 INFO:tasks.workunit.client.0.smithi066.stdout:2/577: write de/d13/d1e/f36 [669867,2125] 0 2024-09-12T01:43:17.701 INFO:tasks.workunit.client.0.smithi066.stdout:0/688: creat d1/d62/d6c/dad/df0/ff4 x:0 0 0 2024-09-12T01:43:17.706 INFO:tasks.workunit.client.0.smithi066.stdout:4/650: truncate d4/d6/d48/d88/f6b 1828934 0 2024-09-12T01:43:17.706 INFO:tasks.workunit.client.0.smithi066.stdout:4/651: truncate d4/d6/d62/f92 325562 0 2024-09-12T01:43:17.706 INFO:tasks.workunit.client.0.smithi066.stdout:4/652: readlink d4/d6/d8/lf 0 2024-09-12T01:43:17.708 INFO:tasks.workunit.client.0.smithi066.stdout:1/612: dwrite d5/dc/f34 [0,4194304] 0 2024-09-12T01:43:17.708 INFO:tasks.workunit.client.0.smithi066.stdout:1/613: write d5/d52/d5d/f9f [1090785,92979] 0 2024-09-12T01:43:17.710 INFO:tasks.workunit.client.1.smithi153.stdout:4/981: dwrite d6/d15/db4/ff0 [0,4194304] 0 2024-09-12T01:43:17.711 INFO:tasks.workunit.client.0.smithi066.stdout:9/639: dwrite d0/d6/d43/f6e [0,4194304] 0 2024-09-12T01:43:17.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/689: dwrite d1/d62/d9f/d64/fbe [4194304,4194304] 0 2024-09-12T01:43:17.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/690: truncate d1/d62/d89/d83/d8b/fc5 211300 0 2024-09-12T01:43:17.733 INFO:tasks.workunit.client.0.smithi066.stdout:2/578: symlink de/d13/d28/d3d/lc3 0 2024-09-12T01:43:17.733 INFO:tasks.workunit.client.0.smithi066.stdout:2/579: dread - de/d13/d1e/d92/f9a zero size 2024-09-12T01:43:17.733 INFO:tasks.workunit.client.0.smithi066.stdout:2/580: stat de/d13/d1e/d25/f5b 0 2024-09-12T01:43:17.733 INFO:tasks.workunit.client.0.smithi066.stdout:2/581: getdents de/d13/d28 0 2024-09-12T01:43:17.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/653: unlink d4/d15/c5b 0 2024-09-12T01:43:17.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/654: chown d4/d6/d27/d2f/d72/lce 3028163 1 2024-09-12T01:43:17.734 INFO:tasks.workunit.client.0.smithi066.stdout:4/655: fdatasync d4/d15/d33/f90 0 2024-09-12T01:43:17.735 INFO:tasks.workunit.client.0.smithi066.stdout:1/614: link d5/dc/d53/dae/lb1 d5/d52/lb9 0 2024-09-12T01:43:17.738 INFO:tasks.workunit.client.0.smithi066.stdout:9/640: dwrite d0/d6/d17/f4d [4194304,4194304] 0 2024-09-12T01:43:17.738 INFO:tasks.workunit.client.0.smithi066.stdout:0/691: creat d1/d62/d9f/d4a/d67/d1b/d26/d9c/ff5 x:0 0 0 2024-09-12T01:43:17.739 INFO:tasks.workunit.client.0.smithi066.stdout:2/582: stat de/d13/cc2 0 2024-09-12T01:43:17.739 INFO:tasks.workunit.client.0.smithi066.stdout:2/583: creat de/d13/d7f/fc4 x:0 0 0 2024-09-12T01:43:17.740 INFO:tasks.workunit.client.0.smithi066.stdout:4/656: creat d4/d15/fd5 x:0 0 0 2024-09-12T01:43:17.740 INFO:tasks.workunit.client.0.smithi066.stdout:0/692: read d1/d62/d9f/d4a/d67/d6e/fa1 [466752,62775] 0 2024-09-12T01:43:17.740 INFO:tasks.workunit.client.1.smithi153.stdout:4/982: dwrite d6/d9/dc/d98/fee [0,4194304] 0 2024-09-12T01:43:17.741 INFO:tasks.workunit.client.1.smithi153.stdout:4/983: chown d6/d9/d20/ffa 550529741 1 2024-09-12T01:43:17.741 INFO:tasks.workunit.client.0.smithi066.stdout:1/615: unlink d5/d52/d60/f72 0 2024-09-12T01:43:17.743 INFO:tasks.workunit.client.1.smithi153.stdout:4/984: mknod d6/d9/d11/d13/d131/c14b 0 2024-09-12T01:43:17.743 INFO:tasks.workunit.client.1.smithi153.stdout:4/985: truncate d6/d9/dc/d98/d3e/f144 890706 0 2024-09-12T01:43:17.745 INFO:tasks.workunit.client.1.smithi153.stdout:4/986: rename d6/d9/d11/f2f to d6/f14c 0 2024-09-12T01:43:17.746 INFO:tasks.workunit.client.0.smithi066.stdout:2/584: creat de/d13/d9c/fc5 x:0 0 0 2024-09-12T01:43:17.747 INFO:tasks.workunit.client.0.smithi066.stdout:2/585: read de/d13/f1f [3026992,64215] 0 2024-09-12T01:43:17.748 INFO:tasks.workunit.client.0.smithi066.stdout:4/657: mkdir d4/d6/d62/db0/dd6 0 2024-09-12T01:43:17.749 INFO:tasks.workunit.client.1.smithi153.stdout:4/987: symlink d6/d6a/d9c/l14d 0 2024-09-12T01:43:17.750 INFO:tasks.workunit.client.0.smithi066.stdout:0/693: unlink d1/d62/d9f/d92/d95/dcd/fdb 0 2024-09-12T01:43:17.750 INFO:tasks.workunit.client.0.smithi066.stdout:5/641: rmdir d0/d26/d2d 39 2024-09-12T01:43:17.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/616: link d5/c1e d5/d15/d58/cba 0 2024-09-12T01:43:17.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/617: dread - d5/d15/f68 zero size 2024-09-12T01:43:17.752 INFO:tasks.workunit.client.0.smithi066.stdout:1/618: chown d5/dc/d53/f45 4 1 2024-09-12T01:43:17.753 INFO:tasks.workunit.client.0.smithi066.stdout:9/641: symlink d0/d6/d17/d4f/le2 0 2024-09-12T01:43:17.755 INFO:tasks.workunit.client.0.smithi066.stdout:2/586: mknod de/d13/d1e/d41/d81/cc6 0 2024-09-12T01:43:17.756 INFO:tasks.workunit.client.0.smithi066.stdout:5/642: dread d0/d26/f86 [0,4194304] 0 2024-09-12T01:43:17.756 INFO:tasks.workunit.client.0.smithi066.stdout:5/643: chown d0/d26/d2f/d30/da8/dc9 1189 1 2024-09-12T01:43:17.756 INFO:tasks.workunit.client.0.smithi066.stdout:5/644: creat d0/d26/d2f/d3b/d6b/fcb x:0 0 0 2024-09-12T01:43:17.757 INFO:tasks.workunit.client.0.smithi066.stdout:4/658: unlink d4/d15/d33/d5e/fb6 0 2024-09-12T01:43:17.759 INFO:tasks.workunit.client.0.smithi066.stdout:0/694: mknod d1/d72/cf6 0 2024-09-12T01:43:17.759 INFO:tasks.workunit.client.0.smithi066.stdout:0/695: stat d1/f4d 0 2024-09-12T01:43:17.760 INFO:tasks.workunit.client.1.smithi153.stdout:4/988: dread d6/f14c [0,4194304] 0 2024-09-12T01:43:17.760 INFO:tasks.workunit.client.1.smithi153.stdout:4/989: creat d6/d9/d11/f14e x:0 0 0 2024-09-12T01:43:17.761 INFO:tasks.workunit.client.0.smithi066.stdout:1/619: creat d5/d52/d60/fbb x:0 0 0 2024-09-12T01:43:17.767 INFO:tasks.workunit.client.0.smithi066.stdout:4/659: dread d4/d6/d8/d18/d45/f95 [0,4194304] 0 2024-09-12T01:43:17.769 INFO:tasks.workunit.client.0.smithi066.stdout:2/587: link de/d13/d1e/d84/fab de/d13/d1e/fc7 0 2024-09-12T01:43:17.770 INFO:tasks.workunit.client.0.smithi066.stdout:2/588: write de/d13/d28/f8e [1604931,113102] 0 2024-09-12T01:43:17.772 INFO:tasks.workunit.client.0.smithi066.stdout:5/645: creat d0/d26/d2f/fcc x:0 0 0 2024-09-12T01:43:17.772 INFO:tasks.workunit.client.0.smithi066.stdout:5/646: chown d0/d26/d2d/d42/d95 12641 1 2024-09-12T01:43:17.774 INFO:tasks.workunit.client.0.smithi066.stdout:0/696: unlink d1/d62/d9f/d4a/d67/f1a 0 2024-09-12T01:43:17.775 INFO:tasks.workunit.client.0.smithi066.stdout:1/620: truncate d5/d52/d60/f79 3113105 0 2024-09-12T01:43:17.778 INFO:tasks.workunit.client.0.smithi066.stdout:9/642: unlink d0/d6/d17/d4f/c1d 0 2024-09-12T01:43:17.778 INFO:tasks.workunit.client.0.smithi066.stdout:4/660: read d4/f16 [12077534,48787] 0 2024-09-12T01:43:17.783 INFO:tasks.workunit.client.0.smithi066.stdout:0/697: dread d1/d72/f5c [0,4194304] 0 2024-09-12T01:43:17.788 INFO:tasks.workunit.client.1.smithi153.stdout:4/990: dwrite d6/d15/db4/f129 [0,4194304] 0 2024-09-12T01:43:17.796 INFO:tasks.workunit.client.1.smithi153.stdout:4/991: getdents d6/d15/db4/dbd/dec 0 2024-09-12T01:43:17.799 INFO:tasks.workunit.client.0.smithi066.stdout:3/725: rmdir d5/d6/d1b/d45/d66/d67/d6d/dc7/df1 0 2024-09-12T01:43:17.799 INFO:tasks.workunit.client.0.smithi066.stdout:3/726: write d5/d6/d1b/d65/d89/f72 [798364,81594] 0 2024-09-12T01:43:17.800 INFO:tasks.workunit.client.1.smithi153.stdout:4/992: symlink d6/d9/d20/l14f 0 2024-09-12T01:43:17.802 INFO:tasks.workunit.client.0.smithi066.stdout:2/589: symlink de/d13/d28/d3d/lc8 0 2024-09-12T01:43:17.806 INFO:tasks.workunit.client.0.smithi066.stdout:5/647: mknod d0/d26/d2f/d30/da8/ccd 0 2024-09-12T01:43:17.807 INFO:tasks.workunit.client.0.smithi066.stdout:1/621: mkdir d5/d15/d58/dbc 0 2024-09-12T01:43:17.808 INFO:tasks.workunit.client.0.smithi066.stdout:1/622: fsync d5/dc/f34 0 2024-09-12T01:43:17.808 INFO:tasks.workunit.client.0.smithi066.stdout:1/623: truncate d5/dc/f9c 97171 0 2024-09-12T01:43:17.809 INFO:tasks.workunit.client.0.smithi066.stdout:9/643: creat d0/d6/d17/d4f/d12/d84/dd4/fe3 x:0 0 0 2024-09-12T01:43:17.813 INFO:tasks.workunit.client.0.smithi066.stdout:4/661: rename d4/d5f/d9a/lb1 to d4/d6/d27/d66/da1/ld7 0 2024-09-12T01:43:17.816 INFO:tasks.workunit.client.0.smithi066.stdout:0/698: mkdir d1/d62/d9f/d7e/df7 0 2024-09-12T01:43:17.818 INFO:tasks.workunit.client.0.smithi066.stdout:1/624: dread d5/d15/f9d [0,4194304] 0 2024-09-12T01:43:17.818 INFO:tasks.workunit.client.0.smithi066.stdout:9/644: truncate d0/d6/f50 3380521 0 2024-09-12T01:43:17.821 INFO:tasks.workunit.client.0.smithi066.stdout:4/662: mkdir d4/d6/d62/db0/dd6/dd8 0 2024-09-12T01:43:17.824 INFO:tasks.workunit.client.0.smithi066.stdout:0/699: mkdir d1/d62/d89/d83/d8b/df8 0 2024-09-12T01:43:17.824 INFO:tasks.workunit.client.0.smithi066.stdout:0/700: chown d1/d62/d9f/d64/fbe 0 1 2024-09-12T01:43:17.825 INFO:tasks.workunit.client.0.smithi066.stdout:3/727: dwrite d5/d6/f96 [0,4194304] 0 2024-09-12T01:43:17.829 INFO:tasks.workunit.client.0.smithi066.stdout:1/625: truncate d5/f47 621048 0 2024-09-12T01:43:17.829 INFO:tasks.workunit.client.0.smithi066.stdout:1/626: chown d5/dc/d36/d4b/fb0 3545 1 2024-09-12T01:43:17.830 INFO:tasks.workunit.client.0.smithi066.stdout:9/645: creat d0/fe4 x:0 0 0 2024-09-12T01:43:17.831 INFO:tasks.workunit.client.0.smithi066.stdout:2/590: dwrite de/d13/d1e/d84/fab [4194304,4194304] 0 2024-09-12T01:43:17.837 INFO:tasks.workunit.client.0.smithi066.stdout:1/627: stat d5/dc/l78 0 2024-09-12T01:43:17.839 INFO:tasks.workunit.client.0.smithi066.stdout:2/591: creat de/d13/d1e/d41/fc9 x:0 0 0 2024-09-12T01:43:17.841 INFO:tasks.workunit.client.0.smithi066.stdout:3/728: dread d5/d6/d1b/d45/d66/d67/d6d/fa1 [0,4194304] 0 2024-09-12T01:43:17.846 INFO:tasks.workunit.client.1.smithi153.stdout:4/993: rmdir d6/d9 39 2024-09-12T01:43:17.848 INFO:tasks.workunit.client.0.smithi066.stdout:5/648: rename d0/d26/d2f to d0/dd/d18/d36/dbf/dce 0 2024-09-12T01:43:17.858 INFO:tasks.workunit.client.0.smithi066.stdout:5/649: dread d0/dd/f13 [0,4194304] 0 2024-09-12T01:43:17.858 INFO:tasks.workunit.client.0.smithi066.stdout:5/650: fdatasync d0/d26/d2d/d33/d55/d82/d87/fb4 0 2024-09-12T01:43:17.858 INFO:tasks.workunit.client.0.smithi066.stdout:5/651: chown d0/dd/f8d 9 1 2024-09-12T01:43:17.917 INFO:tasks.workunit.client.0.smithi066.stdout:0/701: dwrite d1/d62/d9f/d4a/d67/d20/f21 [4194304,4194304] 0 2024-09-12T01:43:17.917 INFO:tasks.workunit.client.0.smithi066.stdout:9/646: rename d0/d6/d17/d4f/d12/d84/dd4/fe3 to d0/d6/d17/d1b/da2/dae/fe5 0 2024-09-12T01:43:17.917 INFO:tasks.workunit.client.0.smithi066.stdout:4/663: dwrite d4/d6/d8/d18/fb7 [0,4194304] 0 2024-09-12T01:43:17.918 INFO:tasks.workunit.client.0.smithi066.stdout:4/664: chown d4/d6/d8/ca9 3598001 1 2024-09-12T01:43:17.918 INFO:tasks.workunit.client.0.smithi066.stdout:4/665: truncate d4/d6/d27/d2f/f87 730709 0 2024-09-12T01:43:17.918 INFO:tasks.workunit.client.0.smithi066.stdout:4/666: creat d4/d6/d27/d66/d6c/fd9 x:0 0 0 2024-09-12T01:43:17.918 INFO:tasks.workunit.client.1.smithi153.stdout:4/994: dwrite d6/d9/dc/f110 [0,4194304] 0 2024-09-12T01:43:17.919 INFO:tasks.workunit.client.1.smithi153.stdout:4/995: fdatasync d6/d9/dc/f121 0 2024-09-12T01:43:17.919 INFO:tasks.workunit.client.0.smithi066.stdout:5/652: mknod d0/d26/d2d/d33/d55/d82/d87/ccf 0 2024-09-12T01:43:17.919 INFO:tasks.workunit.client.0.smithi066.stdout:5/653: truncate d0/dd/d18/d36/dbf/dce/d3b/fc4 99241 0 2024-09-12T01:43:17.919 INFO:tasks.workunit.client.0.smithi066.stdout:0/702: creat d1/d62/d89/d83/ff9 x:0 0 0 2024-09-12T01:43:17.919 INFO:tasks.workunit.client.0.smithi066.stdout:0/703: chown d1/d62/d9f/d64/fbe 3406283 1 2024-09-12T01:43:17.921 INFO:tasks.workunit.client.0.smithi066.stdout:9/647: symlink d0/d6/d17/d4f/d9/le6 0 2024-09-12T01:43:17.925 INFO:tasks.workunit.client.1.smithi153.stdout:4/996: mknod d6/d9/d11/d90/c150 0 2024-09-12T01:43:17.928 INFO:tasks.workunit.client.0.smithi066.stdout:4/667: rmdir d4/d15/d33/d5e/dac/dcb 0 2024-09-12T01:43:17.929 INFO:tasks.workunit.client.0.smithi066.stdout:9/648: mkdir d0/d6/d17/d4f/d9/de/de7 0 2024-09-12T01:43:17.929 INFO:tasks.workunit.client.0.smithi066.stdout:9/649: readlink d0/d6/d37/l65 0 2024-09-12T01:43:17.930 INFO:tasks.workunit.client.0.smithi066.stdout:4/668: link d4/d6/d27/d66/d58/l6e d4/d6/d14/lda 0 2024-09-12T01:43:17.931 INFO:tasks.workunit.client.0.smithi066.stdout:9/650: symlink d0/d6/d17/d1b/d4c/d4b/d86/le8 0 2024-09-12T01:43:17.932 INFO:tasks.workunit.client.0.smithi066.stdout:4/669: link d4/d6/l4b d4/d15/dbd/ldb 0 2024-09-12T01:43:17.933 INFO:tasks.workunit.client.1.smithi153.stdout:4/997: read f0 [3081544,8210] 0 2024-09-12T01:43:17.933 INFO:tasks.workunit.client.1.smithi153.stdout:4/998: chown d6/d9/dc/d98/fa0 1769890 1 2024-09-12T01:43:17.935 INFO:tasks.workunit.client.1.smithi153.stdout:4/999: link d6/d9/dc/d31/l37 d6/d9/d11/d90/db7/d12e/l151 0 2024-09-12T01:43:17.935 INFO:tasks.workunit.client.0.smithi066.stdout:0/704: write d1/d72/fd3 [2146186,126236] 0 2024-09-12T01:43:17.935 INFO:tasks.workunit.client.0.smithi066.stdout:1/628: dwrite d5/d15/d58/fb7 [4194304,4194304] 0 2024-09-12T01:43:17.937 INFO:tasks.workunit.client.0.smithi066.stdout:1/629: unlink d5/d15/f68 0 2024-09-12T01:43:17.938 INFO:tasks.workunit.client.0.smithi066.stdout:1/630: rmdir d5/d15/d58 39 2024-09-12T01:43:17.938 INFO:tasks.workunit.client.1.smithi153.stderr:+ rm -rf -- ./tmp.jZGZBbly5l 2024-09-12T01:43:17.941 INFO:tasks.workunit.client.0.smithi066.stdout:5/654: dwrite d0/f20 [4194304,4194304] 0 2024-09-12T01:43:17.942 INFO:tasks.workunit.client.0.smithi066.stdout:5/655: fdatasync d0/dd/d18/fbc 0 2024-09-12T01:43:17.944 INFO:tasks.workunit.client.0.smithi066.stdout:5/656: truncate d0/d26/f86 2574321 0 2024-09-12T01:43:17.948 INFO:tasks.workunit.client.0.smithi066.stdout:3/729: dwrite d5/d6/d1b/d45/d66/d67/d6d/dc7/f90 [0,4194304] 0 2024-09-12T01:43:17.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/705: write d1/d62/d9f/d4a/d67/d20/f21 [307881,94376] 0 2024-09-12T01:43:17.949 INFO:tasks.workunit.client.0.smithi066.stdout:0/706: write d1/d62/d9f/d4a/d67/d6e/fa1 [1754958,117690] 0 2024-09-12T01:43:17.951 INFO:tasks.workunit.client.0.smithi066.stdout:1/631: dread d5/dc/f10 [0,4194304] 0 2024-09-12T01:43:17.955 INFO:tasks.workunit.client.0.smithi066.stdout:4/670: dwrite d4/d6/d62/fb2 [0,4194304] 0 2024-09-12T01:43:17.955 INFO:tasks.workunit.client.0.smithi066.stdout:4/671: stat d4/d6/d8/d18/c25 0 2024-09-12T01:43:17.964 INFO:tasks.workunit.client.0.smithi066.stdout:5/657: dwrite d0/dd/d18/d36/dbf/dce/d3b/d6b/f8a [0,4194304] 0 2024-09-12T01:43:17.965 INFO:tasks.workunit.client.0.smithi066.stdout:3/730: mkdir d5/d6/d1b/d65/d89/d102 0 2024-09-12T01:43:17.968 INFO:tasks.workunit.client.0.smithi066.stdout:0/707: symlink d1/d62/d9f/d4a/d67/d1b/d3b/lfa 0 2024-09-12T01:43:17.968 INFO:tasks.workunit.client.0.smithi066.stdout:0/708: chown d1/d62/d6c/dad/df0 575 1 2024-09-12T01:43:17.968 INFO:tasks.workunit.client.0.smithi066.stdout:1/632: truncate d5/d52/d5d/f90 485676 0 2024-09-12T01:43:17.968 INFO:tasks.workunit.client.0.smithi066.stdout:1/633: fsync d5/dc/d36/d4b/f5f 0 2024-09-12T01:43:17.969 INFO:tasks.workunit.client.0.smithi066.stdout:5/658: dread d0/d26/d2d/f90 [0,4194304] 0 2024-09-12T01:43:17.969 INFO:tasks.workunit.client.0.smithi066.stdout:5/659: chown d0/d26/d2d/d33/c51 418584322 1 2024-09-12T01:43:17.973 INFO:tasks.workunit.client.0.smithi066.stdout:4/672: symlink d4/d5f/ldc 0 2024-09-12T01:43:17.976 INFO:tasks.workunit.client.0.smithi066.stdout:4/673: write d4/d15/d33/f5d [422905,112185] 0 2024-09-12T01:43:17.985 INFO:tasks.workunit.client.0.smithi066.stdout:3/731: truncate d5/d6/d1b/d65/d89/f1c 2376512 0 2024-09-12T01:43:17.989 INFO:tasks.workunit.client.0.smithi066.stdout:0/709: rmdir d1/d62/d9f/d4a/d67/d20/d5e 39 2024-09-12T01:43:17.989 INFO:tasks.workunit.client.0.smithi066.stdout:5/660: rmdir d0/d26/d2d/d33/d55/d73/d74 39 2024-09-12T01:43:17.991 INFO:tasks.workunit.client.0.smithi066.stdout:1/634: dwrite d5/d52/f66 [0,4194304] 0 2024-09-12T01:43:17.992 INFO:tasks.workunit.client.0.smithi066.stdout:4/674: unlink d4/d6/d8/d18/f69 0 2024-09-12T01:43:17.993 INFO:tasks.workunit.client.0.smithi066.stdout:0/710: mknod d1/d62/d89/cfb 0 2024-09-12T01:43:17.995 INFO:tasks.workunit.client.0.smithi066.stdout:5/661: truncate d0/dd/d18/d36/dbf/dce/f58 34690 0 2024-09-12T01:43:17.999 INFO:tasks.workunit.client.0.smithi066.stdout:1/635: creat d5/dc/d53/fbd x:0 0 0 2024-09-12T01:43:18.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/636: dread - d5/d15/f6e zero size 2024-09-12T01:43:18.007 INFO:tasks.workunit.client.0.smithi066.stdout:1/637: rmdir d5/dc/d36/d57 39 2024-09-12T01:43:18.009 INFO:tasks.workunit.client.0.smithi066.stdout:3/732: dwrite d5/d6/d1b/f62 [0,4194304] 0 2024-09-12T01:43:18.010 INFO:tasks.workunit.client.0.smithi066.stdout:1/638: symlink d5/lbe 0 2024-09-12T01:43:18.013 INFO:tasks.workunit.client.0.smithi066.stdout:7/538: sync 2024-09-12T01:43:18.013 INFO:tasks.workunit.client.0.smithi066.stdout:6/686: sync 2024-09-12T01:43:18.013 INFO:tasks.workunit.client.0.smithi066.stdout:8/690: sync 2024-09-12T01:43:18.018 INFO:tasks.workunit.client.0.smithi066.stdout:8/691: creat d12/d21/d2f/d57/d3c/fe0 x:0 0 0 2024-09-12T01:43:18.021 INFO:tasks.workunit.client.0.smithi066.stdout:1/639: dread d5/d15/d4d/d86/f88 [4194304,4194304] 0 2024-09-12T01:43:18.027 INFO:tasks.workunit.client.0.smithi066.stdout:7/539: write d2/d5/da/d3f/da4/f7e [2328920,102505] 0 2024-09-12T01:43:18.028 INFO:tasks.workunit.client.0.smithi066.stdout:8/692: mkdir d12/d21/d2f/d57/d84/d89/dd8/de1 0 2024-09-12T01:43:18.029 INFO:tasks.workunit.client.0.smithi066.stdout:1/640: symlink d5/dc/d53/d9b/lbf 0 2024-09-12T01:43:18.029 INFO:tasks.workunit.client.0.smithi066.stdout:1/641: write d5/dc/f1f [2640655,86699] 0 2024-09-12T01:43:18.032 INFO:tasks.workunit.client.0.smithi066.stdout:3/733: rename d5/d6 to d5/d35/d103 0 2024-09-12T01:43:18.032 INFO:tasks.workunit.client.0.smithi066.stdout:3/734: truncate d5/d35/d103/d1b/fed 727784 0 2024-09-12T01:43:18.035 INFO:tasks.workunit.client.0.smithi066.stdout:3/735: creat d5/d35/d103/d1b/d45/d66/d67/d75/f104 x:0 0 0 2024-09-12T01:43:18.037 INFO:tasks.workunit.client.0.smithi066.stdout:3/736: mkdir d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/d105 0 2024-09-12T01:43:18.038 INFO:tasks.workunit.client.0.smithi066.stdout:5/662: dwrite d0/d26/d2d/f90 [0,4194304] 0 2024-09-12T01:43:18.038 INFO:tasks.workunit.client.0.smithi066.stdout:6/687: dwrite d2/d99/fa1 [0,4194304] 0 2024-09-12T01:43:18.038 INFO:tasks.workunit.client.0.smithi066.stdout:1/642: write d5/dc/d36/d4b/f5f [2905882,18879] 0 2024-09-12T01:43:18.039 INFO:tasks.workunit.client.0.smithi066.stdout:4/675: write d4/d6/d27/d66/d58/f78 [1007284,124540] 0 2024-09-12T01:43:18.044 INFO:tasks.workunit.client.0.smithi066.stdout:0/711: dwrite d1/d62/d9f/d64/f8f [0,4194304] 0 2024-09-12T01:43:18.045 INFO:tasks.workunit.client.0.smithi066.stdout:7/540: write d2/d5/d6/d22/d75/d2f/f34 [2051438,100382] 0 2024-09-12T01:43:18.045 INFO:tasks.workunit.client.0.smithi066.stdout:7/541: chown d2/d5/d6/d40/d63/c82 113316 1 2024-09-12T01:43:18.045 INFO:tasks.workunit.client.0.smithi066.stdout:7/542: dread - d2/d5/da/d3f/d9b/f78 zero size 2024-09-12T01:43:18.047 INFO:tasks.workunit.client.0.smithi066.stdout:6/688: creat d2/d21/fe5 x:0 0 0 2024-09-12T01:43:18.047 INFO:tasks.workunit.client.0.smithi066.stdout:6/689: fsync d2/d21/f25 0 2024-09-12T01:43:18.048 INFO:tasks.workunit.client.0.smithi066.stdout:6/690: dread - d2/d99/d12/f6e zero size 2024-09-12T01:43:18.058 INFO:tasks.workunit.client.0.smithi066.stdout:5/663: getdents d0/dd/d18 0 2024-09-12T01:43:18.059 INFO:tasks.workunit.client.0.smithi066.stdout:1/643: symlink d5/dc/lc0 0 2024-09-12T01:43:18.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/644: chown d5/d15/cb8 9566 1 2024-09-12T01:43:18.073 INFO:tasks.workunit.client.0.smithi066.stdout:8/693: dwrite d12/d21/d2f/d57/d43/fa9 [0,4194304] 0 2024-09-12T01:43:18.073 INFO:tasks.workunit.client.0.smithi066.stdout:3/737: dwrite d5/d35/d103/d48/fa9 [0,4194304] 0 2024-09-12T01:43:18.074 INFO:tasks.workunit.client.0.smithi066.stdout:1/645: write f1 [8481374,68666] 0 2024-09-12T01:43:18.081 INFO:tasks.workunit.client.0.smithi066.stdout:3/738: truncate d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/f46 1919649 0 2024-09-12T01:43:18.083 INFO:tasks.workunit.client.0.smithi066.stdout:0/712: dwrite d1/d62/d6c/dad/df0/ff4 [0,4194304] 0 2024-09-12T01:43:18.085 INFO:tasks.workunit.client.0.smithi066.stdout:8/694: creat d12/d21/d2f/d57/d84/d89/dd8/de1/fe2 x:0 0 0 2024-09-12T01:43:18.087 INFO:tasks.workunit.client.0.smithi066.stdout:6/691: dwrite d2/d99/f3d [4194304,4194304] 0 2024-09-12T01:43:18.088 INFO:tasks.workunit.client.0.smithi066.stdout:1/646: mknod d5/dc/d53/d9b/da2/cc1 0 2024-09-12T01:43:18.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/739: link d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/c36 d5/d35/d103/d1b/d45/d66/dae/dd7/de8/c106 0 2024-09-12T01:43:18.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/740: stat d5/d35/d103/d1b/d65/d89 0 2024-09-12T01:43:18.090 INFO:tasks.workunit.client.0.smithi066.stdout:3/741: chown d5/d35/d103/d1b/d45/d66/f3b 125825 1 2024-09-12T01:43:18.092 INFO:tasks.workunit.client.0.smithi066.stdout:5/664: dwrite d0/d26/f6f [0,4194304] 0 2024-09-12T01:43:18.092 INFO:tasks.workunit.client.0.smithi066.stdout:5/665: truncate d0/dd/d18/f53 4714568 0 2024-09-12T01:43:18.096 INFO:tasks.workunit.client.0.smithi066.stdout:6/692: dread d2/d31/f39 [0,4194304] 0 2024-09-12T01:43:18.097 INFO:tasks.workunit.client.0.smithi066.stdout:8/695: creat d12/d21/d2f/d53/fe3 x:0 0 0 2024-09-12T01:43:18.100 INFO:tasks.workunit.client.0.smithi066.stdout:1/647: getdents d5/dc/d36 0 2024-09-12T01:43:18.101 INFO:tasks.workunit.client.0.smithi066.stdout:3/742: mkdir d5/d35/d103/d1b/d45/d66/d5c/d101/d107 0 2024-09-12T01:43:18.102 INFO:tasks.workunit.client.0.smithi066.stdout:0/713: dwrite d1/d62/d89/f71 [0,4194304] 0 2024-09-12T01:43:18.105 INFO:tasks.workunit.client.0.smithi066.stdout:8/696: mkdir d12/d21/d2f/d57/d3c/de4 0 2024-09-12T01:43:18.109 INFO:tasks.workunit.client.0.smithi066.stdout:6/693: dread d2/d99/d12/d1d/fce [0,4194304] 0 2024-09-12T01:43:18.109 INFO:tasks.workunit.client.0.smithi066.stdout:6/694: getdents d2/d99/d12/d1d/d6b/dc6 0 2024-09-12T01:43:18.110 INFO:tasks.workunit.client.0.smithi066.stdout:3/743: creat d5/d35/d103/d1b/d65/d89/f108 x:0 0 0 2024-09-12T01:43:18.110 INFO:tasks.workunit.client.0.smithi066.stdout:1/648: write d5/f3b [572211,5631] 0 2024-09-12T01:43:18.110 INFO:tasks.workunit.client.0.smithi066.stdout:3/744: write d5/d35/d103/d1b/d45/d66/d67/d75/d8e/fad [356538,39682] 0 2024-09-12T01:43:18.114 INFO:tasks.workunit.client.0.smithi066.stdout:6/695: write d2/d99/d12/d1d/f96 [2193807,69262] 0 2024-09-12T01:43:18.119 INFO:tasks.workunit.client.0.smithi066.stdout:3/745: write d5/d35/d103/d1b/d45/f49 [1001012,98752] 0 2024-09-12T01:43:18.119 INFO:tasks.workunit.client.0.smithi066.stdout:3/746: readlink d5/d35/d103/d1b/l34 0 2024-09-12T01:43:18.119 INFO:tasks.workunit.client.0.smithi066.stdout:3/747: fsync d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f51 0 2024-09-12T01:43:18.125 INFO:tasks.workunit.client.0.smithi066.stdout:1/649: dwrite d5/dc/d36/d4b/f2b [4194304,4194304] 0 2024-09-12T01:43:18.135 INFO:tasks.workunit.client.0.smithi066.stdout:8/697: creat d12/daf/fe5 x:0 0 0 2024-09-12T01:43:18.137 INFO:tasks.workunit.client.0.smithi066.stdout:6/696: mkdir d2/d99/d12/d1d/d6b/de6 0 2024-09-12T01:43:18.137 INFO:tasks.workunit.client.0.smithi066.stdout:6/697: truncate d2/d21/fe5 374953 0 2024-09-12T01:43:18.140 INFO:tasks.workunit.client.0.smithi066.stdout:1/650: symlink d5/dc/d36/lc2 0 2024-09-12T01:43:18.140 INFO:tasks.workunit.client.0.smithi066.stdout:1/651: stat d5/f7f 0 2024-09-12T01:43:18.141 INFO:tasks.workunit.client.0.smithi066.stdout:8/698: link d12/d21/d2f/d57/f3b d12/d21/d2f/d57/d43/d82/fe6 0 2024-09-12T01:43:18.142 INFO:tasks.workunit.client.0.smithi066.stdout:6/698: creat d2/d99/d12/d1d/dc7/fe7 x:0 0 0 2024-09-12T01:43:18.143 INFO:tasks.workunit.client.0.smithi066.stdout:1/652: creat d5/d52/d5d/fc3 x:0 0 0 2024-09-12T01:43:18.146 INFO:tasks.workunit.client.0.smithi066.stdout:3/748: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/f78 [0,4194304] 0 2024-09-12T01:43:18.147 INFO:tasks.workunit.client.0.smithi066.stdout:6/699: truncate d2/d99/f6a 387146 0 2024-09-12T01:43:18.147 INFO:tasks.workunit.client.0.smithi066.stdout:6/700: write d2/d99/f2d [2247813,84115] 0 2024-09-12T01:43:18.147 INFO:tasks.workunit.client.0.smithi066.stdout:8/699: dread d12/d21/d2f/d57/f2e [0,4194304] 0 2024-09-12T01:43:18.147 INFO:tasks.workunit.client.0.smithi066.stdout:8/700: write d12/d21/d2f/d57/d84/d89/f96 [4333189,10106] 0 2024-09-12T01:43:18.149 INFO:tasks.workunit.client.0.smithi066.stdout:1/653: mkdir d5/dc/d36/d57/dac/dc4 0 2024-09-12T01:43:18.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/749: unlink d5/d35/fbf 0 2024-09-12T01:43:18.155 INFO:tasks.workunit.client.0.smithi066.stdout:3/750: chown d5/d35/d103/l5d 358205 1 2024-09-12T01:43:18.157 INFO:tasks.workunit.client.0.smithi066.stdout:3/751: dread d5/d35/d103/d1b/fed [0,4194304] 0 2024-09-12T01:43:18.157 INFO:tasks.workunit.client.0.smithi066.stdout:3/752: chown d5/d35/d103/d1b/d65/d89/d50/l53 39980404 1 2024-09-12T01:43:18.165 INFO:tasks.workunit.client.0.smithi066.stdout:8/701: rename d12/d21/c25 to d12/d21/d2f/d57/d43/d82/ce7 0 2024-09-12T01:43:18.167 INFO:tasks.workunit.client.0.smithi066.stdout:3/753: symlink d5/d35/d103/d1b/d45/d66/d67/d6d/l109 0 2024-09-12T01:43:18.167 INFO:tasks.workunit.client.0.smithi066.stdout:3/754: chown d5/d35/l39 0 1 2024-09-12T01:43:18.167 INFO:tasks.workunit.client.0.smithi066.stdout:3/755: write d5/d35/f4d [2925751,72266] 0 2024-09-12T01:43:18.173 INFO:tasks.workunit.client.0.smithi066.stdout:3/756: mknod d5/d35/d103/d1b/d45/d66/d67/c10a 0 2024-09-12T01:43:18.180 INFO:tasks.workunit.client.0.smithi066.stdout:6/701: dwrite d2/d21/fe5 [0,4194304] 0 2024-09-12T01:43:18.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/714: dwrite d1/d62/d9f/d4a/d67/f70 [0,4194304] 0 2024-09-12T01:43:18.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/715: write d1/d62/d9f/d4a/d67/d6e/d80/f58 [2165729,40450] 0 2024-09-12T01:43:18.182 INFO:tasks.workunit.client.0.smithi066.stdout:0/716: chown d1/d62/d9f/d92 1767126 1 2024-09-12T01:43:18.182 INFO:tasks.workunit.client.0.smithi066.stdout:6/702: creat d2/d31/fe8 x:0 0 0 2024-09-12T01:43:18.188 INFO:tasks.workunit.client.0.smithi066.stdout:1/654: dwrite d5/f73 [0,4194304] 0 2024-09-12T01:43:18.188 INFO:tasks.workunit.client.0.smithi066.stdout:1/655: write d5/dc/d36/d4b/f31 [4076904,128299] 0 2024-09-12T01:43:18.191 INFO:tasks.workunit.client.0.smithi066.stdout:8/702: dread d12/d21/d2f/d57/d43/fa9 [0,4194304] 0 2024-09-12T01:43:18.198 INFO:tasks.workunit.client.0.smithi066.stdout:6/703: write d2/d21/f51 [625349,57918] 0 2024-09-12T01:43:18.200 INFO:tasks.workunit.client.0.smithi066.stdout:6/704: mknod d2/d99/d12/d49/ce9 0 2024-09-12T01:43:18.201 INFO:tasks.workunit.client.0.smithi066.stdout:6/705: mknod d2/d99/d7b/ddb/cea 0 2024-09-12T01:43:18.202 INFO:tasks.workunit.client.0.smithi066.stdout:6/706: rename d2/d99/d7b/fd7 to d2/d99/d12/d1d/d6b/dc6/dd9/feb 0 2024-09-12T01:43:18.217 INFO:tasks.workunit.client.0.smithi066.stdout:0/717: dwrite d1/d62/f8e [0,4194304] 0 2024-09-12T01:43:18.217 INFO:tasks.workunit.client.0.smithi066.stdout:3/757: dwrite d5/d35/d103/d1b/d45/d66/dae/feb [0,4194304] 0 2024-09-12T01:43:18.217 INFO:tasks.workunit.client.0.smithi066.stdout:3/758: fdatasync d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d86/f9a 0 2024-09-12T01:43:18.217 INFO:tasks.workunit.client.0.smithi066.stdout:3/759: fsync d5/d35/d103/d1b/d45/d66/f6c 0 2024-09-12T01:43:18.220 INFO:tasks.workunit.client.0.smithi066.stdout:0/718: stat d1/d62/d9f/d4a/d67/d3e/l98 0 2024-09-12T01:43:18.220 INFO:tasks.workunit.client.0.smithi066.stdout:0/719: fsync d1/d62/d9f/d4a/d67/d1b/d61/f7f 0 2024-09-12T01:43:18.221 INFO:tasks.workunit.client.0.smithi066.stdout:3/760: symlink d5/d35/l10b 0 2024-09-12T01:43:18.222 INFO:tasks.workunit.client.0.smithi066.stdout:0/720: rename d1/d72/f6f to d1/d62/d9f/d4a/ffc 0 2024-09-12T01:43:18.225 INFO:tasks.workunit.client.0.smithi066.stdout:3/761: dread d5/d35/f8f [0,4194304] 0 2024-09-12T01:43:18.226 INFO:tasks.workunit.client.0.smithi066.stdout:0/721: rmdir d1/d62/d9f/d4a/d67 39 2024-09-12T01:43:18.227 INFO:tasks.workunit.client.0.smithi066.stdout:0/722: chown d1/d62/d89/da3/dc1/lc3 14181 1 2024-09-12T01:43:18.227 INFO:tasks.workunit.client.0.smithi066.stdout:0/723: chown d1/d62/d9f/d4a/d67/d20/da8/ld4 47 1 2024-09-12T01:43:18.229 INFO:tasks.workunit.client.0.smithi066.stdout:6/707: dwrite d2/d99/d12/d1d/d6b/dc6/dd9/fe4 [0,4194304] 0 2024-09-12T01:43:18.242 INFO:tasks.workunit.client.0.smithi066.stdout:0/724: dread d1/d62/d9f/d4a/d67/f91 [0,4194304] 0 2024-09-12T01:43:18.242 INFO:tasks.workunit.client.0.smithi066.stdout:0/725: chown d1/d62/d89/d83/d8b/fc5 3608 1 2024-09-12T01:43:18.242 INFO:tasks.workunit.client.0.smithi066.stdout:3/762: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f51 [0,4194304] 0 2024-09-12T01:43:18.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/651: sync 2024-09-12T01:43:18.253 INFO:tasks.workunit.client.0.smithi066.stdout:3/763: creat d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f10c x:0 0 0 2024-09-12T01:43:18.256 INFO:tasks.workunit.client.0.smithi066.stdout:0/726: getdents d1/d62/d9f/d7c 0 2024-09-12T01:43:18.256 INFO:tasks.workunit.client.0.smithi066.stdout:0/727: stat d1/d62/d9f/d4a/d67/d1b/f7d 0 2024-09-12T01:43:18.256 INFO:tasks.workunit.client.0.smithi066.stdout:2/592: sync 2024-09-12T01:43:18.258 INFO:tasks.workunit.client.0.smithi066.stdout:3/764: mknod d5/d35/d103/d1b/d45/d66/dae/c10d 0 2024-09-12T01:43:18.259 INFO:tasks.workunit.client.0.smithi066.stdout:3/765: read d5/d35/d103/d1b/d45/d66/d67/d7f/fcc [270071,103462] 0 2024-09-12T01:43:18.259 INFO:tasks.workunit.client.0.smithi066.stdout:0/728: rename d1/d62/d9f/d4a/d67/dd0/cd5 to d1/d62/d9f/db4/cfd 0 2024-09-12T01:43:18.262 INFO:tasks.workunit.client.0.smithi066.stdout:2/593: unlink de/d13/d1e/d25/f32 0 2024-09-12T01:43:18.266 INFO:tasks.workunit.client.0.smithi066.stdout:2/594: dread de/d13/d1e/d22/f48 [0,4194304] 0 2024-09-12T01:43:18.266 INFO:tasks.workunit.client.0.smithi066.stdout:2/595: chown de/c67 9009363 1 2024-09-12T01:43:18.266 INFO:tasks.workunit.client.0.smithi066.stdout:0/729: creat d1/ffe x:0 0 0 2024-09-12T01:43:18.267 INFO:tasks.workunit.client.0.smithi066.stdout:3/766: symlink d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/l10e 0 2024-09-12T01:43:18.268 INFO:tasks.workunit.client.0.smithi066.stdout:3/767: chown d5/d35/d103/d1b/d77/dd5/dbd/ccb 7988373 1 2024-09-12T01:43:18.269 INFO:tasks.workunit.client.0.smithi066.stdout:9/652: dwrite d0/d6/d17/d1b/d4c/d4b/f94 [0,4194304] 0 2024-09-12T01:43:18.269 INFO:tasks.workunit.client.0.smithi066.stdout:9/653: truncate d0/d6/d17/d1b/d4c/d42/fa5 877055 0 2024-09-12T01:43:18.270 INFO:tasks.workunit.client.0.smithi066.stdout:2/596: symlink de/d13/d1e/d25/da2/lca 0 2024-09-12T01:43:18.271 INFO:tasks.workunit.client.0.smithi066.stdout:2/597: fsync de/d3c/f4a 0 2024-09-12T01:43:18.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/730: truncate d1/d62/d9f/d4a/f68 3604133 0 2024-09-12T01:43:18.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/731: chown d1/d62/d9f/d4a/d67/f52 375 1 2024-09-12T01:43:18.274 INFO:tasks.workunit.client.0.smithi066.stdout:3/768: symlink d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/l10f 0 2024-09-12T01:43:18.276 INFO:tasks.workunit.client.0.smithi066.stdout:3/769: dread d5/d35/d103/d1b/d65/d89/f1c [0,4194304] 0 2024-09-12T01:43:18.282 INFO:tasks.workunit.client.0.smithi066.stdout:9/654: mkdir d0/d6/d17/d1b/de9 0 2024-09-12T01:43:18.287 INFO:tasks.workunit.client.0.smithi066.stdout:9/655: mknod d0/d6/d17/d1b/d4c/d4b/d86/cea 0 2024-09-12T01:43:18.290 INFO:tasks.workunit.client.0.smithi066.stdout:2/598: getdents de/d13/d7f 0 2024-09-12T01:43:18.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/599: write de/d13/d28/f38 [4829100,1432] 0 2024-09-12T01:43:18.303 INFO:tasks.workunit.client.0.smithi066.stdout:2/600: mknod de/d13/d1e/d22/ccb 0 2024-09-12T01:43:18.303 INFO:tasks.workunit.client.0.smithi066.stdout:0/732: rmdir d1/d62/d9f/d92/d95/dcd 0 2024-09-12T01:43:18.303 INFO:tasks.workunit.client.0.smithi066.stdout:0/733: fsync d1/d62/d9f/d4a/d67/d1b/d3b/f86 0 2024-09-12T01:43:18.304 INFO:tasks.workunit.client.0.smithi066.stdout:2/601: write de/f14 [1613711,78815] 0 2024-09-12T01:43:18.304 INFO:tasks.workunit.client.0.smithi066.stdout:2/602: fsync de/f15 0 2024-09-12T01:43:18.304 INFO:tasks.workunit.client.0.smithi066.stdout:2/603: getdents de/d13/d1e/da3 0 2024-09-12T01:43:18.307 INFO:tasks.workunit.client.0.smithi066.stdout:0/734: rename d1/d62/d9f/d4a/d67/d1b/d26/d5b/f73 to d1/d62/d9f/d4a/d67/d1b/d61/dec/fff 0 2024-09-12T01:43:18.307 INFO:tasks.workunit.client.0.smithi066.stdout:0/735: fsync d1/d62/d9f/d4a/d67/d6e/d80/f58 0 2024-09-12T01:43:18.308 INFO:tasks.workunit.client.0.smithi066.stdout:2/604: creat de/d13/d1e/d25/da2/fcc x:0 0 0 2024-09-12T01:43:18.311 INFO:tasks.workunit.client.0.smithi066.stdout:0/736: getdents d1/d62/d89/da3/dc1 0 2024-09-12T01:43:18.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/656: dwrite d0/d6/d17/d4f/d12/f6b [0,4194304] 0 2024-09-12T01:43:18.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/657: chown d0/d6/d17/d1b/d4c/d42/f5d 0 1 2024-09-12T01:43:18.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/658: chown d0/d6/d17/d28/d79/la7 11493741 1 2024-09-12T01:43:18.315 INFO:tasks.workunit.client.0.smithi066.stdout:3/770: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f4e [0,4194304] 0 2024-09-12T01:43:18.315 INFO:tasks.workunit.client.0.smithi066.stdout:2/605: unlink de/l17 0 2024-09-12T01:43:18.325 INFO:tasks.workunit.client.0.smithi066.stdout:9/659: creat d0/d6/d37/feb x:0 0 0 2024-09-12T01:43:18.325 INFO:tasks.workunit.client.0.smithi066.stdout:9/660: chown d0/d6/d17/d28/fd7 184 1 2024-09-12T01:43:18.330 INFO:tasks.workunit.client.0.smithi066.stdout:3/771: rename d5/d35/d103/d1b/d45/d66/d67/fb2 to d5/d35/d103/d1b/d45/d66/dae/f110 0 2024-09-12T01:43:18.333 INFO:tasks.workunit.client.0.smithi066.stdout:0/737: dwrite d1/d62/d9f/d4a/d67/d1b/d26/d9c/fae [0,4194304] 0 2024-09-12T01:43:18.333 INFO:tasks.workunit.client.0.smithi066.stdout:0/738: rename d1/d62/d9f/d4a/d67 to d1/d62/d9f/d4a/d67/d20/da8/d100 22 2024-09-12T01:43:18.336 INFO:tasks.workunit.client.0.smithi066.stdout:0/739: mknod d1/d62/d9f/de6/c101 0 2024-09-12T01:43:18.359 INFO:tasks.workunit.client.0.smithi066.stdout:9/661: dwrite d0/d6/d37/d85/fcf [0,4194304] 0 2024-09-12T01:43:18.359 INFO:tasks.workunit.client.0.smithi066.stdout:0/740: dwrite d1/d62/d9f/f5a [0,4194304] 0 2024-09-12T01:43:18.365 INFO:tasks.workunit.client.0.smithi066.stdout:0/741: rename d1/d72/de/f7b to d1/d62/d9f/d7c/f102 0 2024-09-12T01:43:18.367 INFO:tasks.workunit.client.0.smithi066.stdout:0/742: rename d1/d62/d9f/d4a/d67/d20/f35 to d1/d62/d89/da3/dc1/de2/f103 0 2024-09-12T01:43:18.371 INFO:tasks.workunit.client.0.smithi066.stdout:9/662: dread d0/d6/d17/d4f/d12/d46/fb3 [0,4194304] 0 2024-09-12T01:43:18.373 INFO:tasks.workunit.client.0.smithi066.stdout:9/663: mkdir d0/d6/d17/d1b/d4c/d4b/dec 0 2024-09-12T01:43:18.376 INFO:tasks.workunit.client.0.smithi066.stdout:9/664: mknod d0/d6/d17/d1b/da2/dae/ced 0 2024-09-12T01:43:18.378 INFO:tasks.workunit.client.0.smithi066.stdout:7/543: sync 2024-09-12T01:43:18.378 INFO:tasks.workunit.client.0.smithi066.stdout:4/676: sync 2024-09-12T01:43:18.381 INFO:tasks.workunit.client.0.smithi066.stdout:7/544: link d2/d5/da/f50 d2/d5/da/d3f/d5e/fba 0 2024-09-12T01:43:18.382 INFO:tasks.workunit.client.0.smithi066.stdout:4/677: symlink d4/d6/d48/d88/ldd 0 2024-09-12T01:43:18.383 INFO:tasks.workunit.client.0.smithi066.stdout:7/545: truncate d2/d5/d6/d22/f30 4395167 0 2024-09-12T01:43:18.384 INFO:tasks.workunit.client.0.smithi066.stdout:4/678: mknod d4/d6/d27/d2f/d72/cde 0 2024-09-12T01:43:18.386 INFO:tasks.workunit.client.0.smithi066.stdout:0/743: dwrite d1/d72/de/f4b [0,4194304] 0 2024-09-12T01:43:18.386 INFO:tasks.workunit.client.0.smithi066.stdout:4/679: mkdir d4/d15/d33/ddf 0 2024-09-12T01:43:18.387 INFO:tasks.workunit.client.0.smithi066.stdout:0/744: mknod d1/d62/d9f/d4a/d67/d1b/d61/c104 0 2024-09-12T01:43:18.388 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:18 smithi066 ceph-mon[27875]: pgmap v8: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 132 MiB/s rd, 181 MiB/s wr, 262 op/s 2024-09-12T01:43:18.392 INFO:tasks.workunit.client.0.smithi066.stdout:4/680: getdents d4/d6/d8/d18 0 2024-09-12T01:43:18.393 INFO:tasks.workunit.client.0.smithi066.stdout:4/681: read - d4/d6/d62/fa5 zero size 2024-09-12T01:43:18.393 INFO:tasks.workunit.client.0.smithi066.stdout:4/682: fsync d4/d6/d27/d66/d6c/fa0 0 2024-09-12T01:43:18.395 INFO:tasks.workunit.client.0.smithi066.stdout:0/745: rmdir d1/d62/d6c/dad/df0 39 2024-09-12T01:43:18.396 INFO:tasks.workunit.client.0.smithi066.stdout:7/546: dread d2/d5/da/d3f/da4/d84/f8a [0,4194304] 0 2024-09-12T01:43:18.397 INFO:tasks.workunit.client.0.smithi066.stdout:4/683: symlink d4/d6/d8/d18/d45/le0 0 2024-09-12T01:43:18.397 INFO:tasks.workunit.client.0.smithi066.stdout:9/665: dwrite d0/d6/d7f/d90/fd8 [0,4194304] 0 2024-09-12T01:43:18.397 INFO:tasks.workunit.client.0.smithi066.stdout:9/666: creat d0/fee x:0 0 0 2024-09-12T01:43:18.400 INFO:tasks.workunit.client.0.smithi066.stdout:7/547: unlink d2/d5/da/d3f/da4/f7e 0 2024-09-12T01:43:18.401 INFO:tasks.workunit.client.0.smithi066.stdout:7/548: dread - d2/d5/da/d3f/d9b/d4d/f4f zero size 2024-09-12T01:43:18.401 INFO:tasks.workunit.client.0.smithi066.stdout:7/549: truncate d2/d5/d6/d40/d51/f72 5150452 0 2024-09-12T01:43:18.402 INFO:tasks.workunit.client.0.smithi066.stdout:4/684: creat d4/d15/d33/fe1 x:0 0 0 2024-09-12T01:43:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:18 smithi153 ceph-mon[34713]: pgmap v8: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 132 MiB/s rd, 181 MiB/s wr, 262 op/s 2024-09-12T01:43:18.412 INFO:tasks.workunit.client.0.smithi066.stdout:9/667: symlink d0/d6/d17/d28/d79/lef 0 2024-09-12T01:43:18.412 INFO:tasks.workunit.client.0.smithi066.stdout:9/668: readlink d0/d6/d17/d28/l44 0 2024-09-12T01:43:18.414 INFO:tasks.workunit.client.0.smithi066.stdout:4/685: getdents d4/d6/d27/d66 0 2024-09-12T01:43:18.414 INFO:tasks.workunit.client.0.smithi066.stdout:4/686: write d4/d84/dba/fc4 [214067,60988] 0 2024-09-12T01:43:18.414 INFO:tasks.workunit.client.0.smithi066.stdout:4/687: chown d4/d6/d14 1849071 1 2024-09-12T01:43:18.415 INFO:tasks.workunit.client.0.smithi066.stdout:9/669: mknod d0/d6/d17/d1b/d4c/d4b/dec/cf0 0 2024-09-12T01:43:18.416 INFO:tasks.workunit.client.0.smithi066.stdout:4/688: read d4/d6/d27/d2f/f87 [718312,123752] 0 2024-09-12T01:43:18.417 INFO:tasks.workunit.client.0.smithi066.stdout:0/746: dwrite d1/f9 [0,4194304] 0 2024-09-12T01:43:18.417 INFO:tasks.workunit.client.0.smithi066.stdout:9/670: rename d0/d6/d17/d4f/d12/f6b to d0/d6/d17/d4f/d9/de/ff1 0 2024-09-12T01:43:18.417 INFO:tasks.workunit.client.0.smithi066.stdout:9/671: stat d0/d6/d17/d4f 0 2024-09-12T01:43:18.418 INFO:tasks.workunit.client.0.smithi066.stdout:4/689: mkdir d4/d6/d8/d18/d45/de2 0 2024-09-12T01:43:18.420 INFO:tasks.workunit.client.0.smithi066.stdout:0/747: mkdir d1/d62/d9f/d4a/d67/d6e/d105 0 2024-09-12T01:43:18.423 INFO:tasks.workunit.client.0.smithi066.stdout:4/690: link d4/d6/d27/d66/d6c/d75/c8c d4/d5f/d9a/ce3 0 2024-09-12T01:43:18.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/550: dwrite d2/d5/da/f36 [0,4194304] 0 2024-09-12T01:43:18.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/551: dread - d2/d5/da/d3f/d9b/f78 zero size 2024-09-12T01:43:18.424 INFO:tasks.workunit.client.0.smithi066.stdout:7/552: stat d2/d71/d93/c94 0 2024-09-12T01:43:18.427 INFO:tasks.workunit.client.0.smithi066.stdout:4/691: rmdir d4/d6/d8/d18/d45/de2 0 2024-09-12T01:43:18.428 INFO:tasks.workunit.client.0.smithi066.stdout:7/553: symlink d2/d5/d6/d22/lbb 0 2024-09-12T01:43:18.428 INFO:tasks.workunit.client.0.smithi066.stdout:7/554: fdatasync d2/d5/d6/d40/fa5 0 2024-09-12T01:43:18.429 INFO:tasks.workunit.client.0.smithi066.stdout:4/692: symlink d4/d5f/d9a/le4 0 2024-09-12T01:43:18.430 INFO:tasks.workunit.client.0.smithi066.stdout:7/555: creat d2/d5/d6/fbc x:0 0 0 2024-09-12T01:43:18.432 INFO:tasks.workunit.client.0.smithi066.stdout:4/693: mkdir d4/de5 0 2024-09-12T01:43:18.434 INFO:tasks.workunit.client.0.smithi066.stdout:7/556: creat d2/d5/da/fbd x:0 0 0 2024-09-12T01:43:18.437 INFO:tasks.workunit.client.0.smithi066.stdout:7/557: unlink d2/d5/d6/d22/d75/l88 0 2024-09-12T01:43:18.437 INFO:tasks.workunit.client.0.smithi066.stdout:7/558: read - d2/d5/da/d3f/d9b/d4d/f4f zero size 2024-09-12T01:43:18.437 INFO:tasks.workunit.client.0.smithi066.stdout:7/559: write d2/d5/da/d3f/da4/d6c/f9d [519256,2659] 0 2024-09-12T01:43:18.441 INFO:tasks.workunit.client.0.smithi066.stdout:4/694: write d4/d15/d33/f90 [1686667,129720] 0 2024-09-12T01:43:18.441 INFO:tasks.workunit.client.0.smithi066.stdout:7/560: mknod d2/d5/d6/cbe 0 2024-09-12T01:43:18.444 INFO:tasks.workunit.client.0.smithi066.stdout:7/561: getdents d2/d5/da/d3f/da4/d84 0 2024-09-12T01:43:18.451 INFO:tasks.workunit.client.0.smithi066.stdout:7/562: creat d2/d41/fbf x:0 0 0 2024-09-12T01:43:18.465 INFO:tasks.workunit.client.0.smithi066.stdout:0/748: dwrite d1/d62/d89/d83/fda [0,4194304] 0 2024-09-12T01:43:18.466 INFO:tasks.workunit.client.0.smithi066.stdout:9/672: dwrite d0/d6/d17/d28/d79/fc6 [4194304,4194304] 0 2024-09-12T01:43:18.466 INFO:tasks.workunit.client.0.smithi066.stdout:9/673: fsync d0/d6/d17/fa0 0 2024-09-12T01:43:18.466 INFO:tasks.workunit.client.0.smithi066.stdout:9/674: creat d0/d6/d17/d4f/d12/d84/dd4/ff2 x:0 0 0 2024-09-12T01:43:18.466 INFO:tasks.workunit.client.0.smithi066.stdout:4/695: dwrite d4/d6/d48/d88/f8f [0,4194304] 0 2024-09-12T01:43:18.466 INFO:tasks.workunit.client.0.smithi066.stdout:4/696: read - d4/d6/d14/fca zero size 2024-09-12T01:43:18.469 INFO:tasks.workunit.client.0.smithi066.stdout:0/749: mkdir d1/d62/d9f/d4a/d67/d1b/d26/d5b/d106 0 2024-09-12T01:43:18.471 INFO:tasks.workunit.client.0.smithi066.stdout:9/675: creat d0/d6/d7f/dd2/ff3 x:0 0 0 2024-09-12T01:43:18.473 INFO:tasks.workunit.client.0.smithi066.stdout:4/697: dread d4/d6/d8/f1a [0,4194304] 0 2024-09-12T01:43:18.475 INFO:tasks.workunit.client.0.smithi066.stdout:9/676: getdents d0/d6/d17/d4f/d12 0 2024-09-12T01:43:18.477 INFO:tasks.workunit.client.0.smithi066.stdout:4/698: mknod d4/d15/dbd/ce6 0 2024-09-12T01:43:18.478 INFO:tasks.workunit.client.0.smithi066.stdout:7/563: dwrite d2/d5/da/d3f/d9b/d4d/f76 [4194304,4194304] 0 2024-09-12T01:43:18.479 INFO:tasks.workunit.client.0.smithi066.stdout:9/677: rename d0/d6/d17/d28/d79/lef to d0/d6/d43/lf4 0 2024-09-12T01:43:18.479 INFO:tasks.workunit.client.0.smithi066.stdout:9/678: fsync d0/d6/d17/d4f/d9/de/fb7 0 2024-09-12T01:43:18.479 INFO:tasks.workunit.client.0.smithi066.stdout:9/679: chown d0/d6/d17/d1b/d4c/d4b/d7d/c75 34 1 2024-09-12T01:43:18.481 INFO:tasks.workunit.client.0.smithi066.stdout:4/699: mknod d4/d6/d62/db0/ce7 0 2024-09-12T01:43:18.483 INFO:tasks.workunit.client.0.smithi066.stdout:0/750: dread d1/d62/d9f/d4a/d67/d1b/f33 [0,4194304] 0 2024-09-12T01:43:18.489 INFO:tasks.workunit.client.0.smithi066.stdout:7/564: mknod d2/d5/d6/d40/d63/cc0 0 2024-09-12T01:43:18.491 INFO:tasks.workunit.client.0.smithi066.stdout:7/565: dread d2/d5/da/d3f/da4/f8f [4194304,4194304] 0 2024-09-12T01:43:18.493 INFO:tasks.workunit.client.0.smithi066.stdout:9/680: mknod d0/d6/d17/d1b/d4c/d42/dab/cf5 0 2024-09-12T01:43:18.495 INFO:tasks.workunit.client.0.smithi066.stdout:9/681: creat d0/d6/d17/d1b/de9/ff6 x:0 0 0 2024-09-12T01:43:18.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/700: dwrite d4/d6/d27/f98 [0,4194304] 0 2024-09-12T01:43:18.497 INFO:tasks.workunit.client.0.smithi066.stdout:4/701: write d4/d15/d33/fe1 [695801,28185] 0 2024-09-12T01:43:18.497 INFO:tasks.workunit.client.0.smithi066.stdout:9/682: mkdir d0/d6/d43/df7 0 2024-09-12T01:43:18.497 INFO:tasks.workunit.client.0.smithi066.stdout:9/683: chown d0/ld9 289332 1 2024-09-12T01:43:18.500 INFO:tasks.workunit.client.0.smithi066.stdout:4/702: mknod d4/d6/d8/d18/d4d/ce8 0 2024-09-12T01:43:18.506 INFO:tasks.workunit.client.0.smithi066.stdout:9/684: read d0/d6/d17/d4f/d9/fa [7566478,31720] 0 2024-09-12T01:43:18.507 INFO:tasks.workunit.client.0.smithi066.stdout:7/566: dwrite d2/d5/da/f50 [0,4194304] 0 2024-09-12T01:43:18.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/685: mkdir d0/d6/d17/d1b/d4c/d4b/d7d/df8 0 2024-09-12T01:43:18.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/686: chown d0/d6/d37/c9b 4432732 1 2024-09-12T01:43:18.511 INFO:tasks.workunit.client.0.smithi066.stdout:7/567: mkdir d2/d5/da/d3f/da4/d6c/d8e/da7/dc1 0 2024-09-12T01:43:18.512 INFO:tasks.workunit.client.0.smithi066.stdout:9/687: mkdir d0/d6/d17/d1b/de9/df9 0 2024-09-12T01:43:18.512 INFO:tasks.workunit.client.0.smithi066.stdout:9/688: creat d0/d6/d17/d1b/d4c/d42/ffa x:0 0 0 2024-09-12T01:43:18.515 INFO:tasks.workunit.client.0.smithi066.stdout:7/568: creat d2/d5/d6/d40/d51/fc2 x:0 0 0 2024-09-12T01:43:18.515 INFO:tasks.workunit.client.0.smithi066.stdout:5/666: sync 2024-09-12T01:43:18.518 INFO:tasks.workunit.client.0.smithi066.stdout:5/667: dread d0/dd/d18/d36/dbf/dce/d3b/d98/fae [0,4194304] 0 2024-09-12T01:43:18.518 INFO:tasks.workunit.client.0.smithi066.stdout:9/689: creat d0/d6/d17/d28/d79/ffb x:0 0 0 2024-09-12T01:43:18.518 INFO:tasks.workunit.client.0.smithi066.stdout:9/690: dread - d0/d6/d17/d4f/d12/fb1 zero size 2024-09-12T01:43:18.518 INFO:tasks.workunit.client.0.smithi066.stdout:9/691: readlink d0/d6/d17/d4f/d9/l54 0 2024-09-12T01:43:18.519 INFO:tasks.workunit.client.0.smithi066.stdout:7/569: symlink d2/d5/d6/d22/d75/lc3 0 2024-09-12T01:43:18.522 INFO:tasks.workunit.client.0.smithi066.stdout:5/668: mknod d0/dd/d18/d36/dbf/dce/cd0 0 2024-09-12T01:43:18.526 INFO:tasks.workunit.client.0.smithi066.stdout:5/669: rmdir d0/d26/d2d/d31/d77 39 2024-09-12T01:43:18.529 INFO:tasks.workunit.client.0.smithi066.stdout:5/670: mknod d0/d26/d2d/d31/cd1 0 2024-09-12T01:43:18.532 INFO:tasks.workunit.client.0.smithi066.stdout:5/671: mknod d0/d26/d2d/d33/d55/d73/cd2 0 2024-09-12T01:43:18.533 INFO:tasks.workunit.client.0.smithi066.stdout:5/672: symlink d0/d26/d2d/d33/d55/d73/d74/ld3 0 2024-09-12T01:43:18.534 INFO:tasks.workunit.client.0.smithi066.stdout:5/673: truncate d0/dd/d18/f7c 983455 0 2024-09-12T01:43:18.535 INFO:tasks.workunit.client.0.smithi066.stdout:5/674: getdents d0/dd/d18 0 2024-09-12T01:43:18.535 INFO:tasks.workunit.client.0.smithi066.stdout:5/675: write d0/d26/d2d/d33/d55/d82/d87/d8e/fc5 [802383,39637] 0 2024-09-12T01:43:18.535 INFO:tasks.workunit.client.0.smithi066.stdout:5/676: truncate d0/dd/d18/d36/dbf/dce/d30/f66 148630 0 2024-09-12T01:43:18.535 INFO:tasks.workunit.client.0.smithi066.stdout:5/677: chown d0/d26/d2d/d33/d55/d84 28 1 2024-09-12T01:43:18.538 INFO:tasks.workunit.client.0.smithi066.stdout:9/692: dwrite d0/d6/d17/d28/d79/ffb [0,4194304] 0 2024-09-12T01:43:18.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/570: dwrite d2/d5/d6/d22/f30 [0,4194304] 0 2024-09-12T01:43:18.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/571: write d2/d5/d6/d40/d63/fa1 [182618,8268] 0 2024-09-12T01:43:18.544 INFO:tasks.workunit.client.0.smithi066.stdout:7/572: chown d2/d5/d6/c77 867341 1 2024-09-12T01:43:18.561 INFO:tasks.workunit.client.0.smithi066.stdout:5/678: dwrite d0/d26/d2d/d33/db0/fb2 [0,4194304] 0 2024-09-12T01:43:18.562 INFO:tasks.workunit.client.0.smithi066.stdout:9/693: dwrite d0/d6/d17/d28/d79/fdb [4194304,4194304] 0 2024-09-12T01:43:18.563 INFO:tasks.workunit.client.0.smithi066.stdout:7/573: truncate d2/d5/d6/d40/d63/fa1 113645 0 2024-09-12T01:43:18.564 INFO:tasks.workunit.client.0.smithi066.stdout:5/679: rmdir d0/d26/d2d/d31 39 2024-09-12T01:43:18.565 INFO:tasks.workunit.client.0.smithi066.stdout:9/694: getdents d0/d6/d17/d1b/d4c 0 2024-09-12T01:43:18.568 INFO:tasks.workunit.client.0.smithi066.stdout:7/574: read d2/d5/da/d3f/da4/d84/f8a [4039976,57867] 0 2024-09-12T01:43:18.576 INFO:tasks.workunit.client.0.smithi066.stdout:9/695: dread d0/f3c [0,4194304] 0 2024-09-12T01:43:18.577 INFO:tasks.workunit.client.0.smithi066.stdout:7/575: write d2/d5/da/d3f/f57 [1952881,114221] 0 2024-09-12T01:43:18.580 INFO:tasks.workunit.client.0.smithi066.stdout:5/680: dwrite d0/dd/d18/fbc [0,4194304] 0 2024-09-12T01:43:18.581 INFO:tasks.workunit.client.0.smithi066.stdout:7/576: creat d2/d5/da/d3f/da4/d6c/d80/d5f/fc4 x:0 0 0 2024-09-12T01:43:18.582 INFO:tasks.workunit.client.0.smithi066.stdout:9/696: mknod d0/d6/d17/d4f/cfc 0 2024-09-12T01:43:18.587 INFO:tasks.workunit.client.0.smithi066.stdout:5/681: mkdir d0/dd/d18/d8c/dd4 0 2024-09-12T01:43:18.588 INFO:tasks.workunit.client.0.smithi066.stdout:7/577: symlink d2/d5/da/d3f/d5e/lc5 0 2024-09-12T01:43:18.591 INFO:tasks.workunit.client.0.smithi066.stdout:9/697: unlink d0/d6/d7f/l88 0 2024-09-12T01:43:18.592 INFO:tasks.workunit.client.0.smithi066.stdout:9/698: write d0/d6/d17/f23 [1948668,38530] 0 2024-09-12T01:43:18.592 INFO:tasks.workunit.client.0.smithi066.stdout:5/682: rename d0/dd/d18/d8c/dd4 to d0/dd/d18/d36/dbf/dce/dd5 0 2024-09-12T01:43:18.596 INFO:tasks.workunit.client.0.smithi066.stdout:7/578: mknod d2/d5/da/d3f/da4/d84/cc6 0 2024-09-12T01:43:18.600 INFO:tasks.workunit.client.0.smithi066.stdout:5/683: rename d0/d26/d2d/l52 to d0/dd/d18/d36/dbf/dce/da4/ld6 0 2024-09-12T01:43:18.600 INFO:tasks.workunit.client.0.smithi066.stdout:9/699: read d0/d6/f8e [2658077,80165] 0 2024-09-12T01:43:18.603 INFO:tasks.workunit.client.0.smithi066.stdout:7/579: mknod d2/d5/d6/d40/d63/cc7 0 2024-09-12T01:43:18.604 INFO:tasks.workunit.client.0.smithi066.stdout:7/580: dread d2/d5/d6/d40/d63/fa1 [0,4194304] 0 2024-09-12T01:43:18.609 INFO:tasks.workunit.client.0.smithi066.stdout:5/684: dread d0/d26/d2d/d42/f80 [4194304,4194304] 0 2024-09-12T01:43:18.611 INFO:tasks.workunit.client.0.smithi066.stdout:5/685: mkdir d0/dd/d18/d36/dbf/dce/dd5/dd7 0 2024-09-12T01:43:18.612 INFO:tasks.workunit.client.0.smithi066.stdout:1/656: sync 2024-09-12T01:43:18.613 INFO:tasks.workunit.client.0.smithi066.stdout:5/686: symlink d0/d26/d2d/d31/ld8 0 2024-09-12T01:43:18.616 INFO:tasks.workunit.client.0.smithi066.stdout:1/657: unlink d5/d15/d58/fb7 0 2024-09-12T01:43:18.616 INFO:tasks.workunit.client.0.smithi066.stdout:1/658: read - d5/f9e zero size 2024-09-12T01:43:18.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/659: unlink d5/dc/c19 0 2024-09-12T01:43:18.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/660: dread - d5/dc/d53/f94 zero size 2024-09-12T01:43:18.620 INFO:tasks.workunit.client.0.smithi066.stdout:7/581: dwrite d2/d5/da/d3f/d9b/d4d/f76 [0,4194304] 0 2024-09-12T01:43:18.621 INFO:tasks.workunit.client.0.smithi066.stdout:1/661: mknod d5/dc/cc5 0 2024-09-12T01:43:18.621 INFO:tasks.workunit.client.0.smithi066.stdout:1/662: getdents d5/d52/d5d/db6 0 2024-09-12T01:43:18.621 INFO:tasks.workunit.client.0.smithi066.stdout:1/663: chown d5/dc/l78 132 1 2024-09-12T01:43:18.628 INFO:tasks.workunit.client.0.smithi066.stdout:7/582: rename d2/d41 to d2/d5/d6/d81/dc8 0 2024-09-12T01:43:18.629 INFO:tasks.workunit.client.0.smithi066.stdout:5/687: dread d0/f2 [0,4194304] 0 2024-09-12T01:43:18.631 INFO:tasks.workunit.client.0.smithi066.stdout:1/664: write d5/dc/d53/d9b/da2/fa5 [1012608,1632] 0 2024-09-12T01:43:18.631 INFO:tasks.workunit.client.0.smithi066.stdout:7/583: symlink d2/d5/d6/d22/dac/lc9 0 2024-09-12T01:43:18.632 INFO:tasks.workunit.client.0.smithi066.stdout:5/688: rename d0/dd/d18/d36/dbf/dce/d3b/c40 to d0/dd/d18/d36/dbf/dce/cd9 0 2024-09-12T01:43:18.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/689: write d0/dd/d18/f3d [4949492,22674] 0 2024-09-12T01:43:18.633 INFO:tasks.workunit.client.0.smithi066.stdout:5/690: chown d0/d26/d2d/d33/d55/d82/d87/d8e/fc5 7 1 2024-09-12T01:43:18.634 INFO:tasks.workunit.client.0.smithi066.stdout:1/665: mkdir d5/dc/d4f/dc6 0 2024-09-12T01:43:18.637 INFO:tasks.workunit.client.0.smithi066.stdout:7/584: symlink d2/d5/da/d3f/da4/d6c/d8e/da7/dc1/lca 0 2024-09-12T01:43:18.641 INFO:tasks.workunit.client.0.smithi066.stdout:5/691: symlink d0/d21/lda 0 2024-09-12T01:43:18.643 INFO:tasks.workunit.client.0.smithi066.stdout:7/585: creat d2/d3c/fcb x:0 0 0 2024-09-12T01:43:18.643 INFO:tasks.workunit.client.0.smithi066.stdout:7/586: write d2/d5/da/d3f/da4/d84/f5b [1434091,17859] 0 2024-09-12T01:43:18.643 INFO:tasks.workunit.client.0.smithi066.stdout:7/587: truncate d2/d5/d6/d40/d63/fa1 206966 0 2024-09-12T01:43:18.643 INFO:tasks.workunit.client.0.smithi066.stdout:7/588: dread - d2/d5/d6/d22/fa9 zero size 2024-09-12T01:43:18.647 INFO:tasks.workunit.client.0.smithi066.stdout:7/589: creat d2/fcc x:0 0 0 2024-09-12T01:43:18.647 INFO:tasks.workunit.client.0.smithi066.stdout:7/590: chown d2/d5/d6/d40/d63/c82 27 1 2024-09-12T01:43:18.651 INFO:tasks.workunit.client.0.smithi066.stdout:5/692: dread d0/d26/f2e [0,4194304] 0 2024-09-12T01:43:18.654 INFO:tasks.workunit.client.0.smithi066.stdout:5/693: mknod d0/d26/d2d/d42/d95/cdb 0 2024-09-12T01:43:18.656 INFO:tasks.workunit.client.0.smithi066.stdout:1/666: dwrite d5/dc/d53/f35 [0,4194304] 0 2024-09-12T01:43:18.656 INFO:tasks.workunit.client.0.smithi066.stdout:1/667: truncate d5/f47 1098339 0 2024-09-12T01:43:18.656 INFO:tasks.workunit.client.0.smithi066.stdout:1/668: read - d5/dc/d36/d57/f8a zero size 2024-09-12T01:43:18.656 INFO:tasks.workunit.client.0.smithi066.stdout:1/669: readlink d5/dc/lc0 0 2024-09-12T01:43:18.661 INFO:tasks.workunit.client.0.smithi066.stdout:7/591: write d2/d5/da/d3f/d9b/d4d/f60 [1511065,65774] 0 2024-09-12T01:43:18.661 INFO:tasks.workunit.client.0.smithi066.stdout:7/592: stat d2/d5/da/d3f/f57 0 2024-09-12T01:43:18.665 INFO:tasks.workunit.client.0.smithi066.stdout:5/694: dread d0/dd/d18/d36/dbf/dce/d3b/d6b/f8a [0,4194304] 0 2024-09-12T01:43:18.665 INFO:tasks.workunit.client.0.smithi066.stdout:5/695: write d0/dd/f13 [3330687,100513] 0 2024-09-12T01:43:18.665 INFO:tasks.workunit.client.0.smithi066.stdout:5/696: chown d0/dd/d18/d36/dbf/dce/d9a/dad 0 1 2024-09-12T01:43:18.667 INFO:tasks.workunit.client.0.smithi066.stdout:7/593: mknod d2/d5/da/d3f/da4/d6c/d8e/da7/dc1/ccd 0 2024-09-12T01:43:18.668 INFO:tasks.workunit.client.0.smithi066.stdout:7/594: truncate d2/d5/da/d3f/da4/d6c/d80/f66 961347 0 2024-09-12T01:43:18.668 INFO:tasks.workunit.client.0.smithi066.stdout:7/595: write d2/fcc [129548,90766] 0 2024-09-12T01:43:18.669 INFO:tasks.workunit.client.0.smithi066.stdout:7/596: unlink d2/d5/d6/d22/d75/f8d 0 2024-09-12T01:43:18.671 INFO:tasks.workunit.client.0.smithi066.stdout:7/597: creat d2/d5/da/d3f/da4/fce x:0 0 0 2024-09-12T01:43:18.675 INFO:tasks.workunit.client.0.smithi066.stdout:1/670: dwrite d5/dc/f40 [4194304,4194304] 0 2024-09-12T01:43:18.676 INFO:tasks.workunit.client.0.smithi066.stdout:5/697: dread d0/dd/d18/f53 [0,4194304] 0 2024-09-12T01:43:18.695 INFO:tasks.workunit.client.0.smithi066.stdout:7/598: dwrite d2/fcc [0,4194304] 0 2024-09-12T01:43:18.706 INFO:tasks.workunit.client.0.smithi066.stdout:1/671: dwrite d5/dc/d36/d4b/f11 [0,4194304] 0 2024-09-12T01:43:18.709 INFO:tasks.workunit.client.0.smithi066.stdout:7/599: dread d2/d5/d6/d81/dc8/d53/f85 [0,4194304] 0 2024-09-12T01:43:18.713 INFO:tasks.workunit.client.0.smithi066.stdout:7/600: creat d2/d5/da/d3f/da4/d6c/fcf x:0 0 0 2024-09-12T01:43:18.715 INFO:tasks.workunit.client.0.smithi066.stdout:7/601: creat d2/d5/d6/d81/dc8/d53/fd0 x:0 0 0 2024-09-12T01:43:18.716 INFO:tasks.workunit.client.0.smithi066.stdout:1/672: dread d5/dc/d36/f96 [0,4194304] 0 2024-09-12T01:43:18.717 INFO:tasks.workunit.client.0.smithi066.stdout:7/602: rename d2/d5/d6/l44 to d2/d5/da/d3f/da4/d6c/d8e/ld1 0 2024-09-12T01:43:18.718 INFO:tasks.workunit.client.0.smithi066.stdout:7/603: dread d2/d5/da/d3f/da4/d6c/f9d [0,4194304] 0 2024-09-12T01:43:18.720 INFO:tasks.workunit.client.0.smithi066.stdout:7/604: mknod d2/d5/da/cd2 0 2024-09-12T01:43:18.724 INFO:tasks.workunit.client.0.smithi066.stdout:1/673: dread d5/dc/f40 [0,4194304] 0 2024-09-12T01:43:18.724 INFO:tasks.workunit.client.0.smithi066.stdout:1/674: fdatasync f4 0 2024-09-12T01:43:18.727 INFO:tasks.workunit.client.0.smithi066.stdout:1/675: truncate d5/dc/f10 983005 0 2024-09-12T01:43:18.727 INFO:tasks.workunit.client.0.smithi066.stdout:1/676: stat d5/d52/d5d/db6 0 2024-09-12T01:43:18.729 INFO:tasks.workunit.client.0.smithi066.stdout:8/703: sync 2024-09-12T01:43:18.729 INFO:tasks.workunit.client.0.smithi066.stdout:2/606: sync 2024-09-12T01:43:18.729 INFO:tasks.workunit.client.0.smithi066.stdout:0/751: sync 2024-09-12T01:43:18.730 INFO:tasks.workunit.client.0.smithi066.stdout:0/752: chown d1/d72 31629425 1 2024-09-12T01:43:18.730 INFO:tasks.workunit.client.0.smithi066.stdout:6/708: sync 2024-09-12T01:43:18.730 INFO:tasks.workunit.client.0.smithi066.stdout:6/709: dread - d2/d21/f7c zero size 2024-09-12T01:43:18.730 INFO:tasks.workunit.client.0.smithi066.stdout:3/772: sync 2024-09-12T01:43:18.731 INFO:tasks.workunit.client.0.smithi066.stdout:2/607: creat de/d13/d28/fcd x:0 0 0 2024-09-12T01:43:18.734 INFO:tasks.workunit.client.0.smithi066.stdout:0/753: unlink d1/d62/d9f/d4a/d67/d20/f21 0 2024-09-12T01:43:18.737 INFO:tasks.workunit.client.0.smithi066.stdout:6/710: symlink d2/d99/d12/lec 0 2024-09-12T01:43:18.739 INFO:tasks.workunit.client.0.smithi066.stdout:3/773: symlink d5/d35/d103/d1b/d45/d66/d67/d6d/de6/l111 0 2024-09-12T01:43:18.739 INFO:tasks.workunit.client.0.smithi066.stdout:3/774: write d5/d35/f4d [1852874,84503] 0 2024-09-12T01:43:18.739 INFO:tasks.workunit.client.0.smithi066.stdout:3/775: truncate d5/d35/d103/d1b/d65/d89/f108 870133 0 2024-09-12T01:43:18.739 INFO:tasks.workunit.client.0.smithi066.stdout:7/605: dwrite d2/d5/da/d3f/da4/f4b [4194304,4194304] 0 2024-09-12T01:43:18.739 INFO:tasks.workunit.client.0.smithi066.stdout:7/606: truncate d2/d5/da/d3f/fb8 539839 0 2024-09-12T01:43:18.741 INFO:tasks.workunit.client.0.smithi066.stdout:2/608: rmdir de/d13/d1e/d22/d4f 39 2024-09-12T01:43:18.741 INFO:tasks.workunit.client.0.smithi066.stdout:2/609: readlink de/d13/d1e/l27 0 2024-09-12T01:43:18.743 INFO:tasks.workunit.client.0.smithi066.stdout:0/754: creat d1/d62/d9f/d4a/d67/d1b/d3b/f107 x:0 0 0 2024-09-12T01:43:18.744 INFO:tasks.workunit.client.0.smithi066.stdout:6/711: creat d2/d31/d57/fed x:0 0 0 2024-09-12T01:43:18.752 INFO:tasks.workunit.client.0.smithi066.stdout:6/712: link d2/f1a d2/d99/d12/d1d/fee 0 2024-09-12T01:43:18.753 INFO:tasks.workunit.client.0.smithi066.stdout:7/607: truncate d2/d5/da/d3f/d9b/f67 2185259 0 2024-09-12T01:43:18.754 INFO:tasks.workunit.client.0.smithi066.stdout:8/704: dwrite d12/d21/d2f/d57/d3c/f76 [0,4194304] 0 2024-09-12T01:43:18.758 INFO:tasks.workunit.client.0.smithi066.stdout:8/705: rename d12/d21/d2f/d57/d84/ld4 to d12/d21/d2f/d57/d84/d50/d56/d69/le8 0 2024-09-12T01:43:18.762 INFO:tasks.workunit.client.0.smithi066.stdout:6/713: read d2/d99/d12/faf [2452800,130912] 0 2024-09-12T01:43:18.762 INFO:tasks.workunit.client.0.smithi066.stdout:6/714: readlink d2/d99/l1b 0 2024-09-12T01:43:18.768 INFO:tasks.workunit.client.0.smithi066.stdout:7/608: dread d2/d5/da/f36 [0,4194304] 0 2024-09-12T01:43:18.769 INFO:tasks.workunit.client.0.smithi066.stdout:7/609: truncate d2/d5/d6/d40/d63/fa1 940792 0 2024-09-12T01:43:18.769 INFO:tasks.workunit.client.0.smithi066.stdout:7/610: truncate d2/d5/d6/d40/fa5 1087054 0 2024-09-12T01:43:18.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/610: dwrite de/d13/f9f [0,4194304] 0 2024-09-12T01:43:18.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/611: dread - de/d13/d1e/d92/f9a zero size 2024-09-12T01:43:18.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/612: read - de/d13/d5c/f78 zero size 2024-09-12T01:43:18.772 INFO:tasks.workunit.client.0.smithi066.stdout:8/706: creat d12/d21/d2f/d57/d84/d50/d56/d69/fe9 x:0 0 0 2024-09-12T01:43:18.778 INFO:tasks.workunit.client.0.smithi066.stdout:3/776: dwrite d5/d35/d103/d1b/d65/d89/fd6 [0,4194304] 0 2024-09-12T01:43:18.779 INFO:tasks.workunit.client.0.smithi066.stdout:6/715: dwrite d2/d99/f1c [0,4194304] 0 2024-09-12T01:43:18.780 INFO:tasks.workunit.client.0.smithi066.stdout:7/611: rename d2/d5/f39 to d2/d5/d6/d22/d75/d2f/fd3 0 2024-09-12T01:43:18.787 INFO:tasks.workunit.client.0.smithi066.stdout:8/707: rmdir d12/d21/d2f/d57/d84/d50 39 2024-09-12T01:43:18.787 INFO:tasks.workunit.client.0.smithi066.stdout:8/708: creat d12/d21/d2f/fea x:0 0 0 2024-09-12T01:43:18.788 INFO:tasks.workunit.client.0.smithi066.stdout:3/777: mkdir d5/d35/d103/d1b/d77/dd5/dbd/d112 0 2024-09-12T01:43:18.789 INFO:tasks.workunit.client.0.smithi066.stdout:6/716: rmdir d2/d99/d12/d1d/d6b/de6 0 2024-09-12T01:43:18.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/613: dwrite de/d13/d1e/f23 [0,4194304] 0 2024-09-12T01:43:18.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/614: read - de/d13/f80 zero size 2024-09-12T01:43:18.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/615: chown de/d13/d5c/c86 255 1 2024-09-12T01:43:18.795 INFO:tasks.workunit.client.0.smithi066.stdout:8/709: rename d12/d21/d2f/d57/d84/d50/c87 to d12/ceb 0 2024-09-12T01:43:18.798 INFO:tasks.workunit.client.0.smithi066.stdout:3/778: symlink d5/d35/d103/d1b/d77/dd5/dbd/l113 0 2024-09-12T01:43:18.800 INFO:tasks.workunit.client.0.smithi066.stdout:7/612: dread d2/d5/d6/f2a [0,4194304] 0 2024-09-12T01:43:18.800 INFO:tasks.workunit.client.0.smithi066.stdout:7/613: creat d2/d5/d6/d22/d75/fd4 x:0 0 0 2024-09-12T01:43:18.800 INFO:tasks.workunit.client.0.smithi066.stdout:7/614: readlink d2/l37 0 2024-09-12T01:43:18.802 INFO:tasks.workunit.client.0.smithi066.stdout:6/717: write d2/d99/d12/d1d/d6b/dc6/dd9/fe4 [1401662,7866] 0 2024-09-12T01:43:18.803 INFO:tasks.workunit.client.0.smithi066.stdout:6/718: dread d2/d99/d12/d1d/d6b/fca [0,4194304] 0 2024-09-12T01:43:18.804 INFO:tasks.workunit.client.0.smithi066.stdout:6/719: chown d2/d99/d72/d76/ca5 13 1 2024-09-12T01:43:18.804 INFO:tasks.workunit.client.0.smithi066.stdout:8/710: creat d12/d21/d2f/d57/d84/d50/d56/db6/dc8/fec x:0 0 0 2024-09-12T01:43:18.804 INFO:tasks.workunit.client.0.smithi066.stdout:8/711: dread - d12/d21/d2f/f9a zero size 2024-09-12T01:43:18.804 INFO:tasks.workunit.client.0.smithi066.stdout:8/712: write d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 [107205,1560] 0 2024-09-12T01:43:18.804 INFO:tasks.workunit.client.0.smithi066.stdout:3/779: mkdir d5/d35/d103/d1b/d45/d66/d67/d114 0 2024-09-12T01:43:18.808 INFO:tasks.workunit.client.0.smithi066.stdout:7/615: symlink d2/d5/da/d3f/da4/d6c/ld5 0 2024-09-12T01:43:18.811 INFO:tasks.workunit.client.0.smithi066.stdout:6/720: link d2/d31/d57/la9 d2/d99/d72/lef 0 2024-09-12T01:43:18.813 INFO:tasks.workunit.client.0.smithi066.stdout:8/713: mkdir d12/d21/d2f/d57/d84/d50/ded 0 2024-09-12T01:43:18.813 INFO:tasks.workunit.client.0.smithi066.stdout:8/714: fdatasync d12/d21/d2f/d57/d43/d82/dbb/fcb 0 2024-09-12T01:43:18.815 INFO:tasks.workunit.client.0.smithi066.stdout:7/616: truncate d2/d5/da/d3f/da4/d84/f87 401971 0 2024-09-12T01:43:18.815 INFO:tasks.workunit.client.0.smithi066.stdout:7/617: creat d2/d5/d6/d81/dc8/d53/fd6 x:0 0 0 2024-09-12T01:43:18.816 INFO:tasks.workunit.client.0.smithi066.stdout:6/721: symlink d2/d99/d12/d49/d9e/dc0/lf0 0 2024-09-12T01:43:18.823 INFO:tasks.workunit.client.0.smithi066.stdout:7/618: link d2/d5/da/d3f/d5e/lc5 d2/d5/da/d3f/da4/d6c/d80/d5f/ld7 0 2024-09-12T01:43:18.825 INFO:tasks.workunit.client.0.smithi066.stdout:8/715: rename d12/d21/d2f/d57/d84/d89 to d12/d21/d2f/d57/d84/d50/d56/db6/dee 0 2024-09-12T01:43:18.826 INFO:tasks.workunit.client.0.smithi066.stdout:6/722: dread d2/d31/fa8 [0,4194304] 0 2024-09-12T01:43:18.827 INFO:tasks.workunit.client.0.smithi066.stdout:8/716: creat d12/d21/d2f/d57/fef x:0 0 0 2024-09-12T01:43:18.837 INFO:tasks.workunit.client.0.smithi066.stdout:8/717: dread d12/d21/d2f/d57/d84/d50/d56/db6/faa [0,4194304] 0 2024-09-12T01:43:18.841 INFO:tasks.workunit.client.0.smithi066.stdout:7/619: dwrite d2/d5/d6/f26 [0,4194304] 0 2024-09-12T01:43:18.858 INFO:tasks.workunit.client.0.smithi066.stdout:7/620: dwrite d2/d5/da/d3f/da4/f61 [0,4194304] 0 2024-09-12T01:43:18.900 INFO:tasks.workunit.client.0.smithi066.stdout:6/723: rename d2/d99/d12/f5c to d2/d99/d7b/ff1 0 2024-09-12T01:43:18.901 INFO:tasks.workunit.client.0.smithi066.stdout:8/718: creat d12/d21/d2f/d57/d84/d50/d56/db6/dee/dd8/ff0 x:0 0 0 2024-09-12T01:43:18.901 INFO:tasks.workunit.client.0.smithi066.stdout:8/719: write d12/d21/d2f/f9c [8819,7601] 0 2024-09-12T01:43:18.906 INFO:tasks.workunit.client.0.smithi066.stdout:7/621: mkdir d2/d5/d6/d22/d75/db6/dd8 0 2024-09-12T01:43:18.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/724: dread d2/d21/f41 [0,4194304] 0 2024-09-12T01:43:18.916 INFO:tasks.workunit.client.0.smithi066.stdout:8/720: symlink d12/d21/d2f/d57/d84/d50/ded/lf1 0 2024-09-12T01:43:18.916 INFO:tasks.workunit.client.0.smithi066.stdout:8/721: chown c7 19 1 2024-09-12T01:43:18.917 INFO:tasks.workunit.client.0.smithi066.stdout:7/622: unlink d2/d5/d6/d22/fa9 0 2024-09-12T01:43:18.918 INFO:tasks.workunit.client.0.smithi066.stdout:6/725: mknod d2/d21/cf2 0 2024-09-12T01:43:18.920 INFO:tasks.workunit.client.0.smithi066.stdout:8/722: rename d12/d21/d2f/d57/d84/d50/ded/lf1 to d12/d21/d2f/d57/d84/d50/d56/db6/dee/d92/lf2 0 2024-09-12T01:43:18.921 INFO:tasks.workunit.client.0.smithi066.stdout:7/623: mknod d2/d5/da/d3f/da4/d6c/d80/d7c/cd9 0 2024-09-12T01:43:18.921 INFO:tasks.workunit.client.0.smithi066.stdout:7/624: chown d2/d5/da/d3f/d5e 7 1 2024-09-12T01:43:18.925 INFO:tasks.workunit.client.0.smithi066.stdout:8/723: creat d12/d21/d2f/d57/d43/d82/ff3 x:0 0 0 2024-09-12T01:43:18.926 INFO:tasks.workunit.client.0.smithi066.stdout:6/726: getdents d2/d99/d72 0 2024-09-12T01:43:18.928 INFO:tasks.workunit.client.0.smithi066.stdout:6/727: mknod d2/d99/d12/d1d/cf3 0 2024-09-12T01:43:18.935 INFO:tasks.workunit.client.0.smithi066.stdout:6/728: rename d2/d99/d12/d1d/dc7 to d2/d99/d12/d1d/df4 0 2024-09-12T01:43:18.936 INFO:tasks.workunit.client.0.smithi066.stdout:6/729: readlink d2/d99/d12/d1d/df4/ld0 0 2024-09-12T01:43:18.936 INFO:tasks.workunit.client.0.smithi066.stdout:6/730: creat d2/d99/d12/d49/d9e/ff5 x:0 0 0 2024-09-12T01:43:18.936 INFO:tasks.workunit.client.0.smithi066.stdout:6/731: fdatasync d2/f2a 0 2024-09-12T01:43:18.943 INFO:tasks.workunit.client.0.smithi066.stdout:7/625: dwrite d2/d5/d6/d40/fa5 [0,4194304] 0 2024-09-12T01:43:18.948 INFO:tasks.workunit.client.0.smithi066.stdout:7/626: creat d2/d5/da/d3f/d9b/fda x:0 0 0 2024-09-12T01:43:18.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/627: getdents d2/d5/d6/d22/d75 0 2024-09-12T01:43:18.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/628: creat d2/d5/d6/d81/dc8/d53/fdb x:0 0 0 2024-09-12T01:43:18.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/629: readlink d2/lab 0 2024-09-12T01:43:18.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/724: dwrite d12/d21/d2f/d57/fef [0,4194304] 0 2024-09-12T01:43:18.956 INFO:tasks.workunit.client.0.smithi066.stdout:8/725: chown d12/f3d 52 1 2024-09-12T01:43:18.957 INFO:tasks.workunit.client.0.smithi066.stdout:6/732: dwrite d2/d99/f6a [0,4194304] 0 2024-09-12T01:43:18.960 INFO:tasks.workunit.client.0.smithi066.stdout:8/726: mknod d12/d21/d2f/d57/cf4 0 2024-09-12T01:43:18.960 INFO:tasks.workunit.client.0.smithi066.stdout:8/727: dread - d12/d21/d2f/d57/fc6 zero size 2024-09-12T01:43:18.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/630: write d2/d5/d6/d81/fa2 [556406,77894] 0 2024-09-12T01:43:18.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/631: write d2/d5/d6/d81/dc8/d53/fd6 [858341,88010] 0 2024-09-12T01:43:18.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/632: chown d2/fcc 963 1 2024-09-12T01:43:18.963 INFO:tasks.workunit.client.0.smithi066.stdout:6/733: link d2/d31/d57/fc5 d2/d99/d12/d1d/ff6 0 2024-09-12T01:43:18.964 INFO:tasks.workunit.client.0.smithi066.stdout:6/734: creat d2/d21/ff7 x:0 0 0 2024-09-12T01:43:18.966 INFO:tasks.workunit.client.0.smithi066.stdout:7/633: unlink d2/d5/da/d3f/da4/d6c/f9d 0 2024-09-12T01:43:18.968 INFO:tasks.workunit.client.0.smithi066.stdout:4/703: sync 2024-09-12T01:43:18.968 INFO:tasks.workunit.client.0.smithi066.stdout:9/700: sync 2024-09-12T01:43:18.972 INFO:tasks.workunit.client.0.smithi066.stdout:4/704: mknod d4/d6/d27/d66/d6c/ce9 0 2024-09-12T01:43:18.972 INFO:tasks.workunit.client.0.smithi066.stdout:4/705: write d4/d6/d62/f9e [1036474,23113] 0 2024-09-12T01:43:18.976 INFO:tasks.workunit.client.0.smithi066.stdout:9/701: mkdir d0/d6/d17/d1b/de9/df9/dfd 0 2024-09-12T01:43:18.979 INFO:tasks.workunit.client.0.smithi066.stdout:8/728: dwrite d12/d21/d2f/d57/d84/d50/d56/f75 [0,4194304] 0 2024-09-12T01:43:18.983 INFO:tasks.workunit.client.0.smithi066.stdout:6/735: rename d2/d31 to d2/d99/d7b/df8 0 2024-09-12T01:43:18.984 INFO:tasks.workunit.client.0.smithi066.stdout:9/702: dread d0/d6/d43/f6e [0,4194304] 0 2024-09-12T01:43:18.985 INFO:tasks.workunit.client.0.smithi066.stdout:9/703: chown d0/d6/d17/d4f/d9 454 1 2024-09-12T01:43:18.985 INFO:tasks.workunit.client.0.smithi066.stdout:7/634: dwrite d2/d5/da/d3f/da4/f8f [4194304,4194304] 0 2024-09-12T01:43:18.985 INFO:tasks.workunit.client.0.smithi066.stdout:7/635: write d2/d5/d6/d81/dc8/fbf [789668,38498] 0 2024-09-12T01:43:18.990 INFO:tasks.workunit.client.0.smithi066.stdout:4/706: rmdir d4/d15 39 2024-09-12T01:43:18.991 INFO:tasks.workunit.client.0.smithi066.stdout:6/736: symlink d2/d99/d12/d1d/df4/dd3/lf9 0 2024-09-12T01:43:18.994 INFO:tasks.workunit.client.0.smithi066.stdout:9/704: mkdir d0/d6/d17/d4f/d9/de/de7/dfe 0 2024-09-12T01:43:18.995 INFO:tasks.workunit.client.0.smithi066.stdout:7/636: mknod d2/d5/da/d3f/da4/d70/cdc 0 2024-09-12T01:43:18.997 INFO:tasks.workunit.client.0.smithi066.stdout:4/707: mkdir d4/d5f/dea 0 2024-09-12T01:43:18.998 INFO:tasks.workunit.client.0.smithi066.stdout:4/708: chown d4/d15/f94 7480681 1 2024-09-12T01:43:18.998 INFO:tasks.workunit.client.0.smithi066.stdout:4/709: creat d4/d6/d27/d66/da1/feb x:0 0 0 2024-09-12T01:43:18.999 INFO:tasks.workunit.client.0.smithi066.stdout:7/637: mkdir d2/d5/da/d3f/da4/ddd 0 2024-09-12T01:43:19.000 INFO:tasks.workunit.client.0.smithi066.stdout:7/638: write d2/d5/da/d3f/da4/f3b [1135037,103340] 0 2024-09-12T01:43:19.002 INFO:tasks.workunit.client.0.smithi066.stdout:8/729: dwrite d12/d21/d2f/fc0 [0,4194304] 0 2024-09-12T01:43:19.014 INFO:tasks.workunit.client.0.smithi066.stdout:7/639: write d2/d5/da/d3f/da4/d84/f87 [340781,62236] 0 2024-09-12T01:43:19.015 INFO:tasks.workunit.client.0.smithi066.stdout:7/640: mknod d2/d5/da/d3f/da4/d6c/cde 0 2024-09-12T01:43:19.015 INFO:tasks.workunit.client.0.smithi066.stdout:7/641: readlink d2/d3c/l74 0 2024-09-12T01:43:19.016 INFO:tasks.workunit.client.0.smithi066.stdout:7/642: truncate d2/d5/d6/d22/d75/d2f/fd3 627187 0 2024-09-12T01:43:19.023 INFO:tasks.workunit.client.0.smithi066.stdout:6/737: dwrite d2/f1a [0,4194304] 0 2024-09-12T01:43:19.024 INFO:tasks.workunit.client.0.smithi066.stdout:6/738: mkdir d2/d99/d7b/df8/d57/dfa 0 2024-09-12T01:43:19.025 INFO:tasks.workunit.client.0.smithi066.stdout:9/705: dwrite d0/d6/d17/d1b/d4c/d4b/d86/f91 [0,4194304] 0 2024-09-12T01:43:19.026 INFO:tasks.workunit.client.0.smithi066.stdout:4/710: dwrite d4/d6/f23 [4194304,4194304] 0 2024-09-12T01:43:19.027 INFO:tasks.workunit.client.0.smithi066.stdout:4/711: dread - d4/d6/d27/d66/d6c/fb5 zero size 2024-09-12T01:43:19.027 INFO:tasks.workunit.client.0.smithi066.stdout:4/712: dread - d4/d6/d27/d66/d6c/fa0 zero size 2024-09-12T01:43:19.032 INFO:tasks.workunit.client.0.smithi066.stdout:4/713: truncate d4/d6/d8/f1a 2954524 0 2024-09-12T01:43:19.033 INFO:tasks.workunit.client.0.smithi066.stdout:4/714: fsync d4/d6/d27/f98 0 2024-09-12T01:43:19.033 INFO:tasks.workunit.client.0.smithi066.stdout:4/715: mkdir d4/d6/d27/d66/dec 0 2024-09-12T01:43:19.033 INFO:tasks.workunit.client.0.smithi066.stdout:9/706: dread d0/d6/d17/d28/d79/ffb [0,4194304] 0 2024-09-12T01:43:19.034 INFO:tasks.workunit.client.0.smithi066.stdout:9/707: dread - d0/d6/d17/d1b/f61 zero size 2024-09-12T01:43:19.038 INFO:tasks.workunit.client.0.smithi066.stdout:7/643: dwrite d2/d5/d6/d40/d51/fc2 [0,4194304] 0 2024-09-12T01:43:19.038 INFO:tasks.workunit.client.0.smithi066.stdout:7/644: write d2/d5/d6/d22/d75/d2f/f34 [1518877,56188] 0 2024-09-12T01:43:19.039 INFO:tasks.workunit.client.0.smithi066.stdout:7/645: chown d2/d5/da/d3f/da4/d70/fb5 855512 1 2024-09-12T01:43:19.043 INFO:tasks.workunit.client.0.smithi066.stdout:7/646: mkdir d2/d5/da/d3f/da4/d6c/ddf 0 2024-09-12T01:43:19.046 INFO:tasks.workunit.client.0.smithi066.stdout:7/647: creat d2/d5/da/d3f/d9b/d4d/fe0 x:0 0 0 2024-09-12T01:43:19.048 INFO:tasks.workunit.client.0.smithi066.stdout:7/648: creat d2/d5/d6/d22/d75/db6/dd8/fe1 x:0 0 0 2024-09-12T01:43:19.048 INFO:tasks.workunit.client.0.smithi066.stdout:7/649: stat d2/d5/da/d3f/da4/d6c/d8e/l96 0 2024-09-12T01:43:19.049 INFO:tasks.workunit.client.0.smithi066.stdout:7/650: write d2/d5/da/d3f/da4/d84/f5b [134988,32228] 0 2024-09-12T01:43:19.049 INFO:tasks.workunit.client.0.smithi066.stdout:7/651: creat d2/d5/d6/fe2 x:0 0 0 2024-09-12T01:43:19.051 INFO:tasks.workunit.client.0.smithi066.stdout:7/652: rmdir d2/d5/da/d3f/da4/d6c/d8e/da7 39 2024-09-12T01:43:19.051 INFO:tasks.workunit.client.0.smithi066.stdout:4/716: dwrite d4/f37 [0,4194304] 0 2024-09-12T01:43:19.054 INFO:tasks.workunit.client.0.smithi066.stdout:7/653: rename d2/d5/d6/d22/c91 to d2/d5/da/d3f/da4/d6c/ce3 0 2024-09-12T01:43:19.054 INFO:tasks.workunit.client.0.smithi066.stdout:7/654: write d2/d5/da/d3f/da4/d6c/fcf [625461,92203] 0 2024-09-12T01:43:19.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/655: read - d2/d5/da/d3f/d9b/d4d/f4f zero size 2024-09-12T01:43:19.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/656: creat d2/d5/da/d3f/d9b/d4d/fe4 x:0 0 0 2024-09-12T01:43:19.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/657: truncate d2/d5/d6/fe2 923870 0 2024-09-12T01:43:19.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/658: write d2/d5/da/d3f/da4/f61 [4899404,57812] 0 2024-09-12T01:43:19.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/659: dread - d2/d5/da/d3f/da4/d70/f9f zero size 2024-09-12T01:43:19.055 INFO:tasks.workunit.client.0.smithi066.stdout:7/660: truncate d2/d3c/fcb 547364 0 2024-09-12T01:43:19.058 INFO:tasks.workunit.client.0.smithi066.stdout:7/661: rename d2/d5/cc to d2/d5/da/d3f/da4/d70/ce5 0 2024-09-12T01:43:19.059 INFO:tasks.workunit.client.0.smithi066.stdout:7/662: rmdir d2/d5/da/d3f/da4/d6c/d8e 39 2024-09-12T01:43:19.059 INFO:tasks.workunit.client.0.smithi066.stdout:7/663: write d2/d5/d6/d81/dc8/d53/fdb [353456,61415] 0 2024-09-12T01:43:19.061 INFO:tasks.workunit.client.0.smithi066.stdout:7/664: mknod d2/d5/d6/d81/dc8/ce6 0 2024-09-12T01:43:19.070 INFO:tasks.workunit.client.0.smithi066.stdout:4/717: dwrite d4/d6/d8/d18/f74 [0,4194304] 0 2024-09-12T01:43:19.071 INFO:tasks.workunit.client.0.smithi066.stdout:4/718: mknod d4/d6/d8/d4a/ced 0 2024-09-12T01:43:19.071 INFO:tasks.workunit.client.0.smithi066.stdout:4/719: read - d4/d6/d14/fca zero size 2024-09-12T01:43:19.071 INFO:tasks.workunit.client.0.smithi066.stdout:7/665: dread d2/d5/d6/d81/dc8/d53/fdb [0,4194304] 0 2024-09-12T01:43:19.074 INFO:tasks.workunit.client.0.smithi066.stdout:7/666: fdatasync d2/d5/d6/d22/d75/d2f/f34 0 2024-09-12T01:43:19.075 INFO:tasks.workunit.client.0.smithi066.stdout:7/667: chown d2/d5/d6/d22/l27 21 1 2024-09-12T01:43:19.081 INFO:tasks.workunit.client.0.smithi066.stdout:4/720: dread d4/d6/d8/d18/d4d/f51 [0,4194304] 0 2024-09-12T01:43:19.082 INFO:tasks.workunit.client.0.smithi066.stdout:4/721: rename d4/d5f/ldc to d4/d6/d8/d18/d45/lee 0 2024-09-12T01:43:19.083 INFO:tasks.workunit.client.0.smithi066.stdout:4/722: chown d4/d6/d27/d66/l55 6336922 1 2024-09-12T01:43:19.083 INFO:tasks.workunit.client.0.smithi066.stdout:4/723: chown d4/d6/d27 8564 1 2024-09-12T01:43:19.083 INFO:tasks.workunit.client.0.smithi066.stdout:4/724: rmdir d4/d6/d27/d66 39 2024-09-12T01:43:19.085 INFO:tasks.workunit.client.0.smithi066.stdout:7/668: dread d2/d5/da/f50 [0,4194304] 0 2024-09-12T01:43:19.085 INFO:tasks.workunit.client.0.smithi066.stdout:7/669: fdatasync d2/d5/da/d3f/da4/f8f 0 2024-09-12T01:43:19.085 INFO:tasks.workunit.client.0.smithi066.stdout:4/725: creat d4/d6/d27/d66/d6c/d75/fef x:0 0 0 2024-09-12T01:43:19.086 INFO:tasks.workunit.client.0.smithi066.stdout:7/670: dread d2/d5/d6/d81/dc8/d53/fdb [0,4194304] 0 2024-09-12T01:43:19.087 INFO:tasks.workunit.client.0.smithi066.stdout:4/726: mkdir d4/d6/d8/d4a/df0 0 2024-09-12T01:43:19.087 INFO:tasks.workunit.client.0.smithi066.stdout:4/727: readlink d4/d6/d48/la8 0 2024-09-12T01:43:19.089 INFO:tasks.workunit.client.0.smithi066.stdout:7/671: rename d2/d5/da/d3f/da4/d84/cc6 to d2/d71/ce7 0 2024-09-12T01:43:19.089 INFO:tasks.workunit.client.0.smithi066.stdout:7/672: fsync d2/d5/da/fbd 0 2024-09-12T01:43:19.089 INFO:tasks.workunit.client.0.smithi066.stdout:7/673: chown d2/d5/d6/d40/d63/fa1 1315282587 1 2024-09-12T01:43:19.089 INFO:tasks.workunit.client.0.smithi066.stdout:7/674: chown d2/d5/d6/d40/d51/lb0 240002333 1 2024-09-12T01:43:19.090 INFO:tasks.workunit.client.0.smithi066.stdout:4/728: creat d4/d6/d8/d4a/df0/ff1 x:0 0 0 2024-09-12T01:43:19.099 INFO:tasks.workunit.client.0.smithi066.stdout:7/675: dread d2/d5/d6/d40/d63/f86 [0,4194304] 0 2024-09-12T01:43:19.100 INFO:tasks.workunit.client.0.smithi066.stdout:7/676: rename d2/d5/da/d3f/da4/d6c/ld5 to d2/le8 0 2024-09-12T01:43:19.102 INFO:tasks.workunit.client.0.smithi066.stdout:7/677: mknod d2/d5/d6/d40/d63/db4/ce9 0 2024-09-12T01:43:19.108 INFO:tasks.workunit.client.0.smithi066.stdout:4/729: dwrite d4/d6/d48/f8b [0,4194304] 0 2024-09-12T01:43:19.110 INFO:tasks.workunit.client.0.smithi066.stdout:4/730: mknod d4/d6/d8/d4a/df0/cf2 0 2024-09-12T01:43:19.111 INFO:tasks.workunit.client.0.smithi066.stdout:4/731: rename d4/d6/d27/d66/d6c/l6d to d4/d15/d33/d5e/dac/lf3 0 2024-09-12T01:43:19.116 INFO:tasks.workunit.client.0.smithi066.stdout:7/678: truncate d2/d5/da/d3f/da4/d6c/fcf 350227 0 2024-09-12T01:43:19.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/679: symlink d2/d71/d93/lea 0 2024-09-12T01:43:19.133 INFO:tasks.workunit.client.0.smithi066.stdout:7/680: dread d2/d5/d6/d40/d63/f86 [4194304,4194304] 0 2024-09-12T01:43:19.134 INFO:tasks.workunit.client.0.smithi066.stdout:7/681: rmdir d2/d5/da/d3f/da4/d6c/d80/d7c 39 2024-09-12T01:43:19.134 INFO:tasks.workunit.client.0.smithi066.stdout:7/682: read d2/d5/da/d3f/da4/f61 [3618649,337] 0 2024-09-12T01:43:19.135 INFO:tasks.workunit.client.0.smithi066.stdout:7/683: stat d2/d5/d6/d22/d75/d2f/c99 0 2024-09-12T01:43:19.135 INFO:tasks.workunit.client.0.smithi066.stdout:5/698: sync 2024-09-12T01:43:19.140 INFO:tasks.workunit.client.0.smithi066.stdout:4/732: dwrite d4/d5f/fc1 [0,4194304] 0 2024-09-12T01:43:19.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/733: rmdir d4/d6/d62/dcf 0 2024-09-12T01:43:19.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/734: dread - d4/d6/d14/fa2 zero size 2024-09-12T01:43:19.145 INFO:tasks.workunit.client.0.smithi066.stdout:4/735: dread d4/d6/d48/d88/f93 [0,4194304] 0 2024-09-12T01:43:19.147 INFO:tasks.workunit.client.0.smithi066.stdout:4/736: rename d4/d6/d27/d66/dec to d4/d15/df4 0 2024-09-12T01:43:19.164 INFO:tasks.workunit.client.0.smithi066.stdout:7/684: dwrite d2/d5/d6/d22/d75/fd4 [0,4194304] 0 2024-09-12T01:43:19.164 INFO:tasks.workunit.client.0.smithi066.stdout:4/737: dwrite d4/d6/d8/d18/d45/f57 [0,4194304] 0 2024-09-12T01:43:19.168 INFO:tasks.workunit.client.0.smithi066.stdout:4/738: mkdir d4/d6/d48/dd2/df5 0 2024-09-12T01:43:19.169 INFO:tasks.workunit.client.0.smithi066.stdout:4/739: read d4/d6/d27/d66/da1/fad [2106443,2103] 0 2024-09-12T01:43:19.169 INFO:tasks.workunit.client.0.smithi066.stdout:4/740: truncate d4/d6/f34 2749235 0 2024-09-12T01:43:19.169 INFO:tasks.workunit.client.0.smithi066.stdout:4/741: stat d4/d6/d8/d18/c42 0 2024-09-12T01:43:19.170 INFO:tasks.workunit.client.0.smithi066.stdout:4/742: creat d4/d15/d33/d5e/ff6 x:0 0 0 2024-09-12T01:43:19.170 INFO:tasks.workunit.client.0.smithi066.stdout:4/743: dread - d4/d6/d48/d88/fc7 zero size 2024-09-12T01:43:19.185 INFO:tasks.workunit.client.0.smithi066.stdout:7/685: dwrite d2/d5/da/d3f/d9b/f67 [0,4194304] 0 2024-09-12T01:43:19.186 INFO:tasks.workunit.client.0.smithi066.stdout:7/686: truncate d2/d5/d6/fe 758176 0 2024-09-12T01:43:19.207 INFO:tasks.workunit.client.0.smithi066.stdout:7/687: dwrite d2/d5/d6/d81/dc8/d53/f85 [0,4194304] 0 2024-09-12T01:43:19.208 INFO:tasks.workunit.client.0.smithi066.stdout:7/688: creat d2/d5/d6/d22/feb x:0 0 0 2024-09-12T01:43:19.217 INFO:tasks.workunit.client.0.smithi066.stdout:7/689: dread d2/d5/da/f11 [0,4194304] 0 2024-09-12T01:43:19.234 INFO:tasks.workunit.client.0.smithi066.stdout:7/690: dwrite d2/d5/d6/d40/d51/f8b [0,4194304] 0 2024-09-12T01:43:19.248 INFO:tasks.workunit.client.0.smithi066.stdout:7/691: dwrite d2/d5/d6/d40/d63/f86 [4194304,4194304] 0 2024-09-12T01:43:19.268 INFO:tasks.workunit.client.0.smithi066.stdout:7/692: dwrite d2/d5/da/d3f/da4/d6c/d80/f58 [4194304,4194304] 0 2024-09-12T01:43:19.268 INFO:tasks.workunit.client.0.smithi066.stdout:7/693: chown d2/d5/da/d3f/da4/d6c/d8e/da7/dc1/ccd 22819 1 2024-09-12T01:43:19.269 INFO:tasks.workunit.client.0.smithi066.stdout:7/694: write d2/d3c/fcb [1542977,6705] 0 2024-09-12T01:43:19.269 INFO:tasks.workunit.client.0.smithi066.stdout:7/695: readlink d2/d5/d6/d22/l27 0 2024-09-12T01:43:19.269 INFO:tasks.workunit.client.0.smithi066.stdout:7/696: dread - d2/f79 zero size 2024-09-12T01:43:19.269 INFO:tasks.workunit.client.0.smithi066.stdout:7/697: symlink d2/d5/d6/d40/lec 0 2024-09-12T01:43:19.269 INFO:tasks.workunit.client.0.smithi066.stdout:7/698: creat d2/d5/d6/d22/d75/db6/dd8/fed x:0 0 0 2024-09-12T01:43:19.272 INFO:tasks.workunit.client.0.smithi066.stdout:7/699: mknod d2/d5/d6/cee 0 2024-09-12T01:43:19.273 INFO:tasks.workunit.client.0.smithi066.stdout:7/700: mknod d2/d5/da/d3f/da4/d84/cef 0 2024-09-12T01:43:19.273 INFO:tasks.workunit.client.0.smithi066.stdout:7/701: truncate d2/d5/d6/d22/feb 708708 0 2024-09-12T01:43:19.276 INFO:tasks.workunit.client.0.smithi066.stdout:7/702: dread d2/d5/da/d3f/da4/f3b [0,4194304] 0 2024-09-12T01:43:19.277 INFO:tasks.workunit.client.0.smithi066.stdout:7/703: symlink d2/d3c/lf0 0 2024-09-12T01:43:19.278 INFO:tasks.workunit.client.0.smithi066.stdout:7/704: creat d2/d5/da/d3f/da4/d6c/d80/d7c/ff1 x:0 0 0 2024-09-12T01:43:19.279 INFO:tasks.workunit.client.0.smithi066.stdout:7/705: getdents d2/d5/d6/d81 0 2024-09-12T01:43:19.284 INFO:tasks.workunit.client.0.smithi066.stdout:1/677: sync 2024-09-12T01:43:19.284 INFO:tasks.workunit.client.0.smithi066.stdout:0/755: sync 2024-09-12T01:43:19.285 INFO:tasks.workunit.client.0.smithi066.stdout:0/756: chown d1/d62/d9f/d4a/d67/d6e/d80/fa6 75105658 1 2024-09-12T01:43:19.296 INFO:tasks.workunit.client.0.smithi066.stdout:7/706: dwrite d2/d5/d6/f26 [0,4194304] 0 2024-09-12T01:43:19.302 INFO:tasks.workunit.client.0.smithi066.stdout:7/707: creat d2/d5/d6/d40/d63/db4/ff2 x:0 0 0 2024-09-12T01:43:19.303 INFO:tasks.workunit.client.0.smithi066.stdout:1/678: dwrite d5/d15/d58/da1/fb3 [0,4194304] 0 2024-09-12T01:43:19.305 INFO:tasks.workunit.client.0.smithi066.stdout:1/679: dread d5/dc/d53/f45 [0,4194304] 0 2024-09-12T01:43:19.308 INFO:tasks.workunit.client.0.smithi066.stdout:7/708: mknod d2/d5/da/cf3 0 2024-09-12T01:43:19.308 INFO:tasks.workunit.client.0.smithi066.stdout:7/709: truncate d2/d5/d6/fe 1799982 0 2024-09-12T01:43:19.308 INFO:tasks.workunit.client.0.smithi066.stdout:7/710: truncate d2/d3c/fcb 2395300 0 2024-09-12T01:43:19.309 INFO:tasks.workunit.client.0.smithi066.stdout:0/757: dwrite d1/d62/d9f/d7c/f9e [0,4194304] 0 2024-09-12T01:43:19.309 INFO:tasks.workunit.client.0.smithi066.stdout:0/758: readlink d1/d62/d9f/d4a/d67/d3e/lb0 0 2024-09-12T01:43:19.311 INFO:tasks.workunit.client.0.smithi066.stdout:7/711: mknod d2/d5/d6/d40/cf4 0 2024-09-12T01:43:19.317 INFO:tasks.workunit.client.0.smithi066.stdout:0/759: mkdir d1/d62/d9f/d4a/d67/d1b/d26/d108 0 2024-09-12T01:43:19.319 INFO:tasks.workunit.client.0.smithi066.stdout:1/680: mkdir d5/d15/d4d/d86/dc7 0 2024-09-12T01:43:19.322 INFO:tasks.workunit.client.0.smithi066.stdout:1/681: link d5/dc/d4f/d8e/f91 d5/dc/d4f/fc8 0 2024-09-12T01:43:19.322 INFO:tasks.workunit.client.0.smithi066.stdout:1/682: chown d5/l30 58 1 2024-09-12T01:43:19.323 INFO:tasks.workunit.client.0.smithi066.stdout:0/760: symlink d1/d72/de/l109 0 2024-09-12T01:43:19.323 INFO:tasks.workunit.client.0.smithi066.stdout:7/712: dwrite d2/d5/d6/d22/feb [0,4194304] 0 2024-09-12T01:43:19.323 INFO:tasks.workunit.client.0.smithi066.stdout:7/713: write d2/d5/da/d3f/da4/d6c/d80/d7c/f97 [1207206,125812] 0 2024-09-12T01:43:19.328 INFO:tasks.workunit.client.0.smithi066.stdout:7/714: mknod d2/d5/da/d3f/da4/d6c/d8e/cf5 0 2024-09-12T01:43:19.330 INFO:tasks.workunit.client.0.smithi066.stdout:7/715: rename d2/d5/d6/f2a to d2/d5/da/d3f/da4/d6c/d80/ff6 0 2024-09-12T01:43:19.335 INFO:tasks.workunit.client.0.smithi066.stdout:0/761: write d1/d62/d9f/d4a/d67/d6e/d80/fe9 [212394,37763] 0 2024-09-12T01:43:19.335 INFO:tasks.workunit.client.0.smithi066.stdout:0/762: chown d1/d72 78836 1 2024-09-12T01:43:19.336 INFO:tasks.workunit.client.0.smithi066.stdout:0/763: creat d1/d62/d9f/d4a/d67/d1b/d61/f10a x:0 0 0 2024-09-12T01:43:19.339 INFO:tasks.workunit.client.0.smithi066.stdout:0/764: rmdir d1/d62/d6c/dad/df0 39 2024-09-12T01:43:19.339 INFO:tasks.workunit.client.0.smithi066.stdout:7/716: write d2/d5/d6/d22/feb [735126,21330] 0 2024-09-12T01:43:19.341 INFO:tasks.workunit.client.0.smithi066.stdout:0/765: unlink d1/d62/d9f/d4a/ffc 0 2024-09-12T01:43:19.343 INFO:tasks.workunit.client.0.smithi066.stdout:1/683: dwrite d5/dc/d53/f5a [0,4194304] 0 2024-09-12T01:43:19.343 INFO:tasks.workunit.client.0.smithi066.stdout:1/684: read - d5/d52/d60/fbb zero size 2024-09-12T01:43:19.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/766: rename d1/d62/d9f/d4a/d67/d1b/d26/d9c/ff5 to d1/d62/d89/da3/dc1/de2/f10b 0 2024-09-12T01:43:19.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/767: stat d1/d62/d9f/d4a/d67/c18 0 2024-09-12T01:43:19.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/768: write d1/d62/d9f/d92/d95/fb2 [321945,113097] 0 2024-09-12T01:43:19.345 INFO:tasks.workunit.client.0.smithi066.stdout:0/769: readlink d1/d62/d9f/db4/l88 0 2024-09-12T01:43:19.354 INFO:tasks.workunit.client.0.smithi066.stdout:1/685: dread d5/f7 [0,4194304] 0 2024-09-12T01:43:19.354 INFO:tasks.workunit.client.0.smithi066.stdout:1/686: getdents d5/dc/d36/d57/dac/dc4 0 2024-09-12T01:43:19.355 INFO:tasks.workunit.client.0.smithi066.stdout:1/687: mknod d5/dc/cc9 0 2024-09-12T01:43:19.359 INFO:tasks.workunit.client.0.smithi066.stdout:7/717: dwrite d2/d5/d6/fbc [0,4194304] 0 2024-09-12T01:43:19.361 INFO:tasks.workunit.client.0.smithi066.stdout:0/770: dwrite d1/d62/d89/da3/feb [0,4194304] 0 2024-09-12T01:43:19.362 INFO:tasks.workunit.client.0.smithi066.stdout:7/718: mkdir d2/d5/da/d3f/d9b/df7 0 2024-09-12T01:43:19.373 INFO:tasks.workunit.client.0.smithi066.stdout:1/688: write d5/d52/f66 [3879179,104833] 0 2024-09-12T01:43:19.375 INFO:tasks.workunit.client.0.smithi066.stdout:1/689: mknod d5/d15/d4d/d86/dc7/cca 0 2024-09-12T01:43:19.377 INFO:tasks.workunit.client.0.smithi066.stdout:1/690: mknod d5/d15/d58/da1/ccb 0 2024-09-12T01:43:19.377 INFO:tasks.workunit.client.0.smithi066.stdout:1/691: stat d5/d52/d5d/c7b 0 2024-09-12T01:43:19.380 INFO:tasks.workunit.client.0.smithi066.stdout:1/692: mknod d5/dc/d4f/d8e/ccc 0 2024-09-12T01:43:19.390 INFO:tasks.workunit.client.0.smithi066.stdout:1/693: write d5/f73 [3211646,117427] 0 2024-09-12T01:43:19.390 INFO:tasks.workunit.client.0.smithi066.stdout:0/771: dwrite d1/d62/d89/da3/dc1/de2/f10b [0,4194304] 0 2024-09-12T01:43:19.390 INFO:tasks.workunit.client.0.smithi066.stdout:1/694: chown d5/d15/d4d 3 1 2024-09-12T01:43:19.392 INFO:tasks.workunit.client.0.smithi066.stdout:0/772: stat d1/d62/d9f/d4a/d67/d1b/c6d 0 2024-09-12T01:43:19.394 INFO:tasks.workunit.client.0.smithi066.stdout:7/719: dwrite d2/d5/da/d3f/da4/d6c/d80/f66 [0,4194304] 0 2024-09-12T01:43:19.394 INFO:tasks.workunit.client.0.smithi066.stdout:7/720: fdatasync d2/d5/da/d3f/d9b/f48 0 2024-09-12T01:43:19.394 INFO:tasks.workunit.client.0.smithi066.stdout:0/773: mknod d1/d62/d9f/d4a/d67/d1b/d26/c10c 0 2024-09-12T01:43:19.394 INFO:tasks.workunit.client.0.smithi066.stdout:1/695: rename d5/dc/d53/c4c to d5/d15/d4d/d86/ccd 0 2024-09-12T01:43:19.411 INFO:tasks.workunit.client.0.smithi066.stdout:7/721: unlink d2/d5/d6/d22/l29 0 2024-09-12T01:43:19.411 INFO:tasks.workunit.client.0.smithi066.stdout:7/722: chown d2/d3c 29 1 2024-09-12T01:43:19.413 INFO:tasks.workunit.client.0.smithi066.stdout:0/774: link d1/d62/d9f/d7c/f102 d1/d62/d9f/f10d 0 2024-09-12T01:43:19.413 INFO:tasks.workunit.client.0.smithi066.stdout:0/775: chown d1/d62/d9f/d4a/d67/d1b/d61/c104 39 1 2024-09-12T01:43:19.414 INFO:tasks.workunit.client.0.smithi066.stdout:0/776: read - d1/d62/d9f/d4a/d67/d6e/fc6 zero size 2024-09-12T01:43:19.414 INFO:tasks.workunit.client.0.smithi066.stdout:0/777: fsync d1/d62/d9f/d4a/d67/d6e/fc6 0 2024-09-12T01:43:19.417 INFO:tasks.workunit.client.0.smithi066.stdout:7/723: unlink d2/d5/da/c21 0 2024-09-12T01:43:19.419 INFO:tasks.workunit.client.0.smithi066.stdout:0/778: getdents d1/d62/d89/da3/dc1/de2 0 2024-09-12T01:43:19.419 INFO:tasks.workunit.client.0.smithi066.stdout:0/779: readlink d1/d62/d9f/d4a/d67/d1b/d26/l37 0 2024-09-12T01:43:19.419 INFO:tasks.workunit.client.0.smithi066.stdout:0/780: readlink d1/d62/lee 0 2024-09-12T01:43:19.422 INFO:tasks.workunit.client.0.smithi066.stdout:1/696: getdents d5/dc 0 2024-09-12T01:43:19.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/724: truncate d2/d5/d6/d40/d63/f86 2550427 0 2024-09-12T01:43:19.423 INFO:tasks.workunit.client.0.smithi066.stdout:7/725: fsync d2/d5/da/d3f/da4/d84/f87 0 2024-09-12T01:43:19.426 INFO:tasks.workunit.client.0.smithi066.stdout:0/781: rename d1/d62/d9f/d4a/d67/d1b/d61/dec/fff to d1/d62/d9f/d4a/d67/d20/f10e 0 2024-09-12T01:43:19.428 INFO:tasks.workunit.client.0.smithi066.stdout:1/697: creat d5/d15/d4d/d86/fce x:0 0 0 2024-09-12T01:43:19.428 INFO:tasks.workunit.client.0.smithi066.stdout:1/698: write d5/f47 [1869759,75859] 0 2024-09-12T01:43:19.431 INFO:tasks.workunit.client.0.smithi066.stdout:7/726: unlink d2/d5/da/d3f/d9b/fda 0 2024-09-12T01:43:19.433 INFO:tasks.workunit.client.0.smithi066.stdout:0/782: rename d1/d62/d9f/d4a/d67/d3e/lb0 to d1/d62/d9f/d4a/d67/d1b/d61/l10f 0 2024-09-12T01:43:19.433 INFO:tasks.workunit.client.0.smithi066.stdout:0/783: readlink d1/d72/de/l109 0 2024-09-12T01:43:19.435 INFO:tasks.workunit.client.0.smithi066.stdout:0/784: link d1/c48 d1/d62/d9f/d4a/d67/d20/da8/c110 0 2024-09-12T01:43:19.437 INFO:tasks.workunit.client.0.smithi066.stdout:1/699: dread d5/dc/d36/d4b/f2b [4194304,4194304] 0 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:0/785: unlink d1/d62/d9f/d7c/l93 0 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/708: sync 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/744: sync 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/745: getdents d4/de5 0 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/746: creat d4/d6/d27/d66/da1/ff7 x:0 0 0 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/747: dread - d4/d15/fd5 zero size 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:2/616: sync 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:5/699: sync 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:3/780: sync 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:5/700: chown d0/dd/d18/c1d 201 1 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:2/617: creat de/d13/d1e/d41/d58/fce x:0 0 0 2024-09-12T01:43:19.519 INFO:tasks.workunit.client.0.smithi066.stdout:8/730: sync 2024-09-12T01:43:19.520 INFO:tasks.workunit.client.0.smithi066.stdout:6/739: sync 2024-09-12T01:43:19.521 INFO:tasks.workunit.client.0.smithi066.stdout:0/786: mkdir d1/d62/d9f/d4a/d67/d20/dc9/d111 0 2024-09-12T01:43:19.521 INFO:tasks.workunit.client.0.smithi066.stdout:9/709: getdents d0/d6/d17/d1b/da2/dae/dc2 0 2024-09-12T01:43:19.521 INFO:tasks.workunit.client.0.smithi066.stdout:9/710: truncate d0/f7 2560454 0 2024-09-12T01:43:19.521 INFO:tasks.workunit.client.0.smithi066.stdout:9/711: chown d0/d6/d17/d1b/d4c/fc9 2 1 2024-09-12T01:43:19.586 INFO:tasks.workunit.client.0.smithi066.stdout:4/748: symlink d4/d15/dbd/lf8 0 2024-09-12T01:43:19.589 INFO:tasks.workunit.client.0.smithi066.stdout:1/700: dwrite d5/dc/d36/d57/f8a [0,4194304] 0 2024-09-12T01:43:19.590 INFO:tasks.workunit.client.0.smithi066.stdout:3/781: rename d5/d35/d103/d1b/d45/d66/dae/dd7/ffc to d5/d35/d103/d1b/d77/f115 0 2024-09-12T01:43:19.593 INFO:tasks.workunit.client.0.smithi066.stdout:5/701: creat d0/dd/d18/d36/dbf/dce/dd5/fdc x:0 0 0 2024-09-12T01:43:19.594 INFO:tasks.workunit.client.0.smithi066.stdout:8/731: mkdir d12/d21/d2f/df5 0 2024-09-12T01:43:19.594 INFO:tasks.workunit.client.0.smithi066.stdout:8/732: dread - d12/d21/d2f/d57/d43/d82/fbe zero size 2024-09-12T01:43:19.595 INFO:tasks.workunit.client.0.smithi066.stdout:0/787: write d1/d72/fd9 [849126,121252] 0 2024-09-12T01:43:19.598 INFO:tasks.workunit.client.0.smithi066.stdout:1/701: creat d5/dc/d53/dae/fcf x:0 0 0 2024-09-12T01:43:19.599 INFO:tasks.workunit.client.0.smithi066.stdout:1/702: truncate d5/d52/d5d/fc3 792242 0 2024-09-12T01:43:19.599 INFO:tasks.workunit.client.0.smithi066.stdout:1/703: chown d5/d15/c2f 20 1 2024-09-12T01:43:19.599 INFO:tasks.workunit.client.0.smithi066.stdout:2/618: rename de/d13/d1e/d22/db6 to de/d3c/d8f/dcf 0 2024-09-12T01:43:19.600 INFO:tasks.workunit.client.0.smithi066.stdout:3/782: getdents d5/d35/d103/d1b/d45/d66/d5c/d101 0 2024-09-12T01:43:19.603 INFO:tasks.workunit.client.0.smithi066.stdout:5/702: symlink d0/dd/d18/d36/dbf/dce/dd5/dd7/ldd 0 2024-09-12T01:43:19.605 INFO:tasks.workunit.client.0.smithi066.stdout:1/704: mknod d5/d15/d58/cd0 0 2024-09-12T01:43:19.608 INFO:tasks.workunit.client.0.smithi066.stdout:9/712: rename d0/d6/d17/d4f/d12/f1f to d0/d6/d17/d1b/da2/dae/dc2/fff 0 2024-09-12T01:43:19.608 INFO:tasks.workunit.client.0.smithi066.stdout:9/713: creat d0/d6/d17/d28/f100 x:0 0 0 2024-09-12T01:43:19.608 INFO:tasks.workunit.client.0.smithi066.stdout:9/714: write d0/d6/d17/d1b/d4c/f2b [3370039,80300] 0 2024-09-12T01:43:19.609 INFO:tasks.workunit.client.0.smithi066.stdout:2/619: creat de/d13/d5c/fd0 x:0 0 0 2024-09-12T01:43:19.609 INFO:tasks.workunit.client.0.smithi066.stdout:2/620: chown de/l97 1 1 2024-09-12T01:43:19.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/621: creat de/d3c/d8f/fd1 x:0 0 0 2024-09-12T01:43:19.610 INFO:tasks.workunit.client.0.smithi066.stdout:5/703: mkdir d0/dd/d18/d36/dbf/dce/d3b/d98/dde 0 2024-09-12T01:43:19.610 INFO:tasks.workunit.client.0.smithi066.stdout:1/705: creat d5/dc/d4f/dc6/fd1 x:0 0 0 2024-09-12T01:43:19.613 INFO:tasks.workunit.client.0.smithi066.stdout:8/733: dwrite d12/d21/f32 [4194304,4194304] 0 2024-09-12T01:43:19.614 INFO:tasks.workunit.client.0.smithi066.stdout:4/749: rename d4/f29 to d4/d6/d27/d2f/d72/ff9 0 2024-09-12T01:43:19.620 INFO:tasks.workunit.client.0.smithi066.stdout:9/715: unlink d0/d6/d7f/d90/fd8 0 2024-09-12T01:43:19.620 INFO:tasks.workunit.client.0.smithi066.stdout:9/716: truncate d0/d6/d17/d1b/de9/ff6 129175 0 2024-09-12T01:43:19.620 INFO:tasks.workunit.client.0.smithi066.stdout:9/717: truncate d0/fb6 1447711 0 2024-09-12T01:43:19.620 INFO:tasks.workunit.client.0.smithi066.stdout:9/718: truncate d0/d6/d43/fa4 2193724 0 2024-09-12T01:43:19.621 INFO:tasks.workunit.client.0.smithi066.stdout:0/788: dwrite d1/d72/fb7 [0,4194304] 0 2024-09-12T01:43:19.622 INFO:tasks.workunit.client.0.smithi066.stdout:0/789: write d1/d62/d89/f9b [320,41544] 0 2024-09-12T01:43:19.622 INFO:tasks.workunit.client.0.smithi066.stdout:2/622: creat de/d13/d1e/d22/fd2 x:0 0 0 2024-09-12T01:43:19.622 INFO:tasks.workunit.client.0.smithi066.stdout:5/704: symlink d0/d26/d2d/d33/d55/d73/d74/ldf 0 2024-09-12T01:43:19.625 INFO:tasks.workunit.client.0.smithi066.stdout:1/706: link d5/dc/d36/d4b/c6f d5/d15/d58/dbc/cd2 0 2024-09-12T01:43:19.625 INFO:tasks.workunit.client.0.smithi066.stdout:1/707: chown d5/d15/d58/da1 2957023 1 2024-09-12T01:43:19.627 INFO:tasks.workunit.client.0.smithi066.stdout:4/750: creat d4/d6/d8/d4a/ffa x:0 0 0 2024-09-12T01:43:19.630 INFO:tasks.workunit.client.0.smithi066.stdout:9/719: unlink d0/d6/d17/d28/d79/fdb 0 2024-09-12T01:43:19.630 INFO:tasks.workunit.client.0.smithi066.stdout:9/720: stat d0/d6/d17/d4f/d9/de/de7/dfe 0 2024-09-12T01:43:19.632 INFO:tasks.workunit.client.0.smithi066.stdout:0/790: mknod d1/d62/d9f/d4a/d67/dd0/c112 0 2024-09-12T01:43:19.634 INFO:tasks.workunit.client.0.smithi066.stdout:2/623: mknod de/d13/d1e/d41/d81/cd3 0 2024-09-12T01:43:19.635 INFO:tasks.workunit.client.0.smithi066.stdout:1/708: mkdir d5/d15/d4d/dd3 0 2024-09-12T01:43:19.635 INFO:tasks.workunit.client.0.smithi066.stdout:1/709: write d5/d52/f7e [542179,52648] 0 2024-09-12T01:43:19.636 INFO:tasks.workunit.client.0.smithi066.stdout:2/624: mkdir de/d13/d28/d3a/dd4 0 2024-09-12T01:43:19.636 INFO:tasks.workunit.client.0.smithi066.stdout:2/625: chown de/d13/d1e/d25/f99 11356 1 2024-09-12T01:43:19.642 INFO:tasks.workunit.client.0.smithi066.stdout:8/734: dwrite d12/d21/d2f/fc0 [0,4194304] 0 2024-09-12T01:43:19.645 INFO:tasks.workunit.client.0.smithi066.stdout:2/626: write de/d13/d28/d3d/f3f [1599338,86219] 0 2024-09-12T01:43:19.646 INFO:tasks.workunit.client.0.smithi066.stdout:2/627: dread - de/d13/d1e/d25/da2/fcc zero size 2024-09-12T01:43:19.646 INFO:tasks.workunit.client.0.smithi066.stdout:9/721: dread d0/f7 [0,4194304] 0 2024-09-12T01:43:19.648 INFO:tasks.workunit.client.0.smithi066.stdout:2/628: rename f1 to de/d13/d1e/d41/da8/fd5 0 2024-09-12T01:43:19.648 INFO:tasks.workunit.client.0.smithi066.stdout:2/629: creat de/d13/fd6 x:0 0 0 2024-09-12T01:43:19.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/630: write de/d13/d5c/f78 [740679,79674] 0 2024-09-12T01:43:19.649 INFO:tasks.workunit.client.0.smithi066.stdout:2/631: chown de/d13/d28/c40 63137 1 2024-09-12T01:43:19.655 INFO:tasks.workunit.client.0.smithi066.stdout:8/735: dread d12/d21/f32 [0,4194304] 0 2024-09-12T01:43:19.657 INFO:tasks.workunit.client.0.smithi066.stdout:8/736: mkdir d12/d21/d2f/d57/d43/df6 0 2024-09-12T01:43:19.657 INFO:tasks.workunit.client.0.smithi066.stdout:8/737: write d12/d21/d2f/d57/f2e [5192452,13208] 0 2024-09-12T01:43:19.658 INFO:tasks.workunit.client.0.smithi066.stdout:8/738: symlink d12/d21/d2f/d57/d84/d50/d56/db6/dee/dd8/lf7 0 2024-09-12T01:43:19.674 INFO:tasks.workunit.client.0.smithi066.stdout:0/791: dwrite d1/d62/d9f/d4a/d67/d1b/d26/d5b/fd8 [0,4194304] 0 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:8/739: dwrite d12/d21/d2f/d57/d43/f91 [0,4194304] 0 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:8/740: chown d12/c15 14370 1 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:2/632: read de/d13/d1e/d41/d58/f73 [366219,110687] 0 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/705: dwrite d0/dd/d18/d36/f5c [0,4194304] 0 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:4/751: dwrite d4/d6/d8/d18/fb7 [0,4194304] 0 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/706: write d0/d26/f35 [2483559,194] 0 2024-09-12T01:43:19.675 INFO:tasks.workunit.client.0.smithi066.stdout:5/707: stat d0/dd/d18/d36/dbf/dce/d30/d8b/cb8 0 2024-09-12T01:43:19.678 INFO:tasks.workunit.client.0.smithi066.stdout:8/741: mkdir d12/d21/d2f/d53/dde/df8 0 2024-09-12T01:43:19.681 INFO:tasks.workunit.client.0.smithi066.stdout:1/710: dwrite d5/d52/d5d/f90 [0,4194304] 0 2024-09-12T01:43:19.681 INFO:tasks.workunit.client.0.smithi066.stdout:9/722: dread d0/d6/d7f/d90/d9a/fba [0,4194304] 0 2024-09-12T01:43:19.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/633: link de/d13/d28/d3d/lc8 de/d13/d28/d3a/dd4/ld7 0 2024-09-12T01:43:19.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/634: stat de/d13/d28/d3a/f83 0 2024-09-12T01:43:19.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/635: readlink de/d13/d1e/d22/d4f/l7c 0 2024-09-12T01:43:19.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/636: write de/d13/d1e/d92/f9a [596360,105900] 0 2024-09-12T01:43:19.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/708: creat d0/dd/d18/d36/dbf/dce/da5/fe0 x:0 0 0 2024-09-12T01:43:19.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/709: chown d0/d26/d2d/d42/d95/cdb 885422 1 2024-09-12T01:43:19.684 INFO:tasks.workunit.client.0.smithi066.stdout:5/710: stat d0/dd/d18/d36/dbf/dce/da5/fe0 0 2024-09-12T01:43:19.684 INFO:tasks.workunit.client.0.smithi066.stdout:8/742: creat d12/d21/d2f/d53/dde/ff9 x:0 0 0 2024-09-12T01:43:19.688 INFO:tasks.workunit.client.0.smithi066.stdout:1/711: symlink d5/dc/d4f/dc6/ld4 0 2024-09-12T01:43:19.689 INFO:tasks.workunit.client.0.smithi066.stdout:2/637: symlink de/d13/d1e/d41/d58/ld8 0 2024-09-12T01:43:19.691 INFO:tasks.workunit.client.0.smithi066.stdout:4/752: dread d4/f37 [0,4194304] 0 2024-09-12T01:43:19.691 INFO:tasks.workunit.client.0.smithi066.stdout:4/753: readlink d4/d6/d8/d18/d45/lee 0 2024-09-12T01:43:19.691 INFO:tasks.workunit.client.0.smithi066.stdout:8/743: truncate d12/f19 6466137 0 2024-09-12T01:43:19.693 INFO:tasks.workunit.client.0.smithi066.stdout:4/754: mknod d4/d6/d8/cfb 0 2024-09-12T01:43:19.695 INFO:tasks.workunit.client.0.smithi066.stdout:8/744: rename d12/d21/d2f/d57/d84/d50/d56/db6/dee/dd8 to d12/d21/d2f/d53/dde/dfa 0 2024-09-12T01:43:19.695 INFO:tasks.workunit.client.0.smithi066.stdout:8/745: chown d12/l38 0 1 2024-09-12T01:43:19.696 INFO:tasks.workunit.client.0.smithi066.stdout:2/638: mknod de/d13/d1e/d25/d5e/cd9 0 2024-09-12T01:43:19.698 INFO:tasks.workunit.client.0.smithi066.stdout:4/755: symlink d4/d15/d33/d5e/lfc 0 2024-09-12T01:43:19.699 INFO:tasks.workunit.client.0.smithi066.stdout:2/639: truncate de/d13/d1e/d22/f54 3801485 0 2024-09-12T01:43:19.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/723: read d0/d6/d17/d1b/d4c/d4b/f94 [3456389,99659] 0 2024-09-12T01:43:19.704 INFO:tasks.workunit.client.0.smithi066.stdout:0/792: dwrite d1/ffe [0,4194304] 0 2024-09-12T01:43:19.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/724: readlink d0/d6/d43/lf4 0 2024-09-12T01:43:19.704 INFO:tasks.workunit.client.0.smithi066.stdout:9/725: read d0/d6/d17/d4f/d9/fa [2130419,994] 0 2024-09-12T01:43:19.705 INFO:tasks.workunit.client.0.smithi066.stdout:8/746: read d12/d21/d2f/d57/d43/f46 [2290013,69446] 0 2024-09-12T01:43:19.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/793: truncate d1/d62/d9f/d4a/d67/d1b/d61/f81 2825748 0 2024-09-12T01:43:19.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/794: readlink d1/d62/d9f/d4a/d67/d20/l32 0 2024-09-12T01:43:19.709 INFO:tasks.workunit.client.0.smithi066.stdout:0/795: chown d1/d62/d9f/d4a/d67/d6e/c78 130 1 2024-09-12T01:43:19.709 INFO:tasks.workunit.client.0.smithi066.stdout:4/756: dread d4/d15/f79 [0,4194304] 0 2024-09-12T01:43:19.710 INFO:tasks.workunit.client.0.smithi066.stdout:4/757: dread - d4/d5f/d9a/fc5 zero size 2024-09-12T01:43:19.711 INFO:tasks.workunit.client.0.smithi066.stdout:9/726: truncate d0/d6/d17/d28/f77 590265 0 2024-09-12T01:43:19.712 INFO:tasks.workunit.client.0.smithi066.stdout:2/640: rmdir de/d13/d1e/d41 39 2024-09-12T01:43:19.712 INFO:tasks.workunit.client.0.smithi066.stdout:2/641: write de/d13/d1e/d41/d58/f73 [3566769,102086] 0 2024-09-12T01:43:19.712 INFO:tasks.workunit.client.0.smithi066.stdout:2/642: fdatasync de/d13/d28/f2f 0 2024-09-12T01:43:19.713 INFO:tasks.workunit.client.0.smithi066.stdout:8/747: symlink d12/d21/d2f/lfb 0 2024-09-12T01:43:19.715 INFO:tasks.workunit.client.0.smithi066.stdout:4/758: link d4/d6/d8/c1d d4/d6/d8/cfd 0 2024-09-12T01:43:19.717 INFO:tasks.workunit.client.0.smithi066.stdout:9/727: creat d0/d6/d17/d1b/da2/dae/dc2/f101 x:0 0 0 2024-09-12T01:43:19.719 INFO:tasks.workunit.client.0.smithi066.stdout:2/643: creat de/d13/d1e/d22/d4f/fda x:0 0 0 2024-09-12T01:43:19.721 INFO:tasks.workunit.client.0.smithi066.stdout:5/711: dwrite d0/dd/d18/d36/dbf/dce/d3b/d98/f99 [4194304,4194304] 0 2024-09-12T01:43:19.721 INFO:tasks.workunit.client.0.smithi066.stdout:5/712: dread - d0/dd/d18/d36/dbf/dce/da5/fb1 zero size 2024-09-12T01:43:19.721 INFO:tasks.workunit.client.0.smithi066.stdout:5/713: creat d0/d26/fe1 x:0 0 0 2024-09-12T01:43:19.722 INFO:tasks.workunit.client.0.smithi066.stdout:4/759: rename d4/d6/d8/d4a/df0/cf2 to d4/d6/d27/d2f/cfe 0 2024-09-12T01:43:19.722 INFO:tasks.workunit.client.0.smithi066.stdout:4/760: truncate d4/d6/d27/d66/d6c/fd9 865794 0 2024-09-12T01:43:19.722 INFO:tasks.workunit.client.0.smithi066.stdout:4/761: creat d4/d6/d27/d66/d58/fff x:0 0 0 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:4/762: dread - d4/d6/d27/d66/fb8 zero size 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:4/763: truncate d4/d6/d27/d66/d6c/fb5 849779 0 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:4/764: dread - d4/d6/d8/d4a/ffa zero size 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:2/644: chown de/d13/d1e/d25/c62 2652961 1 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:2/645: truncate de/d13/d9c/fc5 79741 0 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:2/646: dread - de/d13/d28/f59 zero size 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:8/748: rmdir d12/d21/d2f/d57/d43/d82 39 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:8/749: chown d12/d21/d2f/d57/d84/d50/d56/d69/c77 382947 1 2024-09-12T01:43:19.723 INFO:tasks.workunit.client.0.smithi066.stdout:8/750: fsync d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 0 2024-09-12T01:43:19.724 INFO:tasks.workunit.client.0.smithi066.stdout:0/796: write d1/d62/f8e [2402232,63145] 0 2024-09-12T01:43:19.724 INFO:tasks.workunit.client.0.smithi066.stdout:0/797: truncate d1/d62/d9f/d4a/d67/d20/d5e/f8c 407821 0 2024-09-12T01:43:19.725 INFO:tasks.workunit.client.0.smithi066.stdout:1/712: dwrite d5/d15/d58/da1/fb2 [0,4194304] 0 2024-09-12T01:43:19.727 INFO:tasks.workunit.client.0.smithi066.stdout:5/714: link d0/l1 d0/dd/d18/d36/d4c/db6/le2 0 2024-09-12T01:43:19.730 INFO:tasks.workunit.client.0.smithi066.stdout:2/647: mkdir de/d3c/d8f/dcf/ddb 0 2024-09-12T01:43:19.731 INFO:tasks.workunit.client.0.smithi066.stdout:2/648: stat de/f1d 0 2024-09-12T01:43:19.731 INFO:tasks.workunit.client.0.smithi066.stdout:2/649: dread de/d13/f1f [4194304,4194304] 0 2024-09-12T01:43:19.732 INFO:tasks.workunit.client.0.smithi066.stdout:8/751: creat d12/d21/d2f/d57/d84/d50/d56/d69/d7d/ffc x:0 0 0 2024-09-12T01:43:19.738 INFO:tasks.workunit.client.0.smithi066.stdout:1/713: truncate d5/dc/f8f 2902992 0 2024-09-12T01:43:19.738 INFO:tasks.workunit.client.0.smithi066.stdout:9/728: dwrite d0/d6/d17/d4f/d12/f25 [4194304,4194304] 0 2024-09-12T01:43:19.745 INFO:tasks.workunit.client.0.smithi066.stdout:0/798: dwrite d1/d62/d9f/f5a [0,4194304] 0 2024-09-12T01:43:19.748 INFO:tasks.workunit.client.0.smithi066.stdout:8/752: dread d12/d21/d2f/d57/d84/d50/d56/f75 [0,4194304] 0 2024-09-12T01:43:19.761 INFO:tasks.workunit.client.0.smithi066.stdout:1/714: dwrite d5/d15/f6e [0,4194304] 0 2024-09-12T01:43:19.763 INFO:tasks.workunit.client.0.smithi066.stdout:5/715: rename d0/dd/d18/d8c to d0/d26/de3 0 2024-09-12T01:43:19.763 INFO:tasks.workunit.client.0.smithi066.stdout:5/716: write d0/dd/d18/d36/d4c/db6/fb9 [284735,16790] 0 2024-09-12T01:43:19.763 INFO:tasks.workunit.client.0.smithi066.stdout:5/717: fsync d0/dd/f9b 0 2024-09-12T01:43:19.767 INFO:tasks.workunit.client.0.smithi066.stdout:9/729: write d0/fb6 [1361679,44270] 0 2024-09-12T01:43:19.768 INFO:tasks.workunit.client.0.smithi066.stdout:8/753: unlink d12/d21/d2f/d57/d43/d82/dbb/fcb 0 2024-09-12T01:43:19.768 INFO:tasks.workunit.client.0.smithi066.stdout:8/754: chown d12/d21/d2f/d53/dde 35442 1 2024-09-12T01:43:19.769 INFO:tasks.workunit.client.0.smithi066.stdout:8/755: dread - d12/d21/d2f/d57/d84/d50/d56/db6/f8b zero size 2024-09-12T01:43:19.769 INFO:tasks.workunit.client.0.smithi066.stdout:8/756: fsync d12/d21/d2f/f62 0 2024-09-12T01:43:19.772 INFO:tasks.workunit.client.0.smithi066.stdout:1/715: stat d5/d15/d4d/d86/f99 0 2024-09-12T01:43:19.775 INFO:tasks.workunit.client.0.smithi066.stdout:2/650: rename de/d13/d1e/d41/d81/cc6 to de/d13/d9c/cdc 0 2024-09-12T01:43:19.775 INFO:tasks.workunit.client.0.smithi066.stdout:2/651: read de/d13/d1e/d22/f3b [482747,100866] 0 2024-09-12T01:43:19.778 INFO:tasks.workunit.client.0.smithi066.stdout:5/718: rmdir d0/dd/d18/d36/dbf/dce/d3b/d6b 39 2024-09-12T01:43:19.780 INFO:tasks.workunit.client.0.smithi066.stdout:9/730: creat d0/d6/d17/d1b/d4c/d4b/d86/de0/f102 x:0 0 0 2024-09-12T01:43:19.785 INFO:tasks.workunit.client.0.smithi066.stdout:5/719: mknod d0/d21/ce4 0 2024-09-12T01:43:19.786 INFO:tasks.workunit.client.0.smithi066.stdout:9/731: unlink d0/d6/d17/d1b/d4c/d4b/d7d/caf 0 2024-09-12T01:43:19.786 INFO:tasks.workunit.client.0.smithi066.stdout:9/732: readlink d0/d6/d43/lf4 0 2024-09-12T01:43:19.789 INFO:tasks.workunit.client.0.smithi066.stdout:9/733: rename d0/d6/d17/d1b/da2/dae/fe5 to d0/d6/d17/d1b/d4c/f103 0 2024-09-12T01:43:19.796 INFO:tasks.workunit.client.0.smithi066.stdout:1/716: dwrite d5/dc/d36/d4b/fb0 [0,4194304] 0 2024-09-12T01:43:19.796 INFO:tasks.workunit.client.0.smithi066.stdout:1/717: readlink d5/d52/lb9 0 2024-09-12T01:43:19.799 INFO:tasks.workunit.client.0.smithi066.stdout:1/718: mkdir d5/dc/d36/d57/dac/dd5 0 2024-09-12T01:43:19.803 INFO:tasks.workunit.client.0.smithi066.stdout:8/757: dwrite d12/d21/d2f/d57/d84/f7e [0,4194304] 0 2024-09-12T01:43:19.803 INFO:tasks.workunit.client.0.smithi066.stdout:9/734: write d0/d6/d17/d1b/d4c/f2a [161795,78514] 0 2024-09-12T01:43:19.803 INFO:tasks.workunit.client.0.smithi066.stdout:2/652: dwrite de/d13/d28/f2f [0,4194304] 0 2024-09-12T01:43:19.810 INFO:tasks.workunit.client.0.smithi066.stdout:9/735: mkdir d0/d6/d17/d1b/de9/df9/dfd/d104 0 2024-09-12T01:43:19.810 INFO:tasks.workunit.client.0.smithi066.stdout:1/719: dread d5/dc/f34 [0,4194304] 0 2024-09-12T01:43:19.810 INFO:tasks.workunit.client.0.smithi066.stdout:5/720: dwrite d0/d26/f34 [0,4194304] 0 2024-09-12T01:43:19.813 INFO:tasks.workunit.client.0.smithi066.stdout:2/653: truncate de/d13/d1e/f23 2786566 0 2024-09-12T01:43:19.818 INFO:tasks.workunit.client.0.smithi066.stdout:9/736: link d0/d6/d43/c4e d0/d6/d17/d4f/d12/d84/dd4/c105 0 2024-09-12T01:43:19.819 INFO:tasks.workunit.client.0.smithi066.stdout:1/720: unlink d5/dc/d53/l3d 0 2024-09-12T01:43:19.821 INFO:tasks.workunit.client.0.smithi066.stdout:5/721: mknod d0/dd/d18/ce5 0 2024-09-12T01:43:19.821 INFO:tasks.workunit.client.0.smithi066.stdout:2/654: symlink de/d13/d28/d3a/dd4/ldd 0 2024-09-12T01:43:19.822 INFO:tasks.workunit.client.0.smithi066.stdout:9/737: mknod d0/d6/d37/d85/c106 0 2024-09-12T01:43:19.823 INFO:tasks.workunit.client.0.smithi066.stdout:9/738: readlink d0/d6/d17/d1b/da2/lda 0 2024-09-12T01:43:19.826 INFO:tasks.workunit.client.0.smithi066.stdout:1/721: rename d5/dc/d4f/d8e/ccc to d5/d15/d58/dbc/cd6 0 2024-09-12T01:43:19.828 INFO:tasks.workunit.client.0.smithi066.stdout:9/739: truncate d0/d6/d43/fc1 5249123 0 2024-09-12T01:43:19.831 INFO:tasks.workunit.client.0.smithi066.stdout:2/655: rename de/d13/d28/d3d/lc3 to de/d13/d1e/d25/d5e/lde 0 2024-09-12T01:43:19.831 INFO:tasks.workunit.client.0.smithi066.stdout:9/740: creat d0/d6/d43/df7/f107 x:0 0 0 2024-09-12T01:43:19.836 INFO:tasks.workunit.client.0.smithi066.stdout:5/722: dwrite d0/dd/d18/d36/f79 [0,4194304] 0 2024-09-12T01:43:19.846 INFO:tasks.workunit.client.0.smithi066.stdout:5/723: dread d0/d26/f35 [0,4194304] 0 2024-09-12T01:43:19.846 INFO:tasks.workunit.client.0.smithi066.stdout:5/724: write d0/dd/d18/d36/dbf/dce/d3b/d6b/fb3 [735555,27021] 0 2024-09-12T01:43:19.864 INFO:tasks.workunit.client.0.smithi066.stdout:1/722: dwrite d5/dc/d53/d9b/da2/fa5 [0,4194304] 0 2024-09-12T01:43:19.865 INFO:tasks.workunit.client.0.smithi066.stdout:1/723: mknod d5/dc/d36/d57/dac/cd7 0 2024-09-12T01:43:19.867 INFO:tasks.workunit.client.0.smithi066.stdout:1/724: creat d5/d15/d4d/fd8 x:0 0 0 2024-09-12T01:43:19.867 INFO:tasks.workunit.client.0.smithi066.stdout:1/725: write d5/dc/f29 [801852,108736] 0 2024-09-12T01:43:19.867 INFO:tasks.workunit.client.0.smithi066.stdout:1/726: fdatasync d5/d52/d60/fbb 0 2024-09-12T01:43:19.868 INFO:tasks.workunit.client.0.smithi066.stdout:2/656: dwrite f5 [0,4194304] 0 2024-09-12T01:43:19.868 INFO:tasks.workunit.client.0.smithi066.stdout:2/657: fdatasync de/d13/f6a 0 2024-09-12T01:43:19.869 INFO:tasks.workunit.client.0.smithi066.stdout:9/741: dwrite d0/d6/d7f/d90/d9a/fba [0,4194304] 0 2024-09-12T01:43:19.869 INFO:tasks.workunit.client.0.smithi066.stdout:5/725: dwrite d0/d26/d2d/d33/d55/d82/d87/d8e/fbe [0,4194304] 0 2024-09-12T01:43:19.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/658: mkdir de/d13/d1e/ddf 0 2024-09-12T01:43:19.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/659: creat de/d3c/fe0 x:0 0 0 2024-09-12T01:43:19.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/660: fdatasync de/d13/d28/f8e 0 2024-09-12T01:43:19.870 INFO:tasks.workunit.client.0.smithi066.stdout:2/661: chown de/d13/d1e/c6f 18464 1 2024-09-12T01:43:19.874 INFO:tasks.workunit.client.0.smithi066.stdout:2/662: dread de/d13/d1e/d22/f3b [0,4194304] 0 2024-09-12T01:43:19.875 INFO:tasks.workunit.client.0.smithi066.stdout:5/726: rmdir d0 39 2024-09-12T01:43:19.875 INFO:tasks.workunit.client.0.smithi066.stdout:2/663: dread de/d13/d28/f56 [0,4194304] 0 2024-09-12T01:43:19.878 INFO:tasks.workunit.client.0.smithi066.stdout:5/727: stat d0/dd/d18/c1d 0 2024-09-12T01:43:19.878 INFO:tasks.workunit.client.0.smithi066.stdout:1/727: write d5/f7 [1453275,128303] 0 2024-09-12T01:43:19.878 INFO:tasks.workunit.client.0.smithi066.stdout:1/728: chown d5/f87 3 1 2024-09-12T01:43:19.885 INFO:tasks.workunit.client.0.smithi066.stdout:2/664: unlink de/f42 0 2024-09-12T01:43:19.885 INFO:tasks.workunit.client.0.smithi066.stdout:2/665: write de/d13/d28/f38 [2823940,125105] 0 2024-09-12T01:43:19.886 INFO:tasks.workunit.client.0.smithi066.stdout:1/729: creat d5/d15/d58/dbc/fd9 x:0 0 0 2024-09-12T01:43:19.888 INFO:tasks.workunit.client.0.smithi066.stdout:1/730: truncate d5/dc/f40 4282185 0 2024-09-12T01:43:19.890 INFO:tasks.workunit.client.0.smithi066.stdout:1/731: truncate d5/dc/d36/d4b/f31 963334 0 2024-09-12T01:43:19.890 INFO:tasks.workunit.client.0.smithi066.stdout:1/732: write d5/dc/f12 [1689739,50233] 0 2024-09-12T01:43:19.896 INFO:tasks.workunit.client.0.smithi066.stdout:5/728: dwrite d0/d26/f35 [0,4194304] 0 2024-09-12T01:43:19.896 INFO:tasks.workunit.client.0.smithi066.stdout:5/729: write d0/dd/f13 [3039372,16480] 0 2024-09-12T01:43:19.896 INFO:tasks.workunit.client.0.smithi066.stdout:5/730: chown d0/dd/d18/d36/dbf/dce/d3b/fa9 30894 1 2024-09-12T01:43:19.902 INFO:tasks.workunit.client.0.smithi066.stdout:2/666: dread de/d13/d28/f38 [0,4194304] 0 2024-09-12T01:43:19.909 INFO:tasks.workunit.client.0.smithi066.stdout:2/667: symlink de/d13/d28/d3a/dd4/le1 0 2024-09-12T01:43:19.915 INFO:tasks.workunit.client.0.smithi066.stdout:2/668: unlink de/f14 0 2024-09-12T01:43:19.919 INFO:tasks.workunit.client.0.smithi066.stdout:2/669: dread de/d13/d1e/d25/f99 [0,4194304] 0 2024-09-12T01:43:19.922 INFO:tasks.workunit.client.0.smithi066.stdout:5/731: dwrite d0/dd/d18/d36/dbf/dce/d3b/d6b/f8a [0,4194304] 0 2024-09-12T01:43:19.924 INFO:tasks.workunit.client.0.smithi066.stdout:5/732: rename d0/dd/d18/d36/dbf/dce/d3b/l47 to d0/le6 0 2024-09-12T01:43:19.924 INFO:tasks.workunit.client.0.smithi066.stdout:5/733: write d0/d26/d2d/d31/fa0 [725815,36489] 0 2024-09-12T01:43:19.925 INFO:tasks.workunit.client.0.smithi066.stdout:1/733: dwrite d5/dc/d36/d4b/f31 [0,4194304] 0 2024-09-12T01:43:19.925 INFO:tasks.workunit.client.0.smithi066.stdout:1/734: getdents d5/dc/d36/d57/dac/dd5 0 2024-09-12T01:43:19.927 INFO:tasks.workunit.client.0.smithi066.stdout:5/734: mkdir d0/d26/d2d/d33/de7 0 2024-09-12T01:43:19.927 INFO:tasks.workunit.client.0.smithi066.stdout:5/735: dread - d0/dd/d18/d36/dbf/dce/da5/fb1 zero size 2024-09-12T01:43:19.930 INFO:tasks.workunit.client.0.smithi066.stdout:1/735: unlink d5/d15/f56 0 2024-09-12T01:43:19.931 INFO:tasks.workunit.client.0.smithi066.stdout:2/670: write f5 [3476588,62879] 0 2024-09-12T01:43:19.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/736: rename d0/d26/cc8 to d0/dd/d18/d36/d4c/db6/ce8 0 2024-09-12T01:43:19.937 INFO:tasks.workunit.client.0.smithi066.stdout:5/737: rmdir d0/d26/d2d/d33/d55/d73 39 2024-09-12T01:43:19.938 INFO:tasks.workunit.client.0.smithi066.stdout:1/736: mknod d5/d15/d4d/cda 0 2024-09-12T01:43:19.939 INFO:tasks.workunit.client.0.smithi066.stdout:1/737: stat d5/d52/f8c 0 2024-09-12T01:43:19.939 INFO:tasks.workunit.client.0.smithi066.stdout:1/738: creat d5/d52/d5d/db6/fdb x:0 0 0 2024-09-12T01:43:19.940 INFO:tasks.workunit.client.0.smithi066.stdout:1/739: chown d5/d52/c63 504243 1 2024-09-12T01:43:19.940 INFO:tasks.workunit.client.0.smithi066.stdout:1/740: fsync d5/f7 0 2024-09-12T01:43:19.940 INFO:tasks.workunit.client.0.smithi066.stdout:1/741: chown d5/d15/l75 1505 1 2024-09-12T01:43:19.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/742: dread d5/dc/d36/d4b/f2b [4194304,4194304] 0 2024-09-12T01:43:19.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/743: chown d5/d52/f8c 2832 1 2024-09-12T01:43:19.953 INFO:tasks.workunit.client.0.smithi066.stdout:1/744: dread d5/dc/f40 [0,4194304] 0 2024-09-12T01:43:19.953 INFO:tasks.workunit.client.0.smithi066.stdout:1/745: stat d5/d15/f9d 0 2024-09-12T01:43:19.953 INFO:tasks.workunit.client.0.smithi066.stdout:1/746: creat d5/dc/d53/fdc x:0 0 0 2024-09-12T01:43:19.953 INFO:tasks.workunit.client.0.smithi066.stdout:2/671: dwrite de/d13/d1e/d41/d58/f60 [0,4194304] 0 2024-09-12T01:43:19.955 INFO:tasks.workunit.client.0.smithi066.stdout:1/747: rename d5/dc/d53/d9b/da2 to d5/dc/d36/ddd 0 2024-09-12T01:43:19.958 INFO:tasks.workunit.client.0.smithi066.stdout:2/672: creat de/fe2 x:0 0 0 2024-09-12T01:43:19.959 INFO:tasks.workunit.client.0.smithi066.stdout:1/748: rename d5/d15/d4d/l54 to d5/dc/lde 0 2024-09-12T01:43:19.965 INFO:tasks.workunit.client.0.smithi066.stdout:1/749: mknod d5/d15/d4d/cdf 0 2024-09-12T01:43:19.976 INFO:tasks.workunit.client.0.smithi066.stdout:2/673: dwrite de/d13/d5c/fd0 [0,4194304] 0 2024-09-12T01:43:19.980 INFO:tasks.workunit.client.0.smithi066.stdout:2/674: read de/f1c [2692171,98845] 0 2024-09-12T01:43:19.980 INFO:tasks.workunit.client.0.smithi066.stdout:2/675: readlink de/d13/d1e/d41/l75 0 2024-09-12T01:43:19.981 INFO:tasks.workunit.client.0.smithi066.stdout:2/676: creat de/d13/d28/d3a/fe3 x:0 0 0 2024-09-12T01:43:19.981 INFO:tasks.workunit.client.0.smithi066.stdout:2/677: write de/d13/f87 [808618,27275] 0 2024-09-12T01:43:19.982 INFO:tasks.workunit.client.0.smithi066.stdout:2/678: link de/d13/fd6 de/d13/d28/d3d/fe4 0 2024-09-12T01:43:19.984 INFO:tasks.workunit.client.0.smithi066.stdout:1/750: dwrite f4 [4194304,4194304] 0 2024-09-12T01:43:19.986 INFO:tasks.workunit.client.0.smithi066.stdout:1/751: read - d5/f9e zero size 2024-09-12T01:43:19.989 INFO:tasks.workunit.client.0.smithi066.stdout:1/752: mknod d5/dc/d36/ce0 0 2024-09-12T01:43:19.990 INFO:tasks.workunit.client.0.smithi066.stdout:2/679: dread de/d13/f9f [0,4194304] 0 2024-09-12T01:43:19.993 INFO:tasks.workunit.client.0.smithi066.stdout:2/680: mkdir de/d13/d1e/d22/de5 0 2024-09-12T01:43:19.995 INFO:tasks.workunit.client.0.smithi066.stdout:1/753: getdents d5/d15/d58/da1 0 2024-09-12T01:43:19.998 INFO:tasks.workunit.client.0.smithi066.stdout:2/681: unlink de/d3c/l64 0 2024-09-12T01:43:20.000 INFO:tasks.workunit.client.0.smithi066.stdout:1/754: creat d5/d15/d4d/d86/fe1 x:0 0 0 2024-09-12T01:43:20.009 INFO:tasks.workunit.client.0.smithi066.stdout:1/755: getdents d5/d52/d5d 0 2024-09-12T01:43:20.024 INFO:tasks.workunit.client.0.smithi066.stdout:1/756: dwrite d5/dc/f40 [0,4194304] 0 2024-09-12T01:43:20.037 INFO:tasks.workunit.client.0.smithi066.stdout:1/757: dread d5/d52/d5d/f90 [0,4194304] 0 2024-09-12T01:43:20.041 INFO:tasks.workunit.client.0.smithi066.stdout:1/758: dread d5/dc/d36/f96 [0,4194304] 0 2024-09-12T01:43:20.049 INFO:tasks.workunit.client.0.smithi066.stdout:1/759: rename d5/d15/d58 to d5/dc/d4f/d8e/de2 0 2024-09-12T01:43:20.049 INFO:tasks.workunit.client.0.smithi066.stdout:1/760: chown d5/dc/d36/d57/dac/dc4 54 1 2024-09-12T01:43:20.049 INFO:tasks.workunit.client.0.smithi066.stdout:1/761: read - d5/f9e zero size 2024-09-12T01:43:20.142 INFO:tasks.workunit.client.0.smithi066.stdout:7/727: sync 2024-09-12T01:43:20.142 INFO:tasks.workunit.client.0.smithi066.stdout:6/740: sync 2024-09-12T01:43:20.143 INFO:tasks.workunit.client.0.smithi066.stdout:8/758: sync 2024-09-12T01:43:20.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/765: sync 2024-09-12T01:43:20.143 INFO:tasks.workunit.client.0.smithi066.stdout:0/799: sync 2024-09-12T01:43:20.143 INFO:tasks.workunit.client.0.smithi066.stdout:3/783: sync 2024-09-12T01:43:20.143 INFO:tasks.workunit.client.0.smithi066.stdout:0/800: stat d1/d62/d9f/d4a/d67/d1b/d26/d5b 0 2024-09-12T01:43:20.143 INFO:tasks.workunit.client.0.smithi066.stdout:7/728: write d2/d5/d6/d40/fa5 [4882037,129107] 0 2024-09-12T01:43:20.149 INFO:tasks.workunit.client.0.smithi066.stdout:8/759: dread d12/d21/d2f/f34 [0,4194304] 0 2024-09-12T01:43:20.153 INFO:tasks.workunit.client.0.smithi066.stdout:7/729: dread d2/d5/da/d3f/d9b/f48 [0,4194304] 0 2024-09-12T01:43:20.153 INFO:tasks.workunit.client.0.smithi066.stdout:7/730: write d2/d5/d6/fe2 [1765192,76083] 0 2024-09-12T01:43:20.158 INFO:tasks.workunit.client.0.smithi066.stdout:6/741: creat d2/d99/d72/ffb x:0 0 0 2024-09-12T01:43:20.159 INFO:tasks.workunit.client.0.smithi066.stdout:3/784: creat d5/d35/d103/d1b/d45/d66/d5c/dee/f116 x:0 0 0 2024-09-12T01:43:20.160 INFO:tasks.workunit.client.0.smithi066.stdout:0/801: mkdir d1/d62/d9f/d4a/d67/d1b/d26/d113 0 2024-09-12T01:43:20.161 INFO:tasks.workunit.client.0.smithi066.stdout:4/766: dwrite d4/d6/d14/fa2 [0,4194304] 0 2024-09-12T01:43:20.161 INFO:tasks.workunit.client.0.smithi066.stdout:4/767: dread - d4/d6/fae zero size 2024-09-12T01:43:20.161 INFO:tasks.workunit.client.0.smithi066.stdout:4/768: fsync d4/d6/d8/f1a 0 2024-09-12T01:43:20.169 INFO:tasks.workunit.client.0.smithi066.stdout:7/731: dwrite d2/d5/da/d3f/d9b/d4d/fe0 [0,4194304] 0 2024-09-12T01:43:20.169 INFO:tasks.workunit.client.0.smithi066.stdout:7/732: fsync d2/d5/d6/d22/f59 0 2024-09-12T01:43:20.174 INFO:tasks.workunit.client.0.smithi066.stdout:7/733: dread d2/d5/d6/d22/feb [0,4194304] 0 2024-09-12T01:43:20.199 INFO:tasks.workunit.client.0.smithi066.stdout:8/760: link d12/d21/d2f/f63 d12/d21/d2f/d57/d84/d50/ffd 0 2024-09-12T01:43:20.201 INFO:tasks.workunit.client.0.smithi066.stdout:6/742: creat d2/d99/d72/d76/ffc x:0 0 0 2024-09-12T01:43:20.201 INFO:tasks.workunit.client.0.smithi066.stdout:6/743: write d2/d21/f34 [2692681,45376] 0 2024-09-12T01:43:20.202 INFO:tasks.workunit.client.0.smithi066.stdout:3/785: creat d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/f117 x:0 0 0 2024-09-12T01:43:20.206 INFO:tasks.workunit.client.0.smithi066.stdout:0/802: read d1/d72/f14 [117771,18998] 0 2024-09-12T01:43:20.206 INFO:tasks.workunit.client.0.smithi066.stdout:4/769: rmdir d4/d6/d62/db0/dd6 39 2024-09-12T01:43:20.207 INFO:tasks.workunit.client.0.smithi066.stdout:4/770: creat d4/d6/d14/f100 x:0 0 0 2024-09-12T01:43:20.210 INFO:tasks.workunit.client.0.smithi066.stdout:7/734: creat d2/d5/da/d3f/da4/d6c/d8e/da7/ff8 x:0 0 0 2024-09-12T01:43:20.227 INFO:tasks.workunit.client.0.smithi066.stdout:6/744: creat d2/d99/d7b/df8/d57/ffd x:0 0 0 2024-09-12T01:43:20.229 INFO:tasks.workunit.client.0.smithi066.stdout:3/786: creat d5/d35/d103/d1b/d45/d66/dae/ddc/f118 x:0 0 0 2024-09-12T01:43:20.231 INFO:tasks.workunit.client.0.smithi066.stdout:0/803: rmdir d1/d62/d9f/d4a/d67/d20/dc9/def 0 2024-09-12T01:43:20.231 INFO:tasks.workunit.client.0.smithi066.stdout:0/804: chown d1/d62/d9f/d7c/ff2 118940887 1 2024-09-12T01:43:20.231 INFO:tasks.workunit.client.0.smithi066.stdout:0/805: creat d1/d62/d9f/d4a/d67/d1b/d61/f114 x:0 0 0 2024-09-12T01:43:20.234 INFO:tasks.workunit.client.0.smithi066.stdout:4/771: mkdir d4/d5f/dea/d101 0 2024-09-12T01:43:20.235 INFO:tasks.workunit.client.0.smithi066.stdout:6/745: read d2/d99/d12/d1d/ff6 [3399356,101581] 0 2024-09-12T01:43:20.238 INFO:tasks.workunit.client.0.smithi066.stdout:7/735: link d2/d5/d6/d22/d75/d2f/cb1 d2/d5/d6/d22/d75/db6/cf9 0 2024-09-12T01:43:20.238 INFO:tasks.workunit.client.0.smithi066.stdout:7/736: write d2/d5/da/fbd [999653,66692] 0 2024-09-12T01:43:20.238 INFO:tasks.workunit.client.0.smithi066.stdout:7/737: chown d2/d5/d6/d40/d63/cc7 527 1 2024-09-12T01:43:20.238 INFO:tasks.workunit.client.0.smithi066.stdout:3/787: getdents d5/d35/d103/d1b 0 2024-09-12T01:43:20.242 INFO:tasks.workunit.client.0.smithi066.stdout:0/806: mknod d1/d62/d9f/d4a/d67/d1b/d26/c115 0 2024-09-12T01:43:20.244 INFO:tasks.workunit.client.0.smithi066.stdout:4/772: rename d4/f37 to d4/d84/dba/f102 0 2024-09-12T01:43:20.244 INFO:tasks.workunit.client.0.smithi066.stdout:4/773: readlink d4/d6/d8/d18/d45/lee 0 2024-09-12T01:43:20.244 INFO:tasks.workunit.client.0.smithi066.stdout:4/774: fsync d4/d6/d27/d66/da1/ff7 0 2024-09-12T01:43:20.245 INFO:tasks.workunit.client.0.smithi066.stdout:4/775: chown d4/d6/d27/d66/d6c/c9b 12 1 2024-09-12T01:43:20.245 INFO:tasks.workunit.client.0.smithi066.stdout:4/776: dread d4/d6/d27/d66/d6c/fb5 [0,4194304] 0 2024-09-12T01:43:20.245 INFO:tasks.workunit.client.0.smithi066.stdout:4/777: chown d4/d15/d33/d5e/dac 45581324 1 2024-09-12T01:43:20.246 INFO:tasks.workunit.client.0.smithi066.stdout:7/738: mknod d2/d5/da/d3f/da4/d6c/cfa 0 2024-09-12T01:43:20.248 INFO:tasks.workunit.client.0.smithi066.stdout:0/807: creat d1/d62/d9f/d4a/d67/d1b/d26/d108/f116 x:0 0 0 2024-09-12T01:43:20.249 INFO:tasks.workunit.client.0.smithi066.stdout:4/778: symlink d4/d6/d62/db0/dd6/dd8/l103 0 2024-09-12T01:43:20.251 INFO:tasks.workunit.client.0.smithi066.stdout:7/739: symlink d2/d5/d6/d22/d75/lfb 0 2024-09-12T01:43:20.252 INFO:tasks.workunit.client.0.smithi066.stdout:0/808: rename d1/ffe to d1/d62/d9f/f117 0 2024-09-12T01:43:20.252 INFO:tasks.workunit.client.0.smithi066.stdout:0/809: chown d1/d62/f94 179 1 2024-09-12T01:43:20.253 INFO:tasks.workunit.client.0.smithi066.stdout:0/810: chown d1/d72/fd9 25756 1 2024-09-12T01:43:20.254 INFO:tasks.workunit.client.0.smithi066.stdout:6/746: dwrite d2/d99/d72/fb5 [0,4194304] 0 2024-09-12T01:43:20.254 INFO:tasks.workunit.client.0.smithi066.stdout:6/747: read d2/d99/d12/d1d/d6b/dc6/dd9/fe4 [364112,23057] 0 2024-09-12T01:43:20.254 INFO:tasks.workunit.client.0.smithi066.stdout:6/748: chown d2/d99 925 1 2024-09-12T01:43:20.254 INFO:tasks.workunit.client.0.smithi066.stdout:6/749: write d2/d21/f51 [75644,45789] 0 2024-09-12T01:43:20.254 INFO:tasks.workunit.client.0.smithi066.stdout:7/740: symlink d2/d71/dad/lfc 0 2024-09-12T01:43:20.255 INFO:tasks.workunit.client.0.smithi066.stdout:4/779: dread d4/d6/d27/d66/da1/fad [0,4194304] 0 2024-09-12T01:43:20.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/750: symlink d2/d99/d12/d49/d9e/dc0/lfe 0 2024-09-12T01:43:20.259 INFO:tasks.workunit.client.0.smithi066.stdout:6/751: write d2/d99/d12/d1d/d6b/dc6/dd9/fdd [1018984,101566] 0 2024-09-12T01:43:20.260 INFO:tasks.workunit.client.0.smithi066.stdout:7/741: mkdir d2/d5/d6/d40/dfd 0 2024-09-12T01:43:20.261 INFO:tasks.workunit.client.0.smithi066.stdout:0/811: dread d1/d62/d9f/d4a/d67/d20/f30 [0,4194304] 0 2024-09-12T01:43:20.261 INFO:tasks.workunit.client.0.smithi066.stdout:0/812: readlink d1/d62/d9f/d4a/d67/d6e/lbb 0 2024-09-12T01:43:20.262 INFO:tasks.workunit.client.0.smithi066.stdout:6/752: unlink d2/d99/f73 0 2024-09-12T01:43:20.264 INFO:tasks.workunit.client.0.smithi066.stdout:6/753: truncate d2/d99/d12/d1d/fee 737697 0 2024-09-12T01:43:20.264 INFO:tasks.workunit.client.0.smithi066.stdout:6/754: fdatasync d2/d99/d7b/df8/f85 0 2024-09-12T01:43:20.264 INFO:tasks.workunit.client.0.smithi066.stdout:6/755: chown d2/f77 634739563 1 2024-09-12T01:43:20.297 INFO:tasks.workunit.client.0.smithi066.stdout:6/756: dwrite d2/d99/f82 [4194304,4194304] 0 2024-09-12T01:43:20.298 INFO:tasks.workunit.client.0.smithi066.stdout:0/813: dwrite d1/d72/de/f1d [0,4194304] 0 2024-09-12T01:43:20.299 INFO:tasks.workunit.client.0.smithi066.stdout:7/742: dwrite d2/d5/d6/d40/d63/db4/ff2 [0,4194304] 0 2024-09-12T01:43:20.299 INFO:tasks.workunit.client.0.smithi066.stdout:7/743: fsync d2/d5/d6/d22/d75/db6/dd8/fed 0 2024-09-12T01:43:20.299 INFO:tasks.workunit.client.0.smithi066.stdout:7/744: chown d2/d5/da/f11 1678 1 2024-09-12T01:43:20.299 INFO:tasks.workunit.client.0.smithi066.stdout:6/757: read d2/f45 [110070,122047] 0 2024-09-12T01:43:20.300 INFO:tasks.workunit.client.0.smithi066.stdout:7/745: write d2/d5/da/d3f/d9b/f49 [629187,77831] 0 2024-09-12T01:43:20.302 INFO:tasks.workunit.client.0.smithi066.stdout:6/758: getdents d2/d99/d7b/df8/d5e 0 2024-09-12T01:43:20.302 INFO:tasks.workunit.client.0.smithi066.stdout:6/759: readlink d2/d99/d7b/df8/d5e/l68 0 2024-09-12T01:43:20.304 INFO:tasks.workunit.client.0.smithi066.stdout:7/746: symlink d2/d5/da/d3f/da4/d6c/d8e/lfe 0 2024-09-12T01:43:20.304 INFO:tasks.workunit.client.0.smithi066.stdout:7/747: dread - d2/d5/d6/d81/dc8/d53/fd0 zero size 2024-09-12T01:43:20.304 INFO:tasks.workunit.client.0.smithi066.stdout:6/760: creat d2/d99/d12/d49/d9e/dc0/fff x:0 0 0 2024-09-12T01:43:20.305 INFO:tasks.workunit.client.0.smithi066.stdout:6/761: dread d2/f97 [0,4194304] 0 2024-09-12T01:43:20.309 INFO:tasks.workunit.client.0.smithi066.stdout:6/762: read d2/d99/d7b/df8/f85 [430542,31269] 0 2024-09-12T01:43:20.309 INFO:tasks.workunit.client.0.smithi066.stdout:6/763: read d2/d99/d12/d1d/f91 [3395426,108878] 0 2024-09-12T01:43:20.310 INFO:tasks.workunit.client.0.smithi066.stdout:6/764: symlink d2/d99/d12/d1d/d6b/dbc/l100 0 2024-09-12T01:43:20.311 INFO:tasks.workunit.client.0.smithi066.stdout:6/765: mknod d2/d99/d12/d1d/d6b/c101 0 2024-09-12T01:43:20.312 INFO:tasks.workunit.client.0.smithi066.stdout:6/766: creat d2/d99/d7b/ddb/f102 x:0 0 0 2024-09-12T01:43:20.313 INFO:tasks.workunit.client.0.smithi066.stdout:6/767: dread d2/d99/d12/d1d/d6b/fca [0,4194304] 0 2024-09-12T01:43:20.313 INFO:tasks.workunit.client.0.smithi066.stdout:6/768: fsync d2/d99/f82 0 2024-09-12T01:43:20.314 INFO:tasks.workunit.client.0.smithi066.stdout:6/769: read d2/d99/d12/d1d/d6b/dc6/dd9/fdd [6506,25747] 0 2024-09-12T01:43:20.314 INFO:tasks.workunit.client.0.smithi066.stdout:6/770: write d2/d99/d12/d1d/f91 [1616316,61253] 0 2024-09-12T01:43:20.317 INFO:tasks.workunit.client.0.smithi066.stdout:7/748: dwrite d2/d5/d6/d40/d51/f8b [0,4194304] 0 2024-09-12T01:43:20.317 INFO:tasks.workunit.client.0.smithi066.stdout:7/749: creat d2/d5/da/d3f/da4/d6c/d80/d7c/fff x:0 0 0 2024-09-12T01:43:20.320 INFO:tasks.workunit.client.0.smithi066.stdout:7/750: unlink d2/d5/d6/d81/dc8/d53/fd0 0 2024-09-12T01:43:20.320 INFO:tasks.workunit.client.0.smithi066.stdout:7/751: mkdir d2/d3c/d100 0 2024-09-12T01:43:20.320 INFO:tasks.workunit.client.0.smithi066.stdout:7/752: write d2/d5/d6/d22/d75/db6/dd8/fed [604368,82094] 0 2024-09-12T01:43:20.324 INFO:tasks.workunit.client.0.smithi066.stdout:6/771: write d2/f77 [4608094,97698] 0 2024-09-12T01:43:20.324 INFO:tasks.workunit.client.0.smithi066.stdout:6/772: creat d2/d99/d12/d49/d9e/dc0/f103 x:0 0 0 2024-09-12T01:43:20.326 INFO:tasks.workunit.client.0.smithi066.stdout:7/753: write d2/d5/da/f36 [186985,123404] 0 2024-09-12T01:43:20.349 INFO:tasks.workunit.client.0.smithi066.stdout:7/754: dwrite d2/d5/da/d3f/da4/d84/f87 [0,4194304] 0 2024-09-12T01:43:20.362 INFO:tasks.workunit.client.0.smithi066.stdout:7/755: write d2/d5/d6/d40/d51/f72 [27270,8215] 0 2024-09-12T01:43:20.363 INFO:tasks.workunit.client.0.smithi066.stdout:7/756: dread - d2/d5/da/d3f/da4/d70/f9f zero size 2024-09-12T01:43:20.363 INFO:tasks.workunit.client.0.smithi066.stdout:7/757: creat d2/d5/da/d3f/f101 x:0 0 0 2024-09-12T01:43:20.363 INFO:tasks.workunit.client.0.smithi066.stdout:7/758: chown d2/d5/da/d3f/da4/d6c/d80/d7c/ff1 18339605 1 2024-09-12T01:43:20.366 INFO:tasks.workunit.client.0.smithi066.stdout:7/759: link d2/d5/d6/d22/d75/db6/cf9 d2/d3c/c102 0 2024-09-12T01:43:20.370 INFO:tasks.workunit.client.0.smithi066.stdout:7/760: getdents d2/d5/da/d3f/d9b 0 2024-09-12T01:43:20.370 INFO:tasks.workunit.client.0.smithi066.stdout:7/761: stat d2/d3c/d100 0 2024-09-12T01:43:20.378 INFO:tasks.workunit.client.0.smithi066.stdout:7/762: write d2/d5/d6/d40/d63/f86 [2486907,80487] 0 2024-09-12T01:43:20.385 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:20 smithi153 ceph-mon[34713]: pgmap v9: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 220 MiB/s rd, 284 MiB/s wr, 410 op/s 2024-09-12T01:43:20.388 INFO:tasks.workunit.client.0.smithi066.stdout:7/763: write d2/d5/d6/d81/dc8/d53/f85 [1795895,107548] 0 2024-09-12T01:43:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:20 smithi066 ceph-mon[27875]: pgmap v9: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 220 MiB/s rd, 284 MiB/s wr, 410 op/s 2024-09-12T01:43:20.389 INFO:tasks.workunit.client.0.smithi066.stdout:7/764: read d2/d5/d6/d40/d51/f72 [5012023,50008] 0 2024-09-12T01:43:20.389 INFO:tasks.workunit.client.0.smithi066.stdout:7/765: chown d2/d5/d6/d40/d51/lb0 13 1 2024-09-12T01:43:20.391 INFO:tasks.workunit.client.0.smithi066.stdout:7/766: rmdir d2/d5/d6/d81 39 2024-09-12T01:43:20.401 INFO:tasks.workunit.client.0.smithi066.stdout:7/767: write d2/d5/da/f50 [2875257,32] 0 2024-09-12T01:43:20.403 INFO:tasks.workunit.client.0.smithi066.stdout:7/768: mkdir d2/d3c/d103 0 2024-09-12T01:43:20.406 INFO:tasks.workunit.client.0.smithi066.stdout:7/769: link d2/d5/d6/d22/d75/d2f/f34 d2/d71/d93/f104 0 2024-09-12T01:43:20.410 INFO:tasks.workunit.client.0.smithi066.stdout:7/770: creat d2/d5/da/d3f/da4/d6c/d8e/f105 x:0 0 0 2024-09-12T01:43:20.414 INFO:tasks.workunit.client.0.smithi066.stdout:7/771: creat d2/d5/d6/d81/dc8/f106 x:0 0 0 2024-09-12T01:43:20.433 INFO:tasks.workunit.client.0.smithi066.stdout:7/772: dwrite d2/d5/da/d3f/da4/d84/f5b [0,4194304] 0 2024-09-12T01:43:20.476 INFO:tasks.workunit.client.0.smithi066.stdout:9/742: sync 2024-09-12T01:43:20.477 INFO:tasks.workunit.client.0.smithi066.stdout:9/743: getdents d0/d6/d37 0 2024-09-12T01:43:20.481 INFO:tasks.workunit.client.0.smithi066.stdout:5/738: sync 2024-09-12T01:43:20.481 INFO:tasks.workunit.client.0.smithi066.stdout:5/739: stat d0/dd/d18/d36/dbf/dce/d3b/d6b/f8a 0 2024-09-12T01:43:20.482 INFO:tasks.workunit.client.0.smithi066.stdout:9/744: mknod d0/d6/d17/d1b/d4c/d4b/d7d/c108 0 2024-09-12T01:43:20.484 INFO:tasks.workunit.client.0.smithi066.stdout:5/740: truncate d0/dd/d18/d36/f79 490295 0 2024-09-12T01:43:20.486 INFO:tasks.workunit.client.0.smithi066.stdout:9/745: creat d0/d6/d17/d1b/d4c/d42/dab/f109 x:0 0 0 2024-09-12T01:43:20.492 INFO:tasks.workunit.client.0.smithi066.stdout:5/741: dread d0/d26/d2d/d33/f69 [0,4194304] 0 2024-09-12T01:43:20.496 INFO:tasks.workunit.client.0.smithi066.stdout:9/746: rmdir d0/d6/d17/d1b 39 2024-09-12T01:43:20.498 INFO:tasks.workunit.client.0.smithi066.stdout:5/742: unlink d0/f2 0 2024-09-12T01:43:20.498 INFO:tasks.workunit.client.0.smithi066.stdout:5/743: chown d0/d26/f86 1892 1 2024-09-12T01:43:20.498 INFO:tasks.workunit.client.0.smithi066.stdout:5/744: stat d0/dd/d18/d36/dbf/dce/dd5/fdc 0 2024-09-12T01:43:20.500 INFO:tasks.workunit.client.0.smithi066.stdout:5/745: dread d0/d26/d2d/d33/d55/d82/f28 [0,4194304] 0 2024-09-12T01:43:20.501 INFO:tasks.workunit.client.0.smithi066.stdout:5/746: rmdir d0/dd/d18/d36/dbf/dce/da4 39 2024-09-12T01:43:20.502 INFO:tasks.workunit.client.0.smithi066.stdout:5/747: creat d0/d26/de3/fe9 x:0 0 0 2024-09-12T01:43:20.503 INFO:tasks.workunit.client.0.smithi066.stdout:5/748: symlink d0/dd/d18/d36/dbf/dce/da5/lea 0 2024-09-12T01:43:20.505 INFO:tasks.workunit.client.0.smithi066.stdout:5/749: mkdir d0/dd/d18/d36/dbf/dce/d3b/d98/dde/deb 0 2024-09-12T01:43:20.527 INFO:tasks.workunit.client.0.smithi066.stdout:5/750: dwrite d0/dd/d18/d36/dbf/dce/d30/da8/fab [0,4194304] 0 2024-09-12T01:43:20.533 INFO:tasks.workunit.client.0.smithi066.stdout:5/751: mkdir d0/d26/d2d/d33/dec 0 2024-09-12T01:43:20.536 INFO:tasks.workunit.client.0.smithi066.stdout:5/752: mknod d0/d21/ced 0 2024-09-12T01:43:20.536 INFO:tasks.workunit.client.0.smithi066.stdout:5/753: creat d0/d26/de3/fee x:0 0 0 2024-09-12T01:43:20.545 INFO:tasks.workunit.client.0.smithi066.stdout:5/754: write d0/f4 [2904542,44256] 0 2024-09-12T01:43:20.545 INFO:tasks.workunit.client.0.smithi066.stdout:5/755: getdents d0/dd/d18/d36/dbf/dce/d30/da8/dc9 0 2024-09-12T01:43:20.548 INFO:tasks.workunit.client.0.smithi066.stdout:5/756: creat d0/dd/d18/d36/dbf/dce/d3b/d98/dde/fef x:0 0 0 2024-09-12T01:43:20.548 INFO:tasks.workunit.client.0.smithi066.stdout:5/757: truncate d0/d26/d2d/d33/d55/d73/f8f 897013 0 2024-09-12T01:43:20.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/758: mknod d0/d26/d2d/d33/de7/cf0 0 2024-09-12T01:43:20.568 INFO:tasks.workunit.client.0.smithi066.stdout:5/759: dwrite d0/dd/d18/d36/dbf/dce/dd5/fdc [0,4194304] 0 2024-09-12T01:43:20.568 INFO:tasks.workunit.client.0.smithi066.stdout:5/760: chown d0/d21/c50 1901 1 2024-09-12T01:43:20.572 INFO:tasks.workunit.client.0.smithi066.stdout:5/761: symlink d0/dd/d18/d36/dbf/dce/d30/da8/dc9/lf1 0 2024-09-12T01:43:20.572 INFO:tasks.workunit.client.0.smithi066.stdout:5/762: chown d0/dd/l57 437 1 2024-09-12T01:43:20.572 INFO:tasks.workunit.client.0.smithi066.stdout:5/763: readlink d0/d26/d2d/d31/d77/l78 0 2024-09-12T01:43:20.572 INFO:tasks.workunit.client.0.smithi066.stdout:5/764: fsync d0/d26/d2d/d33/d55/d84/fb5 0 2024-09-12T01:43:20.573 INFO:tasks.workunit.client.0.smithi066.stdout:5/765: creat d0/dd/d18/d36/dbf/dce/d30/d8b/ff2 x:0 0 0 2024-09-12T01:43:20.589 INFO:tasks.workunit.client.0.smithi066.stdout:5/766: dwrite d0/d26/de3/fe9 [0,4194304] 0 2024-09-12T01:43:20.605 INFO:tasks.workunit.client.0.smithi066.stdout:5/767: dwrite d0/dd/d18/fac [0,4194304] 0 2024-09-12T01:43:20.607 INFO:tasks.workunit.client.0.smithi066.stdout:5/768: rename d0/dd/l57 to d0/dd/d18/d36/dbf/dce/d30/lf3 0 2024-09-12T01:43:20.610 INFO:tasks.workunit.client.0.smithi066.stdout:5/769: mkdir d0/dd/d18/d36/dbf/dce/da4/df4 0 2024-09-12T01:43:20.610 INFO:tasks.workunit.client.0.smithi066.stdout:5/770: readlink d0/dd/d18/d36/dbf/dce/d30/l3c 0 2024-09-12T01:43:20.624 INFO:tasks.workunit.client.0.smithi066.stdout:5/771: dwrite d0/d26/d2d/d33/f4f [0,4194304] 0 2024-09-12T01:43:20.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/772: chown d0/dd/d18/d36/dbf/dce/d3b/d6b/fb3 70 1 2024-09-12T01:43:20.640 INFO:tasks.workunit.client.0.smithi066.stdout:5/773: dwrite d0/d26/de3/fee [0,4194304] 0 2024-09-12T01:43:20.640 INFO:tasks.workunit.client.0.smithi066.stdout:5/774: dread - d0/d26/d2d/d33/d55/d82/d87/fb4 zero size 2024-09-12T01:43:20.643 INFO:tasks.workunit.client.0.smithi066.stdout:5/775: mknod d0/dd/d18/d36/dbf/dce/da4/df4/cf5 0 2024-09-12T01:43:20.650 INFO:tasks.workunit.client.0.smithi066.stdout:5/776: read d0/d26/d2d/d42/f89 [3457315,95318] 0 2024-09-12T01:43:20.664 INFO:tasks.workunit.client.0.smithi066.stdout:5/777: dwrite d0/dd/d18/d36/dbf/dce/d30/da8/fab [4194304,4194304] 0 2024-09-12T01:43:20.664 INFO:tasks.workunit.client.0.smithi066.stdout:5/778: write d0/d26/d2d/d33/d55/d73/f9c [2078049,25699] 0 2024-09-12T01:43:20.672 INFO:tasks.workunit.client.0.smithi066.stdout:5/779: dread d0/d26/f34 [4194304,4194304] 0 2024-09-12T01:43:20.672 INFO:tasks.workunit.client.0.smithi066.stdout:5/780: stat d0/d21/ce4 0 2024-09-12T01:43:20.676 INFO:tasks.workunit.client.0.smithi066.stdout:5/781: rename d0/d26/d2d/d33/f69 to d0/d26/d2d/d33/d55/d82/d87/ff6 0 2024-09-12T01:43:20.681 INFO:tasks.workunit.client.0.smithi066.stdout:5/782: truncate d0/f17 72606 0 2024-09-12T01:43:20.691 INFO:tasks.workunit.client.0.smithi066.stdout:5/783: dread d0/d26/d2d/d33/d55/d73/d74/f93 [0,4194304] 0 2024-09-12T01:43:20.693 INFO:tasks.workunit.client.0.smithi066.stdout:5/784: unlink d0/dd/d18/d36/dbf/dce/d30/f65 0 2024-09-12T01:43:20.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/785: dread d0/dd/d18/d36/dbf/dce/d3b/d6b/fb3 [0,4194304] 0 2024-09-12T01:43:20.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/786: stat d0/dd/d18/d36/dbf/dce/d3b/c41 0 2024-09-12T01:43:20.695 INFO:tasks.workunit.client.0.smithi066.stdout:5/787: stat d0/d26/de3/fee 0 2024-09-12T01:43:20.696 INFO:tasks.workunit.client.0.smithi066.stdout:5/788: write d0/dd/d18/f3d [1649685,95810] 0 2024-09-12T01:43:20.696 INFO:tasks.workunit.client.0.smithi066.stdout:5/789: symlink d0/d26/d2d/d33/de7/lf7 0 2024-09-12T01:43:20.749 INFO:tasks.workunit.client.0.smithi066.stdout:1/762: sync 2024-09-12T01:43:20.749 INFO:tasks.workunit.client.0.smithi066.stdout:3/788: sync 2024-09-12T01:43:20.750 INFO:tasks.workunit.client.0.smithi066.stdout:8/761: sync 2024-09-12T01:43:20.750 INFO:tasks.workunit.client.0.smithi066.stdout:2/682: sync 2024-09-12T01:43:20.750 INFO:tasks.workunit.client.0.smithi066.stdout:8/762: dread d12/d21/d2f/d57/d84/d50/d56/f59 [0,4194304] 0 2024-09-12T01:43:20.788 INFO:tasks.workunit.client.0.smithi066.stdout:5/790: creat d0/dd/d18/d36/dbf/dce/d30/ff8 x:0 0 0 2024-09-12T01:43:20.793 INFO:tasks.workunit.client.0.smithi066.stdout:1/763: mkdir d5/dc/d4f/d8e/de3 0 2024-09-12T01:43:20.795 INFO:tasks.workunit.client.0.smithi066.stdout:2/683: creat de/d13/d1e/d41/da8/fe6 x:0 0 0 2024-09-12T01:43:20.801 INFO:tasks.workunit.client.0.smithi066.stdout:8/763: creat d12/d21/d2f/d57/d84/ffe x:0 0 0 2024-09-12T01:43:20.801 INFO:tasks.workunit.client.0.smithi066.stdout:8/764: dread - d12/d21/d2f/d57/d84/d50/d56/db6/f8b zero size 2024-09-12T01:43:20.801 INFO:tasks.workunit.client.0.smithi066.stdout:8/765: dread - d12/d21/d2f/f9a zero size 2024-09-12T01:43:20.802 INFO:tasks.workunit.client.0.smithi066.stdout:3/789: read d5/f56 [1988808,63361] 0 2024-09-12T01:43:20.807 INFO:tasks.workunit.client.0.smithi066.stdout:1/764: mknod d5/dc/d4f/d8e/de2/da1/ce4 0 2024-09-12T01:43:20.809 INFO:tasks.workunit.client.0.smithi066.stdout:5/791: dwrite d0/f20 [0,4194304] 0 2024-09-12T01:43:20.809 INFO:tasks.workunit.client.0.smithi066.stdout:5/792: write d0/d21/f44 [1211324,61345] 0 2024-09-12T01:43:20.813 INFO:tasks.workunit.client.0.smithi066.stdout:1/765: link d5/d52/c63 d5/dc/d4f/d8e/de2/ce5 0 2024-09-12T01:43:20.816 INFO:tasks.workunit.client.0.smithi066.stdout:3/790: dread d5/d35/d103/d1b/d45/d66/d5c/fe2 [0,4194304] 0 2024-09-12T01:43:20.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/684: dread de/d13/d1e/d25/f2b [0,4194304] 0 2024-09-12T01:43:20.818 INFO:tasks.workunit.client.0.smithi066.stdout:5/793: creat d0/d26/d2d/d33/da2/ff9 x:0 0 0 2024-09-12T01:43:20.822 INFO:tasks.workunit.client.0.smithi066.stdout:8/766: dwrite d12/d21/d2f/d57/d84/d50/d56/db6/faa [0,4194304] 0 2024-09-12T01:43:20.822 INFO:tasks.workunit.client.0.smithi066.stdout:3/791: dread d5/d35/d103/d1b/d45/d66/d67/d6d/f55 [0,4194304] 0 2024-09-12T01:43:20.822 INFO:tasks.workunit.client.0.smithi066.stdout:3/792: truncate d5/d35/d103/d1b/d45/d66/d5c/dee/f116 458529 0 2024-09-12T01:43:20.827 INFO:tasks.workunit.client.0.smithi066.stdout:3/793: creat d5/d35/d103/d1b/d45/f119 x:0 0 0 2024-09-12T01:43:20.827 INFO:tasks.workunit.client.0.smithi066.stdout:2/685: rmdir de/d13/d9c 39 2024-09-12T01:43:20.830 INFO:tasks.workunit.client.0.smithi066.stdout:3/794: getdents d5/d35/d103/d1b/d45/d66/d5c 0 2024-09-12T01:43:20.832 INFO:tasks.workunit.client.0.smithi066.stdout:3/795: mkdir d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/d11a 0 2024-09-12T01:43:20.832 INFO:tasks.workunit.client.0.smithi066.stdout:2/686: getdents de/d13/d1e/d84 0 2024-09-12T01:43:20.837 INFO:tasks.workunit.client.0.smithi066.stdout:3/796: symlink d5/l11b 0 2024-09-12T01:43:20.837 INFO:tasks.workunit.client.0.smithi066.stdout:3/797: chown d5/d35/d103/d1b/d77/dd5/le1 0 1 2024-09-12T01:43:20.837 INFO:tasks.workunit.client.0.smithi066.stdout:3/798: truncate d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/f117 532694 0 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:3/799: creat d5/d35/d103/d1b/d45/d66/d67/d7f/da8/df6/f11c x:0 0 0 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:3/800: read - d5/d35/d103/d1b/d45/f119 zero size 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:3/801: fdatasync d5/d35/d103/d1b/d45/d66/d67/d6d/fb0 0 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:8/767: write d12/d21/d2f/d57/d43/d82/fe6 [2682557,16704] 0 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:1/766: dwrite d5/dc/f9c [0,4194304] 0 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:1/767: readlink d5/dc/d53/l64 0 2024-09-12T01:43:20.839 INFO:tasks.workunit.client.0.smithi066.stdout:1/768: truncate d5/f9e 91554 0 2024-09-12T01:43:20.841 INFO:tasks.workunit.client.0.smithi066.stdout:5/794: write d0/d26/d2d/d42/f80 [3993087,94435] 0 2024-09-12T01:43:20.843 INFO:tasks.workunit.client.0.smithi066.stdout:8/768: symlink d12/d21/d2f/d57/d84/d50/d56/d69/lff 0 2024-09-12T01:43:20.843 INFO:tasks.workunit.client.0.smithi066.stdout:8/769: dread - d12/d21/d2f/d57/d3c/f78 zero size 2024-09-12T01:43:20.843 INFO:tasks.workunit.client.0.smithi066.stdout:8/770: readlink d12/d21/d2f/d57/d84/d50/d56/db6/l81 0 2024-09-12T01:43:20.844 INFO:tasks.workunit.client.0.smithi066.stdout:1/769: link d5/dc/d53/f94 d5/d52/fe6 0 2024-09-12T01:43:20.847 INFO:tasks.workunit.client.0.smithi066.stdout:5/795: symlink d0/dd/d18/d36/dbf/dce/d30/da8/dc9/lfa 0 2024-09-12T01:43:20.848 INFO:tasks.workunit.client.0.smithi066.stdout:8/771: truncate d12/d21/d2f/d57/d43/d66/d98/fc9 3290329 0 2024-09-12T01:43:20.850 INFO:tasks.workunit.client.0.smithi066.stdout:1/770: creat d5/d15/d4d/d86/dc7/fe7 x:0 0 0 2024-09-12T01:43:20.850 INFO:tasks.workunit.client.0.smithi066.stdout:1/771: write d5/d15/d4d/fd8 [301556,86210] 0 2024-09-12T01:43:20.854 INFO:tasks.workunit.client.0.smithi066.stdout:8/772: creat d12/d21/d2f/d53/dde/df8/f100 x:0 0 0 2024-09-12T01:43:20.854 INFO:tasks.workunit.client.0.smithi066.stdout:8/773: dread - d12/d21/d2f/d53/dde/ff9 zero size 2024-09-12T01:43:20.856 INFO:tasks.workunit.client.0.smithi066.stdout:2/687: dwrite de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:20.857 INFO:tasks.workunit.client.0.smithi066.stdout:8/774: truncate d12/d21/d2f/d57/d84/d50/d56/db6/dee/fa4 341412 0 2024-09-12T01:43:20.858 INFO:tasks.workunit.client.0.smithi066.stdout:5/796: dread d0/d26/f34 [4194304,4194304] 0 2024-09-12T01:43:20.859 INFO:tasks.workunit.client.0.smithi066.stdout:8/775: link d12/d21/d2f/d53/fc4 d12/d21/d2f/d57/d3c/f101 0 2024-09-12T01:43:20.861 INFO:tasks.workunit.client.0.smithi066.stdout:5/797: symlink d0/d26/d2d/d33/d55/lfb 0 2024-09-12T01:43:20.863 INFO:tasks.workunit.client.0.smithi066.stdout:1/772: dread f1 [4194304,4194304] 0 2024-09-12T01:43:20.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/798: dread d0/d26/d2d/d33/d55/d82/f72 [0,4194304] 0 2024-09-12T01:43:20.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/799: chown d0/d26/d2d/d33/db0/cc3 2 1 2024-09-12T01:43:20.864 INFO:tasks.workunit.client.0.smithi066.stdout:5/800: chown d0/l1 27 1 2024-09-12T01:43:20.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/688: dread de/d13/d1e/d22/f74 [0,4194304] 0 2024-09-12T01:43:20.869 INFO:tasks.workunit.client.0.smithi066.stdout:2/689: write de/d13/d9c/fc5 [1050585,109437] 0 2024-09-12T01:43:20.871 INFO:tasks.workunit.client.0.smithi066.stdout:2/690: symlink de/d13/d1e/d22/d4f/le7 0 2024-09-12T01:43:20.875 INFO:tasks.workunit.client.0.smithi066.stdout:1/773: rename d5/dc/d4f to d5/dc/d36/de8 0 2024-09-12T01:43:20.875 INFO:tasks.workunit.client.0.smithi066.stdout:5/801: write d0/d26/de3/fee [3901140,87943] 0 2024-09-12T01:43:20.875 INFO:tasks.workunit.client.0.smithi066.stdout:5/802: fsync d0/dd/f8d 0 2024-09-12T01:43:20.876 INFO:tasks.workunit.client.0.smithi066.stdout:2/691: mknod de/d13/d5c/ce8 0 2024-09-12T01:43:20.885 INFO:tasks.workunit.client.0.smithi066.stdout:5/803: symlink d0/d26/d2d/lfc 0 2024-09-12T01:43:20.885 INFO:tasks.workunit.client.0.smithi066.stdout:5/804: write d0/dd/d18/f3d [5369769,118852] 0 2024-09-12T01:43:20.886 INFO:tasks.workunit.client.0.smithi066.stdout:5/805: dread d0/dd/d18/d36/dbf/dce/d3b/fc4 [0,4194304] 0 2024-09-12T01:43:20.890 INFO:tasks.workunit.client.0.smithi066.stdout:5/806: getdents d0/dd/d18/d36/dbf/dce/d30 0 2024-09-12T01:43:20.901 INFO:tasks.workunit.client.0.smithi066.stdout:2/692: dwrite de/fa7 [0,4194304] 0 2024-09-12T01:43:20.903 INFO:tasks.workunit.client.0.smithi066.stdout:1/774: dwrite d5/f3b [0,4194304] 0 2024-09-12T01:43:20.904 INFO:tasks.workunit.client.0.smithi066.stdout:1/775: dread - d5/d52/d5d/db6/fdb zero size 2024-09-12T01:43:20.904 INFO:tasks.workunit.client.0.smithi066.stdout:5/807: write d0/d26/d2d/d42/f80 [8269367,116516] 0 2024-09-12T01:43:20.904 INFO:tasks.workunit.client.0.smithi066.stdout:2/693: chown de/l19 55 1 2024-09-12T01:43:20.904 INFO:tasks.workunit.client.0.smithi066.stdout:2/694: write de/d13/d28/f59 [593194,130796] 0 2024-09-12T01:43:20.904 INFO:tasks.workunit.client.0.smithi066.stdout:2/695: write de/d13/f80 [3462,80774] 0 2024-09-12T01:43:20.906 INFO:tasks.workunit.client.0.smithi066.stdout:5/808: mkdir d0/dd/d18/d36/dbf/dce/d30/da8/dfd 0 2024-09-12T01:43:20.909 INFO:tasks.workunit.client.0.smithi066.stdout:5/809: rename d0/d21/lc7 to d0/dd/d18/d36/dbf/dce/d30/da8/lfe 0 2024-09-12T01:43:20.911 INFO:tasks.workunit.client.0.smithi066.stdout:2/696: mknod de/d13/d1e/d25/ce9 0 2024-09-12T01:43:20.911 INFO:tasks.workunit.client.0.smithi066.stdout:2/697: write de/d13/d1e/d22/f3b [1480098,72994] 0 2024-09-12T01:43:20.912 INFO:tasks.workunit.client.0.smithi066.stdout:2/698: write de/d13/d28/d3d/f5f [41239,9588] 0 2024-09-12T01:43:20.912 INFO:tasks.workunit.client.0.smithi066.stdout:2/699: dread - de/d13/d28/d3a/f83 zero size 2024-09-12T01:43:20.914 INFO:tasks.workunit.client.0.smithi066.stdout:5/810: unlink d0/d26/d2d/d31/cd1 0 2024-09-12T01:43:20.922 INFO:tasks.workunit.client.0.smithi066.stdout:1/776: dwrite d5/d15/d4d/d86/f88 [4194304,4194304] 0 2024-09-12T01:43:20.926 INFO:tasks.workunit.client.0.smithi066.stdout:2/700: dread de/d13/d1e/d84/fab [0,4194304] 0 2024-09-12T01:43:20.927 INFO:tasks.workunit.client.0.smithi066.stdout:5/811: write d0/dd/d18/d36/f5c [460465,98972] 0 2024-09-12T01:43:20.930 INFO:tasks.workunit.client.0.smithi066.stdout:2/701: dread de/d13/d1e/fc7 [0,4194304] 0 2024-09-12T01:43:20.930 INFO:tasks.workunit.client.0.smithi066.stdout:2/702: dread - de/d13/d28/fcd zero size 2024-09-12T01:43:20.930 INFO:tasks.workunit.client.0.smithi066.stdout:5/812: creat d0/d26/d2d/d42/d95/dc0/fff x:0 0 0 2024-09-12T01:43:20.931 INFO:tasks.workunit.client.0.smithi066.stdout:2/703: rmdir de/d13/d9c 39 2024-09-12T01:43:20.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/813: mknod d0/d26/d2d/d33/d55/d73/d74/c100 0 2024-09-12T01:43:20.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/814: fsync d0/d26/d2d/d33/d55/d73/d74/f93 0 2024-09-12T01:43:20.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/815: chown d0/dd/d18/ce5 1520 1 2024-09-12T01:43:20.933 INFO:tasks.workunit.client.0.smithi066.stdout:5/816: getdents d0/dd/d18/d36/dbf/dce/d30/da8/dfd 0 2024-09-12T01:43:20.935 INFO:tasks.workunit.client.0.smithi066.stdout:2/704: rename de/d13/d1e/d22/d4f/l7c to de/d13/d1e/lea 0 2024-09-12T01:43:20.939 INFO:tasks.workunit.client.0.smithi066.stdout:1/777: dwrite d5/d15/d4d/d86/f99 [0,4194304] 0 2024-09-12T01:43:20.942 INFO:tasks.workunit.client.0.smithi066.stdout:2/705: dread de/d13/f87 [0,4194304] 0 2024-09-12T01:43:20.943 INFO:tasks.workunit.client.0.smithi066.stdout:5/817: dread d0/d26/f86 [0,4194304] 0 2024-09-12T01:43:20.947 INFO:tasks.workunit.client.0.smithi066.stdout:1/778: rename d5/d15/l37 to d5/dc/d36/de8/d8e/de2/le9 0 2024-09-12T01:43:20.958 INFO:tasks.workunit.client.0.smithi066.stdout:2/706: dwrite de/d13/d28/d3d/f3f [0,4194304] 0 2024-09-12T01:43:20.958 INFO:tasks.workunit.client.0.smithi066.stdout:2/707: stat de/d13/d1e/d22/f48 0 2024-09-12T01:43:20.958 INFO:tasks.workunit.client.0.smithi066.stdout:2/708: chown de/d13/d1e/c5a 16214418 1 2024-09-12T01:43:20.968 INFO:tasks.workunit.client.0.smithi066.stdout:5/818: creat d0/d26/d2d/d33/de7/f101 x:0 0 0 2024-09-12T01:43:20.973 INFO:tasks.workunit.client.0.smithi066.stdout:1/779: rmdir d5/dc/d36/d4b 39 2024-09-12T01:43:20.975 INFO:tasks.workunit.client.0.smithi066.stdout:2/709: mkdir de/d13/d1e/d25/deb 0 2024-09-12T01:43:20.976 INFO:tasks.workunit.client.0.smithi066.stdout:2/710: chown de/l19 1 1 2024-09-12T01:43:20.976 INFO:tasks.workunit.client.0.smithi066.stdout:2/711: chown de/d13/d1e/f36 531 1 2024-09-12T01:43:20.976 INFO:tasks.workunit.client.0.smithi066.stdout:2/712: dread - de/d13/d7f/fac zero size 2024-09-12T01:43:20.976 INFO:tasks.workunit.client.0.smithi066.stdout:1/780: fdatasync d5/f87 0 2024-09-12T01:43:20.976 INFO:tasks.workunit.client.0.smithi066.stdout:5/819: dread d0/d26/f34 [0,4194304] 0 2024-09-12T01:43:20.977 INFO:tasks.workunit.client.0.smithi066.stdout:1/781: mknod d5/dc/d36/ddd/cea 0 2024-09-12T01:43:20.978 INFO:tasks.workunit.client.0.smithi066.stdout:5/820: creat d0/dd/d18/d36/dbf/f102 x:0 0 0 2024-09-12T01:43:20.979 INFO:tasks.workunit.client.0.smithi066.stdout:4/780: sync 2024-09-12T01:43:20.980 INFO:tasks.workunit.client.0.smithi066.stdout:0/814: sync 2024-09-12T01:43:20.980 INFO:tasks.workunit.client.0.smithi066.stdout:4/781: readlink d4/d15/l20 0 2024-09-12T01:43:20.980 INFO:tasks.workunit.client.0.smithi066.stdout:0/815: chown d1/d62/d9f/d4a/d67/d6e/d105 238859 1 2024-09-12T01:43:20.980 INFO:tasks.workunit.client.0.smithi066.stdout:4/782: write d4/d6/d27/d66/da1/ff7 [263581,53590] 0 2024-09-12T01:43:20.980 INFO:tasks.workunit.client.0.smithi066.stdout:6/773: sync 2024-09-12T01:43:20.983 INFO:tasks.workunit.client.0.smithi066.stdout:4/783: read d4/d6/d27/d66/d58/f78 [260048,101989] 0 2024-09-12T01:43:20.983 INFO:tasks.workunit.client.0.smithi066.stdout:4/784: readlink d4/d6/d48/lc8 0 2024-09-12T01:43:20.983 INFO:tasks.workunit.client.0.smithi066.stdout:4/785: creat d4/d5f/d9a/f104 x:0 0 0 2024-09-12T01:43:20.989 INFO:tasks.workunit.client.0.smithi066.stdout:1/782: dread d5/dc/d36/de8/d8e/de2/da1/fb2 [0,4194304] 0 2024-09-12T01:43:20.996 INFO:tasks.workunit.client.0.smithi066.stdout:1/783: write d5/d15/d4d/d86/f88 [6985919,44417] 0 2024-09-12T01:43:20.997 INFO:tasks.workunit.client.0.smithi066.stdout:0/816: write d1/d72/fb7 [1705286,36982] 0 2024-09-12T01:43:20.998 INFO:tasks.workunit.client.0.smithi066.stdout:0/817: chown d1/d62/d89/da3/dc1/de2/f10b 3792424 1 2024-09-12T01:43:20.998 INFO:tasks.workunit.client.0.smithi066.stdout:1/784: mknod d5/d52/ceb 0 2024-09-12T01:43:21.000 INFO:tasks.workunit.client.0.smithi066.stdout:0/818: mkdir d1/d62/d9f/d4a/d67/d20/dc9/d118 0 2024-09-12T01:43:21.003 INFO:tasks.workunit.client.0.smithi066.stdout:0/819: symlink d1/d62/d9f/d4a/d67/d20/da8/l119 0 2024-09-12T01:43:21.003 INFO:tasks.workunit.client.0.smithi066.stdout:0/820: dread - d1/d62/d9f/d4a/d67/d3e/fb8 zero size 2024-09-12T01:43:21.004 INFO:tasks.workunit.client.0.smithi066.stdout:0/821: symlink d1/d62/d9f/d4a/d67/d20/d5e/l11a 0 2024-09-12T01:43:21.007 INFO:tasks.workunit.client.0.smithi066.stdout:0/822: rename d1/d62/d9f/d4a/d67/d1b/d3b/lfa to d1/d62/d9f/d4a/d67/d1b/d26/d5b/l11b 0 2024-09-12T01:43:21.009 INFO:tasks.workunit.client.0.smithi066.stdout:0/823: mknod d1/d62/d9f/d4a/d67/d1b/d26/d113/c11c 0 2024-09-12T01:43:21.012 INFO:tasks.workunit.client.0.smithi066.stdout:0/824: mkdir d1/d62/d9f/d4a/d67/d11d 0 2024-09-12T01:43:21.013 INFO:tasks.workunit.client.0.smithi066.stdout:0/825: rename d1/d72/de/c51 to d1/d62/d9f/d4a/d67/d3e/c11e 0 2024-09-12T01:43:21.013 INFO:tasks.workunit.client.0.smithi066.stdout:0/826: write d1/d62/d9f/d7c/ff2 [760051,76489] 0 2024-09-12T01:43:21.014 INFO:tasks.workunit.client.0.smithi066.stdout:0/827: symlink d1/d62/d9f/d4a/d67/d6e/d105/l11f 0 2024-09-12T01:43:21.020 INFO:tasks.workunit.client.0.smithi066.stdout:6/774: dwrite d2/d99/d7b/fbd [0,4194304] 0 2024-09-12T01:43:21.020 INFO:tasks.workunit.client.0.smithi066.stdout:5/821: dwrite d0/d26/f86 [0,4194304] 0 2024-09-12T01:43:21.020 INFO:tasks.workunit.client.0.smithi066.stdout:1/785: dwrite d5/dc/d53/f45 [0,4194304] 0 2024-09-12T01:43:21.020 INFO:tasks.workunit.client.0.smithi066.stdout:5/822: dread - d0/dd/f9b zero size 2024-09-12T01:43:21.020 INFO:tasks.workunit.client.0.smithi066.stdout:6/775: chown d2/d99/d12/d49/f55 0 1 2024-09-12T01:43:21.020 INFO:tasks.workunit.client.0.smithi066.stdout:6/776: read - d2/d99/d72/d76/ffc zero size 2024-09-12T01:43:21.022 INFO:tasks.workunit.client.0.smithi066.stdout:1/786: getdents d5/dc/d36/d57/dac 0 2024-09-12T01:43:21.023 INFO:tasks.workunit.client.0.smithi066.stdout:0/828: dread d1/d62/d9f/d7c/f9e [0,4194304] 0 2024-09-12T01:43:21.023 INFO:tasks.workunit.client.0.smithi066.stdout:4/786: dwrite d4/d6/d27/d2f/f54 [0,4194304] 0 2024-09-12T01:43:21.023 INFO:tasks.workunit.client.0.smithi066.stdout:4/787: fsync d4/d6/d48/d88/f6b 0 2024-09-12T01:43:21.023 INFO:tasks.workunit.client.0.smithi066.stdout:4/788: chown d4/d6/fae 61879377 1 2024-09-12T01:43:21.023 INFO:tasks.workunit.client.0.smithi066.stdout:0/829: write d1/d62/d9f/d4a/d67/d6e/fc6 [234486,79000] 0 2024-09-12T01:43:21.023 INFO:tasks.workunit.client.0.smithi066.stdout:5/823: link d0/d26/d2d/d33/d55/d73/d74/c100 d0/c103 0 2024-09-12T01:43:21.024 INFO:tasks.workunit.client.0.smithi066.stdout:6/777: mknod d2/d99/d72/c104 0 2024-09-12T01:43:21.024 INFO:tasks.workunit.client.0.smithi066.stdout:6/778: write d2/d99/d12/d1d/d6b/dc6/dd9/fdd [1514254,94860] 0 2024-09-12T01:43:21.025 INFO:tasks.workunit.client.0.smithi066.stdout:1/787: unlink d5/dc/f40 0 2024-09-12T01:43:21.025 INFO:tasks.workunit.client.0.smithi066.stdout:1/788: write d5/dc/d36/de8/d8e/de2/dbc/fd9 [99514,23916] 0 2024-09-12T01:43:21.025 INFO:tasks.workunit.client.0.smithi066.stdout:1/789: chown d5/dc/d36/de8 29456 1 2024-09-12T01:43:21.026 INFO:tasks.workunit.client.0.smithi066.stdout:1/790: dread d5/d52/d5d/fc3 [0,4194304] 0 2024-09-12T01:43:21.029 INFO:tasks.workunit.client.0.smithi066.stdout:4/789: truncate d4/d6/d48/d88/f6b 674280 0 2024-09-12T01:43:21.030 INFO:tasks.workunit.client.0.smithi066.stdout:4/790: readlink d4/l1b 0 2024-09-12T01:43:21.030 INFO:tasks.workunit.client.0.smithi066.stdout:6/779: rmdir d2/d21/d92 39 2024-09-12T01:43:21.030 INFO:tasks.workunit.client.0.smithi066.stdout:1/791: mknod d5/dc/d36/ddd/cec 0 2024-09-12T01:43:21.031 INFO:tasks.workunit.client.0.smithi066.stdout:1/792: stat d5/dc/d36/de8/d8e/de2 0 2024-09-12T01:43:21.033 INFO:tasks.workunit.client.0.smithi066.stdout:6/780: truncate d2/d99/d12/d1d/f96 737319 0 2024-09-12T01:43:21.033 INFO:tasks.workunit.client.0.smithi066.stdout:1/793: mknod d5/dc/d36/d4b/ced 0 2024-09-12T01:43:21.034 INFO:tasks.workunit.client.0.smithi066.stdout:6/781: dread d2/f97 [0,4194304] 0 2024-09-12T01:43:21.037 INFO:tasks.workunit.client.0.smithi066.stdout:1/794: link d5/l2e d5/dc/d36/d4b/lee 0 2024-09-12T01:43:21.038 INFO:tasks.workunit.client.0.smithi066.stdout:4/791: dread d4/d6/d27/f98 [0,4194304] 0 2024-09-12T01:43:21.040 INFO:tasks.workunit.client.0.smithi066.stdout:6/782: rename d2/d99/d7b/df8/f93 to d2/d99/f105 0 2024-09-12T01:43:21.041 INFO:tasks.workunit.client.0.smithi066.stdout:4/792: mkdir d4/d5f/d105 0 2024-09-12T01:43:21.044 INFO:tasks.workunit.client.0.smithi066.stdout:4/793: mknod d4/d15/d33/ddf/c106 0 2024-09-12T01:43:21.045 INFO:tasks.workunit.client.0.smithi066.stdout:1/795: dread d5/dc/d53/f5a [0,4194304] 0 2024-09-12T01:43:21.045 INFO:tasks.workunit.client.0.smithi066.stdout:6/783: getdents d2/d99/d12/d1d 0 2024-09-12T01:43:21.048 INFO:tasks.workunit.client.0.smithi066.stdout:4/794: unlink d4/d6/d8/d18/d45/f57 0 2024-09-12T01:43:21.048 INFO:tasks.workunit.client.0.smithi066.stdout:5/824: dwrite d0/d26/d2d/f90 [0,4194304] 0 2024-09-12T01:43:21.049 INFO:tasks.workunit.client.0.smithi066.stdout:6/784: unlink d2/f38 0 2024-09-12T01:43:21.049 INFO:tasks.workunit.client.0.smithi066.stdout:5/825: dread d0/d26/d2d/d33/d55/d82/f28 [0,4194304] 0 2024-09-12T01:43:21.050 INFO:tasks.workunit.client.0.smithi066.stdout:0/830: dwrite d1/d62/d9f/fea [0,4194304] 0 2024-09-12T01:43:21.050 INFO:tasks.workunit.client.0.smithi066.stdout:0/831: stat d1/d72/de/f3c 0 2024-09-12T01:43:21.050 INFO:tasks.workunit.client.0.smithi066.stdout:0/832: chown d1/d62/d9f/d4a/d67/d3e 967 1 2024-09-12T01:43:21.053 INFO:tasks.workunit.client.0.smithi066.stdout:4/795: link d4/d6/l53 d4/d6/d27/d66/da1/l107 0 2024-09-12T01:43:21.055 INFO:tasks.workunit.client.0.smithi066.stdout:6/785: symlink d2/d99/l106 0 2024-09-12T01:43:21.058 INFO:tasks.workunit.client.0.smithi066.stdout:0/833: dread d1/d62/d9f/d64/f8f [0,4194304] 0 2024-09-12T01:43:21.061 INFO:tasks.workunit.client.0.smithi066.stdout:0/834: dread d1/d62/d9f/d4a/d67/d6e/d80/fa6 [0,4194304] 0 2024-09-12T01:43:21.063 INFO:tasks.workunit.client.0.smithi066.stdout:1/796: getdents d5/dc 0 2024-09-12T01:43:21.084 INFO:tasks.workunit.client.0.smithi066.stdout:4/796: symlink d4/d6/d27/d66/d6c/d75/l108 0 2024-09-12T01:43:21.090 INFO:tasks.workunit.client.0.smithi066.stdout:5/826: dwrite d0/f17 [0,4194304] 0 2024-09-12T01:43:21.090 INFO:tasks.workunit.client.0.smithi066.stdout:5/827: creat d0/d26/d2d/d33/da2/f104 x:0 0 0 2024-09-12T01:43:21.090 INFO:tasks.workunit.client.0.smithi066.stdout:0/835: mkdir d1/d62/d9f/d120 0 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:1/797: link d5/d15/d4d/cdf d5/d52/d5d/db6/cef 0 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:1/798: chown d5/dc/d53/dae/lb1 96191824 1 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:1/799: chown d5/dc/d36/f9a 6794 1 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:8/776: sync 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:7/773: sync 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:9/747: sync 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:9/748: write d0/d6/d17/d28/f6f [373209,57618] 0 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:3/802: sync 2024-09-12T01:43:21.092 INFO:tasks.workunit.client.0.smithi066.stdout:3/803: truncate d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/faa 828687 0 2024-09-12T01:43:21.093 INFO:tasks.workunit.client.0.smithi066.stdout:6/786: getdents d2 0 2024-09-12T01:43:21.097 INFO:tasks.workunit.client.0.smithi066.stdout:5/828: link d0/d21/ced d0/d21/c105 0 2024-09-12T01:43:21.098 INFO:tasks.workunit.client.0.smithi066.stdout:0/836: symlink d1/d62/d9f/de6/l121 0 2024-09-12T01:43:21.098 INFO:tasks.workunit.client.0.smithi066.stdout:0/837: fsync d1/d62/d9f/d4a/d67/d3e/f75 0 2024-09-12T01:43:21.098 INFO:tasks.workunit.client.0.smithi066.stdout:1/800: mkdir d5/d52/d5d/df0 0 2024-09-12T01:43:21.100 INFO:tasks.workunit.client.0.smithi066.stdout:8/777: creat d12/d21/d2f/d57/d43/f102 x:0 0 0 2024-09-12T01:43:21.100 INFO:tasks.workunit.client.0.smithi066.stdout:8/778: readlink d12/d21/d2f/d57/d84/d50/d56/d69/lff 0 2024-09-12T01:43:21.100 INFO:tasks.workunit.client.0.smithi066.stdout:8/779: dread - d12/d21/d2f/d57/d3c/f7b zero size 2024-09-12T01:43:21.103 INFO:tasks.workunit.client.0.smithi066.stdout:9/749: link d0/d6/d17/d4f/d12/fb1 d0/d6/d37/f10a 0 2024-09-12T01:43:21.103 INFO:tasks.workunit.client.0.smithi066.stdout:3/804: rmdir d5/d35/d103/d48 39 2024-09-12T01:43:21.107 INFO:tasks.workunit.client.0.smithi066.stdout:5/829: symlink d0/dd/d18/l106 0 2024-09-12T01:43:21.108 INFO:tasks.workunit.client.0.smithi066.stdout:0/838: mknod d1/d62/d9f/d7c/c122 0 2024-09-12T01:43:21.108 INFO:tasks.workunit.client.0.smithi066.stdout:0/839: stat d1/d62/d9f/d4a/d67/d1b/d26/d5b/l8a 0 2024-09-12T01:43:21.110 INFO:tasks.workunit.client.0.smithi066.stdout:7/774: read d2/d5/da/d3f/da4/d84/f5b [2173945,11522] 0 2024-09-12T01:43:21.110 INFO:tasks.workunit.client.0.smithi066.stdout:7/775: fdatasync d2/d5/da/d3f/d9b/d4d/fe4 0 2024-09-12T01:43:21.110 INFO:tasks.workunit.client.0.smithi066.stdout:7/776: write d2/d5/d6/d22/d75/d2f/f34 [4171990,109841] 0 2024-09-12T01:43:21.110 INFO:tasks.workunit.client.0.smithi066.stdout:4/797: dwrite d4/d15/f38 [0,4194304] 0 2024-09-12T01:43:21.113 INFO:tasks.workunit.client.0.smithi066.stdout:1/801: rename d5/d52/fe6 to d5/dc/d36/de8/d8e/de2/ff1 0 2024-09-12T01:43:21.113 INFO:tasks.workunit.client.0.smithi066.stdout:5/830: unlink d0/d26/d2d/d42/f80 0 2024-09-12T01:43:21.114 INFO:tasks.workunit.client.0.smithi066.stdout:0/840: creat d1/d62/d6c/dad/f123 x:0 0 0 2024-09-12T01:43:21.116 INFO:tasks.workunit.client.0.smithi066.stdout:1/802: truncate d5/dc/f8f 1660258 0 2024-09-12T01:43:21.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/798: dread d4/d15/d33/f90 [0,4194304] 0 2024-09-12T01:43:21.121 INFO:tasks.workunit.client.0.smithi066.stdout:7/777: rename d2/d5/da/d3f/da4/d6c/d80/d5f/fc4 to d2/d5/d6/d40/d63/f107 0 2024-09-12T01:43:21.121 INFO:tasks.workunit.client.0.smithi066.stdout:7/778: write d2/d5/d6/d40/d63/f107 [554878,11435] 0 2024-09-12T01:43:21.122 INFO:tasks.workunit.client.0.smithi066.stdout:0/841: rmdir d1/d62/d89/d83/d8b/df8 0 2024-09-12T01:43:21.123 INFO:tasks.workunit.client.0.smithi066.stdout:0/842: chown d1/d62/d9f/d4a/d67/d1b/d61/f81 3961 1 2024-09-12T01:43:21.127 INFO:tasks.workunit.client.0.smithi066.stdout:4/799: truncate d4/f71 7383591 0 2024-09-12T01:43:21.127 INFO:tasks.workunit.client.0.smithi066.stdout:4/800: readlink d4/d6/d48/d88/ldd 0 2024-09-12T01:43:21.128 INFO:tasks.workunit.client.0.smithi066.stdout:5/831: write d0/dd/d18/d36/dbf/dce/d3b/d98/fae [631663,94682] 0 2024-09-12T01:43:21.129 INFO:tasks.workunit.client.0.smithi066.stdout:7/779: unlink d2/d71/dad/lfc 0 2024-09-12T01:43:21.129 INFO:tasks.workunit.client.0.smithi066.stdout:7/780: chown d2/d5/cb7 1949 1 2024-09-12T01:43:21.130 INFO:tasks.workunit.client.0.smithi066.stdout:0/843: creat d1/d62/d9f/d92/db9/ded/f124 x:0 0 0 2024-09-12T01:43:21.131 INFO:tasks.workunit.client.0.smithi066.stdout:4/801: creat d4/f109 x:0 0 0 2024-09-12T01:43:21.132 INFO:tasks.workunit.client.0.smithi066.stdout:4/802: readlink d4/d15/d33/d5e/dac/lf3 0 2024-09-12T01:43:21.134 INFO:tasks.workunit.client.0.smithi066.stdout:7/781: mknod d2/d5/da/c108 0 2024-09-12T01:43:21.135 INFO:tasks.workunit.client.0.smithi066.stdout:6/787: dwrite d2/d21/ff7 [0,4194304] 0 2024-09-12T01:43:21.136 INFO:tasks.workunit.client.0.smithi066.stdout:9/750: dwrite d0/fb6 [0,4194304] 0 2024-09-12T01:43:21.136 INFO:tasks.workunit.client.0.smithi066.stdout:9/751: write d0/d6/d17/d4f/d12/f87 [602,57630] 0 2024-09-12T01:43:21.137 INFO:tasks.workunit.client.0.smithi066.stdout:3/805: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/de6/ff5 [0,4194304] 0 2024-09-12T01:43:21.137 INFO:tasks.workunit.client.0.smithi066.stdout:0/844: truncate d1/d72/de/f2a 2208754 0 2024-09-12T01:43:21.137 INFO:tasks.workunit.client.0.smithi066.stdout:8/780: dwrite d12/f47 [0,4194304] 0 2024-09-12T01:43:21.137 INFO:tasks.workunit.client.0.smithi066.stdout:8/781: fsync d12/d21/d2f/d57/d84/f60 0 2024-09-12T01:43:21.137 INFO:tasks.workunit.client.0.smithi066.stdout:5/832: truncate d0/d26/d2d/d33/f4f 3344743 0 2024-09-12T01:43:21.138 INFO:tasks.workunit.client.0.smithi066.stdout:7/782: mkdir d2/d5/da/d3f/d9b/d109 0 2024-09-12T01:43:21.141 INFO:tasks.workunit.client.0.smithi066.stdout:6/788: creat d2/d21/d92/f107 x:0 0 0 2024-09-12T01:43:21.142 INFO:tasks.workunit.client.0.smithi066.stdout:4/803: write d4/f52 [1396184,70194] 0 2024-09-12T01:43:21.145 INFO:tasks.workunit.client.0.smithi066.stdout:9/752: symlink d0/d6/d17/d1b/d4c/l10b 0 2024-09-12T01:43:21.148 INFO:tasks.workunit.client.0.smithi066.stdout:3/806: symlink d5/d35/d103/d1b/d45/d66/d67/d75/d8e/l11d 0 2024-09-12T01:43:21.149 INFO:tasks.workunit.client.0.smithi066.stdout:3/807: chown d5/d35/d103/d1b/d45/d66/d5c 62141193 1 2024-09-12T01:43:21.154 INFO:tasks.workunit.client.0.smithi066.stdout:8/782: symlink d12/l103 0 2024-09-12T01:43:21.154 INFO:tasks.workunit.client.0.smithi066.stdout:8/783: fsync d12/daf/fe5 0 2024-09-12T01:43:21.157 INFO:tasks.workunit.client.0.smithi066.stdout:5/833: unlink d0/d26/d2d/d33/d55/d82/f72 0 2024-09-12T01:43:21.159 INFO:tasks.workunit.client.0.smithi066.stdout:7/783: symlink d2/d71/d93/l10a 0 2024-09-12T01:43:21.160 INFO:tasks.workunit.client.0.smithi066.stdout:6/789: link d2/d99/d12/d1d/d6b/dbc/cb6 d2/d99/d12/c108 0 2024-09-12T01:43:21.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/804: rmdir d4/d5f/d105 0 2024-09-12T01:43:21.162 INFO:tasks.workunit.client.0.smithi066.stdout:4/805: write d4/d6/d14/fca [908149,34423] 0 2024-09-12T01:43:21.171 INFO:tasks.workunit.client.0.smithi066.stdout:5/834: mknod d0/dd/d18/d36/dbf/dce/d30/d8b/c107 0 2024-09-12T01:43:21.173 INFO:tasks.workunit.client.0.smithi066.stdout:4/806: creat d4/d6/d48/f10a x:0 0 0 2024-09-12T01:43:21.173 INFO:tasks.workunit.client.0.smithi066.stdout:4/807: creat d4/d6/d27/d66/d6c/d75/f10b x:0 0 0 2024-09-12T01:43:21.173 INFO:tasks.workunit.client.0.smithi066.stdout:4/808: fsync d4/d15/f38 0 2024-09-12T01:43:21.174 INFO:tasks.workunit.client.0.smithi066.stdout:8/784: dwrite d12/f31 [0,4194304] 0 2024-09-12T01:43:21.177 INFO:tasks.workunit.client.0.smithi066.stdout:5/835: symlink d0/d26/d2d/d33/d55/d82/l108 0 2024-09-12T01:43:21.177 INFO:tasks.workunit.client.0.smithi066.stdout:5/836: truncate d0/d26/d2d/d33/da2/ff9 532762 0 2024-09-12T01:43:21.177 INFO:tasks.workunit.client.0.smithi066.stdout:6/790: dwrite d2/d99/d12/d49/d9e/dc0/fff [0,4194304] 0 2024-09-12T01:43:21.177 INFO:tasks.workunit.client.0.smithi066.stdout:6/791: readlink d2/l8 0 2024-09-12T01:43:21.177 INFO:tasks.workunit.client.0.smithi066.stdout:6/792: readlink d2/d99/d12/l29 0 2024-09-12T01:43:21.177 INFO:tasks.workunit.client.0.smithi066.stdout:6/793: chown d2/f45 479055640 1 2024-09-12T01:43:21.182 INFO:tasks.workunit.client.0.smithi066.stdout:4/809: creat d4/d5f/f10c x:0 0 0 2024-09-12T01:43:21.182 INFO:tasks.workunit.client.0.smithi066.stdout:4/810: creat d4/d84/dba/f10d x:0 0 0 2024-09-12T01:43:21.188 INFO:tasks.workunit.client.0.smithi066.stdout:5/837: symlink d0/d26/d2d/d33/l109 0 2024-09-12T01:43:21.189 INFO:tasks.workunit.client.0.smithi066.stdout:5/838: write d0/d26/d2d/d33/d55/d82/d87/d8e/fc5 [348877,4238] 0 2024-09-12T01:43:21.194 INFO:tasks.workunit.client.0.smithi066.stdout:4/811: mkdir d4/d5f/dea/d10e 0 2024-09-12T01:43:21.200 INFO:tasks.workunit.client.0.smithi066.stdout:4/812: rename d4/d6/d14/l22 to d4/d6/d8/l10f 0 2024-09-12T01:43:21.201 INFO:tasks.workunit.client.0.smithi066.stdout:9/753: write d0/d6/d17/d1b/d4c/d42/fa5 [890326,23528] 0 2024-09-12T01:43:21.201 INFO:tasks.workunit.client.0.smithi066.stdout:4/813: truncate d4/d5f/f85 2629261 0 2024-09-12T01:43:21.201 INFO:tasks.workunit.client.0.smithi066.stdout:0/845: write d1/d62/d9f/d4a/d67/d1b/d61/f81 [1306409,69791] 0 2024-09-12T01:43:21.202 INFO:tasks.workunit.client.0.smithi066.stdout:5/839: dread d0/dd/d18/f7c [0,4194304] 0 2024-09-12T01:43:21.202 INFO:tasks.workunit.client.0.smithi066.stdout:5/840: stat d0/c7e 0 2024-09-12T01:43:21.203 INFO:tasks.workunit.client.0.smithi066.stdout:8/785: dwrite d12/d21/d2f/f63 [0,4194304] 0 2024-09-12T01:43:21.203 INFO:tasks.workunit.client.0.smithi066.stdout:8/786: write d12/db2/fb8 [3713515,66143] 0 2024-09-12T01:43:21.203 INFO:tasks.workunit.client.0.smithi066.stdout:6/794: dwrite d2/d99/d12/f6e [0,4194304] 0 2024-09-12T01:43:21.203 INFO:tasks.workunit.client.0.smithi066.stdout:6/795: chown d2/d99/d12/c24 10 1 2024-09-12T01:43:21.204 INFO:tasks.workunit.client.0.smithi066.stdout:9/754: unlink d0/d6/d17/d4f/d12/cd5 0 2024-09-12T01:43:21.204 INFO:tasks.workunit.client.0.smithi066.stdout:9/755: fdatasync d0/d6/d37/d85/fcf 0 2024-09-12T01:43:21.207 INFO:tasks.workunit.client.0.smithi066.stdout:5/841: mkdir d0/d26/d2d/d33/dec/d10a 0 2024-09-12T01:43:21.208 INFO:tasks.workunit.client.0.smithi066.stdout:8/787: mkdir d12/d21/d2f/d57/d84/d50/d56/db6/dc8/d104 0 2024-09-12T01:43:21.212 INFO:tasks.workunit.client.0.smithi066.stdout:9/756: mkdir d0/d6/d17/d1b/d4c/d42/d10c 0 2024-09-12T01:43:21.212 INFO:tasks.workunit.client.0.smithi066.stdout:9/757: fdatasync d0/d6/d37/d85/fa8 0 2024-09-12T01:43:21.212 INFO:tasks.workunit.client.0.smithi066.stdout:9/758: dread - d0/d6/d17/d1b/d4c/d42/dab/f109 zero size 2024-09-12T01:43:21.213 INFO:tasks.workunit.client.0.smithi066.stdout:0/846: dread d1/d62/d89/fde [0,4194304] 0 2024-09-12T01:43:21.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/796: dread d2/d99/d12/d1d/d6b/f89 [0,4194304] 0 2024-09-12T01:43:21.215 INFO:tasks.workunit.client.0.smithi066.stdout:6/797: creat d2/d99/d12/d1d/d6b/dc6/dd9/f109 x:0 0 0 2024-09-12T01:43:21.216 INFO:tasks.workunit.client.0.smithi066.stdout:5/842: mkdir d0/dd/d18/d36/dbf/dce/d3b/d98/d10b 0 2024-09-12T01:43:21.219 INFO:tasks.workunit.client.0.smithi066.stdout:4/814: rename d4/d6/d8/d18/d45 to d4/d6/d8/d110 0 2024-09-12T01:43:21.222 INFO:tasks.workunit.client.0.smithi066.stdout:0/847: dread d1/d62/d9f/d4a/f68 [0,4194304] 0 2024-09-12T01:43:21.222 INFO:tasks.workunit.client.0.smithi066.stdout:0/848: write d1/d62/d6c/dad/f123 [163751,121662] 0 2024-09-12T01:43:21.229 INFO:tasks.workunit.client.0.smithi066.stdout:9/759: rename d0/d6/d17/d4f/d12/f87 to d0/d6/d17/d1b/d4c/d42/f10d 0 2024-09-12T01:43:21.229 INFO:tasks.workunit.client.0.smithi066.stdout:9/760: write d0/d6/d37/f55 [3929864,90843] 0 2024-09-12T01:43:21.229 INFO:tasks.workunit.client.0.smithi066.stdout:9/761: fsync d0/d6/d17/d1b/d4c/fc9 0 2024-09-12T01:43:21.229 INFO:tasks.workunit.client.0.smithi066.stdout:9/762: truncate d0/fe4 674897 0 2024-09-12T01:43:21.229 INFO:tasks.workunit.client.0.smithi066.stdout:9/763: dread - d0/d6/d17/f98 zero size 2024-09-12T01:43:21.230 INFO:tasks.workunit.client.0.smithi066.stdout:0/849: symlink d1/d62/d9f/d92/d95/l125 0 2024-09-12T01:43:21.230 INFO:tasks.workunit.client.0.smithi066.stdout:0/850: chown d1/d62/d6c/dad/cb5 85 1 2024-09-12T01:43:21.231 INFO:tasks.workunit.client.0.smithi066.stdout:4/815: dread d4/d6/d8/f32 [0,4194304] 0 2024-09-12T01:43:21.231 INFO:tasks.workunit.client.0.smithi066.stdout:4/816: chown d4/d6/d27 3603 1 2024-09-12T01:43:21.232 INFO:tasks.workunit.client.0.smithi066.stdout:4/817: chown d4/d6/d8/d110/f95 29809 1 2024-09-12T01:43:21.232 INFO:tasks.workunit.client.0.smithi066.stdout:4/818: chown d4/d6/d8/d110/le0 305287 1 2024-09-12T01:43:21.235 INFO:tasks.workunit.client.0.smithi066.stdout:8/788: dwrite d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f8f [0,4194304] 0 2024-09-12T01:43:21.237 INFO:tasks.workunit.client.0.smithi066.stdout:5/843: rename d0/dd/d18/fbc to d0/dd/d18/d36/dbf/dce/d3b/d6b/f10c 0 2024-09-12T01:43:21.237 INFO:tasks.workunit.client.0.smithi066.stdout:5/844: dread - d0/dd/d18/d36/dbf/dce/da5/fe0 zero size 2024-09-12T01:43:21.237 INFO:tasks.workunit.client.0.smithi066.stdout:0/851: symlink d1/d62/d9f/d7e/l126 0 2024-09-12T01:43:21.239 INFO:tasks.workunit.client.0.smithi066.stdout:4/819: symlink d4/d6/d27/l111 0 2024-09-12T01:43:21.240 INFO:tasks.workunit.client.0.smithi066.stdout:6/798: dwrite d2/d99/d7b/ff1 [4194304,4194304] 0 2024-09-12T01:43:21.240 INFO:tasks.workunit.client.0.smithi066.stdout:6/799: fsync d2/d99/d72/d87/fc3 0 2024-09-12T01:43:21.245 INFO:tasks.workunit.client.0.smithi066.stdout:8/789: dread d12/d21/fac [0,4194304] 0 2024-09-12T01:43:21.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/764: dwrite d0/f6a [0,4194304] 0 2024-09-12T01:43:21.248 INFO:tasks.workunit.client.0.smithi066.stdout:9/765: write d0/d6/d17/d4f/d9/fe1 [275947,81193] 0 2024-09-12T01:43:21.248 INFO:tasks.workunit.client.0.smithi066.stdout:0/852: dread d1/d62/d9f/d4a/d67/f70 [0,4194304] 0 2024-09-12T01:43:21.249 INFO:tasks.workunit.client.0.smithi066.stdout:4/820: rename d4/d15/dbd/ldb to d4/d84/dba/l112 0 2024-09-12T01:43:21.261 INFO:tasks.workunit.client.0.smithi066.stdout:8/790: link d12/d21/d2f/d57/d43/d66/d98/fc9 d12/d21/d2f/d57/d84/d50/d56/d69/d7d/dc7/f105 0 2024-09-12T01:43:21.261 INFO:tasks.workunit.client.0.smithi066.stdout:8/791: write d12/d21/d2f/d57/d3c/f7b [112415,116454] 0 2024-09-12T01:43:21.262 INFO:tasks.workunit.client.0.smithi066.stdout:0/853: read d1/d62/d9f/f5a [1420794,66218] 0 2024-09-12T01:43:21.262 INFO:tasks.workunit.client.0.smithi066.stdout:0/854: readlink d1/d62/d9f/d4a/d67/d1b/d3b/laf 0 2024-09-12T01:43:21.265 INFO:tasks.workunit.client.0.smithi066.stdout:4/821: symlink d4/d6/d8/d18/d4d/l113 0 2024-09-12T01:43:21.269 INFO:tasks.workunit.client.0.smithi066.stdout:8/792: symlink d12/d21/d2f/d57/d84/d50/d56/db6/dc8/l106 0 2024-09-12T01:43:21.269 INFO:tasks.workunit.client.0.smithi066.stdout:8/793: write d12/f5f [314189,74556] 0 2024-09-12T01:43:21.269 INFO:tasks.workunit.client.0.smithi066.stdout:5/845: dwrite d0/f17 [0,4194304] 0 2024-09-12T01:43:21.270 INFO:tasks.workunit.client.0.smithi066.stdout:0/855: mkdir d1/d62/d9f/d4a/d67/d20/dc9/d111/d127 0 2024-09-12T01:43:21.272 INFO:tasks.workunit.client.0.smithi066.stdout:0/856: dread d1/d62/d9f/d4a/d67/d20/f10e [0,4194304] 0 2024-09-12T01:43:21.273 INFO:tasks.workunit.client.0.smithi066.stdout:4/822: symlink d4/d15/d33/ddf/l114 0 2024-09-12T01:43:21.273 INFO:tasks.workunit.client.0.smithi066.stdout:4/823: fdatasync d4/d6/d8/fbf 0 2024-09-12T01:43:21.278 INFO:tasks.workunit.client.0.smithi066.stdout:8/794: rename d12/d21/d2f/d57/d84/c9b to d12/d21/d2f/d53/dde/dfa/de1/c107 0 2024-09-12T01:43:21.285 INFO:tasks.workunit.client.0.smithi066.stdout:0/857: dread d1/d72/de/f19 [0,4194304] 0 2024-09-12T01:43:21.285 INFO:tasks.workunit.client.0.smithi066.stdout:5/846: symlink d0/dd/l10d 0 2024-09-12T01:43:21.285 INFO:tasks.workunit.client.0.smithi066.stdout:5/847: write d0/dd/d18/f53 [2763629,5391] 0 2024-09-12T01:43:21.285 INFO:tasks.workunit.client.0.smithi066.stdout:5/848: fdatasync d0/dd/d18/d36/f67 0 2024-09-12T01:43:21.290 INFO:tasks.workunit.client.0.smithi066.stdout:8/795: unlink d12/d21/d2f/d57/d43/f91 0 2024-09-12T01:43:21.290 INFO:tasks.workunit.client.0.smithi066.stdout:8/796: creat d12/d21/d2f/d57/d3c/f108 x:0 0 0 2024-09-12T01:43:21.292 INFO:tasks.workunit.client.0.smithi066.stdout:0/858: creat d1/d62/d9f/d120/f128 x:0 0 0 2024-09-12T01:43:21.292 INFO:tasks.workunit.client.0.smithi066.stdout:0/859: stat d1/d62/d9f/d4a/d67/d20/d5e/fa7 0 2024-09-12T01:43:21.292 INFO:tasks.workunit.client.0.smithi066.stdout:5/849: mkdir d0/d26/d2d/d33/db0/d10e 0 2024-09-12T01:43:21.298 INFO:tasks.workunit.client.0.smithi066.stdout:8/797: dread d12/d21/d2f/d57/d3c/f76 [0,4194304] 0 2024-09-12T01:43:21.300 INFO:tasks.workunit.client.0.smithi066.stdout:6/800: dwrite d2/d21/d92/f107 [0,4194304] 0 2024-09-12T01:43:21.302 INFO:tasks.workunit.client.0.smithi066.stdout:8/798: getdents d12/d21/d2f/d57/d43/d66 0 2024-09-12T01:43:21.303 INFO:tasks.workunit.client.0.smithi066.stdout:8/799: read - d12/d21/d2f/d57/d84/d50/d56/db6/f8b zero size 2024-09-12T01:43:21.305 INFO:tasks.workunit.client.0.smithi066.stdout:0/860: dread d1/d72/fd3 [0,4194304] 0 2024-09-12T01:43:21.307 INFO:tasks.workunit.client.0.smithi066.stdout:6/801: link c0 d2/d99/d72/d76/c10a 0 2024-09-12T01:43:21.310 INFO:tasks.workunit.client.0.smithi066.stdout:8/800: mknod d12/c109 0 2024-09-12T01:43:21.310 INFO:tasks.workunit.client.0.smithi066.stdout:8/801: readlink d12/d21/d2f/d57/d84/d50/d56/d69/d7d/l88 0 2024-09-12T01:43:21.310 INFO:tasks.workunit.client.0.smithi066.stdout:5/850: dwrite d0/d26/d2d/d42/f89 [0,4194304] 0 2024-09-12T01:43:21.313 INFO:tasks.workunit.client.0.smithi066.stdout:0/861: creat d1/d62/d9f/d4a/d67/d6e/d80/f129 x:0 0 0 2024-09-12T01:43:21.314 INFO:tasks.workunit.client.0.smithi066.stdout:6/802: symlink d2/d99/d12/d1d/l10b 0 2024-09-12T01:43:21.314 INFO:tasks.workunit.client.0.smithi066.stdout:6/803: truncate d2/d99/d7b/df8/d57/fed 545486 0 2024-09-12T01:43:21.317 INFO:tasks.workunit.client.0.smithi066.stdout:8/802: mknod d12/d21/d2f/d53/dde/df8/c10a 0 2024-09-12T01:43:21.319 INFO:tasks.workunit.client.0.smithi066.stdout:0/862: rename d1/d62/d9f/d7e to d1/d62/d9f/d4a/d12a 0 2024-09-12T01:43:21.323 INFO:tasks.workunit.client.0.smithi066.stdout:6/804: rename d2/d99/d12/d1d/f2b to d2/d99/d12/f10c 0 2024-09-12T01:43:21.325 INFO:tasks.workunit.client.0.smithi066.stdout:6/805: dread d2/d99/d12/d1d/fee [0,4194304] 0 2024-09-12T01:43:21.326 INFO:tasks.workunit.client.0.smithi066.stdout:0/863: write d1/d72/de/f1d [1385272,31373] 0 2024-09-12T01:43:21.327 INFO:tasks.workunit.client.0.smithi066.stdout:5/851: dwrite d0/dd/d18/d36/f79 [0,4194304] 0 2024-09-12T01:43:21.340 INFO:tasks.workunit.client.0.smithi066.stdout:8/803: dwrite d12/d21/d2f/f34 [0,4194304] 0 2024-09-12T01:43:21.350 INFO:tasks.workunit.client.0.smithi066.stdout:0/864: dwrite d1/d62/d89/d83/fda [4194304,4194304] 0 2024-09-12T01:43:21.406 INFO:tasks.workunit.client.0.smithi066.stdout:6/806: creat d2/d99/d72/d76/f10d x:0 0 0 2024-09-12T01:43:21.415 INFO:tasks.workunit.client.0.smithi066.stdout:5/852: symlink d0/d26/d2d/d33/da2/l10f 0 2024-09-12T01:43:21.415 INFO:tasks.workunit.client.0.smithi066.stdout:5/853: fsync d0/dd/d18/d36/dbf/dce/da5/fb1 0 2024-09-12T01:43:21.415 INFO:tasks.workunit.client.0.smithi066.stdout:5/854: fsync d0/dd/d18/d36/dbf/dce/d30/da8/fab 0 2024-09-12T01:43:21.415 INFO:tasks.workunit.client.0.smithi066.stdout:8/804: mkdir d12/d21/d2f/df5/d10b 0 2024-09-12T01:43:21.417 INFO:tasks.workunit.client.0.smithi066.stdout:0/865: mkdir d1/d62/d9f/d4a/d67/d1b/d26/d9c/d12b 0 2024-09-12T01:43:21.420 INFO:tasks.workunit.client.0.smithi066.stdout:6/807: mknod d2/d99/d12/c10e 0 2024-09-12T01:43:21.421 INFO:tasks.workunit.client.0.smithi066.stdout:5/855: mkdir d0/dd/d18/d110 0 2024-09-12T01:43:21.422 INFO:tasks.workunit.client.0.smithi066.stdout:8/805: mkdir d12/d21/d2f/d57/d43/d66/d98/d10c 0 2024-09-12T01:43:21.423 INFO:tasks.workunit.client.0.smithi066.stdout:0/866: creat d1/d62/d9f/d4a/d67/d1b/d61/dec/f12c x:0 0 0 2024-09-12T01:43:21.424 INFO:tasks.workunit.client.0.smithi066.stdout:5/856: truncate d0/dd/d18/d36/dbf/dce/d3b/d98/f99 7986894 0 2024-09-12T01:43:21.426 INFO:tasks.workunit.client.0.smithi066.stdout:5/857: mkdir d0/d26/d2d/d33/dec/d10a/d111 0 2024-09-12T01:43:21.427 INFO:tasks.workunit.client.0.smithi066.stdout:5/858: symlink d0/d26/d2d/d33/db0/d10e/l112 0 2024-09-12T01:43:21.428 INFO:tasks.workunit.client.0.smithi066.stdout:5/859: stat d0/l1 0 2024-09-12T01:43:21.428 INFO:tasks.workunit.client.0.smithi066.stdout:5/860: stat d0/d26/d2d/d42/d95/c97 0 2024-09-12T01:43:21.432 INFO:tasks.workunit.client.0.smithi066.stdout:5/861: dread d0/d26/d2d/d33/d55/d73/f9c [0,4194304] 0 2024-09-12T01:43:21.433 INFO:tasks.workunit.client.0.smithi066.stdout:5/862: chown d0/dd/d18/d36/dbf/dce/f58 0 1 2024-09-12T01:43:21.433 INFO:tasks.workunit.client.0.smithi066.stdout:5/863: fsync d0/d21/f44 0 2024-09-12T01:43:21.433 INFO:tasks.workunit.client.0.smithi066.stdout:6/808: write d2/d99/d12/d1d/fce [2285614,49238] 0 2024-09-12T01:43:21.434 INFO:tasks.workunit.client.0.smithi066.stdout:5/864: unlink d0/dd/d18/d36/dbf/dce/d3b/d6b/f10c 0 2024-09-12T01:43:21.437 INFO:tasks.workunit.client.0.smithi066.stdout:5/865: creat d0/d26/d2d/d33/d55/d82/d87/f113 x:0 0 0 2024-09-12T01:43:21.438 INFO:tasks.workunit.client.0.smithi066.stdout:5/866: write d0/d26/d2d/d33/f88 [857755,4752] 0 2024-09-12T01:43:21.439 INFO:tasks.workunit.client.0.smithi066.stdout:5/867: mknod d0/dd/d18/d36/dbf/dce/d30/c114 0 2024-09-12T01:43:21.441 INFO:tasks.workunit.client.0.smithi066.stdout:5/868: truncate d0/f20 1420584 0 2024-09-12T01:43:21.441 INFO:tasks.workunit.client.0.smithi066.stdout:5/869: dread - d0/dd/d18/d36/dbf/dce/d3b/d98/dde/fef zero size 2024-09-12T01:43:21.443 INFO:tasks.workunit.client.0.smithi066.stdout:8/806: rmdir d12/d21/d2f/d53/dde/df8 39 2024-09-12T01:43:21.443 INFO:tasks.workunit.client.0.smithi066.stdout:8/807: chown d12/daf/ld1 1 1 2024-09-12T01:43:21.444 INFO:tasks.workunit.client.0.smithi066.stdout:8/808: mkdir d12/d21/d2f/d57/d84/d50/d10d 0 2024-09-12T01:43:21.444 INFO:tasks.workunit.client.0.smithi066.stdout:8/809: write d12/d21/d2f/d57/d43/d66/fb9 [769641,60969] 0 2024-09-12T01:43:21.444 INFO:tasks.workunit.client.0.smithi066.stdout:0/867: dwrite d1/d72/de/f19 [4194304,4194304] 0 2024-09-12T01:43:21.446 INFO:tasks.workunit.client.0.smithi066.stdout:5/870: dread d0/d26/d2d/d31/fa0 [0,4194304] 0 2024-09-12T01:43:21.446 INFO:tasks.workunit.client.0.smithi066.stdout:5/871: write d0/d26/d2d/d33/d55/d82/d87/ff6 [3832317,74514] 0 2024-09-12T01:43:21.448 INFO:tasks.workunit.client.0.smithi066.stdout:5/872: creat d0/d26/d2d/f115 x:0 0 0 2024-09-12T01:43:21.451 INFO:tasks.workunit.client.0.smithi066.stdout:6/809: write d2/d99/d12/d1d/d6b/f86 [22896,75747] 0 2024-09-12T01:43:21.453 INFO:tasks.workunit.client.0.smithi066.stdout:5/873: dread d0/dd/d18/d36/dbf/dce/d9a/f9f [0,4194304] 0 2024-09-12T01:43:21.455 INFO:tasks.workunit.client.0.smithi066.stdout:0/868: dread d1/d62/d9f/d4a/d67/d1b/d26/d5b/fd8 [0,4194304] 0 2024-09-12T01:43:21.457 INFO:tasks.workunit.client.0.smithi066.stdout:6/810: symlink d2/d99/d12/d1d/l10f 0 2024-09-12T01:43:21.459 INFO:tasks.workunit.client.0.smithi066.stdout:0/869: write d1/d62/d9f/d7c/f9e [979933,77943] 0 2024-09-12T01:43:21.463 INFO:tasks.workunit.client.0.smithi066.stdout:5/874: rmdir d0/dd/d18/d36/dbf/dce/d30/da8/dfd 0 2024-09-12T01:43:21.463 INFO:tasks.workunit.client.0.smithi066.stdout:5/875: dread - d0/d26/d2d/d33/d55/d84/fba zero size 2024-09-12T01:43:21.463 INFO:tasks.workunit.client.0.smithi066.stdout:5/876: write d0/dd/d18/d36/dbf/dce/da5/fe0 [745656,3698] 0 2024-09-12T01:43:21.464 INFO:tasks.workunit.client.0.smithi066.stdout:5/877: mkdir d0/d26/d2d/d42/d116 0 2024-09-12T01:43:21.469 INFO:tasks.workunit.client.0.smithi066.stdout:6/811: dread d2/d99/d7b/ff1 [0,4194304] 0 2024-09-12T01:43:21.470 INFO:tasks.workunit.client.0.smithi066.stdout:6/812: chown d2/d99/d7b/df8/d57/ffd 6 1 2024-09-12T01:43:21.470 INFO:tasks.workunit.client.0.smithi066.stdout:6/813: write d2/d99/d12/d1d/d6b/dc6/dd9/f109 [418420,45724] 0 2024-09-12T01:43:21.472 INFO:tasks.workunit.client.0.smithi066.stdout:6/814: getdents d2/d99/d72/d76 0 2024-09-12T01:43:21.472 INFO:tasks.workunit.client.0.smithi066.stdout:6/815: dread - d2/d99/d12/d49/d9e/dc0/f103 zero size 2024-09-12T01:43:21.475 INFO:tasks.workunit.client.0.smithi066.stdout:6/816: rename d2/d99/d12/d1d/d6b/dbc/cb6 to d2/d99/d72/db7/c110 0 2024-09-12T01:43:21.475 INFO:tasks.workunit.client.0.smithi066.stdout:6/817: write d2/d99/d12/d1d/fee [1047869,42726] 0 2024-09-12T01:43:21.477 INFO:tasks.workunit.client.0.smithi066.stdout:2/713: sync 2024-09-12T01:43:21.477 INFO:tasks.workunit.client.0.smithi066.stdout:2/714: dread - de/d13/d1e/d41/d58/fce zero size 2024-09-12T01:43:21.477 INFO:tasks.workunit.client.0.smithi066.stdout:2/715: write f2 [2201715,35644] 0 2024-09-12T01:43:21.478 INFO:tasks.workunit.client.0.smithi066.stdout:6/818: mknod d2/d99/d12/d1d/d6b/dbc/c111 0 2024-09-12T01:43:21.480 INFO:tasks.workunit.client.0.smithi066.stdout:2/716: rmdir de/d13/d1e/ddf 0 2024-09-12T01:43:21.481 INFO:tasks.workunit.client.0.smithi066.stdout:6/819: creat d2/d99/d7b/df8/f112 x:0 0 0 2024-09-12T01:43:21.483 INFO:tasks.workunit.client.0.smithi066.stdout:6/820: mknod d2/d99/d12/c113 0 2024-09-12T01:43:21.483 INFO:tasks.workunit.client.0.smithi066.stdout:6/821: fsync d2/d99/d72/d76/ffc 0 2024-09-12T01:43:21.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/717: rename de/d3c/d8f/dcf/fb7 to de/fec 0 2024-09-12T01:43:21.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/718: read de/d13/d1e/d41/d58/f73 [4698185,62460] 0 2024-09-12T01:43:21.486 INFO:tasks.workunit.client.0.smithi066.stdout:2/719: mkdir de/d13/d28/d3a/ded 0 2024-09-12T01:43:21.489 INFO:tasks.workunit.client.0.smithi066.stdout:2/720: rename de/d13/d7f/cba to de/d13/d1e/cee 0 2024-09-12T01:43:21.489 INFO:tasks.workunit.client.0.smithi066.stdout:2/721: readlink de/d13/d1e/d41/l75 0 2024-09-12T01:43:21.502 INFO:tasks.workunit.client.0.smithi066.stdout:0/870: dwrite d1/d62/d9f/d7c/f9e [0,4194304] 0 2024-09-12T01:43:21.505 INFO:tasks.workunit.client.0.smithi066.stdout:5/878: dwrite d0/d26/f6f [4194304,4194304] 0 2024-09-12T01:43:21.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/871: creat d1/d62/d9f/d4a/d67/d11d/f12d x:0 0 0 2024-09-12T01:43:21.509 INFO:tasks.workunit.client.0.smithi066.stdout:5/879: truncate d0/dd/d18/d36/dbf/dce/d30/f66 126314 0 2024-09-12T01:43:21.510 INFO:tasks.workunit.client.0.smithi066.stdout:6/822: dwrite d2/d99/d72/ffb [0,4194304] 0 2024-09-12T01:43:21.515 INFO:tasks.workunit.client.0.smithi066.stdout:5/880: link d0/dd/d18/d36/d4c/db6/le2 d0/d26/d2d/d33/d55/d82/d87/l117 0 2024-09-12T01:43:21.516 INFO:tasks.workunit.client.0.smithi066.stdout:5/881: dread - d0/d26/d2d/d33/d55/d84/fba zero size 2024-09-12T01:43:21.517 INFO:tasks.workunit.client.0.smithi066.stdout:2/722: dwrite de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:21.517 INFO:tasks.workunit.client.0.smithi066.stdout:2/723: readlink de/d13/d28/d3d/l4e 0 2024-09-12T01:43:21.519 INFO:tasks.workunit.client.0.smithi066.stdout:6/823: link d2/d99/d12/d1d/d6b/dbc/c111 d2/d99/d72/db7/c114 0 2024-09-12T01:43:21.519 INFO:tasks.workunit.client.0.smithi066.stdout:6/824: creat d2/d99/d7b/df8/f115 x:0 0 0 2024-09-12T01:43:21.519 INFO:tasks.workunit.client.0.smithi066.stdout:6/825: chown d2/d99/d12/d1d/d6b/dc6/dd9/feb 784 1 2024-09-12T01:43:21.526 INFO:tasks.workunit.client.0.smithi066.stdout:5/882: mkdir d0/dd/d18/d36/d4c/d118 0 2024-09-12T01:43:21.526 INFO:tasks.workunit.client.0.smithi066.stdout:5/883: chown d0/dd/d18/d36/dbf/dce/d30/d8b 529 1 2024-09-12T01:43:21.530 INFO:tasks.workunit.client.0.smithi066.stdout:2/724: mknod de/d13/cef 0 2024-09-12T01:43:21.530 INFO:tasks.workunit.client.0.smithi066.stdout:2/725: write de/f12 [1305158,6069] 0 2024-09-12T01:43:21.530 INFO:tasks.workunit.client.0.smithi066.stdout:2/726: readlink de/d3c/l7e 0 2024-09-12T01:43:21.532 INFO:tasks.workunit.client.0.smithi066.stdout:5/884: unlink d0/dd/d18/d36/dbf/dce/d30/d8b/cb8 0 2024-09-12T01:43:21.532 INFO:tasks.workunit.client.0.smithi066.stdout:5/885: write d0/d26/d2d/d33/d55/d82/d87/fb4 [419763,10905] 0 2024-09-12T01:43:21.536 INFO:tasks.workunit.client.0.smithi066.stdout:6/826: getdents d2/d99/d7b 0 2024-09-12T01:43:21.538 INFO:tasks.workunit.client.0.smithi066.stdout:5/886: mknod d0/d26/d2d/d33/da2/c119 0 2024-09-12T01:43:21.557 INFO:tasks.workunit.client.0.smithi066.stdout:6/827: dwrite d2/d21/f30 [0,4194304] 0 2024-09-12T01:43:21.562 INFO:tasks.workunit.client.0.smithi066.stdout:6/828: creat d2/d99/d12/d49/f116 x:0 0 0 2024-09-12T01:43:21.567 INFO:tasks.workunit.client.0.smithi066.stdout:6/829: link d2/d99/d12/d1d/d6b/cbe d2/d99/d7b/df8/c117 0 2024-09-12T01:43:21.567 INFO:tasks.workunit.client.0.smithi066.stdout:6/830: fsync d2/d99/d12/d49/d9e/fa6 0 2024-09-12T01:43:21.567 INFO:tasks.workunit.client.0.smithi066.stdout:6/831: stat d2/d99/d7b/df8/le0 0 2024-09-12T01:43:21.569 INFO:tasks.workunit.client.0.smithi066.stdout:6/832: creat d2/d99/d12/d1d/f118 x:0 0 0 2024-09-12T01:43:21.572 INFO:tasks.workunit.client.0.smithi066.stdout:6/833: symlink d2/d99/d12/d1d/d6b/dbc/l119 0 2024-09-12T01:43:21.575 INFO:tasks.workunit.client.0.smithi066.stdout:1/803: sync 2024-09-12T01:43:21.575 INFO:tasks.workunit.client.0.smithi066.stdout:1/804: write d5/dc/d36/de8/d8e/de2/dbc/fd9 [50364,2952] 0 2024-09-12T01:43:21.579 INFO:tasks.workunit.client.0.smithi066.stdout:5/887: rmdir d0/dd/d18/d36/dbf 39 2024-09-12T01:43:21.582 INFO:tasks.workunit.client.0.smithi066.stdout:1/805: link d5/dc/d36/de8/d8e/f91 d5/dc/d36/de8/d8e/de2/ff2 0 2024-09-12T01:43:21.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/888: chown d0/d26/l43 114967 1 2024-09-12T01:43:21.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/889: readlink d0/d26/d2d/d42/la3 0 2024-09-12T01:43:21.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/890: fdatasync d0/dd/d18/f3d 0 2024-09-12T01:43:21.585 INFO:tasks.workunit.client.0.smithi066.stdout:5/891: creat d0/dd/d18/d36/d4c/db6/f11a x:0 0 0 2024-09-12T01:43:21.597 INFO:tasks.workunit.client.0.smithi066.stdout:6/834: dwrite d2/d99/d12/d1d/f91 [0,4194304] 0 2024-09-12T01:43:21.597 INFO:tasks.workunit.client.0.smithi066.stdout:6/835: fsync d2/f5 0 2024-09-12T01:43:21.598 INFO:tasks.workunit.client.0.smithi066.stdout:6/836: write d2/d99/f60 [795420,64072] 0 2024-09-12T01:43:21.598 INFO:tasks.workunit.client.0.smithi066.stdout:6/837: write d2/f5f [1518683,25678] 0 2024-09-12T01:43:21.598 INFO:tasks.workunit.client.0.smithi066.stdout:6/838: dread - d2/d99/d12/d1d/df4/fe7 zero size 2024-09-12T01:43:21.598 INFO:tasks.workunit.client.0.smithi066.stdout:6/839: fdatasync d2/d99/d72/fb5 0 2024-09-12T01:43:21.599 INFO:tasks.workunit.client.0.smithi066.stdout:6/840: write d2/d99/d7b/df8/f69 [3316206,57802] 0 2024-09-12T01:43:21.599 INFO:tasks.workunit.client.0.smithi066.stdout:6/841: mknod d2/d99/d12/c11a 0 2024-09-12T01:43:21.604 INFO:tasks.workunit.client.0.smithi066.stdout:5/892: dread d0/dd/d18/d36/f67 [0,4194304] 0 2024-09-12T01:43:21.604 INFO:tasks.workunit.client.0.smithi066.stdout:5/893: write d0/d26/d2d/d33/da2/ff9 [1310859,15582] 0 2024-09-12T01:43:21.604 INFO:tasks.workunit.client.0.smithi066.stdout:6/842: truncate d2/d99/d72/ffb 2115588 0 2024-09-12T01:43:21.604 INFO:tasks.workunit.client.0.smithi066.stdout:6/843: fdatasync d2/d99/fa1 0 2024-09-12T01:43:21.605 INFO:tasks.workunit.client.0.smithi066.stdout:5/894: truncate d0/dd/d18/f7c 449688 0 2024-09-12T01:43:21.605 INFO:tasks.workunit.client.0.smithi066.stdout:5/895: write d0/dd/d18/f3d [6374184,84301] 0 2024-09-12T01:43:21.605 INFO:tasks.workunit.client.0.smithi066.stdout:5/896: chown d0/d26/d2d/d33/de7/lf7 15114 1 2024-09-12T01:43:21.605 INFO:tasks.workunit.client.0.smithi066.stdout:1/806: dwrite d5/d15/fad [0,4194304] 0 2024-09-12T01:43:21.606 INFO:tasks.workunit.client.0.smithi066.stdout:6/844: mkdir d2/d99/d12/d1d/df4/d11b 0 2024-09-12T01:43:21.606 INFO:tasks.workunit.client.0.smithi066.stdout:5/897: mkdir d0/dd/d18/d36/dbf/dce/d30/da8/d11b 0 2024-09-12T01:43:21.611 INFO:tasks.workunit.client.0.smithi066.stdout:1/807: mknod d5/d15/d4d/dd3/cf3 0 2024-09-12T01:43:21.612 INFO:tasks.workunit.client.0.smithi066.stdout:6/845: mkdir d2/d99/d7b/d11c 0 2024-09-12T01:43:21.615 INFO:tasks.workunit.client.0.smithi066.stdout:5/898: mknod d0/dd/d18/d36/dbf/dce/dd5/dd7/c11c 0 2024-09-12T01:43:21.616 INFO:tasks.workunit.client.0.smithi066.stdout:6/846: truncate d2/d99/d12/f6e 2846326 0 2024-09-12T01:43:21.616 INFO:tasks.workunit.client.0.smithi066.stdout:6/847: creat d2/d99/d7b/df8/d57/f11d x:0 0 0 2024-09-12T01:43:21.619 INFO:tasks.workunit.client.0.smithi066.stdout:5/899: unlink d0/d26/d2d/d33/da2/c119 0 2024-09-12T01:43:21.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/900: symlink d0/dd/d18/d36/dbf/dce/d30/d8b/l11d 0 2024-09-12T01:43:21.625 INFO:tasks.workunit.client.0.smithi066.stdout:5/901: chown d0/dd/d18/d36/dbf/dce/dd5 106 1 2024-09-12T01:43:21.627 INFO:tasks.workunit.client.0.smithi066.stdout:1/808: dwrite d5/f3b [0,4194304] 0 2024-09-12T01:43:21.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/848: rmdir d2/d99/d12/d49 39 2024-09-12T01:43:21.631 INFO:tasks.workunit.client.0.smithi066.stdout:6/849: stat d2/d99/d12/d1d/d6b/f89 0 2024-09-12T01:43:21.634 INFO:tasks.workunit.client.0.smithi066.stdout:5/902: dread d0/dd/d18/f3d [4194304,4194304] 0 2024-09-12T01:43:21.634 INFO:tasks.workunit.client.0.smithi066.stdout:5/903: readlink d0/d26/d2d/d42/la3 0 2024-09-12T01:43:21.647 INFO:tasks.workunit.client.0.smithi066.stdout:5/904: dread d0/d26/d2d/d33/f88 [0,4194304] 0 2024-09-12T01:43:21.649 INFO:tasks.workunit.client.0.smithi066.stdout:6/850: dwrite d2/d99/d12/d1d/ff6 [0,4194304] 0 2024-09-12T01:43:21.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/905: creat d0/dd/d18/d36/dbf/dce/d3b/f11e x:0 0 0 2024-09-12T01:43:21.649 INFO:tasks.workunit.client.0.smithi066.stdout:5/906: dread - d0/d26/d2d/d33/de7/f101 zero size 2024-09-12T01:43:21.651 INFO:tasks.workunit.client.0.smithi066.stdout:5/907: write d0/dd/d18/d36/dbf/dce/d3b/d6b/fb3 [497674,114008] 0 2024-09-12T01:43:21.652 INFO:tasks.workunit.client.0.smithi066.stdout:5/908: fsync d0/d26/faf 0 2024-09-12T01:43:21.653 INFO:tasks.workunit.client.0.smithi066.stdout:5/909: write d0/dd/d18/f7c [511539,104447] 0 2024-09-12T01:43:21.654 INFO:tasks.workunit.client.0.smithi066.stdout:5/910: mkdir d0/d26/d2d/d42/d11f 0 2024-09-12T01:43:21.655 INFO:tasks.workunit.client.0.smithi066.stdout:5/911: creat d0/d26/d2d/d33/d55/f120 x:0 0 0 2024-09-12T01:43:21.656 INFO:tasks.workunit.client.0.smithi066.stdout:5/912: unlink d0/dd/d18/d36/dbf/dce/d9a/f9f 0 2024-09-12T01:43:21.656 INFO:tasks.workunit.client.0.smithi066.stdout:5/913: chown d0/dd/d18/d36/d4c/db6/f11a 23340320 1 2024-09-12T01:43:21.658 INFO:tasks.workunit.client.0.smithi066.stdout:5/914: rename d0/dd/d18/d36/dbf/dce/d30/d8b/ff2 to d0/d26/d2d/d33/f121 0 2024-09-12T01:43:21.659 INFO:tasks.workunit.client.0.smithi066.stdout:5/915: mkdir d0/d26/d2d/d33/d55/d73/d122 0 2024-09-12T01:43:21.661 INFO:tasks.workunit.client.0.smithi066.stdout:6/851: dread d2/d99/d12/faf [0,4194304] 0 2024-09-12T01:43:21.661 INFO:tasks.workunit.client.0.smithi066.stdout:6/852: write d2/d99/d12/d1d/fce [861705,505] 0 2024-09-12T01:43:21.661 INFO:tasks.workunit.client.0.smithi066.stdout:6/853: chown d2/d99/d7b/df8/d57/f66 15057770 1 2024-09-12T01:43:21.661 INFO:tasks.workunit.client.0.smithi066.stdout:6/854: stat d2/d99/d7b/l8c 0 2024-09-12T01:43:21.662 INFO:tasks.workunit.client.0.smithi066.stdout:5/916: link d0/le6 d0/dd/d18/d36/dbf/dce/d3b/d98/l123 0 2024-09-12T01:43:21.664 INFO:tasks.workunit.client.0.smithi066.stdout:3/808: sync 2024-09-12T01:43:21.664 INFO:tasks.workunit.client.0.smithi066.stdout:7/784: sync 2024-09-12T01:43:21.664 INFO:tasks.workunit.client.0.smithi066.stdout:3/809: read - d5/d35/f9d zero size 2024-09-12T01:43:21.664 INFO:tasks.workunit.client.0.smithi066.stdout:7/785: dread - d2/d5/da/d3f/da4/d6c/d80/d7c/ff1 zero size 2024-09-12T01:43:21.667 INFO:tasks.workunit.client.0.smithi066.stdout:5/917: symlink d0/dd/d18/d36/dbf/dce/da4/df4/l124 0 2024-09-12T01:43:21.668 INFO:tasks.workunit.client.0.smithi066.stdout:6/855: getdents d2/d99/d7b/df8 0 2024-09-12T01:43:21.669 INFO:tasks.workunit.client.0.smithi066.stdout:5/918: dread d0/dd/f6d [0,4194304] 0 2024-09-12T01:43:21.671 INFO:tasks.workunit.client.0.smithi066.stdout:3/810: symlink d5/d35/d103/d1b/d65/d89/d50/l11e 0 2024-09-12T01:43:21.673 INFO:tasks.workunit.client.0.smithi066.stdout:6/856: symlink d2/d99/d7b/df8/d5e/l11e 0 2024-09-12T01:43:21.677 INFO:tasks.workunit.client.0.smithi066.stdout:5/919: rmdir d0/dd/d18/d36/dbf/dce/dd5 39 2024-09-12T01:43:21.677 INFO:tasks.workunit.client.0.smithi066.stdout:5/920: truncate d0/dd/d18/d36/dbf/dce/d30/ff8 769420 0 2024-09-12T01:43:21.677 INFO:tasks.workunit.client.0.smithi066.stdout:5/921: chown d0/dd/d18/d36/d4c/db6/fb9 1 1 2024-09-12T01:43:21.678 INFO:tasks.workunit.client.0.smithi066.stdout:6/857: creat d2/d99/d7b/df8/d57/dfa/f11f x:0 0 0 2024-09-12T01:43:21.681 INFO:tasks.workunit.client.0.smithi066.stdout:5/922: mkdir d0/dd/d18/d36/dbf/dce/d3b/d98/dde/d125 0 2024-09-12T01:43:21.681 INFO:tasks.workunit.client.0.smithi066.stdout:5/923: chown d0/d26/d2d/d33/dec/d10a 0 1 2024-09-12T01:43:21.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/924: creat d0/dd/d18/d36/dbf/dce/d30/f126 x:0 0 0 2024-09-12T01:43:21.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/925: write d0/dd/d18/f7c [218916,99670] 0 2024-09-12T01:43:21.683 INFO:tasks.workunit.client.0.smithi066.stdout:5/926: write d0/d21/f44 [1497041,97812] 0 2024-09-12T01:43:21.684 INFO:tasks.workunit.client.0.smithi066.stdout:5/927: mknod d0/dd/d18/d110/c127 0 2024-09-12T01:43:21.685 INFO:tasks.workunit.client.0.smithi066.stdout:5/928: creat d0/dd/d18/d36/dbf/f128 x:0 0 0 2024-09-12T01:43:21.686 INFO:tasks.workunit.client.0.smithi066.stdout:5/929: dread - d0/dd/d18/d36/dbf/dce/d3b/f11e zero size 2024-09-12T01:43:21.686 INFO:tasks.workunit.client.0.smithi066.stdout:7/786: dwrite d2/d5/d6/d40/d63/fa1 [0,4194304] 0 2024-09-12T01:43:21.687 INFO:tasks.workunit.client.0.smithi066.stdout:5/930: truncate d0/d26/d2d/d33/d55/d73/d74/f93 2859377 0 2024-09-12T01:43:21.687 INFO:tasks.workunit.client.0.smithi066.stdout:7/787: write d2/d5/d6/d81/dc8/fbf [1786790,111241] 0 2024-09-12T01:43:21.687 INFO:tasks.workunit.client.0.smithi066.stdout:7/788: write d2/d5/da/d3f/da4/d6c/d80/d7c/ff1 [832244,92114] 0 2024-09-12T01:43:21.687 INFO:tasks.workunit.client.0.smithi066.stdout:7/789: dread - d2/d5/da/d3f/da4/d6c/d8e/da7/ff8 zero size 2024-09-12T01:43:21.687 INFO:tasks.workunit.client.0.smithi066.stdout:3/811: dwrite d5/d35/d103/ffb [0,4194304] 0 2024-09-12T01:43:21.691 INFO:tasks.workunit.client.0.smithi066.stdout:5/931: rmdir d0/dd/d18/d110 39 2024-09-12T01:43:21.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/858: read d2/d99/d7b/df8/d5e/f71 [3094541,83200] 0 2024-09-12T01:43:21.691 INFO:tasks.workunit.client.0.smithi066.stdout:6/859: write d2/d99/d12/d49/d9e/ff5 [825549,75170] 0 2024-09-12T01:43:21.693 INFO:tasks.workunit.client.0.smithi066.stdout:7/790: creat d2/d5/da/d3f/da4/d6c/d80/f10b x:0 0 0 2024-09-12T01:43:21.696 INFO:tasks.workunit.client.0.smithi066.stdout:3/812: creat d5/d35/d103/d1b/d45/d66/d67/d114/f11f x:0 0 0 2024-09-12T01:43:21.697 INFO:tasks.workunit.client.0.smithi066.stdout:5/932: creat d0/d26/d2d/d33/dec/d10a/d111/f129 x:0 0 0 2024-09-12T01:43:21.698 INFO:tasks.workunit.client.0.smithi066.stdout:6/860: mkdir d2/d99/d12/d49/d120 0 2024-09-12T01:43:21.699 INFO:tasks.workunit.client.0.smithi066.stdout:7/791: mknod d2/d5/d6/d81/c10c 0 2024-09-12T01:43:21.701 INFO:tasks.workunit.client.0.smithi066.stdout:3/813: truncate d5/d35/d103/d1b/d45/d66/d67/d6d/fa1 4803700 0 2024-09-12T01:43:21.702 INFO:tasks.workunit.client.0.smithi066.stdout:5/933: creat d0/d26/d2d/d42/f12a x:0 0 0 2024-09-12T01:43:21.704 INFO:tasks.workunit.client.0.smithi066.stdout:6/861: symlink d2/d99/d72/d87/l121 0 2024-09-12T01:43:21.711 INFO:tasks.workunit.client.0.smithi066.stdout:6/862: creat d2/d99/d12/d1d/df4/d11b/f122 x:0 0 0 2024-09-12T01:43:21.712 INFO:tasks.workunit.client.0.smithi066.stdout:6/863: write d2/d99/d12/d1d/fce [903136,62697] 0 2024-09-12T01:43:21.712 INFO:tasks.workunit.client.0.smithi066.stdout:7/792: getdents d2/d5/da/d3f/da4 0 2024-09-12T01:43:21.715 INFO:tasks.workunit.client.0.smithi066.stdout:7/793: mkdir d2/d5/da/d3f/d10d 0 2024-09-12T01:43:21.726 INFO:tasks.workunit.client.0.smithi066.stdout:6/864: dread d2/d21/fe5 [0,4194304] 0 2024-09-12T01:43:21.726 INFO:tasks.workunit.client.0.smithi066.stdout:6/865: stat d2/d99 0 2024-09-12T01:43:21.726 INFO:tasks.workunit.client.0.smithi066.stdout:3/814: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f10c [0,4194304] 0 2024-09-12T01:43:21.728 INFO:tasks.workunit.client.0.smithi066.stdout:5/934: dwrite d0/dd/f9b [0,4194304] 0 2024-09-12T01:43:21.728 INFO:tasks.workunit.client.0.smithi066.stdout:5/935: dread - d0/d26/d2d/fbb zero size 2024-09-12T01:43:21.732 INFO:tasks.workunit.client.0.smithi066.stdout:3/815: creat d5/d35/d103/d1b/d77/dd5/dbd/d112/f120 x:0 0 0 2024-09-12T01:43:21.732 INFO:tasks.workunit.client.0.smithi066.stdout:3/816: dread - d5/d35/d103/d1b/d65/d89/fea zero size 2024-09-12T01:43:21.737 INFO:tasks.workunit.client.0.smithi066.stdout:7/794: dwrite d2/d5/d6/fe [0,4194304] 0 2024-09-12T01:43:21.737 INFO:tasks.workunit.client.0.smithi066.stdout:6/866: dread d2/d99/d12/d1d/d6b/f89 [0,4194304] 0 2024-09-12T01:43:21.740 INFO:tasks.workunit.client.0.smithi066.stdout:3/817: dread d5/d35/d103/d1b/d65/d89/f1c [0,4194304] 0 2024-09-12T01:43:21.751 INFO:tasks.workunit.client.0.smithi066.stdout:7/795: unlink d2/d5/da/d3f/d9b/f49 0 2024-09-12T01:43:21.751 INFO:tasks.workunit.client.0.smithi066.stdout:6/867: dwrite d2/d99/d7b/df8/d5e/f80 [0,4194304] 0 2024-09-12T01:43:21.751 INFO:tasks.workunit.client.0.smithi066.stdout:3/818: symlink d5/d35/d103/d1b/d45/d66/d5c/d101/l121 0 2024-09-12T01:43:21.754 INFO:tasks.workunit.client.0.smithi066.stdout:5/936: getdents d0/dd/d18/d36/dbf 0 2024-09-12T01:43:21.755 INFO:tasks.workunit.client.0.smithi066.stdout:7/796: getdents d2/d5/d6/d22/dac 0 2024-09-12T01:43:21.755 INFO:tasks.workunit.client.0.smithi066.stdout:7/797: creat d2/d5/d6/d40/d51/f10e x:0 0 0 2024-09-12T01:43:21.758 INFO:tasks.workunit.client.0.smithi066.stdout:3/819: mkdir d5/d35/d103/d1b/d122 0 2024-09-12T01:43:21.758 INFO:tasks.workunit.client.0.smithi066.stdout:3/820: fsync d5/f92 0 2024-09-12T01:43:21.759 INFO:tasks.workunit.client.0.smithi066.stdout:5/937: creat d0/dd/d18/d36/dbf/dce/da4/df4/f12b x:0 0 0 2024-09-12T01:43:21.759 INFO:tasks.workunit.client.0.smithi066.stdout:5/938: stat d0/d26/d2d/d33/d55/d82/d87/d8e 0 2024-09-12T01:43:21.759 INFO:tasks.workunit.client.0.smithi066.stdout:5/939: chown d0/c103 1 1 2024-09-12T01:43:21.761 INFO:tasks.workunit.client.0.smithi066.stdout:7/798: mkdir d2/d71/dad/d10f 0 2024-09-12T01:43:21.762 INFO:tasks.workunit.client.0.smithi066.stdout:3/821: mkdir d5/d35/d103/d1b/d45/d66/de7/d123 0 2024-09-12T01:43:21.762 INFO:tasks.workunit.client.0.smithi066.stdout:3/822: dread - d5/d35/d103/d1b/d77/dd5/dbd/d112/f120 zero size 2024-09-12T01:43:21.765 INFO:tasks.workunit.client.0.smithi066.stdout:3/823: mknod d5/d35/d103/d1b/d45/d66/dae/dd7/c124 0 2024-09-12T01:43:21.765 INFO:tasks.workunit.client.0.smithi066.stdout:3/824: chown d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/lef 4235975 1 2024-09-12T01:43:21.767 INFO:tasks.workunit.client.0.smithi066.stdout:5/940: mkdir d0/d26/d12c 0 2024-09-12T01:43:21.769 INFO:tasks.workunit.client.0.smithi066.stdout:6/868: dwrite d2/d99/d12/d1d/f91 [0,4194304] 0 2024-09-12T01:43:21.769 INFO:tasks.workunit.client.0.smithi066.stdout:7/799: dread d2/d5/da/d3f/d9b/d4d/f76 [0,4194304] 0 2024-09-12T01:43:21.770 INFO:tasks.workunit.client.0.smithi066.stdout:3/825: rename d5/d35/d103/d1b/d65/d89/d50/l11e to d5/d35/d103/d1b/d45/d66/d67/d114/l125 0 2024-09-12T01:43:21.770 INFO:tasks.workunit.client.0.smithi066.stdout:3/826: fsync d5/d35/d103/d1b/d45/d66/d67/d6d/fa1 0 2024-09-12T01:43:21.776 INFO:tasks.workunit.client.0.smithi066.stdout:5/941: symlink d0/d26/d2d/d42/d95/dc0/l12d 0 2024-09-12T01:43:21.780 INFO:tasks.workunit.client.0.smithi066.stdout:3/827: dread d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f10c [0,4194304] 0 2024-09-12T01:43:21.781 INFO:tasks.workunit.client.0.smithi066.stdout:7/800: creat d2/d3c/d103/f110 x:0 0 0 2024-09-12T01:43:21.781 INFO:tasks.workunit.client.0.smithi066.stdout:7/801: readlink d2/d5/da/d3f/da4/d6c/d8e/lfe 0 2024-09-12T01:43:21.781 INFO:tasks.workunit.client.0.smithi066.stdout:7/802: dread - d2/d5/da/d3f/da4/fce zero size 2024-09-12T01:43:21.784 INFO:tasks.workunit.client.0.smithi066.stdout:5/942: truncate d0/dd/d18/fac 1968142 0 2024-09-12T01:43:21.784 INFO:tasks.workunit.client.0.smithi066.stdout:5/943: chown d0/dd/d18/d36/dbf/dce/da5/fe0 10 1 2024-09-12T01:43:21.784 INFO:tasks.workunit.client.0.smithi066.stdout:5/944: readlink d0/dd/l1c 0 2024-09-12T01:43:21.785 INFO:tasks.workunit.client.0.smithi066.stdout:6/869: dwrite d2/d99/d72/d87/fc3 [0,4194304] 0 2024-09-12T01:43:21.790 INFO:tasks.workunit.client.0.smithi066.stdout:3/828: write d5/ff [2303191,63670] 0 2024-09-12T01:43:21.792 INFO:tasks.workunit.client.0.smithi066.stdout:7/803: dread d2/d5/da/d3f/da4/d6c/d80/d7c/f97 [0,4194304] 0 2024-09-12T01:43:21.803 INFO:tasks.workunit.client.0.smithi066.stdout:9/766: sync 2024-09-12T01:43:21.803 INFO:tasks.workunit.client.0.smithi066.stdout:4/824: sync 2024-09-12T01:43:21.813 INFO:tasks.workunit.client.0.smithi066.stdout:6/870: dwrite d2/d21/f7c [0,4194304] 0 2024-09-12T01:43:21.826 INFO:tasks.workunit.client.0.smithi066.stdout:6/871: symlink d2/d99/d72/l123 0 2024-09-12T01:43:21.827 INFO:tasks.workunit.client.0.smithi066.stdout:6/872: truncate d2/d99/d12/d1d/df4/d11b/f122 802943 0 2024-09-12T01:43:21.827 INFO:tasks.workunit.client.0.smithi066.stdout:6/873: dread - d2/d99/fc1 zero size 2024-09-12T01:43:21.827 INFO:tasks.workunit.client.0.smithi066.stdout:6/874: dread - d2/d99/d12/fcd zero size 2024-09-12T01:43:21.827 INFO:tasks.workunit.client.0.smithi066.stdout:5/945: dwrite d0/dd/d18/d36/dbf/f128 [0,4194304] 0 2024-09-12T01:43:21.827 INFO:tasks.workunit.client.0.smithi066.stdout:7/804: dwrite d2/fcc [0,4194304] 0 2024-09-12T01:43:21.828 INFO:tasks.workunit.client.0.smithi066.stdout:6/875: mknod d2/d99/d7b/ddf/c124 0 2024-09-12T01:43:21.831 INFO:tasks.workunit.client.0.smithi066.stdout:3/829: dwrite d5/d35/d103/d1b/d45/d66/d67/d7f/da8/df6/ffe [0,4194304] 0 2024-09-12T01:43:21.831 INFO:tasks.workunit.client.0.smithi066.stdout:3/830: chown d5/l6e 5163423 1 2024-09-12T01:43:21.831 INFO:tasks.workunit.client.0.smithi066.stdout:3/831: chown d5/d35/d103/d1b/d65/d89/fb1 10128592 1 2024-09-12T01:43:21.832 INFO:tasks.workunit.client.0.smithi066.stdout:4/825: dwrite d4/d15/d33/f90 [0,4194304] 0 2024-09-12T01:43:21.832 INFO:tasks.workunit.client.0.smithi066.stdout:4/826: chown d4/d6/d27/l49 45 1 2024-09-12T01:43:21.832 INFO:tasks.workunit.client.0.smithi066.stdout:4/827: chown d4/d6/d27/d66/d6c/fd9 124263 1 2024-09-12T01:43:21.832 INFO:tasks.workunit.client.0.smithi066.stdout:7/805: truncate d2/d5/da/d3f/da4/d6c/d80/f58 6349175 0 2024-09-12T01:43:21.832 INFO:tasks.workunit.client.0.smithi066.stdout:7/806: fsync d2/d5/d6/d40/d63/fa1 0 2024-09-12T01:43:21.846 INFO:tasks.workunit.client.0.smithi066.stdout:5/946: dwrite d0/d26/d2d/d33/f121 [0,4194304] 0 2024-09-12T01:43:21.846 INFO:tasks.workunit.client.0.smithi066.stdout:5/947: fsync d0/d26/f6f 0 2024-09-12T01:43:21.846 INFO:tasks.workunit.client.0.smithi066.stdout:3/832: rename d5/d35/d103/d1b/d65/d89/l1f to d5/d35/d103/d1b/d45/d85/dd2/l126 0 2024-09-12T01:43:21.846 INFO:tasks.workunit.client.0.smithi066.stdout:3/833: chown d5/d35/d103/d1b/d45/d66/c97 10622248 1 2024-09-12T01:43:21.850 INFO:tasks.workunit.client.0.smithi066.stdout:7/807: link d2/d3c/c102 d2/d5/d6/d22/dac/c111 0 2024-09-12T01:43:21.851 INFO:tasks.workunit.client.0.smithi066.stdout:6/876: getdents d2/d21/d92 0 2024-09-12T01:43:21.853 INFO:tasks.workunit.client.0.smithi066.stdout:4/828: dwrite d4/d6/d27/d66/d6c/fa0 [0,4194304] 0 2024-09-12T01:43:21.853 INFO:tasks.workunit.client.0.smithi066.stdout:8/810: sync 2024-09-12T01:43:21.853 INFO:tasks.workunit.client.0.smithi066.stdout:2/727: sync 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:8/811: write d12/d21/d2f/d57/d43/f46 [3897740,18843] 0 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:2/728: creat de/d13/d1e/d41/da8/ff0 x:0 0 0 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:1/809: sync 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:1/810: stat d5/dc/d36/ce0 0 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:0/872: sync 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:2/729: write de/d13/d1e/d22/d4f/fb4 [694492,69257] 0 2024-09-12T01:43:21.854 INFO:tasks.workunit.client.0.smithi066.stdout:2/730: readlink de/d13/d1e/l20 0 2024-09-12T01:43:21.856 INFO:tasks.workunit.client.0.smithi066.stdout:5/948: mknod d0/d26/d2d/d42/c12e 0 2024-09-12T01:43:21.858 INFO:tasks.workunit.client.0.smithi066.stdout:3/834: creat d5/d35/d103/d1b/d45/d66/d67/d7f/f127 x:0 0 0 2024-09-12T01:43:21.859 INFO:tasks.workunit.client.0.smithi066.stdout:7/808: dread d2/d5/da/d3f/d9b/d4d/f60 [0,4194304] 0 2024-09-12T01:43:21.860 INFO:tasks.workunit.client.0.smithi066.stdout:6/877: link d2/d99/d7b/ff1 d2/d99/d12/d49/d9e/f125 0 2024-09-12T01:43:21.865 INFO:tasks.workunit.client.0.smithi066.stdout:4/829: truncate d4/d15/d33/f5d 467838 0 2024-09-12T01:43:21.867 INFO:tasks.workunit.client.0.smithi066.stdout:1/811: unlink d5/d52/d5d/l6b 0 2024-09-12T01:43:21.869 INFO:tasks.workunit.client.0.smithi066.stdout:0/873: getdents d1/d62/d9f/d4a/d67/d1b/d26/d113 0 2024-09-12T01:43:21.870 INFO:tasks.workunit.client.0.smithi066.stdout:0/874: chown d1/d62/d9f/d4a/d67/f52 1285 1 2024-09-12T01:43:21.870 INFO:tasks.workunit.client.0.smithi066.stdout:0/875: chown d1/d62/d89/d83/d8b/fa5 5191086 1 2024-09-12T01:43:21.870 INFO:tasks.workunit.client.0.smithi066.stdout:0/876: truncate d1/d62/d9f/db4/fd6 360291 0 2024-09-12T01:43:21.870 INFO:tasks.workunit.client.0.smithi066.stdout:0/877: creat d1/d62/d9f/f12e x:0 0 0 2024-09-12T01:43:21.870 INFO:tasks.workunit.client.0.smithi066.stdout:0/878: fsync d1/d62/d9f/d64/ff3 0 2024-09-12T01:43:21.870 INFO:tasks.workunit.client.0.smithi066.stdout:0/879: dread - d1/d62/d9f/d4a/d67/d1b/d61/f114 zero size 2024-09-12T01:43:21.871 INFO:tasks.workunit.client.0.smithi066.stdout:2/731: symlink de/d13/d9c/lf1 0 2024-09-12T01:43:21.871 INFO:tasks.workunit.client.0.smithi066.stdout:2/732: fsync de/d13/d28/f8e 0 2024-09-12T01:43:21.872 INFO:tasks.workunit.client.0.smithi066.stdout:5/949: dwrite d0/d26/d2d/d33/d55/d73/d74/f93 [0,4194304] 0 2024-09-12T01:43:21.873 INFO:tasks.workunit.client.0.smithi066.stdout:3/835: truncate d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f51 3649376 0 2024-09-12T01:43:21.873 INFO:tasks.workunit.client.0.smithi066.stdout:3/836: chown d5/d35/d103/d1b/d45/fd0 10628 1 2024-09-12T01:43:21.874 INFO:tasks.workunit.client.0.smithi066.stdout:7/809: mkdir d2/d5/d6/d81/dc8/d53/d112 0 2024-09-12T01:43:21.877 INFO:tasks.workunit.client.0.smithi066.stdout:6/878: rename d2/d99/f2d to d2/d99/d12/f126 0 2024-09-12T01:43:21.878 INFO:tasks.workunit.client.0.smithi066.stdout:1/812: mkdir d5/dc/d53/dae/df4 0 2024-09-12T01:43:21.883 INFO:tasks.workunit.client.0.smithi066.stdout:3/837: dread f2 [0,4194304] 0 2024-09-12T01:43:21.886 INFO:tasks.workunit.client.0.smithi066.stdout:5/950: rmdir d0/dd/d18/d36/dbf/dce/d3b/d98/dde/deb 0 2024-09-12T01:43:21.889 INFO:tasks.workunit.client.0.smithi066.stdout:2/733: dwrite de/d13/f1f [0,4194304] 0 2024-09-12T01:43:21.891 INFO:tasks.workunit.client.0.smithi066.stdout:4/830: rename d4/d6/d27/d66/d58/f8d to d4/d6/d8/d4a/df0/f115 0 2024-09-12T01:43:21.892 INFO:tasks.workunit.client.0.smithi066.stdout:1/813: rmdir d5/dc/d36 39 2024-09-12T01:43:21.893 INFO:tasks.workunit.client.0.smithi066.stdout:1/814: chown d5/d52/d60/c92 242300 1 2024-09-12T01:43:21.895 INFO:tasks.workunit.client.0.smithi066.stdout:0/880: rmdir d1/d62/d9f/db4 39 2024-09-12T01:43:21.896 INFO:tasks.workunit.client.0.smithi066.stdout:5/951: mkdir d0/d26/d2d/d33/dec/d10a/d12f 0 2024-09-12T01:43:21.897 INFO:tasks.workunit.client.0.smithi066.stdout:5/952: dread - d0/dd/d18/d36/dbf/f102 zero size 2024-09-12T01:43:21.897 INFO:tasks.workunit.client.0.smithi066.stdout:6/879: write d2/fe [2041724,59633] 0 2024-09-12T01:43:21.897 INFO:tasks.workunit.client.0.smithi066.stdout:6/880: chown d2/f97 30600429 1 2024-09-12T01:43:21.899 INFO:tasks.workunit.client.0.smithi066.stdout:2/734: dread de/d13/d1e/d22/f54 [0,4194304] 0 2024-09-12T01:43:21.899 INFO:tasks.workunit.client.0.smithi066.stdout:2/735: fsync de/d13/d1e/fb0 0 2024-09-12T01:43:21.899 INFO:tasks.workunit.client.0.smithi066.stdout:2/736: write de/d13/d28/f8e [2293173,49933] 0 2024-09-12T01:43:21.899 INFO:tasks.workunit.client.0.smithi066.stdout:2/737: write de/fe2 [754606,25043] 0 2024-09-12T01:43:21.905 INFO:tasks.workunit.client.0.smithi066.stdout:3/838: dwrite d5/d35/d103/d1b/d77/f7c [0,4194304] 0 2024-09-12T01:43:21.910 INFO:tasks.workunit.client.0.smithi066.stdout:6/881: write d2/d99/d7b/df8/d57/fc5 [1146698,95667] 0 2024-09-12T01:43:21.910 INFO:tasks.workunit.client.0.smithi066.stdout:7/810: rmdir d2/d5/d6 39 2024-09-12T01:43:21.912 INFO:tasks.workunit.client.0.smithi066.stdout:4/831: rename d4/d6/d14/fca to d4/d6/d8/d4a/df0/f116 0 2024-09-12T01:43:21.912 INFO:tasks.workunit.client.0.smithi066.stdout:4/832: creat d4/d15/d33/d5e/f117 x:0 0 0 2024-09-12T01:43:21.912 INFO:tasks.workunit.client.0.smithi066.stdout:1/815: rmdir d5/dc/d36/ddd 39 2024-09-12T01:43:21.914 INFO:tasks.workunit.client.0.smithi066.stdout:0/881: mknod d1/d62/d9f/d92/db9/ded/c12f 0 2024-09-12T01:43:21.914 INFO:tasks.workunit.client.0.smithi066.stdout:5/953: mknod d0/dd/d18/d36/dbf/dce/d3b/d98/dde/c130 0 2024-09-12T01:43:21.914 INFO:tasks.workunit.client.0.smithi066.stdout:5/954: write d0/dd/d18/d36/dbf/dce/f58 [1051566,129095] 0 2024-09-12T01:43:21.923 INFO:tasks.workunit.client.0.smithi066.stdout:0/882: write d1/d72/de/f19 [5066560,89308] 0 2024-09-12T01:43:21.970 INFO:tasks.workunit.client.0.smithi066.stdout:2/738: fsync de/d13/d1e/d25/f29 0 2024-09-12T01:43:21.970 INFO:tasks.workunit.client.0.smithi066.stdout:2/739: fdatasync de/d13/d1e/d22/f54 0 2024-09-12T01:43:21.978 INFO:tasks.workunit.client.0.smithi066.stdout:3/839: rmdir d5/d35/d103/d1b/d45/d66/d5c 39 2024-09-12T01:43:21.979 INFO:tasks.workunit.client.0.smithi066.stdout:3/840: dread - d5/d35/d103/d1b/d45/d66/fd8 zero size 2024-09-12T01:43:21.983 INFO:tasks.workunit.client.0.smithi066.stdout:7/811: creat d2/d5/d6/d81/dc8/f113 x:0 0 0 2024-09-12T01:43:21.995 INFO:tasks.workunit.client.0.smithi066.stdout:1/816: symlink d5/dc/d36/d57/dac/dc4/lf5 0 2024-09-12T01:43:21.998 INFO:tasks.workunit.client.0.smithi066.stdout:5/955: mkdir d0/d26/de3/d131 0 2024-09-12T01:43:22.006 INFO:tasks.workunit.client.0.smithi066.stdout:7/812: dwrite d2/d5/da/f36 [0,4194304] 0 2024-09-12T01:43:22.008 INFO:tasks.workunit.client.0.smithi066.stdout:7/813: dread d2/d5/d6/d81/dc8/d53/fdb [0,4194304] 0 2024-09-12T01:43:22.061 INFO:tasks.workunit.client.0.smithi066.stdout:0/883: rmdir d1/d62/d89/d83/d8b 39 2024-09-12T01:43:22.069 INFO:tasks.workunit.client.0.smithi066.stdout:0/884: write d1/d62/d9f/fea [1267199,42133] 0 2024-09-12T01:43:22.077 INFO:tasks.workunit.client.0.smithi066.stdout:0/885: dread d1/d62/d9f/d7c/f102 [0,4194304] 0 2024-09-12T01:43:22.078 INFO:tasks.workunit.client.0.smithi066.stdout:6/882: rename d2/d21/d92/f107 to d2/d99/d72/d87/f127 0 2024-09-12T01:43:22.085 INFO:tasks.workunit.client.0.smithi066.stdout:6/883: read d2/d99/d72/ffb [1041382,79725] 0 2024-09-12T01:43:22.097 INFO:tasks.workunit.client.0.smithi066.stdout:2/740: creat de/d13/d1e/d22/de5/ff2 x:0 0 0 2024-09-12T01:43:22.101 INFO:tasks.workunit.client.0.smithi066.stdout:1/817: symlink d5/dc/d36/ddd/lf6 0 2024-09-12T01:43:22.104 INFO:tasks.workunit.client.0.smithi066.stdout:6/884: dwrite d2/d99/d12/d1d/f91 [4194304,4194304] 0 2024-09-12T01:43:22.108 INFO:tasks.workunit.client.0.smithi066.stdout:5/956: creat d0/dd/d18/d36/dbf/dce/dd5/f132 x:0 0 0 2024-09-12T01:43:22.113 INFO:tasks.workunit.client.0.smithi066.stdout:7/814: mknod d2/d5/d6/d22/d75/db6/c114 0 2024-09-12T01:43:22.114 INFO:tasks.workunit.client.0.smithi066.stdout:2/741: unlink de/d13/d1e/d22/de5/ff2 0 2024-09-12T01:43:22.114 INFO:tasks.workunit.client.0.smithi066.stdout:2/742: dread de/d13/d1e/fb0 [0,4194304] 0 2024-09-12T01:43:22.114 INFO:tasks.workunit.client.0.smithi066.stdout:6/885: unlink d2/d99/d12/d1d/d6b/f89 0 2024-09-12T01:43:22.114 INFO:tasks.workunit.client.0.smithi066.stdout:6/886: chown d2/d99/d72/d76/c10a 127780 1 2024-09-12T01:43:22.116 INFO:tasks.workunit.client.0.smithi066.stdout:5/957: creat d0/d26/d2d/d33/db0/f133 x:0 0 0 2024-09-12T01:43:22.116 INFO:tasks.workunit.client.0.smithi066.stdout:5/958: chown d0/dd/d18/d36/dbf/dce/d3b 778802 1 2024-09-12T01:43:22.117 INFO:tasks.workunit.client.0.smithi066.stdout:4/833: write d4/d6/d27/d2f/f87 [734604,86454] 0 2024-09-12T01:43:22.118 INFO:tasks.workunit.client.0.smithi066.stdout:7/815: write d2/d5/da/d3f/da4/d6c/d80/d7c/ff1 [494264,33361] 0 2024-09-12T01:43:22.118 INFO:tasks.workunit.client.0.smithi066.stdout:6/887: creat d2/d99/d7b/d11c/f128 x:0 0 0 2024-09-12T01:43:22.120 INFO:tasks.workunit.client.0.smithi066.stdout:4/834: rmdir d4/d15/dbd 39 2024-09-12T01:43:22.122 INFO:tasks.workunit.client.0.smithi066.stdout:6/888: creat d2/d99/d12/d49/d9e/f129 x:0 0 0 2024-09-12T01:43:22.122 INFO:tasks.workunit.client.0.smithi066.stdout:4/835: mkdir d4/d6/d8/d4a/d118 0 2024-09-12T01:43:22.124 INFO:tasks.workunit.client.0.smithi066.stdout:6/889: symlink d2/d99/d7b/df8/d57/dfa/l12a 0 2024-09-12T01:43:22.124 INFO:tasks.workunit.client.0.smithi066.stdout:6/890: stat d2/d99/d7b/df8/d57/fc5 0 2024-09-12T01:43:22.124 INFO:tasks.workunit.client.0.smithi066.stdout:6/891: mknod d2/d99/d12/d1d/d6b/dbc/c12b 0 2024-09-12T01:43:22.127 INFO:tasks.workunit.client.0.smithi066.stdout:6/892: creat d2/d99/d12/d49/d120/f12c x:0 0 0 2024-09-12T01:43:22.128 INFO:tasks.workunit.client.0.smithi066.stdout:6/893: mknod d2/d99/d12/d49/d9e/c12d 0 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: pgmap v10: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 202 MiB/s rd, 261 MiB/s wr, 375 op/s 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi153 to 2581M 2024-09-12T01:43:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:21 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:22.140 INFO:tasks.workunit.client.0.smithi066.stdout:4/836: dwrite d4/d6/d8/f43 [4194304,4194304] 0 2024-09-12T01:43:22.141 INFO:tasks.workunit.client.0.smithi066.stdout:3/841: creat d5/d35/d103/f128 x:0 0 0 2024-09-12T01:43:22.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/837: mkdir d4/d84/dba/d119 0 2024-09-12T01:43:22.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/838: truncate d4/d6/d27/d66/d6c/fb5 1884623 0 2024-09-12T01:43:22.143 INFO:tasks.workunit.client.0.smithi066.stdout:4/839: write d4/d5f/f10c [659277,32972] 0 2024-09-12T01:43:22.143 INFO:tasks.workunit.client.0.smithi066.stdout:3/842: truncate d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/f90 3196321 0 2024-09-12T01:43:22.145 INFO:tasks.workunit.client.0.smithi066.stdout:4/840: mknod d4/d6/d8/d4a/d118/c11a 0 2024-09-12T01:43:22.145 INFO:tasks.workunit.client.0.smithi066.stdout:4/841: write d4/f52 [5036028,90326] 0 2024-09-12T01:43:22.146 INFO:tasks.workunit.client.0.smithi066.stdout:4/842: rename d4/d84/dba/d119 to d4/d6/d48/dd2/d11b 0 2024-09-12T01:43:22.146 INFO:tasks.workunit.client.0.smithi066.stdout:4/843: dread - d4/d15/d33/d5e/ff6 zero size 2024-09-12T01:43:22.150 INFO:tasks.workunit.client.0.smithi066.stdout:4/844: link d4/d6/d27/d66/d58/f77 d4/d6/d8/d18/d4d/f11c 0 2024-09-12T01:43:22.152 INFO:tasks.workunit.client.0.smithi066.stdout:4/845: mknod d4/d6/d8/d110/c11d 0 2024-09-12T01:43:22.152 INFO:tasks.workunit.client.0.smithi066.stdout:4/846: fdatasync d4/d6/d14/fa2 0 2024-09-12T01:43:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: pgmap v10: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 202 MiB/s rd, 261 MiB/s wr, 375 op/s 2024-09-12T01:43:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:22.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi153 to 2581M 2024-09-12T01:43:22.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:21 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:22.159 INFO:tasks.workunit.client.0.smithi066.stdout:3/843: dwrite f4 [0,4194304] 0 2024-09-12T01:43:22.162 INFO:tasks.workunit.client.0.smithi066.stdout:3/844: truncate d5/d35/d103/d1b/f3f 3882230 0 2024-09-12T01:43:22.162 INFO:tasks.workunit.client.0.smithi066.stdout:3/845: chown d5/d35/d103/d1b/l76 85869 1 2024-09-12T01:43:22.165 INFO:tasks.workunit.client.0.smithi066.stdout:3/846: creat d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/d105/f129 x:0 0 0 2024-09-12T01:43:22.166 INFO:tasks.workunit.client.0.smithi066.stdout:3/847: rmdir d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d86 39 2024-09-12T01:43:22.167 INFO:tasks.workunit.client.0.smithi066.stdout:3/848: rename d5/d35/d103/d48/ffa to d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/f12a 0 2024-09-12T01:43:22.168 INFO:tasks.workunit.client.0.smithi066.stdout:3/849: symlink d5/d35/d103/d1b/d45/d66/d67/d75/d8e/l12b 0 2024-09-12T01:43:22.170 INFO:tasks.workunit.client.0.smithi066.stdout:4/847: dwrite d4/d6/d27/d2f/d72/ff9 [0,4194304] 0 2024-09-12T01:43:22.170 INFO:tasks.workunit.client.0.smithi066.stdout:3/850: rmdir d5/d35/d103/d1b/d45/d66/d67/d75 39 2024-09-12T01:43:22.170 INFO:tasks.workunit.client.0.smithi066.stdout:3/851: chown d5/d35/d103/d1b/d65/d89/f72 2734191 1 2024-09-12T01:43:22.170 INFO:tasks.workunit.client.0.smithi066.stdout:3/852: truncate d5/d35/d103/d1b/d45/d66/f6c 608492 0 2024-09-12T01:43:22.171 INFO:tasks.workunit.client.0.smithi066.stdout:3/853: creat d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/d11a/f12c x:0 0 0 2024-09-12T01:43:22.173 INFO:tasks.workunit.client.0.smithi066.stdout:3/854: link d5/d35/d103/d1b/d77/d8b/cc9 d5/d35/d103/d48/d9c/c12d 0 2024-09-12T01:43:22.174 INFO:tasks.workunit.client.0.smithi066.stdout:3/855: creat d5/d35/f12e x:0 0 0 2024-09-12T01:43:22.176 INFO:tasks.workunit.client.0.smithi066.stdout:3/856: rename d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/fb8 to d5/d35/d103/d1b/d45/d66/d67/d7f/f12f 0 2024-09-12T01:43:22.176 INFO:tasks.workunit.client.0.smithi066.stdout:3/857: chown d5/d35/d103/d1b/d45/d66/d67/d7f/la0 356781175 1 2024-09-12T01:43:22.178 INFO:tasks.workunit.client.0.smithi066.stdout:3/858: dread d5/d35/d103/d1b/d45/d66/d67/d6d/f55 [0,4194304] 0 2024-09-12T01:43:22.178 INFO:tasks.workunit.client.0.smithi066.stdout:3/859: dread - d5/d35/d103/d1b/d45/d66/fd8 zero size 2024-09-12T01:43:22.183 INFO:tasks.workunit.client.0.smithi066.stdout:7/816: rmdir d2/d5/d6/d40 39 2024-09-12T01:43:22.183 INFO:tasks.workunit.client.0.smithi066.stdout:4/848: dwrite d4/f109 [0,4194304] 0 2024-09-12T01:43:22.184 INFO:tasks.workunit.client.0.smithi066.stdout:7/817: getdents d2/d3c/d103 0 2024-09-12T01:43:22.184 INFO:tasks.workunit.client.0.smithi066.stdout:7/818: readlink d2/d5/d6/d22/d75/l15 0 2024-09-12T01:43:22.188 INFO:tasks.workunit.client.0.smithi066.stdout:4/849: getdents d4/d15/dbd 0 2024-09-12T01:43:22.200 INFO:tasks.workunit.client.0.smithi066.stdout:5/959: creat d0/dd/d18/d36/d4c/f134 x:0 0 0 2024-09-12T01:43:22.201 INFO:tasks.workunit.client.0.smithi066.stdout:4/850: mkdir d4/d6/d62/d11e 0 2024-09-12T01:43:22.201 INFO:tasks.workunit.client.0.smithi066.stdout:4/851: getdents d4/d6/d48/dd2/df5 0 2024-09-12T01:43:22.202 INFO:tasks.workunit.client.0.smithi066.stdout:5/960: symlink d0/dd/d18/l135 0 2024-09-12T01:43:22.203 INFO:tasks.workunit.client.0.smithi066.stdout:4/852: mknod d4/d6/d48/dd2/c11f 0 2024-09-12T01:43:22.206 INFO:tasks.workunit.client.0.smithi066.stdout:3/860: dwrite f3 [4194304,4194304] 0 2024-09-12T01:43:22.209 INFO:tasks.workunit.client.0.smithi066.stdout:3/861: symlink d5/d35/d103/d1b/d45/d66/d5c/d101/l130 0 2024-09-12T01:43:22.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/862: symlink d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d86/l131 0 2024-09-12T01:43:22.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/863: write d5/d35/d103/d48/fdf [1584421,60175] 0 2024-09-12T01:43:22.211 INFO:tasks.workunit.client.0.smithi066.stdout:3/864: chown d5/d35/d103/d1b/d45/d66/d67/d6d/de6/l111 24 1 2024-09-12T01:43:22.216 INFO:tasks.workunit.client.0.smithi066.stdout:3/865: write d5/d35/d103/d1b/d45/d66/d5c/fe2 [2016986,102005] 0 2024-09-12T01:43:22.217 INFO:tasks.workunit.client.0.smithi066.stdout:3/866: mkdir d5/d35/d103/d1b/d77/d8b/d132 0 2024-09-12T01:43:22.217 INFO:tasks.workunit.client.0.smithi066.stdout:3/867: chown d5/d35/d103/d1b/d45/d66/d67/d6d 1 1 2024-09-12T01:43:22.218 INFO:tasks.workunit.client.0.smithi066.stdout:5/961: dwrite d0/d26/d2d/d31/f6a [0,4194304] 0 2024-09-12T01:43:22.220 INFO:tasks.workunit.client.0.smithi066.stdout:3/868: creat d5/d35/d103/d1b/d45/d85/f133 x:0 0 0 2024-09-12T01:43:22.220 INFO:tasks.workunit.client.0.smithi066.stdout:3/869: stat d5/d35/d103/d1b/d65/d89/c37 0 2024-09-12T01:43:22.224 INFO:tasks.workunit.client.0.smithi066.stdout:5/962: creat d0/dd/d18/d36/dbf/dce/d3b/d98/d10b/f136 x:0 0 0 2024-09-12T01:43:22.226 INFO:tasks.workunit.client.0.smithi066.stdout:5/963: mknod d0/d26/d2d/d33/d55/c137 0 2024-09-12T01:43:22.255 INFO:tasks.workunit.client.0.smithi066.stdout:7/819: mkdir d2/d115 0 2024-09-12T01:43:22.256 INFO:tasks.workunit.client.0.smithi066.stdout:7/820: mknod d2/d71/dad/c116 0 2024-09-12T01:43:22.256 INFO:tasks.workunit.client.0.smithi066.stdout:7/821: chown d2/d5/da/d3f/da4/d6c/d8e/ld1 27681 1 2024-09-12T01:43:22.256 INFO:tasks.workunit.client.0.smithi066.stdout:7/822: fsync d2/d5/d6/fbc 0 2024-09-12T01:43:22.256 INFO:tasks.workunit.client.0.smithi066.stdout:9/767: sync 2024-09-12T01:43:22.256 INFO:tasks.workunit.client.0.smithi066.stdout:8/812: sync 2024-09-12T01:43:22.259 INFO:tasks.workunit.client.0.smithi066.stdout:7/823: write d2/d5/da/d3f/da4/d6c/d80/d7c/f97 [609970,103380] 0 2024-09-12T01:43:22.261 INFO:tasks.workunit.client.0.smithi066.stdout:3/870: link d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/f90 d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f134 0 2024-09-12T01:43:22.261 INFO:tasks.workunit.client.0.smithi066.stdout:3/871: readlink d5/d35/d103/d1b/d45/d66/d67/d7f/la0 0 2024-09-12T01:43:22.261 INFO:tasks.workunit.client.0.smithi066.stdout:3/872: truncate d5/d35/d103/d1b/d45/d85/f133 291899 0 2024-09-12T01:43:22.264 INFO:tasks.workunit.client.0.smithi066.stdout:3/873: creat d5/d35/d103/d1b/d77/dd5/f135 x:0 0 0 2024-09-12T01:43:22.268 INFO:tasks.workunit.client.0.smithi066.stdout:4/853: rename d4/d6/d8/f1a to d4/f120 0 2024-09-12T01:43:22.270 INFO:tasks.workunit.client.0.smithi066.stdout:4/854: creat d4/d5f/dea/f121 x:0 0 0 2024-09-12T01:43:22.272 INFO:tasks.workunit.client.0.smithi066.stdout:4/855: creat d4/de5/f122 x:0 0 0 2024-09-12T01:43:22.274 INFO:tasks.workunit.client.0.smithi066.stdout:8/813: rename d12/d21/d2f/d57/d84/d50/d56/fba to d12/d21/d2f/f10e 0 2024-09-12T01:43:22.276 INFO:tasks.workunit.client.0.smithi066.stdout:3/874: rename d5/d35/d103/d1b/d45/d85/l98 to d5/d35/d103/d1b/d45/d66/dae/dd7/l136 0 2024-09-12T01:43:22.277 INFO:tasks.workunit.client.0.smithi066.stdout:3/875: creat d5/d35/d103/f137 x:0 0 0 2024-09-12T01:43:22.278 INFO:tasks.workunit.client.0.smithi066.stdout:4/856: rename d4/d6/f34 to d4/d6/d62/db0/f123 0 2024-09-12T01:43:22.278 INFO:tasks.workunit.client.0.smithi066.stdout:4/857: chown d4/d15/d33/fe1 255 1 2024-09-12T01:43:22.278 INFO:tasks.workunit.client.0.smithi066.stdout:4/858: chown d4/d6/d48/d88/f93 25627 1 2024-09-12T01:43:22.279 INFO:tasks.workunit.client.0.smithi066.stdout:3/876: creat d5/d35/d103/d1b/d45/d66/de7/f138 x:0 0 0 2024-09-12T01:43:22.280 INFO:tasks.workunit.client.0.smithi066.stdout:4/859: truncate d4/d6/d48/d88/f6b 93479 0 2024-09-12T01:43:22.281 INFO:tasks.workunit.client.0.smithi066.stdout:3/877: creat d5/f139 x:0 0 0 2024-09-12T01:43:22.282 INFO:tasks.workunit.client.0.smithi066.stdout:4/860: truncate d4/d6/d8/d4a/df0/f116 206996 0 2024-09-12T01:43:22.283 INFO:tasks.workunit.client.0.smithi066.stdout:3/878: creat d5/d35/d103/d1b/d45/d66/dae/dd7/f13a x:0 0 0 2024-09-12T01:43:22.284 INFO:tasks.workunit.client.0.smithi066.stdout:4/861: rename d4/d6/d48/d88/c68 to d4/d6/d27/d66/d58/c124 0 2024-09-12T01:43:22.284 INFO:tasks.workunit.client.0.smithi066.stdout:4/862: write d4/d6/d27/d2f/f91 [683017,76871] 0 2024-09-12T01:43:22.285 INFO:tasks.workunit.client.0.smithi066.stdout:4/863: mknod d4/d6/d8/d4a/d118/c125 0 2024-09-12T01:43:22.286 INFO:tasks.workunit.client.0.smithi066.stdout:3/879: getdents d5/d35/d103/d1b/d77/dd5/dbd/d112 0 2024-09-12T01:43:22.288 INFO:tasks.workunit.client.0.smithi066.stdout:3/880: getdents d5/d35/d103/d1b/d45/d66/d67/d6d/dc7 0 2024-09-12T01:43:22.289 INFO:tasks.workunit.client.0.smithi066.stdout:6/894: mknod d2/d99/d72/c12e 0 2024-09-12T01:43:22.291 INFO:tasks.workunit.client.0.smithi066.stdout:6/895: unlink d2/d99/d7b/df8/d57/la9 0 2024-09-12T01:43:22.292 INFO:tasks.workunit.client.0.smithi066.stdout:6/896: mknod d2/d99/d12/d49/d120/c12f 0 2024-09-12T01:43:22.292 INFO:tasks.workunit.client.0.smithi066.stdout:6/897: readlink d2/d99/d12/d1d/d6b/l6c 0 2024-09-12T01:43:22.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/743: unlink de/d13/d28/c40 0 2024-09-12T01:43:22.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/744: chown de/f15 436616 1 2024-09-12T01:43:22.293 INFO:tasks.workunit.client.0.smithi066.stdout:2/745: dread - de/d13/d1e/fbf zero size 2024-09-12T01:43:22.293 INFO:tasks.workunit.client.0.smithi066.stdout:6/898: symlink d2/d99/d7b/df8/d5e/l130 0 2024-09-12T01:43:22.296 INFO:tasks.workunit.client.0.smithi066.stdout:9/768: dwrite d0/d6/f13 [0,4194304] 0 2024-09-12T01:43:22.297 INFO:tasks.workunit.client.0.smithi066.stdout:1/818: unlink d5/dc/d53/l46 0 2024-09-12T01:43:22.297 INFO:tasks.workunit.client.0.smithi066.stdout:7/824: dwrite d2/d5/d6/d22/d75/fd4 [0,4194304] 0 2024-09-12T01:43:22.297 INFO:tasks.workunit.client.0.smithi066.stdout:8/814: dread d12/f19 [4194304,4194304] 0 2024-09-12T01:43:22.298 INFO:tasks.workunit.client.0.smithi066.stdout:2/746: link de/d13/d1e/d25/fc1 de/d13/d1e/d25/deb/ff3 0 2024-09-12T01:43:22.298 INFO:tasks.workunit.client.0.smithi066.stdout:2/747: write de/d13/d1e/d25/fc1 [2772,59746] 0 2024-09-12T01:43:22.298 INFO:tasks.workunit.client.0.smithi066.stdout:2/748: read - de/d13/d28/d3a/fe3 zero size 2024-09-12T01:43:22.298 INFO:tasks.workunit.client.0.smithi066.stdout:6/899: rmdir d2/d99/d12/d49/d9e 39 2024-09-12T01:43:22.299 INFO:tasks.workunit.client.0.smithi066.stdout:3/881: write d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/f90 [339221,27375] 0 2024-09-12T01:43:22.300 INFO:tasks.workunit.client.0.smithi066.stdout:9/769: creat d0/d6/d17/d1b/d4c/d42/d10c/f10e x:0 0 0 2024-09-12T01:43:22.305 INFO:tasks.workunit.client.0.smithi066.stdout:7/825: mkdir d2/d5/da/d3f/da4/d6c/ddf/d117 0 2024-09-12T01:43:22.307 INFO:tasks.workunit.client.0.smithi066.stdout:2/749: link de/d13/f80 de/d13/d1e/d41/d58/ff4 0 2024-09-12T01:43:22.307 INFO:tasks.workunit.client.0.smithi066.stdout:2/750: truncate de/d13/d7f/fac 26213 0 2024-09-12T01:43:22.307 INFO:tasks.workunit.client.0.smithi066.stdout:2/751: write de/d13/d1e/d41/d58/ff4 [144713,67600] 0 2024-09-12T01:43:22.307 INFO:tasks.workunit.client.0.smithi066.stdout:6/900: creat d2/d99/d12/d1d/d6b/dbc/f131 x:0 0 0 2024-09-12T01:43:22.311 INFO:tasks.workunit.client.0.smithi066.stdout:9/770: mkdir d0/d6/d17/d1b/de9/df9/d10f 0 2024-09-12T01:43:22.312 INFO:tasks.workunit.client.0.smithi066.stdout:3/882: dwrite d5/d35/d103/d1b/d45/d66/d67/d7f/da8/df6/f11c [0,4194304] 0 2024-09-12T01:43:22.312 INFO:tasks.workunit.client.0.smithi066.stdout:3/883: write d5/d35/d103/d1b/d45/d66/dae/dd7/de8/ff4 [823454,111699] 0 2024-09-12T01:43:22.315 INFO:tasks.workunit.client.0.smithi066.stdout:7/826: write d2/d5/da/d3f/da4/d6c/d80/d7c/fff [206151,110307] 0 2024-09-12T01:43:22.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/752: dread de/d13/d1e/d41/da8/fd5 [0,4194304] 0 2024-09-12T01:43:22.319 INFO:tasks.workunit.client.0.smithi066.stdout:2/753: write de/d13/d28/f56 [776718,105565] 0 2024-09-12T01:43:22.320 INFO:tasks.workunit.client.0.smithi066.stdout:6/901: truncate d2/d99/d12/f10c 576015 0 2024-09-12T01:43:22.324 INFO:tasks.workunit.client.0.smithi066.stdout:9/771: rmdir d0/d6/d7f/d90 39 2024-09-12T01:43:22.327 INFO:tasks.workunit.client.0.smithi066.stdout:3/884: link d5/d35/d103/d1b/d65/d89/d50/l95 d5/d35/d103/d1b/d45/d66/d67/d75/l13b 0 2024-09-12T01:43:22.329 INFO:tasks.workunit.client.0.smithi066.stdout:1/819: rename d5/d52/d5d to d5/dc/d36/df7 0 2024-09-12T01:43:22.329 INFO:tasks.workunit.client.0.smithi066.stdout:1/820: write d5/d15/fad [5240155,62424] 0 2024-09-12T01:43:22.329 INFO:tasks.workunit.client.0.smithi066.stdout:1/821: fsync d5/d15/d4d/d86/dc7/fe7 0 2024-09-12T01:43:22.331 INFO:tasks.workunit.client.0.smithi066.stdout:2/754: dread de/f1d [0,4194304] 0 2024-09-12T01:43:22.331 INFO:tasks.workunit.client.0.smithi066.stdout:7/827: rmdir d2/d5/da/d3f/d9b/d109 0 2024-09-12T01:43:22.333 INFO:tasks.workunit.client.0.smithi066.stdout:6/902: symlink d2/d99/d12/d1d/d6b/dc6/dd9/l132 0 2024-09-12T01:43:22.334 INFO:tasks.workunit.client.0.smithi066.stdout:9/772: symlink d0/d6/d17/d1b/de9/df9/d10f/l110 0 2024-09-12T01:43:22.337 INFO:tasks.workunit.client.0.smithi066.stdout:3/885: rename d5/d35/d103/d1b/d45/d66/d67/d6d/de6 to d5/d35/d103/d1b/d77/dd5/d13c 0 2024-09-12T01:43:22.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/755: creat de/d13/d28/d3a/ff5 x:0 0 0 2024-09-12T01:43:22.340 INFO:tasks.workunit.client.0.smithi066.stdout:2/756: readlink de/d13/d28/d3a/dd4/le1 0 2024-09-12T01:43:22.340 INFO:tasks.workunit.client.0.smithi066.stdout:4/864: rmdir d4/de5 39 2024-09-12T01:43:22.340 INFO:tasks.workunit.client.0.smithi066.stdout:4/865: fdatasync d4/d15/f94 0 2024-09-12T01:43:22.340 INFO:tasks.workunit.client.0.smithi066.stdout:4/866: fdatasync d4/d6/d8/d18/d4d/f11c 0 2024-09-12T01:43:22.341 INFO:tasks.workunit.client.0.smithi066.stdout:4/867: readlink d4/d6/d27/d2f/d72/lce 0 2024-09-12T01:43:22.343 INFO:tasks.workunit.client.0.smithi066.stdout:7/828: creat d2/d3c/d100/f118 x:0 0 0 2024-09-12T01:43:22.343 INFO:tasks.workunit.client.0.smithi066.stdout:7/829: dread - d2/d5/da/d3f/f101 zero size 2024-09-12T01:43:22.344 INFO:tasks.workunit.client.0.smithi066.stdout:6/903: unlink d2/d99/d72/d76/c10a 0 2024-09-12T01:43:22.345 INFO:tasks.workunit.client.0.smithi066.stdout:6/904: dread - d2/d99/d12/fcd zero size 2024-09-12T01:43:22.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/773: creat d0/d6/d17/d1b/d4c/d4b/f111 x:0 0 0 2024-09-12T01:43:22.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/774: chown d0/d6/d17/d1b/da2/dae/dc2 30613918 1 2024-09-12T01:43:22.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/775: write d0/d6/d17/d28/d79/ffb [4842858,82897] 0 2024-09-12T01:43:22.349 INFO:tasks.workunit.client.0.smithi066.stdout:2/757: rename de/d13/d1e/d25/f2b to de/d13/d28/ff6 0 2024-09-12T01:43:22.352 INFO:tasks.workunit.client.0.smithi066.stdout:4/868: unlink d4/d6/d8/cfb 0 2024-09-12T01:43:22.352 INFO:tasks.workunit.client.0.smithi066.stdout:4/869: fdatasync d4/d6/d27/d66/d6c/fb5 0 2024-09-12T01:43:22.352 INFO:tasks.workunit.client.0.smithi066.stdout:4/870: readlink d4/d6/d8/d4a/lcc 0 2024-09-12T01:43:22.353 INFO:tasks.workunit.client.0.smithi066.stdout:6/905: mkdir d2/d99/d12/d49/d120/d133 0 2024-09-12T01:43:22.356 INFO:tasks.workunit.client.0.smithi066.stdout:3/886: mkdir d5/d13d 0 2024-09-12T01:43:22.357 INFO:tasks.workunit.client.0.smithi066.stdout:4/871: getdents d4/d6/d27/d66/d6c 0 2024-09-12T01:43:22.359 INFO:tasks.workunit.client.0.smithi066.stdout:6/906: creat d2/d99/d72/d87/f134 x:0 0 0 2024-09-12T01:43:22.361 INFO:tasks.workunit.client.0.smithi066.stdout:6/907: truncate d2/f1a 938856 0 2024-09-12T01:43:22.365 INFO:tasks.workunit.client.0.smithi066.stdout:1/822: dwrite d5/f6d [4194304,4194304] 0 2024-09-12T01:43:22.365 INFO:tasks.workunit.client.0.smithi066.stdout:6/908: mknod d2/d99/d12/d1d/d6b/dc6/c135 0 2024-09-12T01:43:22.365 INFO:tasks.workunit.client.0.smithi066.stdout:7/830: dwrite d2/d3c/d103/f110 [0,4194304] 0 2024-09-12T01:43:22.368 INFO:tasks.workunit.client.0.smithi066.stdout:2/758: dread de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:22.369 INFO:tasks.workunit.client.0.smithi066.stdout:6/909: rename d2/d99/d7b/df8/d57/l65 to d2/d99/d7b/ddb/l136 0 2024-09-12T01:43:22.372 INFO:tasks.workunit.client.0.smithi066.stdout:7/831: mknod d2/d71/c119 0 2024-09-12T01:43:22.373 INFO:tasks.workunit.client.0.smithi066.stdout:2/759: write de/d13/d1e/d25/f33 [822034,116318] 0 2024-09-12T01:43:22.373 INFO:tasks.workunit.client.0.smithi066.stdout:2/760: fdatasync de/d13/d28/d3a/f6b 0 2024-09-12T01:43:22.373 INFO:tasks.workunit.client.0.smithi066.stdout:2/761: readlink de/l2e 0 2024-09-12T01:43:22.378 INFO:tasks.workunit.client.0.smithi066.stdout:7/832: rename d2/d5/d6/d40/d51/f72 to d2/d3c/d100/f11a 0 2024-09-12T01:43:22.379 INFO:tasks.workunit.client.0.smithi066.stdout:1/823: dread d5/dc/f10 [0,4194304] 0 2024-09-12T01:43:22.379 INFO:tasks.workunit.client.0.smithi066.stdout:9/776: dread d0/d6/d17/d28/d79/ffb [0,4194304] 0 2024-09-12T01:43:22.380 INFO:tasks.workunit.client.0.smithi066.stdout:7/833: mkdir d2/d5/da/d3f/d9b/df7/d11b 0 2024-09-12T01:43:22.381 INFO:tasks.workunit.client.0.smithi066.stdout:1/824: mkdir d5/dc/d53/df8 0 2024-09-12T01:43:22.381 INFO:tasks.workunit.client.0.smithi066.stdout:4/872: dwrite d4/d15/d33/d5e/f117 [0,4194304] 0 2024-09-12T01:43:22.381 INFO:tasks.workunit.client.0.smithi066.stdout:4/873: chown d4/f16 239114 1 2024-09-12T01:43:22.382 INFO:tasks.workunit.client.0.smithi066.stdout:3/887: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f4e [0,4194304] 0 2024-09-12T01:43:22.384 INFO:tasks.workunit.client.0.smithi066.stdout:9/777: mknod d0/d6/d7f/dd2/c112 0 2024-09-12T01:43:22.387 INFO:tasks.workunit.client.0.smithi066.stdout:7/834: mkdir d2/d5/d6/d22/d75/d11c 0 2024-09-12T01:43:22.389 INFO:tasks.workunit.client.0.smithi066.stdout:6/910: dread d2/d99/d7b/df8/d57/fc5 [0,4194304] 0 2024-09-12T01:43:22.389 INFO:tasks.workunit.client.0.smithi066.stdout:6/911: chown d2/d99/d12/d1d/d6b/c98 1033155 1 2024-09-12T01:43:22.390 INFO:tasks.workunit.client.0.smithi066.stdout:1/825: rmdir d5/dc/d53/df8 0 2024-09-12T01:43:22.393 INFO:tasks.workunit.client.0.smithi066.stdout:2/762: dwrite de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:22.393 INFO:tasks.workunit.client.0.smithi066.stdout:2/763: write de/d3c/d8f/fc0 [643502,5405] 0 2024-09-12T01:43:22.397 INFO:tasks.workunit.client.0.smithi066.stdout:4/874: rename d4/d6/d27/d66/d58/l6e to d4/d84/l126 0 2024-09-12T01:43:22.400 INFO:tasks.workunit.client.0.smithi066.stdout:6/912: mkdir d2/d21/d137 0 2024-09-12T01:43:22.403 INFO:tasks.workunit.client.0.smithi066.stdout:1/826: creat d5/dc/d36/de8/d8e/de2/ff9 x:0 0 0 2024-09-12T01:43:22.403 INFO:tasks.workunit.client.0.smithi066.stdout:1/827: stat d5/d52/d60/l76 0 2024-09-12T01:43:22.403 INFO:tasks.workunit.client.0.smithi066.stdout:1/828: readlink d5/l2e 0 2024-09-12T01:43:22.403 INFO:tasks.workunit.client.0.smithi066.stdout:1/829: write d5/f87 [129101,32648] 0 2024-09-12T01:43:22.404 INFO:tasks.workunit.client.0.smithi066.stdout:2/764: creat de/d13/d7f/ff7 x:0 0 0 2024-09-12T01:43:22.406 INFO:tasks.workunit.client.0.smithi066.stdout:7/835: rmdir d2/d5/da/d3f/da4/d6c/d8e 39 2024-09-12T01:43:22.410 INFO:tasks.workunit.client.0.smithi066.stdout:1/830: mknod d5/dc/d36/de8/d8e/cfa 0 2024-09-12T01:43:22.411 INFO:tasks.workunit.client.0.smithi066.stdout:4/875: dread d4/d84/dba/f102 [0,4194304] 0 2024-09-12T01:43:22.411 INFO:tasks.workunit.client.0.smithi066.stdout:9/778: dwrite d0/fe4 [0,4194304] 0 2024-09-12T01:43:22.411 INFO:tasks.workunit.client.0.smithi066.stdout:3/888: dwrite d5/d35/d103/d1b/d45/fd0 [0,4194304] 0 2024-09-12T01:43:22.414 INFO:tasks.workunit.client.0.smithi066.stdout:7/836: link d2/d5/da/d3f/da4/f8f d2/d5/da/d3f/da4/d6c/ddf/f11d 0 2024-09-12T01:43:22.415 INFO:tasks.workunit.client.0.smithi066.stdout:6/913: symlink d2/d99/d72/d76/l138 0 2024-09-12T01:43:22.415 INFO:tasks.workunit.client.0.smithi066.stdout:6/914: fdatasync d2/d99/fa1 0 2024-09-12T01:43:22.417 INFO:tasks.workunit.client.0.smithi066.stdout:1/831: mkdir d5/d52/d60/dfb 0 2024-09-12T01:43:22.420 INFO:tasks.workunit.client.0.smithi066.stdout:2/765: dread de/fa7 [0,4194304] 0 2024-09-12T01:43:22.420 INFO:tasks.workunit.client.0.smithi066.stdout:4/876: symlink d4/de5/l127 0 2024-09-12T01:43:22.427 INFO:tasks.workunit.client.0.smithi066.stdout:4/877: dread d4/d6/d8/f43 [0,4194304] 0 2024-09-12T01:43:22.427 INFO:tasks.workunit.client.0.smithi066.stdout:4/878: chown d4/d6/d62/lbb 401949 1 2024-09-12T01:43:22.428 INFO:tasks.workunit.client.0.smithi066.stdout:4/879: truncate d4/d6/d8/d4a/df0/f116 627864 0 2024-09-12T01:43:22.429 INFO:tasks.workunit.client.0.smithi066.stdout:3/889: dwrite d5/d35/d103/d1b/d45/d66/d67/d7f/fe9 [0,4194304] 0 2024-09-12T01:43:22.432 INFO:tasks.workunit.client.0.smithi066.stdout:9/779: mkdir d0/d6/d17/d1b/d4c/d4b/d113 0 2024-09-12T01:43:22.432 INFO:tasks.workunit.client.0.smithi066.stdout:9/780: truncate d0/d6/d17/d1b/d4c/d42/d10c/f10e 1031 0 2024-09-12T01:43:22.432 INFO:tasks.workunit.client.0.smithi066.stdout:9/781: creat d0/d6/d17/d1b/d4c/d42/d10c/f114 x:0 0 0 2024-09-12T01:43:22.438 INFO:tasks.workunit.client.0.smithi066.stdout:7/837: truncate d2/d5/da/f36 2030909 0 2024-09-12T01:43:22.438 INFO:tasks.workunit.client.0.smithi066.stdout:7/838: chown d2/d5/d6/f26 7389 1 2024-09-12T01:43:22.439 INFO:tasks.workunit.client.0.smithi066.stdout:6/915: truncate d2/d99/d12/f90 3902976 0 2024-09-12T01:43:22.440 INFO:tasks.workunit.client.0.smithi066.stdout:1/832: mkdir d5/dc/d36/d57/dac/dd5/dfc 0 2024-09-12T01:43:22.440 INFO:tasks.workunit.client.0.smithi066.stdout:1/833: truncate d5/dc/d36/de8/d8e/de2/dbc/fd9 757849 0 2024-09-12T01:43:22.441 INFO:tasks.workunit.client.0.smithi066.stdout:2/766: truncate de/d13/d1e/d25/d5e/f85 733743 0 2024-09-12T01:43:22.441 INFO:tasks.workunit.client.0.smithi066.stdout:2/767: read de/d3c/f4a [2515716,81391] 0 2024-09-12T01:43:22.441 INFO:tasks.workunit.client.0.smithi066.stdout:2/768: chown de/d13/d28/d3d 51587 1 2024-09-12T01:43:22.441 INFO:tasks.workunit.client.0.smithi066.stdout:2/769: write de/d13/d28/d3a/f83 [261297,105285] 0 2024-09-12T01:43:22.442 INFO:tasks.workunit.client.0.smithi066.stdout:2/770: chown de/d13/d1e/d25/da2 31 1 2024-09-12T01:43:22.443 INFO:tasks.workunit.client.0.smithi066.stdout:4/880: dwrite d4/d6/d8/d4a/ffa [0,4194304] 0 2024-09-12T01:43:22.450 INFO:tasks.workunit.client.0.smithi066.stdout:3/890: creat d5/d35/d103/d1b/d77/dd5/dcf/f13e x:0 0 0 2024-09-12T01:43:22.450 INFO:tasks.workunit.client.0.smithi066.stdout:3/891: fdatasync f2 0 2024-09-12T01:43:22.450 INFO:tasks.workunit.client.0.smithi066.stdout:3/892: truncate d5/d35/d103/d1b/d45/f119 198062 0 2024-09-12T01:43:22.450 INFO:tasks.workunit.client.0.smithi066.stdout:3/893: creat d5/d35/d103/f13f x:0 0 0 2024-09-12T01:43:22.450 INFO:tasks.workunit.client.0.smithi066.stdout:3/894: stat d5/d35/d103/d1b/d45/d66/d67/d7f/f127 0 2024-09-12T01:43:22.459 INFO:tasks.workunit.client.0.smithi066.stdout:4/881: dwrite d4/d6/d27/d66/d58/f77 [0,4194304] 0 2024-09-12T01:43:22.464 INFO:tasks.workunit.client.0.smithi066.stdout:3/895: dread d5/d35/d103/d1b/f62 [0,4194304] 0 2024-09-12T01:43:22.467 INFO:tasks.workunit.client.0.smithi066.stdout:9/782: creat d0/d6/d17/d1b/d4c/d4b/d7d/f115 x:0 0 0 2024-09-12T01:43:22.470 INFO:tasks.workunit.client.0.smithi066.stdout:7/839: creat d2/d5/d6/f11e x:0 0 0 2024-09-12T01:43:22.472 INFO:tasks.workunit.client.0.smithi066.stdout:6/916: rename d2/d99/d12/d49/d9e/dc0/fff to d2/d21/f139 0 2024-09-12T01:43:22.473 INFO:tasks.workunit.client.0.smithi066.stdout:6/917: chown d2/d99/d12/d1d/f118 23296 1 2024-09-12T01:43:22.482 INFO:tasks.workunit.client.0.smithi066.stdout:1/834: write d5/d15/f6e [922429,69580] 0 2024-09-12T01:43:22.482 INFO:tasks.workunit.client.0.smithi066.stdout:1/835: fdatasync d5/dc/d36/d4b/f2b 0 2024-09-12T01:43:22.484 INFO:tasks.workunit.client.0.smithi066.stdout:1/836: dread d5/dc/d36/df7/fa0 [0,4194304] 0 2024-09-12T01:43:22.485 INFO:tasks.workunit.client.0.smithi066.stdout:4/882: symlink d4/d6/d8/d18/l128 0 2024-09-12T01:43:22.485 INFO:tasks.workunit.client.0.smithi066.stdout:4/883: fdatasync d4/d6/d27/d66/da1/feb 0 2024-09-12T01:43:22.486 INFO:tasks.workunit.client.0.smithi066.stdout:3/896: symlink d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/l140 0 2024-09-12T01:43:22.489 INFO:tasks.workunit.client.0.smithi066.stdout:9/783: creat d0/d6/d17/d1b/da2/dae/f116 x:0 0 0 2024-09-12T01:43:22.489 INFO:tasks.workunit.client.0.smithi066.stdout:9/784: read - d0/d6/d17/d1b/da2/dae/f116 zero size 2024-09-12T01:43:22.489 INFO:tasks.workunit.client.0.smithi066.stdout:9/785: chown d0/d6/d17/d1b/d4c/d4b/dec 784345 1 2024-09-12T01:43:22.491 INFO:tasks.workunit.client.0.smithi066.stdout:7/840: unlink d2/d5/da/d3f/d9b/l6a 0 2024-09-12T01:43:22.491 INFO:tasks.workunit.client.0.smithi066.stdout:7/841: fdatasync d2/d5/d6/d40/d63/db4/ff2 0 2024-09-12T01:43:22.491 INFO:tasks.workunit.client.0.smithi066.stdout:7/842: fdatasync d2/d5/d6/d22/d75/d2f/fd3 0 2024-09-12T01:43:22.491 INFO:tasks.workunit.client.0.smithi066.stdout:7/843: chown d2/d5/d6/d40/d63/db4 4 1 2024-09-12T01:43:22.491 INFO:tasks.workunit.client.0.smithi066.stdout:6/918: mknod d2/d99/d12/d49/d9e/c13a 0 2024-09-12T01:43:22.493 INFO:tasks.workunit.client.0.smithi066.stdout:1/837: creat d5/dc/d36/df7/db6/ffd x:0 0 0 2024-09-12T01:43:22.494 INFO:tasks.workunit.client.0.smithi066.stdout:3/897: dread d5/f17 [0,4194304] 0 2024-09-12T01:43:22.495 INFO:tasks.workunit.client.0.smithi066.stdout:4/884: mknod d4/d6/d48/d88/c129 0 2024-09-12T01:43:22.499 INFO:tasks.workunit.client.0.smithi066.stdout:9/786: rmdir d0/d6 39 2024-09-12T01:43:22.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/844: unlink d2/d5/da/d3f/d5e/lc5 0 2024-09-12T01:43:22.501 INFO:tasks.workunit.client.0.smithi066.stdout:7/845: dread - d2/f79 zero size 2024-09-12T01:43:22.501 INFO:tasks.workunit.client.0.smithi066.stdout:1/838: fdatasync d5/f47 0 2024-09-12T01:43:22.502 INFO:tasks.workunit.client.0.smithi066.stdout:3/898: dread d5/d35/d103/d1b/d45/d66/d5c/fe2 [0,4194304] 0 2024-09-12T01:43:22.503 INFO:tasks.workunit.client.0.smithi066.stdout:4/885: truncate d4/d5f/f10c 156401 0 2024-09-12T01:43:22.504 INFO:tasks.workunit.client.0.smithi066.stdout:9/787: mkdir d0/d6/d17/d1b/d4c/d42/dab/d117 0 2024-09-12T01:43:22.505 INFO:tasks.workunit.client.0.smithi066.stdout:6/919: dread d2/d21/f34 [0,4194304] 0 2024-09-12T01:43:22.508 INFO:tasks.workunit.client.0.smithi066.stdout:3/899: symlink d5/d35/d103/d1b/d65/d89/d102/l141 0 2024-09-12T01:43:22.511 INFO:tasks.workunit.client.0.smithi066.stdout:9/788: mknod d0/d6/d17/d1b/de9/c118 0 2024-09-12T01:43:22.513 INFO:tasks.workunit.client.0.smithi066.stdout:6/920: getdents d2/d99/d12/d1d/df4 0 2024-09-12T01:43:22.515 INFO:tasks.workunit.client.0.smithi066.stdout:3/900: unlink d5/d35/d103/d1b/d45/d66/d67/d75/d8e/cc2 0 2024-09-12T01:43:22.517 INFO:tasks.workunit.client.0.smithi066.stdout:1/839: dread f4 [4194304,4194304] 0 2024-09-12T01:43:22.517 INFO:tasks.workunit.client.0.smithi066.stdout:1/840: truncate d5/dc/d36/de8/d8e/de2/ff2 1073440 0 2024-09-12T01:43:22.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/789: creat d0/d6/d17/d4f/d12/d46/f119 x:0 0 0 2024-09-12T01:43:22.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/790: chown d0/d6/d43/fa4 249060 1 2024-09-12T01:43:22.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/791: truncate d0/d6/d17/d1b/d4c/d42/ffa 278282 0 2024-09-12T01:43:22.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/792: readlink d0/d6/d17/d1b/d4c/d4b/d7d/l8c 0 2024-09-12T01:43:22.519 INFO:tasks.workunit.client.0.smithi066.stdout:9/793: rename d0/d6/d37 to d0/d6/d37/d11a 22 2024-09-12T01:43:22.520 INFO:tasks.workunit.client.0.smithi066.stdout:6/921: unlink d2/d99/d12/d49/d9e/c13a 0 2024-09-12T01:43:22.524 INFO:tasks.workunit.client.0.smithi066.stdout:9/794: mknod d0/d6/d17/d1b/d4c/c11b 0 2024-09-12T01:43:22.530 INFO:tasks.workunit.client.0.smithi066.stdout:9/795: unlink d0/d6/d17/d1b/d4c/l2f 0 2024-09-12T01:43:22.530 INFO:tasks.workunit.client.0.smithi066.stdout:9/796: write d0/d6/d17/f74 [164124,54765] 0 2024-09-12T01:43:22.531 INFO:tasks.workunit.client.0.smithi066.stdout:3/901: read f3 [4685009,117345] 0 2024-09-12T01:43:22.531 INFO:tasks.workunit.client.0.smithi066.stdout:3/902: stat d5/d35/d103/d1b/d77/dd5/d13c 0 2024-09-12T01:43:22.535 INFO:tasks.workunit.client.0.smithi066.stdout:1/841: mkdir d5/d15/d4d/d86/dfe 0 2024-09-12T01:43:22.535 INFO:tasks.workunit.client.0.smithi066.stdout:4/886: dwrite d4/d15/d33/d5e/ff6 [0,4194304] 0 2024-09-12T01:43:22.538 INFO:tasks.workunit.client.0.smithi066.stdout:9/797: creat d0/d6/d17/d4f/d12/f11c x:0 0 0 2024-09-12T01:43:22.539 INFO:tasks.workunit.client.0.smithi066.stdout:3/903: mknod d5/d35/d103/d1b/d45/d85/dd2/c142 0 2024-09-12T01:43:22.541 INFO:tasks.workunit.client.0.smithi066.stdout:6/922: dread d2/f22 [4194304,4194304] 0 2024-09-12T01:43:22.541 INFO:tasks.workunit.client.0.smithi066.stdout:7/846: dwrite d2/d5/da/d3f/da4/d70/f9f [0,4194304] 0 2024-09-12T01:43:22.541 INFO:tasks.workunit.client.0.smithi066.stdout:6/923: creat d2/d99/d12/d1d/df4/d11b/f13b x:0 0 0 2024-09-12T01:43:22.542 INFO:tasks.workunit.client.0.smithi066.stdout:1/842: creat d5/dc/d36/d57/dac/dc4/fff x:0 0 0 2024-09-12T01:43:22.545 INFO:tasks.workunit.client.0.smithi066.stdout:4/887: write d4/d84/dba/f102 [3618388,2646] 0 2024-09-12T01:43:22.550 INFO:tasks.workunit.client.0.smithi066.stdout:7/847: mknod d2/d5/da/d3f/d5e/c11f 0 2024-09-12T01:43:22.553 INFO:tasks.workunit.client.0.smithi066.stdout:6/924: mkdir d2/d99/d7b/df8/d57/d13c 0 2024-09-12T01:43:22.554 INFO:tasks.workunit.client.0.smithi066.stdout:6/925: write d2/f5 [3983561,88356] 0 2024-09-12T01:43:22.554 INFO:tasks.workunit.client.0.smithi066.stdout:1/843: mknod d5/d52/d60/c100 0 2024-09-12T01:43:22.554 INFO:tasks.workunit.client.0.smithi066.stdout:1/844: fsync d5/dc/f9c 0 2024-09-12T01:43:22.557 INFO:tasks.workunit.client.0.smithi066.stdout:4/888: dread d4/d6/d48/d88/f8f [0,4194304] 0 2024-09-12T01:43:22.557 INFO:tasks.workunit.client.0.smithi066.stdout:9/798: rmdir d0/d6/d17/d28 39 2024-09-12T01:43:22.557 INFO:tasks.workunit.client.0.smithi066.stdout:3/904: dwrite d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/f12a [0,4194304] 0 2024-09-12T01:43:22.567 INFO:tasks.workunit.client.0.smithi066.stdout:9/799: mknod d0/d6/d7f/d90/c11d 0 2024-09-12T01:43:22.571 INFO:tasks.workunit.client.0.smithi066.stdout:3/905: unlink d5/d35/d103/d1b/f62 0 2024-09-12T01:43:22.576 INFO:tasks.workunit.client.0.smithi066.stdout:9/800: dread d0/fb6 [0,4194304] 0 2024-09-12T01:43:22.576 INFO:tasks.workunit.client.0.smithi066.stdout:9/801: fdatasync d0/d6/d43/fc1 0 2024-09-12T01:43:22.576 INFO:tasks.workunit.client.0.smithi066.stdout:1/845: dwrite d5/dc/d53/f5a [0,4194304] 0 2024-09-12T01:43:22.576 INFO:tasks.workunit.client.0.smithi066.stdout:6/926: link d2/d99/d72/l123 d2/d21/d92/l13d 0 2024-09-12T01:43:22.578 INFO:tasks.workunit.client.0.smithi066.stdout:4/889: getdents d4/d84/dba 0 2024-09-12T01:43:22.581 INFO:tasks.workunit.client.0.smithi066.stdout:9/802: creat d0/d6/d37/f11e x:0 0 0 2024-09-12T01:43:22.581 INFO:tasks.workunit.client.0.smithi066.stdout:9/803: read d0/d6/f10 [538820,75798] 0 2024-09-12T01:43:22.581 INFO:tasks.workunit.client.0.smithi066.stdout:3/906: write d5/d35/d103/d1b/f2e [660012,96985] 0 2024-09-12T01:43:22.581 INFO:tasks.workunit.client.0.smithi066.stdout:3/907: write d5/d35/d103/d1b/d45/d66/d67/d75/ff2 [972102,37170] 0 2024-09-12T01:43:22.586 INFO:tasks.workunit.client.0.smithi066.stdout:4/890: creat d4/d84/f12a x:0 0 0 2024-09-12T01:43:22.589 INFO:tasks.workunit.client.0.smithi066.stdout:3/908: rename d5/d35/d103/d1b to d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/d143 22 2024-09-12T01:43:22.590 INFO:tasks.workunit.client.0.smithi066.stdout:1/846: dread d5/dc/f8f [0,4194304] 0 2024-09-12T01:43:22.590 INFO:tasks.workunit.client.0.smithi066.stdout:1/847: write d5/dc/d36/de8/d8e/de2/da1/fb3 [5085729,82031] 0 2024-09-12T01:43:22.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/891: mknod d4/d6/d27/d66/da1/c12b 0 2024-09-12T01:43:22.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/892: dread - d4/d6/d27/d66/d6c/d75/fef zero size 2024-09-12T01:43:22.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/893: chown d4/d6/d27/d66/d6c/d75/fef 2 1 2024-09-12T01:43:22.592 INFO:tasks.workunit.client.0.smithi066.stdout:4/894: write d4/d6/d27/d66/d6c/d75/f10b [10368,92651] 0 2024-09-12T01:43:22.593 INFO:tasks.workunit.client.0.smithi066.stdout:3/909: mkdir d5/d35/d103/d144 0 2024-09-12T01:43:22.593 INFO:tasks.workunit.client.0.smithi066.stdout:3/910: write d5/d35/d103/d1b/d45/d66/dae/dd7/de8/ff4 [1030695,13258] 0 2024-09-12T01:43:22.593 INFO:tasks.workunit.client.0.smithi066.stdout:4/895: mkdir d4/d6/d8/d18/d4d/d12c 0 2024-09-12T01:43:22.595 INFO:tasks.workunit.client.0.smithi066.stdout:6/927: dwrite d2/d99/d7b/df8/f69 [0,4194304] 0 2024-09-12T01:43:22.595 INFO:tasks.workunit.client.0.smithi066.stdout:3/911: mkdir d5/d35/d103/d1b/d77/dd5/dbd/d112/d145 0 2024-09-12T01:43:22.596 INFO:tasks.workunit.client.0.smithi066.stdout:4/896: symlink d4/d6/d27/d66/d6c/d75/l12d 0 2024-09-12T01:43:22.596 INFO:tasks.workunit.client.0.smithi066.stdout:4/897: chown d4/d6/d27/d66/d6c/cd0 16615 1 2024-09-12T01:43:22.606 INFO:tasks.workunit.client.0.smithi066.stdout:6/928: write d2/d21/ff7 [2312801,93813] 0 2024-09-12T01:43:22.606 INFO:tasks.workunit.client.0.smithi066.stdout:6/929: chown d2/d99/d12/l2f 141994188 1 2024-09-12T01:43:22.621 INFO:tasks.workunit.client.0.smithi066.stdout:3/912: dwrite d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/fda [0,4194304] 0 2024-09-12T01:43:22.625 INFO:tasks.workunit.client.0.smithi066.stdout:6/930: dread d2/d99/d72/d87/f127 [0,4194304] 0 2024-09-12T01:43:22.625 INFO:tasks.workunit.client.0.smithi066.stdout:4/898: dwrite d4/d6/d8/f3b [0,4194304] 0 2024-09-12T01:43:22.626 INFO:tasks.workunit.client.0.smithi066.stdout:6/931: truncate d2/d99/d7b/df8/fa8 3346897 0 2024-09-12T01:43:22.626 INFO:tasks.workunit.client.0.smithi066.stdout:6/932: readlink d2/d99/d12/d1d/l42 0 2024-09-12T01:43:22.628 INFO:tasks.workunit.client.0.smithi066.stdout:4/899: rename d4/d15/c2a to d4/d6/d27/d66/da1/c12e 0 2024-09-12T01:43:22.631 INFO:tasks.workunit.client.0.smithi066.stdout:3/913: write d5/d35/f73 [398277,86996] 0 2024-09-12T01:43:22.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/933: creat d2/d99/d12/d1d/d6b/dc6/f13e x:0 0 0 2024-09-12T01:43:22.632 INFO:tasks.workunit.client.0.smithi066.stdout:6/934: fdatasync d2/f5 0 2024-09-12T01:43:22.635 INFO:tasks.workunit.client.0.smithi066.stdout:4/900: creat d4/d5f/dea/d101/f12f x:0 0 0 2024-09-12T01:43:22.636 INFO:tasks.workunit.client.0.smithi066.stdout:3/914: mknod d5/d35/d103/c146 0 2024-09-12T01:43:22.639 INFO:tasks.workunit.client.0.smithi066.stdout:6/935: unlink d2/d99/d7b/df8/d57/fed 0 2024-09-12T01:43:22.644 INFO:tasks.workunit.client.0.smithi066.stdout:4/901: rename d4/d6/d27/d2f/f87 to d4/d15/dbd/f130 0 2024-09-12T01:43:22.646 INFO:tasks.workunit.client.0.smithi066.stdout:4/902: rmdir d4/d6/d27/d2f/d72 39 2024-09-12T01:43:22.646 INFO:tasks.workunit.client.0.smithi066.stdout:4/903: dread - d4/d6/fae zero size 2024-09-12T01:43:22.646 INFO:tasks.workunit.client.0.smithi066.stdout:4/904: dread - d4/d6/fae zero size 2024-09-12T01:43:22.651 INFO:tasks.workunit.client.0.smithi066.stdout:3/915: rename d5/d35/d103/d1b/d45/d85/f133 to d5/d35/d103/d1b/d65/d89/d50/f147 0 2024-09-12T01:43:22.651 INFO:tasks.workunit.client.0.smithi066.stdout:3/916: write d5/d35/d103/d1b/d77/dd5/dbd/d112/f120 [510938,63437] 0 2024-09-12T01:43:22.651 INFO:tasks.workunit.client.0.smithi066.stdout:3/917: write d5/d35/d103/d1b/d65/d89/f1c [4987141,110833] 0 2024-09-12T01:43:22.653 INFO:tasks.workunit.client.0.smithi066.stdout:6/936: rename d2/d99/l9d to d2/d99/d7b/d11c/l13f 0 2024-09-12T01:43:22.661 INFO:tasks.workunit.client.0.smithi066.stdout:3/918: dread d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/fda [0,4194304] 0 2024-09-12T01:43:22.662 INFO:tasks.workunit.client.0.smithi066.stdout:4/905: dwrite d4/d5f/dea/f121 [0,4194304] 0 2024-09-12T01:43:22.662 INFO:tasks.workunit.client.0.smithi066.stdout:4/906: truncate d4/d6/d8/fbf 723312 0 2024-09-12T01:43:22.662 INFO:tasks.workunit.client.0.smithi066.stdout:4/907: write d4/d6/d8/d4a/df0/f116 [1538590,80312] 0 2024-09-12T01:43:22.662 INFO:tasks.workunit.client.0.smithi066.stdout:3/919: mknod d5/d35/d103/d1b/d77/c148 0 2024-09-12T01:43:22.671 INFO:tasks.workunit.client.0.smithi066.stdout:3/920: mknod d5/d35/d103/d1b/d45/d66/d5c/c149 0 2024-09-12T01:43:22.672 INFO:tasks.workunit.client.0.smithi066.stdout:6/937: dread d2/d99/d12/d1d/f91 [0,4194304] 0 2024-09-12T01:43:22.673 INFO:tasks.workunit.client.0.smithi066.stdout:3/921: symlink d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/l14a 0 2024-09-12T01:43:22.673 INFO:tasks.workunit.client.0.smithi066.stdout:3/922: chown d5/d35/d103/f96 6 1 2024-09-12T01:43:22.677 INFO:tasks.workunit.client.0.smithi066.stdout:6/938: getdents d2/d99/d7b/df8/d5e 0 2024-09-12T01:43:22.684 INFO:tasks.workunit.client.0.smithi066.stdout:4/908: dwrite d4/d5f/fc1 [4194304,4194304] 0 2024-09-12T01:43:22.684 INFO:tasks.workunit.client.0.smithi066.stdout:4/909: creat d4/d15/d33/d5e/f131 x:0 0 0 2024-09-12T01:43:22.688 INFO:tasks.workunit.client.0.smithi066.stdout:6/939: dread d2/d99/d72/d87/fc3 [0,4194304] 0 2024-09-12T01:43:22.688 INFO:tasks.workunit.client.0.smithi066.stdout:6/940: chown d2/d99/d12/c11a 10399 1 2024-09-12T01:43:22.693 INFO:tasks.workunit.client.0.smithi066.stdout:3/923: dwrite d5/d35/d103/d1b/d45/d85/f9e [0,4194304] 0 2024-09-12T01:43:22.697 INFO:tasks.workunit.client.0.smithi066.stdout:3/924: mkdir d5/d14b 0 2024-09-12T01:43:22.697 INFO:tasks.workunit.client.0.smithi066.stdout:3/925: readlink d5/d35/d103/d1b/d45/d66/l5f 0 2024-09-12T01:43:22.699 INFO:tasks.workunit.client.0.smithi066.stdout:3/926: unlink d5/d35/d103/l1e 0 2024-09-12T01:43:22.700 INFO:tasks.workunit.client.0.smithi066.stdout:4/910: dread d4/d6/d62/f65 [0,4194304] 0 2024-09-12T01:43:22.702 INFO:tasks.workunit.client.0.smithi066.stdout:4/911: unlink d4/d15/d33/d5e/f131 0 2024-09-12T01:43:22.702 INFO:tasks.workunit.client.0.smithi066.stdout:4/912: readlink d4/d6/d48/lc8 0 2024-09-12T01:43:22.702 INFO:tasks.workunit.client.0.smithi066.stdout:6/941: dwrite d2/d99/d12/d1d/df4/d11b/f13b [0,4194304] 0 2024-09-12T01:43:22.702 INFO:tasks.workunit.client.0.smithi066.stdout:6/942: write d2/d99/d7b/ddb/f102 [669900,29165] 0 2024-09-12T01:43:22.702 INFO:tasks.workunit.client.0.smithi066.stdout:6/943: readlink d2/d99/d7b/df8/d5e/l61 0 2024-09-12T01:43:22.703 INFO:tasks.workunit.client.0.smithi066.stdout:4/913: creat d4/d6/d27/d2f/d72/f132 x:0 0 0 2024-09-12T01:43:22.711 INFO:tasks.workunit.client.0.smithi066.stdout:4/914: write d4/d6/d8/f3b [3426959,13920] 0 2024-09-12T01:43:22.711 INFO:tasks.workunit.client.0.smithi066.stdout:3/927: write d5/d35/d103/d1b/d65/d89/fd6 [1175850,27194] 0 2024-09-12T01:43:22.711 INFO:tasks.workunit.client.0.smithi066.stdout:4/915: stat d4/d6/d8/c19 0 2024-09-12T01:43:22.717 INFO:tasks.workunit.client.0.smithi066.stdout:6/944: mkdir d2/d99/d7b/ddf/d140 0 2024-09-12T01:43:22.718 INFO:tasks.workunit.client.0.smithi066.stdout:6/945: chown d2/d99/d7b/df8/d5e/le3 562 1 2024-09-12T01:43:22.719 INFO:tasks.workunit.client.0.smithi066.stdout:4/916: rename d4/d6/d27/d2f/f54 to d4/d6/d27/f133 0 2024-09-12T01:43:22.762 INFO:tasks.workunit.client.0.smithi066.stdout:4/917: rmdir d4/d6/d62/d11e 0 2024-09-12T01:43:22.764 INFO:tasks.workunit.client.0.smithi066.stdout:4/918: symlink d4/d6/l134 0 2024-09-12T01:43:22.764 INFO:tasks.workunit.client.0.smithi066.stdout:4/919: truncate d4/d6/d27/d66/d6c/fa0 3795278 0 2024-09-12T01:43:22.768 INFO:tasks.workunit.client.0.smithi066.stdout:0/886: sync 2024-09-12T01:43:22.774 INFO:tasks.workunit.client.0.smithi066.stdout:4/920: dread d4/d6/d62/fb2 [0,4194304] 0 2024-09-12T01:43:22.774 INFO:tasks.workunit.client.0.smithi066.stdout:4/921: creat d4/d5f/f135 x:0 0 0 2024-09-12T01:43:22.779 INFO:tasks.workunit.client.0.smithi066.stdout:6/946: write d2/d99/d72/d76/f83 [274894,129549] 0 2024-09-12T01:43:22.779 INFO:tasks.workunit.client.0.smithi066.stdout:6/947: readlink d2/d99/d12/d1d/l62 0 2024-09-12T01:43:22.779 INFO:tasks.workunit.client.0.smithi066.stdout:6/948: creat d2/d99/d12/d1d/df4/d11b/f141 x:0 0 0 2024-09-12T01:43:22.782 INFO:tasks.workunit.client.0.smithi066.stdout:6/949: mknod d2/d99/d7b/ddf/d140/c142 0 2024-09-12T01:43:22.789 INFO:tasks.workunit.client.0.smithi066.stdout:4/922: dwrite d4/d6/fae [0,4194304] 0 2024-09-12T01:43:22.791 INFO:tasks.workunit.client.0.smithi066.stdout:4/923: symlink d4/d6/d8/l136 0 2024-09-12T01:43:22.801 INFO:tasks.workunit.client.0.smithi066.stdout:6/950: dwrite d2/d99/d72/d87/fc3 [0,4194304] 0 2024-09-12T01:43:22.801 INFO:tasks.workunit.client.0.smithi066.stdout:6/951: fdatasync d2/d99/f3d 0 2024-09-12T01:43:22.801 INFO:tasks.workunit.client.0.smithi066.stdout:6/952: chown d2/d99/d12/d1d/l10f 19978 1 2024-09-12T01:43:22.805 INFO:tasks.workunit.client.0.smithi066.stdout:6/953: mkdir d2/d99/d7b/df8/d57/d143 0 2024-09-12T01:43:22.806 INFO:tasks.workunit.client.0.smithi066.stdout:6/954: creat d2/d99/d12/d49/f144 x:0 0 0 2024-09-12T01:43:22.806 INFO:tasks.workunit.client.0.smithi066.stdout:6/955: write d2/d99/d12/d1d/ff6 [1033097,95269] 0 2024-09-12T01:43:22.806 INFO:tasks.workunit.client.0.smithi066.stdout:6/956: dread - d2/d99/d12/d49/d120/f12c zero size 2024-09-12T01:43:22.806 INFO:tasks.workunit.client.0.smithi066.stdout:4/924: dread d4/d15/d33/d5e/ff6 [0,4194304] 0 2024-09-12T01:43:22.808 INFO:tasks.workunit.client.0.smithi066.stdout:6/957: dread d2/d99/d7b/ddb/f102 [0,4194304] 0 2024-09-12T01:43:22.815 INFO:tasks.workunit.client.0.smithi066.stdout:4/925: write d4/d6/d27/f98 [2062625,32422] 0 2024-09-12T01:43:22.823 INFO:tasks.workunit.client.0.smithi066.stdout:6/958: dwrite d2/fa3 [0,4194304] 0 2024-09-12T01:43:22.824 INFO:tasks.workunit.client.0.smithi066.stdout:6/959: link d2/d99/d12/d49/f116 d2/d99/d12/d49/f145 0 2024-09-12T01:43:22.828 INFO:tasks.workunit.client.0.smithi066.stdout:6/960: mknod d2/d99/d72/db7/c146 0 2024-09-12T01:43:22.853 INFO:tasks.workunit.client.0.smithi066.stdout:6/961: dwrite d2/d99/d12/d49/d9e/dc0/f103 [0,4194304] 0 2024-09-12T01:43:22.855 INFO:tasks.workunit.client.0.smithi066.stdout:6/962: symlink d2/d21/d137/l147 0 2024-09-12T01:43:22.856 INFO:tasks.workunit.client.0.smithi066.stdout:6/963: mkdir d2/d99/d72/db7/d148 0 2024-09-12T01:43:22.859 INFO:tasks.workunit.client.0.smithi066.stdout:6/964: creat d2/d99/d72/f149 x:0 0 0 2024-09-12T01:43:22.861 INFO:tasks.workunit.client.0.smithi066.stdout:6/965: rename d2/d99/d7b/df8/d5e/ce2 to d2/d99/d72/db7/d148/c14a 0 2024-09-12T01:43:22.861 INFO:tasks.workunit.client.0.smithi066.stdout:6/966: chown d2/d99/d7b/df8/d57/dfa/l12a 7096754 1 2024-09-12T01:43:22.862 INFO:tasks.workunit.client.0.smithi066.stdout:6/967: write d2/d99/d72/ffb [2559130,107282] 0 2024-09-12T01:43:22.865 INFO:tasks.workunit.client.0.smithi066.stdout:6/968: creat d2/d99/d7b/df8/d57/f14b x:0 0 0 2024-09-12T01:43:22.869 INFO:tasks.workunit.client.0.smithi066.stdout:6/969: rename d2/d99/d12/faf to d2/f14c 0 2024-09-12T01:43:22.869 INFO:tasks.workunit.client.0.smithi066.stdout:6/970: write d2/d99/d12/d1d/d6b/dc6/dd9/f109 [1020968,95007] 0 2024-09-12T01:43:22.877 INFO:tasks.workunit.client.0.smithi066.stdout:6/971: write d2/fa3 [6917694,123053] 0 2024-09-12T01:43:22.877 INFO:tasks.workunit.client.0.smithi066.stdout:6/972: symlink d2/d21/d92/l14d 0 2024-09-12T01:43:22.879 INFO:tasks.workunit.client.0.smithi066.stdout:6/973: creat d2/d99/d7b/df8/d57/d143/f14e x:0 0 0 2024-09-12T01:43:22.879 INFO:tasks.workunit.client.0.smithi066.stdout:6/974: write d2/d99/d12/fcd [536427,101595] 0 2024-09-12T01:43:22.883 INFO:tasks.workunit.client.0.smithi066.stdout:5/964: sync 2024-09-12T01:43:22.883 INFO:tasks.workunit.client.0.smithi066.stdout:8/815: sync 2024-09-12T01:43:22.884 INFO:tasks.workunit.client.0.smithi066.stdout:5/965: mknod d0/dd/d18/d36/dbf/dce/dd5/c138 0 2024-09-12T01:43:22.886 INFO:tasks.workunit.client.0.smithi066.stdout:5/966: mknod d0/d26/d2d/d33/d55/d73/d74/c139 0 2024-09-12T01:43:22.886 INFO:tasks.workunit.client.0.smithi066.stdout:5/967: stat d0/dd/d18/d36/dbf/dce/dd5/f132 0 2024-09-12T01:43:22.893 INFO:tasks.workunit.client.0.smithi066.stdout:8/816: dread d12/d21/d2f/f48 [0,4194304] 0 2024-09-12T01:43:22.894 INFO:tasks.workunit.client.0.smithi066.stdout:8/817: truncate d12/d21/d2f/d57/d84/d50/d56/db6/dee/f96 1807819 0 2024-09-12T01:43:22.895 INFO:tasks.workunit.client.0.smithi066.stdout:8/818: mkdir d12/d21/d2f/d53/d10f 0 2024-09-12T01:43:22.898 INFO:tasks.workunit.client.0.smithi066.stdout:8/819: rename d12/d21/d2f/d57/d84/d50/d56/lb5 to d12/d21/d2f/d57/d84/d50/l110 0 2024-09-12T01:43:22.901 INFO:tasks.workunit.client.0.smithi066.stdout:8/820: rename d12/c6a to d12/d21/d2f/d57/d84/d50/c111 0 2024-09-12T01:43:22.901 INFO:tasks.workunit.client.0.smithi066.stdout:6/975: dwrite d2/d99/d7b/df8/f85 [0,4194304] 0 2024-09-12T01:43:22.905 INFO:tasks.workunit.client.0.smithi066.stdout:6/976: dread d2/d99/d12/d49/d9e/f125 [4194304,4194304] 0 2024-09-12T01:43:22.906 INFO:tasks.workunit.client.0.smithi066.stdout:6/977: dread - d2/d99/d12/d1d/d6b/dbc/f131 zero size 2024-09-12T01:43:22.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/978: mknod d2/d99/d7b/ddb/c14f 0 2024-09-12T01:43:22.907 INFO:tasks.workunit.client.0.smithi066.stdout:6/979: chown d2/d21/ff7 5415152 1 2024-09-12T01:43:22.909 INFO:tasks.workunit.client.0.smithi066.stdout:8/821: write d12/d21/d2f/d57/d3c/f6d [3290438,83759] 0 2024-09-12T01:43:22.931 INFO:tasks.workunit.client.0.smithi066.stdout:6/980: dwrite d2/f5f [0,4194304] 0 2024-09-12T01:43:22.931 INFO:tasks.workunit.client.0.smithi066.stdout:8/822: dwrite d12/d21/d2f/f95 [4194304,4194304] 0 2024-09-12T01:43:22.934 INFO:tasks.workunit.client.0.smithi066.stdout:6/981: read d2/f4e [339686,78780] 0 2024-09-12T01:43:22.934 INFO:tasks.workunit.client.0.smithi066.stdout:6/982: fsync d2/d99/d7b/ff1 0 2024-09-12T01:43:22.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/823: creat d12/d21/d2f/d57/d84/d50/d56/db6/dee/f112 x:0 0 0 2024-09-12T01:43:22.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/824: truncate d12/d21/d2f/d57/d84/d50/d56/d69/fe9 517266 0 2024-09-12T01:43:22.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/825: dread - d12/d21/d2f/d57/d84/d50/d56/db6/dee/f112 zero size 2024-09-12T01:43:22.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/826: fsync d12/d21/d2f/d53/dde/df8/f100 0 2024-09-12T01:43:22.937 INFO:tasks.workunit.client.0.smithi066.stdout:8/827: truncate d12/d21/d2f/d53/dde/df8/f100 978505 0 2024-09-12T01:43:22.941 INFO:tasks.workunit.client.0.smithi066.stdout:6/983: stat d2/d99/d12/c108 0 2024-09-12T01:43:22.941 INFO:tasks.workunit.client.0.smithi066.stdout:6/984: chown d2/d99/d12/d1d/df4/d11b/f141 612540 1 2024-09-12T01:43:22.944 INFO:tasks.workunit.client.0.smithi066.stdout:8/828: mknod d12/d21/d2f/d57/d84/d50/d56/d69/d7d/dc7/c113 0 2024-09-12T01:43:22.946 INFO:tasks.workunit.client.0.smithi066.stdout:8/829: creat d12/d21/d2f/d57/d84/d50/d56/db6/dc8/d104/f114 x:0 0 0 2024-09-12T01:43:22.948 INFO:tasks.workunit.client.0.smithi066.stdout:8/830: mknod d12/d21/d2f/d57/d84/d50/d56/d69/d7d/c115 0 2024-09-12T01:43:22.950 INFO:tasks.workunit.client.0.smithi066.stdout:6/985: read d2/d21/f52 [2330471,46703] 0 2024-09-12T01:43:22.950 INFO:tasks.workunit.client.0.smithi066.stdout:6/986: dread - d2/d99/d12/d1d/df4/fe7 zero size 2024-09-12T01:43:22.951 INFO:tasks.workunit.client.0.smithi066.stdout:8/831: symlink d12/d21/d2f/d57/d43/l116 0 2024-09-12T01:43:22.953 INFO:tasks.workunit.client.0.smithi066.stdout:6/987: getdents d2/d99/d7b/ddb 0 2024-09-12T01:43:22.957 INFO:tasks.workunit.client.0.smithi066.stdout:6/988: rename d2/d99/d72/d76/ffc to d2/d99/d7b/df8/d57/d13c/f150 0 2024-09-12T01:43:22.959 INFO:tasks.workunit.client.0.smithi066.stdout:8/832: read d12/d21/f32 [8227562,19884] 0 2024-09-12T01:43:22.960 INFO:tasks.workunit.client.0.smithi066.stdout:8/833: creat d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f117 x:0 0 0 2024-09-12T01:43:22.960 INFO:tasks.workunit.client.0.smithi066.stdout:6/989: symlink d2/d99/d12/d1d/df4/l151 0 2024-09-12T01:43:22.963 INFO:tasks.workunit.client.0.smithi066.stdout:8/834: symlink d12/d21/d2f/d57/d43/d66/l118 0 2024-09-12T01:43:22.965 INFO:tasks.workunit.client.0.smithi066.stdout:6/990: mknod d2/d99/c152 0 2024-09-12T01:43:22.975 INFO:tasks.workunit.client.0.smithi066.stdout:6/991: write d2/d99/fa1 [3733969,30334] 0 2024-09-12T01:43:22.978 INFO:tasks.workunit.client.0.smithi066.stdout:8/835: dwrite d12/d21/d2f/d57/d84/d50/ffd [0,4194304] 0 2024-09-12T01:43:22.983 INFO:tasks.workunit.client.0.smithi066.stdout:8/836: truncate d12/d21/d2f/f63 256996 0 2024-09-12T01:43:23.002 INFO:tasks.workunit.client.0.smithi066.stdout:8/837: dwrite d12/d21/d2f/d57/d84/d50/d56/f75 [0,4194304] 0 2024-09-12T01:43:23.004 INFO:tasks.workunit.client.0.smithi066.stdout:8/838: rename d12/daf/cbd to d12/d21/d2f/d57/d84/d50/d56/c119 0 2024-09-12T01:43:23.004 INFO:tasks.workunit.client.0.smithi066.stdout:8/839: write d12/d21/d2f/d57/d43/d82/ff3 [794750,86789] 0 2024-09-12T01:43:23.005 INFO:tasks.workunit.client.0.smithi066.stdout:8/840: mkdir d12/d21/d2f/df5/d11a 0 2024-09-12T01:43:23.006 INFO:tasks.workunit.client.0.smithi066.stdout:8/841: readlink d12/d21/d2f/d57/d84/d50/l94 0 2024-09-12T01:43:23.007 INFO:tasks.workunit.client.0.smithi066.stdout:8/842: dread d12/d21/d2f/d57/d84/d50/d56/f59 [0,4194304] 0 2024-09-12T01:43:23.007 INFO:tasks.workunit.client.0.smithi066.stdout:8/843: write d12/d21/d2f/d57/d84/d50/ffd [635009,52183] 0 2024-09-12T01:43:23.009 INFO:tasks.workunit.client.0.smithi066.stdout:8/844: link d12/d21/d2f/d57/d84/d50/d56/db6/dee/f96 d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f11b 0 2024-09-12T01:43:23.010 INFO:tasks.workunit.client.0.smithi066.stdout:8/845: write d12/d21/d2f/d57/fc6 [922387,123201] 0 2024-09-12T01:43:23.011 INFO:tasks.workunit.client.0.smithi066.stdout:8/846: fsync d12/d21/d2f/d57/d84/d50/ffd 0 2024-09-12T01:43:23.012 INFO:tasks.workunit.client.0.smithi066.stdout:8/847: symlink d12/d21/d2f/d57/d43/d82/l11c 0 2024-09-12T01:43:23.015 INFO:tasks.workunit.client.0.smithi066.stdout:8/848: creat d12/d21/d2f/d57/d43/d66/d98/d10c/f11d x:0 0 0 2024-09-12T01:43:23.015 INFO:tasks.workunit.client.0.smithi066.stdout:8/849: truncate d12/d21/d2f/f9c 843174 0 2024-09-12T01:43:23.019 INFO:tasks.workunit.client.0.smithi066.stdout:8/850: dread d12/d21/d2f/d57/d84/d50/ffd [0,4194304] 0 2024-09-12T01:43:23.036 INFO:tasks.workunit.client.0.smithi066.stdout:8/851: dwrite d12/d21/fac [0,4194304] 0 2024-09-12T01:43:23.036 INFO:tasks.workunit.client.0.smithi066.stdout:8/852: dread - d12/d21/d2f/d57/d84/d50/d56/db6/f8b zero size 2024-09-12T01:43:23.037 INFO:tasks.workunit.client.0.smithi066.stdout:8/853: mkdir d12/d21/d2f/d57/d84/d50/d56/d69/d7d/dc7/d11e 0 2024-09-12T01:43:23.041 INFO:tasks.workunit.client.0.smithi066.stdout:8/854: dread d12/d21/fac [4194304,4194304] 0 2024-09-12T01:43:23.041 INFO:tasks.workunit.client.0.smithi066.stdout:8/855: write d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f117 [601012,62279] 0 2024-09-12T01:43:23.063 INFO:tasks.workunit.client.0.smithi066.stdout:8/856: dwrite d12/d21/d2f/d57/d84/f60 [0,4194304] 0 2024-09-12T01:43:23.064 INFO:tasks.workunit.client.0.smithi066.stdout:8/857: creat d12/d21/d2f/d53/dde/dfa/f11f x:0 0 0 2024-09-12T01:43:23.065 INFO:tasks.workunit.client.0.smithi066.stdout:8/858: rename d12/d21/d2f/d57/d43/d82/dbb/lcc to d12/d21/d2f/d57/d84/d50/d56/l120 0 2024-09-12T01:43:23.066 INFO:tasks.workunit.client.0.smithi066.stdout:8/859: fsync d12/d21/d2f/d57/d84/d50/d56/db6/fd7 0 2024-09-12T01:43:23.067 INFO:tasks.workunit.client.0.smithi066.stdout:8/860: rename d12/d21/d2f/d57/fbf to d12/d21/d2f/d53/d10f/f121 0 2024-09-12T01:43:23.069 INFO:tasks.workunit.client.0.smithi066.stdout:8/861: link d12/d21/d2f/d57/d3c/f108 d12/d21/d2f/d57/d43/d66/d98/d10c/f122 0 2024-09-12T01:43:23.069 INFO:tasks.workunit.client.0.smithi066.stdout:8/862: stat d12/d21/d2f/d57/d84/d50 0 2024-09-12T01:43:23.076 INFO:tasks.workunit.client.0.smithi066.stdout:8/863: dread d12/d21/d2f/d57/d84/f60 [0,4194304] 0 2024-09-12T01:43:23.092 INFO:tasks.workunit.client.0.smithi066.stdout:8/864: dwrite d12/f23 [0,4194304] 0 2024-09-12T01:43:23.095 INFO:tasks.workunit.client.0.smithi066.stdout:8/865: write d12/d21/d2f/d57/d84/f60 [3899298,70270] 0 2024-09-12T01:43:23.110 INFO:tasks.workunit.client.0.smithi066.stdout:8/866: dwrite d12/d21/d2f/d57/d3c/f108 [0,4194304] 0 2024-09-12T01:43:23.113 INFO:tasks.workunit.client.0.smithi066.stdout:8/867: unlink d12/d21/d2f/d57/d84/d50/d56/db6/l81 0 2024-09-12T01:43:23.114 INFO:tasks.workunit.client.0.smithi066.stdout:8/868: creat d12/f123 x:0 0 0 2024-09-12T01:43:23.115 INFO:tasks.workunit.client.0.smithi066.stdout:8/869: rename d12/d21/d2f/d57/d84/d50/d56/d69/d7d/c115 to d12/d21/d2f/d53/dde/df8/c124 0 2024-09-12T01:43:23.117 INFO:tasks.workunit.client.0.smithi066.stdout:8/870: dread d12/d21/d2f/d57/d43/d66/fb9 [0,4194304] 0 2024-09-12T01:43:23.118 INFO:tasks.workunit.client.0.smithi066.stdout:8/871: creat d12/d21/d2f/d57/d84/d50/d56/f125 x:0 0 0 2024-09-12T01:43:23.119 INFO:tasks.workunit.client.0.smithi066.stdout:8/872: rename d12/d21/d2f/d53/dde/ff9 to d12/d21/d2f/df5/d11a/f126 0 2024-09-12T01:43:23.119 INFO:tasks.workunit.client.0.smithi066.stdout:8/873: fdatasync d12/f123 0 2024-09-12T01:43:23.121 INFO:tasks.workunit.client.0.smithi066.stdout:8/874: mkdir d12/d21/d2f/d53/dde/df8/d127 0 2024-09-12T01:43:23.121 INFO:tasks.workunit.client.0.smithi066.stdout:8/875: truncate d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 187319 0 2024-09-12T01:43:23.129 INFO:tasks.workunit.client.0.smithi066.stdout:8/876: write d12/f23 [505631,81103] 0 2024-09-12T01:43:23.129 INFO:tasks.workunit.client.0.smithi066.stdout:8/877: truncate d12/d21/d2f/d57/d43/d82/fbe 167041 0 2024-09-12T01:43:23.129 INFO:tasks.workunit.client.0.smithi066.stdout:8/878: fsync d12/d21/f61 0 2024-09-12T01:43:23.129 INFO:tasks.workunit.client.0.smithi066.stdout:8/879: fsync d12/d21/d2f/d57/d84/f7e 0 2024-09-12T01:43:23.130 INFO:tasks.workunit.client.0.smithi066.stdout:8/880: unlink c1 0 2024-09-12T01:43:23.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:22 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:23.146 INFO:tasks.workunit.client.0.smithi066.stdout:8/881: dwrite d12/d21/d2f/d53/dde/dfa/f11f [0,4194304] 0 2024-09-12T01:43:23.151 INFO:tasks.workunit.client.0.smithi066.stdout:8/882: creat d12/d21/d2f/d57/d43/d82/f128 x:0 0 0 2024-09-12T01:43:23.153 INFO:tasks.workunit.client.0.smithi066.stdout:8/883: mknod d12/d21/d2f/d57/d84/d50/d56/d69/d7d/dc7/c129 0 2024-09-12T01:43:23.153 INFO:tasks.workunit.client.0.smithi066.stdout:8/884: chown d12/d21/d2f/d57/d3c/de4 5800226 1 2024-09-12T01:43:23.153 INFO:tasks.workunit.client.0.smithi066.stdout:8/885: write d12/d21/d2f/d57/d84/d50/ffd [107965,16365] 0 2024-09-12T01:43:23.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:22 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:23.156 INFO:tasks.workunit.client.0.smithi066.stdout:8/886: creat d12/d21/d2f/df5/d11a/f12a x:0 0 0 2024-09-12T01:43:23.156 INFO:tasks.workunit.client.0.smithi066.stdout:8/887: truncate d12/d21/d2f/d57/d84/d50/d56/db6/dc8/d104/f114 699377 0 2024-09-12T01:43:23.158 INFO:tasks.workunit.client.0.smithi066.stdout:8/888: link c7 d12/d21/d2f/d57/d84/d50/d10d/c12b 0 2024-09-12T01:43:23.158 INFO:tasks.workunit.client.0.smithi066.stdout:8/889: read - d12/d21/d2f/d57/d43/d66/d98/fae zero size 2024-09-12T01:43:23.160 INFO:tasks.workunit.client.0.smithi066.stdout:8/890: mkdir d12/d21/d2f/d57/d43/d66/d98/d12c 0 2024-09-12T01:43:23.161 INFO:tasks.workunit.client.0.smithi066.stdout:8/891: creat d12/d21/d2f/d57/d43/d66/d98/f12d x:0 0 0 2024-09-12T01:43:23.166 INFO:tasks.workunit.client.0.smithi066.stdout:8/892: write d12/d21/d2f/fc0 [1692273,40744] 0 2024-09-12T01:43:23.167 INFO:tasks.workunit.client.0.smithi066.stdout:8/893: symlink d12/d21/d2f/d57/d84/d50/d56/db6/dc8/l12e 0 2024-09-12T01:43:23.167 INFO:tasks.workunit.client.0.smithi066.stdout:2/771: sync 2024-09-12T01:43:23.167 INFO:tasks.workunit.client.0.smithi066.stdout:2/772: write de/f15 [1453325,105301] 0 2024-09-12T01:43:23.168 INFO:tasks.workunit.client.0.smithi066.stdout:8/894: mknod d12/d21/d2f/d53/dde/c12f 0 2024-09-12T01:43:23.169 INFO:tasks.workunit.client.0.smithi066.stdout:2/773: symlink de/d13/d28/d3a/dd4/lf8 0 2024-09-12T01:43:23.170 INFO:tasks.workunit.client.0.smithi066.stdout:8/895: creat d12/d21/d2f/d57/d84/d50/f130 x:0 0 0 2024-09-12T01:43:23.170 INFO:tasks.workunit.client.0.smithi066.stdout:8/896: read - d12/f74 zero size 2024-09-12T01:43:23.172 INFO:tasks.workunit.client.0.smithi066.stdout:2/774: rename de/d13/d1e/d84/f8a to de/d13/d28/d3d/ff9 0 2024-09-12T01:43:23.173 INFO:tasks.workunit.client.0.smithi066.stdout:8/897: creat d12/d21/d2f/d57/d43/df6/f131 x:0 0 0 2024-09-12T01:43:23.173 INFO:tasks.workunit.client.0.smithi066.stdout:8/898: creat d12/f132 x:0 0 0 2024-09-12T01:43:23.173 INFO:tasks.workunit.client.0.smithi066.stdout:8/899: chown d12/d21/d2f/d57/d3c/l5e 196 1 2024-09-12T01:43:23.173 INFO:tasks.workunit.client.0.smithi066.stdout:2/775: dread de/d13/d7f/fac [0,4194304] 0 2024-09-12T01:43:23.175 INFO:tasks.workunit.client.0.smithi066.stdout:8/900: dread d12/d21/d2f/d57/fc6 [0,4194304] 0 2024-09-12T01:43:23.175 INFO:tasks.workunit.client.0.smithi066.stdout:2/776: rmdir de/d13/d9c 39 2024-09-12T01:43:23.180 INFO:tasks.workunit.client.0.smithi066.stdout:2/777: symlink de/d13/d28/d3a/lfa 0 2024-09-12T01:43:23.186 INFO:tasks.workunit.client.0.smithi066.stdout:2/778: write de/d13/d1e/f23 [736848,126464] 0 2024-09-12T01:43:23.186 INFO:tasks.workunit.client.0.smithi066.stdout:2/779: write de/d13/d1e/d41/fc9 [70647,1818] 0 2024-09-12T01:43:23.187 INFO:tasks.workunit.client.0.smithi066.stdout:2/780: truncate de/fa7 1229997 0 2024-09-12T01:43:23.187 INFO:tasks.workunit.client.0.smithi066.stdout:2/781: chown de/d13/d28/d3d/l4e 90464529 1 2024-09-12T01:43:23.187 INFO:tasks.workunit.client.0.smithi066.stdout:2/782: stat de/d13/d1e/d41/d58/f73 0 2024-09-12T01:43:23.188 INFO:tasks.workunit.client.0.smithi066.stdout:2/783: chown de/d13/d28/f35 12379125 1 2024-09-12T01:43:23.188 INFO:tasks.workunit.client.0.smithi066.stdout:2/784: chown de/d13/d1e/d41 7 1 2024-09-12T01:43:23.188 INFO:tasks.workunit.client.0.smithi066.stdout:2/785: stat de/d13/d1e/d41/d81/fb8 0 2024-09-12T01:43:23.189 INFO:tasks.workunit.client.0.smithi066.stdout:2/786: link de/d13/d1e/d25/d5e/cd9 de/d13/d28/d3d/cfb 0 2024-09-12T01:43:23.189 INFO:tasks.workunit.client.0.smithi066.stdout:2/787: chown de/d13/d1e/d41/da8/ff0 240913504 1 2024-09-12T01:43:23.190 INFO:tasks.workunit.client.0.smithi066.stdout:8/901: dwrite d12/d21/d2f/f95 [4194304,4194304] 0 2024-09-12T01:43:23.192 INFO:tasks.workunit.client.0.smithi066.stdout:8/902: symlink d12/daf/l133 0 2024-09-12T01:43:23.192 INFO:tasks.workunit.client.0.smithi066.stdout:8/903: creat d12/d21/d2f/d57/d43/d66/d98/f134 x:0 0 0 2024-09-12T01:43:23.196 INFO:tasks.workunit.client.0.smithi066.stdout:8/904: mknod d12/d21/d2f/d57/d43/d66/d98/d12c/c135 0 2024-09-12T01:43:23.208 INFO:tasks.workunit.client.0.smithi066.stdout:8/905: mkdir d12/d21/d2f/d57/d84/d50/d56/d69/d7d/d136 0 2024-09-12T01:43:23.208 INFO:tasks.workunit.client.0.smithi066.stdout:2/788: dwrite f9 [0,4194304] 0 2024-09-12T01:43:23.219 INFO:tasks.workunit.client.0.smithi066.stdout:8/906: dread d12/d21/d2f/f45 [0,4194304] 0 2024-09-12T01:43:23.219 INFO:tasks.workunit.client.0.smithi066.stdout:2/789: mkdir de/d3c/d8f/dcf/dfc 0 2024-09-12T01:43:23.221 INFO:tasks.workunit.client.0.smithi066.stdout:2/790: rmdir de/d13/d1e/d25/deb 39 2024-09-12T01:43:23.246 INFO:tasks.workunit.client.0.smithi066.stdout:8/907: dwrite d12/d21/d2f/d57/f3b [0,4194304] 0 2024-09-12T01:43:23.246 INFO:tasks.workunit.client.0.smithi066.stdout:8/908: chown d12/d21/d2f/d57/d84/d50/d10d/c12b 147557228 1 2024-09-12T01:43:23.246 INFO:tasks.workunit.client.0.smithi066.stdout:8/909: truncate d12/d21/d2f/d53/dde/df8/f100 1919664 0 2024-09-12T01:43:23.246 INFO:tasks.workunit.client.0.smithi066.stdout:8/910: chown d12/d21/d2f/d57/d84/d50/l110 151675 1 2024-09-12T01:43:23.247 INFO:tasks.workunit.client.0.smithi066.stdout:2/791: dwrite de/d13/d1e/d41/d58/f60 [0,4194304] 0 2024-09-12T01:43:23.248 INFO:tasks.workunit.client.0.smithi066.stdout:8/911: creat d12/d21/d2f/d57/d84/d50/ded/f137 x:0 0 0 2024-09-12T01:43:23.253 INFO:tasks.workunit.client.0.smithi066.stdout:8/912: rename d12/d21/f61 to d12/d21/d2f/d57/d84/d50/ded/f138 0 2024-09-12T01:43:23.253 INFO:tasks.workunit.client.0.smithi066.stdout:8/913: dread - d12/f74 zero size 2024-09-12T01:43:23.256 INFO:tasks.workunit.client.0.smithi066.stdout:8/914: creat d12/d21/d2f/d53/d10f/f139 x:0 0 0 2024-09-12T01:43:23.256 INFO:tasks.workunit.client.0.smithi066.stdout:8/915: read d12/d21/d2f/d57/d3c/f7b [41820,9681] 0 2024-09-12T01:43:23.258 INFO:tasks.workunit.client.0.smithi066.stdout:8/916: dread d12/d21/d2f/d57/d84/d50/d56/db6/dee/d92/fa0 [0,4194304] 0 2024-09-12T01:43:23.258 INFO:tasks.workunit.client.0.smithi066.stdout:8/917: chown d12/d21/d2f/d57/d43/d66/f68 26054514 1 2024-09-12T01:43:23.258 INFO:tasks.workunit.client.0.smithi066.stdout:8/918: write d12/f5b [3949116,53551] 0 2024-09-12T01:43:23.258 INFO:tasks.workunit.client.0.smithi066.stdout:8/919: fsync d12/d21/d2f/d57/d84/d50/d56/db6/dee/f9e 0 2024-09-12T01:43:23.258 INFO:tasks.workunit.client.0.smithi066.stdout:8/920: fdatasync d12/d21/d2f/d57/fc6 0 2024-09-12T01:43:23.258 INFO:tasks.workunit.client.0.smithi066.stdout:8/921: creat d12/d21/d2f/d57/d43/df6/f13a x:0 0 0 2024-09-12T01:43:23.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/922: readlink l8 0 2024-09-12T01:43:23.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/923: write d12/d21/d2f/d57/d84/f7e [4282413,50228] 0 2024-09-12T01:43:23.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/924: rmdir d12/d21/d2f/df5 39 2024-09-12T01:43:23.259 INFO:tasks.workunit.client.0.smithi066.stdout:8/925: chown d12/d21/d2f/d57/d84/d50/d56/db6/dc8/d104/f114 14025152 1 2024-09-12T01:43:23.267 INFO:tasks.workunit.client.0.smithi066.stdout:2/792: dwrite de/d13/d28/f52 [0,4194304] 0 2024-09-12T01:43:23.268 INFO:tasks.workunit.client.0.smithi066.stdout:8/926: write d12/d21/d2f/f95 [168500,93456] 0 2024-09-12T01:43:23.268 INFO:tasks.workunit.client.0.smithi066.stdout:8/927: dread - d12/d21/d2f/d57/d84/d50/fca zero size 2024-09-12T01:43:23.268 INFO:tasks.workunit.client.0.smithi066.stdout:2/793: getdents de/d13/d28/d3a/dd4 0 2024-09-12T01:43:23.269 INFO:tasks.workunit.client.0.smithi066.stdout:2/794: fsync de/d13/d1e/d92/f9a 0 2024-09-12T01:43:23.270 INFO:tasks.workunit.client.0.smithi066.stdout:8/928: mkdir d12/d21/d2f/d57/d13b 0 2024-09-12T01:43:23.270 INFO:tasks.workunit.client.0.smithi066.stdout:8/929: readlink d12/d21/d2f/d57/d43/ldb 0 2024-09-12T01:43:23.292 INFO:tasks.workunit.client.0.smithi066.stdout:2/795: dwrite de/f1d [0,4194304] 0 2024-09-12T01:43:23.315 INFO:tasks.workunit.client.0.smithi066.stdout:7/848: sync 2024-09-12T01:43:23.316 INFO:tasks.workunit.client.0.smithi066.stdout:9/804: sync 2024-09-12T01:43:23.316 INFO:tasks.workunit.client.0.smithi066.stdout:9/805: fsync d0/d6/d17/d1b/d4c/d42/dab/f109 0 2024-09-12T01:43:23.316 INFO:tasks.workunit.client.0.smithi066.stdout:9/806: chown d0/d6 199 1 2024-09-12T01:43:23.316 INFO:tasks.workunit.client.0.smithi066.stdout:9/807: write d0/d6/d17/d1b/d4c/d42/dab/f109 [370161,1098] 0 2024-09-12T01:43:23.324 INFO:tasks.workunit.client.0.smithi066.stdout:7/849: dread d2/d5/d6/d40/d51/fc2 [0,4194304] 0 2024-09-12T01:43:23.344 INFO:tasks.workunit.client.0.smithi066.stdout:9/808: unlink d0/d6/d17/d4f/d9/cad 0 2024-09-12T01:43:23.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/809: rmdir d0/d6/d17/d1b/d4c/d42/dab/d117 0 2024-09-12T01:43:23.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/810: readlink d0/d6/d17/d1b/d4c/d4b/d86/le8 0 2024-09-12T01:43:23.347 INFO:tasks.workunit.client.0.smithi066.stdout:2/796: rename de/d13/d1e/d41 to de/d13/d28/d3a/dfd 0 2024-09-12T01:43:23.348 INFO:tasks.workunit.client.0.smithi066.stdout:9/811: creat d0/d6/d7f/d90/f11f x:0 0 0 2024-09-12T01:43:23.353 INFO:tasks.workunit.client.0.smithi066.stdout:7/850: rename d2/d3c/d100 to d2/d5/d6/d120 0 2024-09-12T01:43:23.357 INFO:tasks.workunit.client.0.smithi066.stdout:2/797: rename de/c10 to de/d3c/d8f/dcf/cfe 0 2024-09-12T01:43:23.357 INFO:tasks.workunit.client.0.smithi066.stdout:2/798: dread - de/d13/d28/d3a/dfd/d58/fce zero size 2024-09-12T01:43:23.359 INFO:tasks.workunit.client.0.smithi066.stdout:2/799: mkdir de/d13/d28/d3d/dff 0 2024-09-12T01:43:23.361 INFO:tasks.workunit.client.0.smithi066.stdout:7/851: dread d2/d5/d6/d22/f30 [0,4194304] 0 2024-09-12T01:43:23.365 INFO:tasks.workunit.client.0.smithi066.stdout:9/812: dwrite d0/d6/d17/d1b/d4c/d42/d10c/f114 [0,4194304] 0 2024-09-12T01:43:23.365 INFO:tasks.workunit.client.0.smithi066.stdout:9/813: dread - d0/d6/d17/d1b/d4c/d4b/d7d/f115 zero size 2024-09-12T01:43:23.370 INFO:tasks.workunit.client.0.smithi066.stdout:7/852: rename d2/d5/d6/d81/dc8 to d2/d5/d6/d40/d51/d121 0 2024-09-12T01:43:23.372 INFO:tasks.workunit.client.0.smithi066.stdout:9/814: rename d0/cb5 to d0/d6/d17/d1b/da2/c120 0 2024-09-12T01:43:23.374 INFO:tasks.workunit.client.0.smithi066.stdout:7/853: mknod d2/d71/c122 0 2024-09-12T01:43:23.378 INFO:tasks.workunit.client.0.smithi066.stdout:2/800: dwrite de/d13/d1e/d22/f54 [0,4194304] 0 2024-09-12T01:43:23.378 INFO:tasks.workunit.client.0.smithi066.stdout:2/801: chown de/d13/d1e/d92/f9a 1010731281 1 2024-09-12T01:43:23.380 INFO:tasks.workunit.client.0.smithi066.stdout:7/854: mkdir d2/d5/d6/d40/d51/d121/d123 0 2024-09-12T01:43:23.381 INFO:tasks.workunit.client.0.smithi066.stdout:9/815: getdents d0/d6/d37/d85 0 2024-09-12T01:43:23.381 INFO:tasks.workunit.client.0.smithi066.stdout:9/816: write d0/d6/f10 [5039154,93437] 0 2024-09-12T01:43:23.396 INFO:tasks.workunit.client.0.smithi066.stdout:9/817: dread d0/d6/d43/fc1 [0,4194304] 0 2024-09-12T01:43:23.405 INFO:tasks.workunit.client.0.smithi066.stdout:2/802: dwrite de/d13/d1e/d22/f8c [0,4194304] 0 2024-09-12T01:43:23.405 INFO:tasks.workunit.client.0.smithi066.stdout:2/803: creat de/d13/d1e/d92/f100 x:0 0 0 2024-09-12T01:43:23.410 INFO:tasks.workunit.client.0.smithi066.stdout:9/818: write d0/d6/d17/d4f/d9/de/f5b [864997,127546] 0 2024-09-12T01:43:23.416 INFO:tasks.workunit.client.0.smithi066.stdout:2/804: dread de/d13/d1e/d22/f44 [0,4194304] 0 2024-09-12T01:43:23.421 INFO:tasks.workunit.client.0.smithi066.stdout:9/819: rename d0/f2 to d0/d6/d17/d1b/d4c/d42/d10c/f121 0 2024-09-12T01:43:23.421 INFO:tasks.workunit.client.0.smithi066.stdout:9/820: chown d0/d6/d17/d1b/d4c/f2a 2202 1 2024-09-12T01:43:23.424 INFO:tasks.workunit.client.0.smithi066.stdout:2/805: rename de/d13/d28/d3a/dfd/d58/ff4 to de/d3c/d8f/dcf/ddb/f101 0 2024-09-12T01:43:23.428 INFO:tasks.workunit.client.0.smithi066.stdout:9/821: mknod d0/d6/d17/d1b/d4c/c122 0 2024-09-12T01:43:23.429 INFO:tasks.workunit.client.0.smithi066.stdout:9/822: dread d0/d6/d17/d1b/d4c/d42/d10c/f10e [0,4194304] 0 2024-09-12T01:43:23.433 INFO:tasks.workunit.client.0.smithi066.stdout:9/823: mknod d0/d6/d17/d1b/d4c/d4b/d7d/df8/c123 0 2024-09-12T01:43:23.448 INFO:tasks.workunit.client.0.smithi066.stdout:2/806: dwrite de/d13/fd6 [0,4194304] 0 2024-09-12T01:43:23.454 INFO:tasks.workunit.client.0.smithi066.stdout:9/824: dread d0/d6/d17/f18 [0,4194304] 0 2024-09-12T01:43:23.457 INFO:tasks.workunit.client.0.smithi066.stdout:9/825: rename d0/d6/lcb to d0/d6/d17/d4f/d9/de/de7/l124 0 2024-09-12T01:43:23.459 INFO:tasks.workunit.client.0.smithi066.stdout:9/826: symlink d0/d6/d17/l125 0 2024-09-12T01:43:23.459 INFO:tasks.workunit.client.0.smithi066.stdout:2/807: dread de/d13/d28/f2f [0,4194304] 0 2024-09-12T01:43:23.459 INFO:tasks.workunit.client.0.smithi066.stdout:2/808: chown de/d13/d7f/c79 4 1 2024-09-12T01:43:23.464 INFO:tasks.workunit.client.0.smithi066.stdout:9/827: symlink d0/d6/d17/d28/l126 0 2024-09-12T01:43:23.474 INFO:tasks.workunit.client.0.smithi066.stdout:2/809: getdents de/d13/d1e/d92 0 2024-09-12T01:43:23.475 INFO:tasks.workunit.client.0.smithi066.stdout:2/810: write de/d13/d1e/d92/f9a [241875,19629] 0 2024-09-12T01:43:23.477 INFO:tasks.workunit.client.0.smithi066.stdout:2/811: readlink de/d13/d1e/d25/lb1 0 2024-09-12T01:43:23.478 INFO:tasks.workunit.client.0.smithi066.stdout:2/812: read de/f21 [376960,115010] 0 2024-09-12T01:43:23.479 INFO:tasks.workunit.client.0.smithi066.stdout:2/813: mknod de/d3c/c102 0 2024-09-12T01:43:23.485 INFO:tasks.workunit.client.0.smithi066.stdout:9/828: dwrite d0/d6/d7f/dd2/ff3 [0,4194304] 0 2024-09-12T01:43:23.492 INFO:tasks.workunit.client.0.smithi066.stdout:1/848: sync 2024-09-12T01:43:23.492 INFO:tasks.workunit.client.0.smithi066.stdout:3/928: sync 2024-09-12T01:43:23.492 INFO:tasks.workunit.client.0.smithi066.stdout:3/929: fsync d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f134 0 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:3/930: dread d5/d35/d103/d1b/d45/d66/d67/d75/d8e/fad [0,4194304] 0 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:3/931: creat d5/d35/d103/d1b/d45/f14c x:0 0 0 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:3/932: chown d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/d11a 65649 1 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:3/933: write d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/f117 [749651,3877] 0 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:1/849: creat d5/d52/d60/dfb/f101 x:0 0 0 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:1/850: truncate d5/dc/d53/fdc 522434 0 2024-09-12T01:43:23.496 INFO:tasks.workunit.client.0.smithi066.stdout:1/851: chown d5/dc/d36/de8/d8e/de2/da1/ce4 1 1 2024-09-12T01:43:23.499 INFO:tasks.workunit.client.0.smithi066.stdout:3/934: getdents d5/d35/d103/d1b/d77/dd5/dbd/d112 0 2024-09-12T01:43:23.501 INFO:tasks.workunit.client.0.smithi066.stdout:3/935: symlink d5/d35/d103/d1b/d45/d66/de7/l14d 0 2024-09-12T01:43:23.501 INFO:tasks.workunit.client.0.smithi066.stdout:3/936: write d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f134 [2928071,24719] 0 2024-09-12T01:43:23.503 INFO:tasks.workunit.client.0.smithi066.stdout:1/852: link d5/d52/d60/l76 d5/d15/l102 0 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:3/937: mknod d5/d35/d103/d1b/d45/d66/d5c/d101/c14e 0 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:3/938: readlink d5/d35/d103/d1b/d45/d66/d67/d7f/da8/le3 0 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:3/939: chown d5/d35/d103/d1b/d45/d66/d67/d6d/f7a 4423732 1 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:3/940: chown d5/d35/d103/d1b/d45/d66/d67/d75/d8e 19 1 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:1/853: read d5/dc/d36/f9a [347130,46996] 0 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:4/926: sync 2024-09-12T01:43:23.505 INFO:tasks.workunit.client.0.smithi066.stdout:0/887: sync 2024-09-12T01:43:23.506 INFO:tasks.workunit.client.0.smithi066.stdout:1/854: rmdir d5/d52 39 2024-09-12T01:43:23.506 INFO:tasks.workunit.client.0.smithi066.stdout:1/855: write d5/dc/d36/f96 [4422861,105430] 0 2024-09-12T01:43:23.506 INFO:tasks.workunit.client.0.smithi066.stdout:1/856: truncate d5/d15/d4d/d86/dc7/fe7 258934 0 2024-09-12T01:43:23.506 INFO:tasks.workunit.client.0.smithi066.stdout:0/888: rmdir d1/d62/d9f/d4a/d67/d20/dc9/d111 39 2024-09-12T01:43:23.507 INFO:tasks.workunit.client.0.smithi066.stdout:0/889: fdatasync d1/d62/d9f/f10d 0 2024-09-12T01:43:23.507 INFO:tasks.workunit.client.0.smithi066.stdout:4/927: mkdir d4/d5f/d137 0 2024-09-12T01:43:23.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/829: dwrite d0/d6/d17/d28/d79/fc6 [0,4194304] 0 2024-09-12T01:43:23.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/830: write d0/d6/d17/d28/f5f [8782,11076] 0 2024-09-12T01:43:23.508 INFO:tasks.workunit.client.0.smithi066.stdout:9/831: dread - d0/d6/f2d zero size 2024-09-12T01:43:23.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/890: symlink d1/d62/d9f/d4a/d67/d1b/d26/d9c/l130 0 2024-09-12T01:43:23.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/891: write d1/d62/d9f/d120/f128 [780277,37212] 0 2024-09-12T01:43:23.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/892: fsync d1/d62/d9f/d4a/d67/d20/f10e 0 2024-09-12T01:43:23.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/893: chown d1/d62/d9f/d7c/ff2 853446206 1 2024-09-12T01:43:23.511 INFO:tasks.workunit.client.0.smithi066.stdout:0/894: write d1/d62/d9f/d4a/d67/d20/f30 [4951447,37349] 0 2024-09-12T01:43:23.512 INFO:tasks.workunit.client.0.smithi066.stdout:4/928: mknod d4/d15/df4/c138 0 2024-09-12T01:43:23.518 INFO:tasks.workunit.client.0.smithi066.stdout:4/929: creat d4/de5/f139 x:0 0 0 2024-09-12T01:43:23.519 INFO:tasks.workunit.client.0.smithi066.stdout:1/857: write d5/dc/d36/ddd/fa5 [3218766,76764] 0 2024-09-12T01:43:23.519 INFO:tasks.workunit.client.0.smithi066.stdout:4/930: creat d4/d6/d48/f13a x:0 0 0 2024-09-12T01:43:23.521 INFO:tasks.workunit.client.0.smithi066.stdout:1/858: creat d5/d52/f103 x:0 0 0 2024-09-12T01:43:23.521 INFO:tasks.workunit.client.0.smithi066.stdout:1/859: dread - d5/dc/d36/f89 zero size 2024-09-12T01:43:23.522 INFO:tasks.workunit.client.0.smithi066.stdout:1/860: symlink d5/dc/d53/l104 0 2024-09-12T01:43:23.525 INFO:tasks.workunit.client.0.smithi066.stdout:4/931: dread d4/d6/d27/d66/d6c/fa0 [0,4194304] 0 2024-09-12T01:43:23.534 INFO:tasks.workunit.client.0.smithi066.stdout:1/861: write d5/d52/d60/f79 [1717167,4512] 0 2024-09-12T01:43:23.536 INFO:tasks.workunit.client.0.smithi066.stdout:1/862: creat d5/d15/d4d/dd3/f105 x:0 0 0 2024-09-12T01:43:23.538 INFO:tasks.workunit.client.0.smithi066.stdout:4/932: dread d4/d15/d33/f90 [0,4194304] 0 2024-09-12T01:43:23.539 INFO:tasks.workunit.client.0.smithi066.stdout:0/895: dwrite d1/d62/d89/d83/fda [4194304,4194304] 0 2024-09-12T01:43:23.541 INFO:tasks.workunit.client.0.smithi066.stdout:1/863: rmdir d5/d52/d60 39 2024-09-12T01:43:23.546 INFO:tasks.workunit.client.0.smithi066.stdout:1/864: rename d5/d15/f9d to d5/dc/f106 0 2024-09-12T01:43:23.551 INFO:tasks.workunit.client.0.smithi066.stdout:1/865: creat d5/dc/d36/d4b/f107 x:0 0 0 2024-09-12T01:43:23.552 INFO:tasks.workunit.client.0.smithi066.stdout:0/896: write d1/d62/d6c/f5d [3562902,87295] 0 2024-09-12T01:43:23.553 INFO:tasks.workunit.client.0.smithi066.stdout:1/866: truncate d5/dc/f12 502331 0 2024-09-12T01:43:23.556 INFO:tasks.workunit.client.0.smithi066.stdout:1/867: creat d5/dc/d53/d9b/f108 x:0 0 0 2024-09-12T01:43:23.557 INFO:tasks.workunit.client.0.smithi066.stdout:4/933: dwrite d4/d6/d8/d18/fb7 [0,4194304] 0 2024-09-12T01:43:23.559 INFO:tasks.workunit.client.0.smithi066.stdout:1/868: mknod d5/dc/d36/de8/d8e/de2/da1/c109 0 2024-09-12T01:43:23.559 INFO:tasks.workunit.client.0.smithi066.stdout:1/869: fsync d5/dc/d36/de8/d8e/f91 0 2024-09-12T01:43:23.560 INFO:tasks.workunit.client.0.smithi066.stdout:4/934: creat d4/d6/d8/d4a/f13b x:0 0 0 2024-09-12T01:43:23.563 INFO:tasks.workunit.client.0.smithi066.stdout:1/870: link d5/dc/d36/d4b/f5f d5/dc/d36/d57/dac/dd5/f10a 0 2024-09-12T01:43:23.570 INFO:tasks.workunit.client.0.smithi066.stdout:4/935: write d4/d6/d8/d4a/ffa [1197530,53203] 0 2024-09-12T01:43:23.570 INFO:tasks.workunit.client.0.smithi066.stdout:4/936: truncate d4/d15/d33/fe1 1649637 0 2024-09-12T01:43:23.572 INFO:tasks.workunit.client.0.smithi066.stdout:0/897: dwrite d1/d62/d9f/d4a/d67/d6e/d80/f129 [0,4194304] 0 2024-09-12T01:43:23.572 INFO:tasks.workunit.client.0.smithi066.stdout:0/898: readlink d1/d62/d9f/d4a/d67/l22 0 2024-09-12T01:43:23.574 INFO:tasks.workunit.client.0.smithi066.stdout:4/937: creat d4/d6/d8/d18/d4d/d12c/f13c x:0 0 0 2024-09-12T01:43:23.574 INFO:tasks.workunit.client.0.smithi066.stdout:4/938: chown d4/d6/d27/laf 23795051 1 2024-09-12T01:43:23.576 INFO:tasks.workunit.client.0.smithi066.stdout:0/899: dread d1/d62/d89/d83/d8b/fa5 [0,4194304] 0 2024-09-12T01:43:23.578 INFO:tasks.workunit.client.0.smithi066.stdout:4/939: mknod d4/d6/d62/db0/dd6/c13d 0 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/940: creat d4/d6/d8/d18/f13e x:0 0 0 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/941: write d4/d6/d48/f8b [10401571,89698] 0 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/942: write d4/d6/d27/f98 [1653677,130091] 0 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/943: truncate d4/d15/fd5 639956 0 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/944: chown d4/d6/d27/d66/faa 21009318 1 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/945: stat d4/d6/d14/ca3 0 2024-09-12T01:43:23.580 INFO:tasks.workunit.client.0.smithi066.stdout:4/946: write d4/d6/d48/d88/fc7 [755694,60978] 0 2024-09-12T01:43:23.581 INFO:tasks.workunit.client.0.smithi066.stdout:1/871: dwrite d5/d15/fad [4194304,4194304] 0 2024-09-12T01:43:23.581 INFO:tasks.workunit.client.0.smithi066.stdout:4/947: rename d4/d6/d62/db0/dd6/c13d to d4/d6/d14/c13f 0 2024-09-12T01:43:23.583 INFO:tasks.workunit.client.0.smithi066.stdout:4/948: rename d4/d6/d27/d66/da1/ld7 to d4/d6/d62/db0/dd6/dd8/l140 0 2024-09-12T01:43:23.619 INFO:tasks.workunit.client.0.smithi066.stdout:1/872: dwrite d5/dc/f12 [0,4194304] 0 2024-09-12T01:43:23.620 INFO:tasks.workunit.client.0.smithi066.stdout:4/949: dwrite d4/d84/f12a [0,4194304] 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/950: stat d4/d15/fd5 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/951: truncate d4/d6/d27/d66/fb8 22536 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/952: creat d4/d5f/dea/d101/f141 x:0 0 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/953: truncate d4/d6/d8/d18/d4d/f11c 4894595 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/954: fsync d4/d6/d27/d66/d6c/d75/fef 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/955: stat d4/d6/cb4 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:4/956: readlink d4/d5f/d9a/le4 0 2024-09-12T01:43:23.621 INFO:tasks.workunit.client.0.smithi066.stdout:0/900: dwrite d1/d62/d9f/db4/fd6 [0,4194304] 0 2024-09-12T01:43:23.639 INFO:tasks.workunit.client.0.smithi066.stdout:4/957: symlink d4/d6/d8/d18/d4d/l142 0 2024-09-12T01:43:23.639 INFO:tasks.workunit.client.0.smithi066.stdout:4/958: creat d4/d5f/dea/f143 x:0 0 0 2024-09-12T01:43:23.639 INFO:tasks.workunit.client.0.smithi066.stdout:0/901: truncate d1/d62/d9f/d4a/f68 1584745 0 2024-09-12T01:43:23.640 INFO:tasks.workunit.client.0.smithi066.stdout:4/959: dread d4/d6/d27/d66/d6c/fb5 [0,4194304] 0 2024-09-12T01:43:23.645 INFO:tasks.workunit.client.0.smithi066.stdout:4/960: rmdir d4/d6/d62/db0/dd6 39 2024-09-12T01:43:23.645 INFO:tasks.workunit.client.0.smithi066.stdout:4/961: write d4/d6/d27/d66/da1/fad [295632,27939] 0 2024-09-12T01:43:23.646 INFO:tasks.workunit.client.0.smithi066.stdout:4/962: creat d4/d15/d33/f144 x:0 0 0 2024-09-12T01:43:23.653 INFO:tasks.workunit.client.0.smithi066.stdout:0/902: write d1/f4d [316881,7118] 0 2024-09-12T01:43:23.654 INFO:tasks.workunit.client.0.smithi066.stdout:0/903: rmdir d1/d62/d89/da3/dc1/de2 39 2024-09-12T01:43:23.656 INFO:tasks.workunit.client.0.smithi066.stdout:0/904: mknod d1/d62/d9f/d4a/d67/d1b/d26/d5b/c131 0 2024-09-12T01:43:23.658 INFO:tasks.workunit.client.0.smithi066.stdout:0/905: link d1/d62/d89/cdd d1/d62/d6c/dad/c132 0 2024-09-12T01:43:23.658 INFO:tasks.workunit.client.0.smithi066.stdout:0/906: getdents d1/d62/d9f/d4a/d67/d1b/d26/d9c/d12b 0 2024-09-12T01:43:23.666 INFO:tasks.workunit.client.0.smithi066.stdout:0/907: dread d1/d62/d89/fde [0,4194304] 0 2024-09-12T01:43:23.666 INFO:tasks.workunit.client.0.smithi066.stdout:4/963: dwrite d4/d6/d48/d88/f93 [0,4194304] 0 2024-09-12T01:43:23.671 INFO:tasks.workunit.client.0.smithi066.stdout:4/964: getdents d4 0 2024-09-12T01:43:23.672 INFO:tasks.workunit.client.0.smithi066.stdout:4/965: mkdir d4/d145 0 2024-09-12T01:43:23.678 INFO:tasks.workunit.client.0.smithi066.stdout:0/908: dread d1/d62/d9f/d92/d95/fb2 [0,4194304] 0 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:5/968: sync 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:7/855: sync 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/992: sync 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:8/930: sync 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/993: fdatasync d2/d99/d7b/ff1 0 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/994: creat d2/d99/d12/d1d/d6b/dc6/f153 x:0 0 0 2024-09-12T01:43:23.679 INFO:tasks.workunit.client.0.smithi066.stdout:6/995: write d2/d99/d12/d1d/df4/fe7 [395518,126191] 0 2024-09-12T01:43:23.680 INFO:tasks.workunit.client.0.smithi066.stdout:0/909: creat d1/d62/d9f/d4a/d67/d1b/d26/d9c/d12b/f133 x:0 0 0 2024-09-12T01:43:23.682 INFO:tasks.workunit.client.0.smithi066.stdout:7/856: mkdir d2/d124 0 2024-09-12T01:43:23.686 INFO:tasks.workunit.client.0.smithi066.stdout:5/969: creat d0/d26/d2d/d31/d77/f13a x:0 0 0 2024-09-12T01:43:23.686 INFO:tasks.workunit.client.0.smithi066.stdout:5/970: truncate d0/d26/d2d/d33/dec/d10a/d111/f129 804896 0 2024-09-12T01:43:23.688 INFO:tasks.workunit.client.0.smithi066.stdout:6/996: symlink d2/d99/d12/d1d/l154 0 2024-09-12T01:43:23.688 INFO:tasks.workunit.client.0.smithi066.stdout:6/997: write d2/d99/d7b/df8/d57/ffd [241637,226] 0 2024-09-12T01:43:23.689 INFO:tasks.workunit.client.0.smithi066.stdout:0/910: symlink d1/d62/d9f/d4a/d67/d20/dc9/d111/d127/l134 0 2024-09-12T01:43:23.689 INFO:tasks.workunit.client.0.smithi066.stdout:0/911: write d1/d62/d9f/d4a/d67/d6e/fa1 [699857,130490] 0 2024-09-12T01:43:23.689 INFO:tasks.workunit.client.0.smithi066.stdout:0/912: write d1/d72/fd3 [5220250,107486] 0 2024-09-12T01:43:23.690 INFO:tasks.workunit.client.0.smithi066.stdout:7/857: symlink d2/l125 0 2024-09-12T01:43:23.690 INFO:tasks.workunit.client.0.smithi066.stdout:7/858: chown d2/d5/da/d3f/da4/f3b 591544 1 2024-09-12T01:43:23.693 INFO:tasks.workunit.client.0.smithi066.stdout:6/998: mkdir d2/d99/d12/d1d/d155 0 2024-09-12T01:43:23.693 INFO:tasks.workunit.client.0.smithi066.stdout:6/999: write d2/d99/d12/d1d/d6b/dc6/dd9/fe4 [4668764,20494] 0 2024-09-12T01:43:23.694 INFO:tasks.workunit.client.0.smithi066.stdout:4/966: dwrite d4/d6/d27/d2f/d72/ff9 [4194304,4194304] 0 2024-09-12T01:43:23.697 INFO:tasks.workunit.client.0.smithi066.stdout:7/859: unlink d2/d5/da/d3f/da4/d6c/fcf 0 2024-09-12T01:43:23.697 INFO:tasks.workunit.client.0.smithi066.stdout:7/860: chown d2/d5/da/d3f/f101 471867 1 2024-09-12T01:43:23.697 INFO:tasks.workunit.client.0.smithi066.stdout:7/861: fdatasync d2/d5/da/d3f/da4/f4c 0 2024-09-12T01:43:23.700 INFO:tasks.workunit.client.0.smithi066.stdout:8/931: dwrite d12/d21/d2f/d57/d84/f60 [0,4194304] 0 2024-09-12T01:43:23.701 INFO:tasks.workunit.client.0.smithi066.stdout:7/862: rmdir d2/d5/d6/d22/d75/db6/dd8 39 2024-09-12T01:43:23.706 INFO:tasks.workunit.client.0.smithi066.stdout:8/932: rename d12/d21/d2f/d57/d3c/f108 to d12/d21/d2f/d57/d3c/f13c 0 2024-09-12T01:43:23.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/913: dwrite d1/d72/fd3 [4194304,4194304] 0 2024-09-12T01:43:23.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/914: chown d1/d62/d9f/d64/ff3 22102 1 2024-09-12T01:43:23.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/915: readlink d1/d62/d9f/d4a/d67/d3e/l45 0 2024-09-12T01:43:23.719 INFO:tasks.workunit.client.0.smithi066.stdout:0/916: dread - d1/d62/d9f/d4a/d67/d1b/d61/dec/f12c zero size 2024-09-12T01:43:23.720 INFO:tasks.workunit.client.0.smithi066.stdout:0/917: fdatasync d1/d62/d9f/d4a/d67/d1b/d61/f7f 0 2024-09-12T01:43:23.721 INFO:tasks.workunit.client.0.smithi066.stdout:0/918: link d1/d62/d9f/d4a/d67/d1b/d26/d5b/c131 d1/d62/d9f/d92/db9/c135 0 2024-09-12T01:43:23.721 INFO:tasks.workunit.client.0.smithi066.stdout:0/919: write d1/d62/d89/f82 [877252,46627] 0 2024-09-12T01:43:23.721 INFO:tasks.workunit.client.0.smithi066.stdout:0/920: chown d1/d62/d9f/d4a/d67/d1b/d26/d9c/cd2 3060700 1 2024-09-12T01:43:23.730 INFO:tasks.workunit.client.0.smithi066.stdout:0/921: dread d1/d62/d9f/d4a/d67/d1b/d61/f7f [0,4194304] 0 2024-09-12T01:43:23.730 INFO:tasks.workunit.client.0.smithi066.stdout:0/922: symlink d1/d72/de/l136 0 2024-09-12T01:43:23.733 INFO:tasks.workunit.client.0.smithi066.stdout:8/933: fsync d12/d21/d2f/d57/d43/d66/d98/d10c/f122 0 2024-09-12T01:43:23.733 INFO:tasks.workunit.client.0.smithi066.stdout:8/934: fdatasync d12/d21/d2f/d57/d84/d50/ffd 0 2024-09-12T01:43:23.733 INFO:tasks.workunit.client.0.smithi066.stdout:5/971: dwrite d0/dd/d18/d36/dbf/dce/d30/f66 [0,4194304] 0 2024-09-12T01:43:23.733 INFO:tasks.workunit.client.0.smithi066.stdout:7/863: dwrite d2/d5/d6/d22/d75/fd4 [0,4194304] 0 2024-09-12T01:43:23.738 INFO:tasks.workunit.client.0.smithi066.stdout:5/972: mknod d0/dd/d18/d36/dbf/dce/d30/d8b/c13b 0 2024-09-12T01:43:23.739 INFO:tasks.workunit.client.0.smithi066.stdout:5/973: creat d0/d26/d2d/d33/d55/d82/f13c x:0 0 0 2024-09-12T01:43:23.748 INFO:tasks.workunit.client.0.smithi066.stdout:7/864: dread d2/d5/da/d3f/da4/d84/f87 [0,4194304] 0 2024-09-12T01:43:23.757 INFO:tasks.workunit.client.0.smithi066.stdout:0/923: dwrite d1/d62/d9f/d120/f128 [0,4194304] 0 2024-09-12T01:43:23.758 INFO:tasks.workunit.client.0.smithi066.stdout:7/865: dread d2/d5/da/d3f/da4/d6c/d80/d7c/f97 [0,4194304] 0 2024-09-12T01:43:23.758 INFO:tasks.workunit.client.0.smithi066.stdout:7/866: readlink d2/l37 0 2024-09-12T01:43:23.758 INFO:tasks.workunit.client.0.smithi066.stdout:7/867: read - d2/d5/d6/d22/d75/db6/dd8/fe1 zero size 2024-09-12T01:43:23.760 INFO:tasks.workunit.client.0.smithi066.stdout:0/924: creat d1/d62/d9f/d4a/d12a/de8/f137 x:0 0 0 2024-09-12T01:43:23.766 INFO:tasks.workunit.client.0.smithi066.stdout:8/935: dwrite d12/d21/d2f/d57/d84/d50/d56/d69/d7d/fa3 [0,4194304] 0 2024-09-12T01:43:23.772 INFO:tasks.workunit.client.0.smithi066.stdout:8/936: symlink d12/d21/d2f/d57/d84/d50/d56/db6/dc8/l13d 0 2024-09-12T01:43:23.773 INFO:tasks.workunit.client.0.smithi066.stdout:8/937: chown d12/d21/d2f/d57/d84/d50/d56/f97 0 1 2024-09-12T01:43:23.774 INFO:tasks.workunit.client.0.smithi066.stdout:8/938: mknod d12/d21/d2f/d57/d84/d50/d56/db6/dc8/c13e 0 2024-09-12T01:43:23.774 INFO:tasks.workunit.client.0.smithi066.stdout:8/939: truncate d12/d21/d2f/d57/d43/df6/f13a 916718 0 2024-09-12T01:43:23.774 INFO:tasks.workunit.client.0.smithi066.stdout:8/940: write d12/d21/d2f/d57/d3c/f99 [903167,130484] 0 2024-09-12T01:43:23.775 INFO:tasks.workunit.client.0.smithi066.stdout:8/941: creat d12/daf/f13f x:0 0 0 2024-09-12T01:43:23.785 INFO:tasks.workunit.client.0.smithi066.stdout:0/925: dwrite d1/d62/d6c/fbf [0,4194304] 0 2024-09-12T01:43:23.785 INFO:tasks.workunit.client.0.smithi066.stdout:0/926: write d1/d62/d9f/fcf [5084330,81198] 0 2024-09-12T01:43:23.785 INFO:tasks.workunit.client.0.smithi066.stdout:0/927: write d1/d62/d89/da3/dc1/de2/f103 [3974207,65194] 0 2024-09-12T01:43:23.786 INFO:tasks.workunit.client.0.smithi066.stdout:7/868: dwrite d2/d5/da/d3f/da4/d6c/d80/d7c/ff1 [0,4194304] 0 2024-09-12T01:43:23.799 INFO:tasks.workunit.client.0.smithi066.stdout:7/869: dread d2/d71/d93/f104 [0,4194304] 0 2024-09-12T01:43:23.802 INFO:tasks.workunit.client.0.smithi066.stdout:7/870: dread d2/d5/da/f7a [0,4194304] 0 2024-09-12T01:43:23.802 INFO:tasks.workunit.client.0.smithi066.stdout:0/928: dwrite d1/d62/d9f/d4a/d67/d11d/f12d [0,4194304] 0 2024-09-12T01:43:23.805 INFO:tasks.workunit.client.0.smithi066.stdout:7/871: dread d2/d5/da/d3f/da4/f4c [0,4194304] 0 2024-09-12T01:43:23.808 INFO:tasks.workunit.client.0.smithi066.stdout:7/872: creat d2/d5/d6/d40/d51/d121/d123/f126 x:0 0 0 2024-09-12T01:43:23.812 INFO:tasks.workunit.client.0.smithi066.stdout:7/873: read d2/d5/da/f36 [231292,29120] 0 2024-09-12T01:43:23.824 INFO:tasks.workunit.client.0.smithi066.stdout:7/874: dread d2/d5/da/d3f/da4/d6c/d80/f58 [0,4194304] 0 2024-09-12T01:43:23.824 INFO:tasks.workunit.client.0.smithi066.stdout:7/875: truncate d2/d5/d6/f11e 845866 0 2024-09-12T01:43:23.824 INFO:tasks.workunit.client.0.smithi066.stdout:0/929: dwrite d1/d72/de/f4b [0,4194304] 0 2024-09-12T01:43:23.824 INFO:tasks.workunit.client.0.smithi066.stdout:0/930: write d1/d62/d89/da3/feb [5016624,95143] 0 2024-09-12T01:43:23.825 INFO:tasks.workunit.client.0.smithi066.stdout:7/876: rename d2/le8 to d2/d5/da/d3f/d9b/df7/d11b/l127 0 2024-09-12T01:43:23.826 INFO:tasks.workunit.client.0.smithi066.stdout:7/877: stat d2/d5/d6/d22/d75/d2f/f34 0 2024-09-12T01:43:23.826 INFO:tasks.workunit.client.0.smithi066.stdout:0/931: truncate d1/d72/de/f3c 2172337 0 2024-09-12T01:43:23.827 INFO:tasks.workunit.client.0.smithi066.stdout:7/878: symlink d2/d5/da/d3f/d5e/l128 0 2024-09-12T01:43:23.832 INFO:tasks.workunit.client.0.smithi066.stdout:7/879: mkdir d2/d5/da/d3f/da4/d6c/d80/d5f/d129 0 2024-09-12T01:43:23.832 INFO:tasks.workunit.client.0.smithi066.stdout:7/880: chown d2/d5/da/d3f/d5e/fba 61 1 2024-09-12T01:43:23.833 INFO:tasks.workunit.client.0.smithi066.stdout:7/881: getdents d2/d5/d6/d22/d75/db6/dd8 0 2024-09-12T01:43:23.833 INFO:tasks.workunit.client.0.smithi066.stdout:7/882: write d2/d71/d93/f104 [4282917,98239] 0 2024-09-12T01:43:23.834 INFO:tasks.workunit.client.0.smithi066.stdout:7/883: write d2/d5/da/d3f/d5e/fba [4239083,102501] 0 2024-09-12T01:43:23.844 INFO:tasks.workunit.client.0.smithi066.stdout:0/932: dwrite d1/d62/d9f/d4a/d67/d1b/d26/d5b/fd8 [0,4194304] 0 2024-09-12T01:43:23.848 INFO:tasks.workunit.client.0.smithi066.stdout:0/933: rmdir d1/d62/d9f/d4a/d67/d1b/d61 39 2024-09-12T01:43:23.852 INFO:tasks.workunit.client.0.smithi066.stdout:0/934: rename d1/d62/d9f/d4a/d67/d20/da8/c110 to d1/d62/d9f/d4a/d67/d1b/d61/c138 0 2024-09-12T01:43:23.855 INFO:tasks.workunit.client.0.smithi066.stdout:0/935: link d1/d62/d9f/d4a/d67/d1b/d3b/l41 d1/d62/d9f/d4a/d67/d1b/l139 0 2024-09-12T01:43:23.857 INFO:tasks.workunit.client.0.smithi066.stdout:7/884: dwrite d2/d5/da/d3f/d9b/f67 [0,4194304] 0 2024-09-12T01:43:23.861 INFO:tasks.workunit.client.0.smithi066.stdout:7/885: mkdir d2/d5/da/d3f/da4/d6c/ddf/d117/d12a 0 2024-09-12T01:43:23.861 INFO:tasks.workunit.client.0.smithi066.stdout:7/886: write d2/d5/d6/d40/d51/d121/d53/fdb [1299999,10779] 0 2024-09-12T01:43:23.861 INFO:tasks.workunit.client.0.smithi066.stdout:7/887: dread - d2/d5/da/d3f/da4/d70/fb5 zero size 2024-09-12T01:43:23.862 INFO:tasks.workunit.client.0.smithi066.stdout:0/936: link d1/d72/f4f d1/d62/d9f/d64/f13a 0 2024-09-12T01:43:23.865 INFO:tasks.workunit.client.0.smithi066.stdout:7/888: symlink d2/d5/da/d3f/da4/d6c/d8e/da7/dc1/l12b 0 2024-09-12T01:43:23.871 INFO:tasks.workunit.client.0.smithi066.stdout:0/937: mknod d1/d62/d6c/c13b 0 2024-09-12T01:43:23.872 INFO:tasks.workunit.client.0.smithi066.stdout:0/938: write d1/d72/fd9 [18415,103179] 0 2024-09-12T01:43:23.872 INFO:tasks.workunit.client.0.smithi066.stdout:0/939: truncate d1/d62/d9f/fcf 5197833 0 2024-09-12T01:43:23.875 INFO:tasks.workunit.client.0.smithi066.stdout:7/889: creat d2/d5/da/d3f/da4/d6c/d80/d5f/d129/f12c x:0 0 0 2024-09-12T01:43:23.877 INFO:tasks.workunit.client.0.smithi066.stdout:7/890: symlink d2/d5/da/d3f/da4/d6c/d8e/l12d 0 2024-09-12T01:43:23.879 INFO:tasks.workunit.client.0.smithi066.stdout:7/891: mkdir d2/d5/d6/d40/d51/d121/d53/d12e 0 2024-09-12T01:43:23.883 INFO:tasks.workunit.client.0.smithi066.stdout:7/892: write d2/d5/da/d3f/da4/d6c/d80/f58 [1658442,77050] 0 2024-09-12T01:43:23.883 INFO:tasks.workunit.client.0.smithi066.stdout:7/893: chown d2/d5/da/d3f/da4/d6c/d80/ff6 101381619 1 2024-09-12T01:43:23.886 INFO:tasks.workunit.client.0.smithi066.stdout:7/894: symlink d2/d124/l12f 0 2024-09-12T01:43:23.886 INFO:tasks.workunit.client.0.smithi066.stdout:7/895: write d2/d5/da/d3f/d9b/f78 [825279,30404] 0 2024-09-12T01:43:23.892 INFO:tasks.workunit.client.0.smithi066.stdout:0/940: dwrite d1/d62/d9f/d7c/ff2 [0,4194304] 0 2024-09-12T01:43:23.894 INFO:tasks.workunit.client.0.smithi066.stdout:0/941: mknod d1/d62/d9f/d4a/d67/d1b/d3b/c13c 0 2024-09-12T01:43:23.910 INFO:tasks.workunit.client.0.smithi066.stdout:7/896: dwrite d2/d5/d6/d40/d63/fa1 [4194304,4194304] 0 2024-09-12T01:43:23.912 INFO:tasks.workunit.client.0.smithi066.stdout:7/897: rmdir d2/d5/da/d3f/da4/d6c/d80/d7c 39 2024-09-12T01:43:23.915 INFO:tasks.workunit.client.0.smithi066.stdout:7/898: unlink d2/d5/lb2 0 2024-09-12T01:43:23.916 INFO:tasks.workunit.client.0.smithi066.stdout:7/899: creat d2/d71/dad/f130 x:0 0 0 2024-09-12T01:43:23.916 INFO:tasks.workunit.client.0.smithi066.stdout:7/900: chown d2/f79 724451 1 2024-09-12T01:43:23.917 INFO:tasks.workunit.client.0.smithi066.stdout:7/901: stat d2/d5 0 2024-09-12T01:43:23.918 INFO:tasks.workunit.client.0.smithi066.stdout:7/902: truncate d2/d5/da/f50 3417996 0 2024-09-12T01:43:23.918 INFO:tasks.workunit.client.0.smithi066.stdout:7/903: readlink d2/d5/d6/d40/d51/l9e 0 2024-09-12T01:43:23.918 INFO:tasks.workunit.client.0.smithi066.stdout:7/904: write d2/f79 [315881,29748] 0 2024-09-12T01:43:23.920 INFO:tasks.workunit.client.0.smithi066.stdout:7/905: link d2/fcc d2/d5/d6/d22/f131 0 2024-09-12T01:43:23.923 INFO:tasks.workunit.client.0.smithi066.stdout:7/906: truncate d2/d5/d6/d40/d63/db4/ff2 2894147 0 2024-09-12T01:43:23.923 INFO:tasks.workunit.client.0.smithi066.stdout:7/907: dread - d2/d5/da/d3f/da4/fce zero size 2024-09-12T01:43:23.926 INFO:tasks.workunit.client.0.smithi066.stdout:7/908: link d2/d5/d6/d40/d51/fc2 d2/d5/da/d3f/da4/d6c/d8e/da7/dc1/f132 0 2024-09-12T01:43:23.928 INFO:tasks.workunit.client.0.smithi066.stdout:7/909: mknod d2/d71/c133 0 2024-09-12T01:43:23.928 INFO:tasks.workunit.client.0.smithi066.stdout:7/910: write d2/d5/d6/fe2 [2316516,91512] 0 2024-09-12T01:43:23.932 INFO:tasks.workunit.client.0.smithi066.stdout:7/911: getdents d2/d5/da/d3f/da4/d6c/ddf 0 2024-09-12T01:43:23.940 INFO:tasks.workunit.client.0.smithi066.stdout:7/912: truncate d2/d5/d6/d40/d63/db4/ff2 198234 0 2024-09-12T01:43:23.940 INFO:tasks.workunit.client.0.smithi066.stdout:7/913: chown d2/d5/da/d3f/d5e/c11f 4185690 1 2024-09-12T01:43:23.940 INFO:tasks.workunit.client.0.smithi066.stdout:7/914: dread - d2/d5/d6/d120/f118 zero size 2024-09-12T01:43:23.940 INFO:tasks.workunit.client.0.smithi066.stdout:7/915: creat d2/d3c/f134 x:0 0 0 2024-09-12T01:43:23.941 INFO:tasks.workunit.client.0.smithi066.stdout:7/916: truncate d2/d5/da/d3f/da4/d70/fb5 895207 0 2024-09-12T01:43:23.943 INFO:tasks.workunit.client.0.smithi066.stdout:7/917: symlink d2/d5/d6/d22/l135 0 2024-09-12T01:43:23.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/918: dread d2/d5/d6/d22/d75/d2f/f34 [0,4194304] 0 2024-09-12T01:43:23.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/919: read d2/d5/da/d3f/da4/d84/f5b [655013,79281] 0 2024-09-12T01:43:23.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/920: truncate d2/d5/d6/d22/d75/fd4 4678716 0 2024-09-12T01:43:23.949 INFO:tasks.workunit.client.0.smithi066.stdout:7/921: fdatasync d2/d5/da/d3f/da4/d6c/d80/ff6 0 2024-09-12T01:43:23.951 INFO:tasks.workunit.client.0.smithi066.stdout:7/922: creat d2/d5/da/d3f/da4/d6c/d8e/da7/f136 x:0 0 0 2024-09-12T01:43:23.954 INFO:tasks.workunit.client.0.smithi066.stdout:7/923: symlink d2/d5/d6/d40/d51/d121/d53/l137 0 2024-09-12T01:43:23.958 INFO:tasks.workunit.client.0.smithi066.stdout:7/924: unlink d2/c2c 0 2024-09-12T01:43:23.958 INFO:tasks.workunit.client.0.smithi066.stdout:7/925: readlink d2/d5/da/d3f/d5e/l128 0 2024-09-12T01:43:23.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/926: creat d2/d5/da/d3f/d9b/df7/d11b/f138 x:0 0 0 2024-09-12T01:43:23.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/927: fdatasync d2/d5/da/f7a 0 2024-09-12T01:43:23.960 INFO:tasks.workunit.client.0.smithi066.stdout:7/928: dread - d2/d5/da/d3f/f101 zero size 2024-09-12T01:43:23.961 INFO:tasks.workunit.client.0.smithi066.stdout:7/929: mkdir d2/d5/da/d3f/d139 0 2024-09-12T01:43:23.962 INFO:tasks.workunit.client.0.smithi066.stdout:7/930: mknod d2/d5/d6/d40/d51/c13a 0 2024-09-12T01:43:23.963 INFO:tasks.workunit.client.0.smithi066.stdout:7/931: unlink d2/d3c/lf0 0 2024-09-12T01:43:24.097 INFO:tasks.workunit.client.0.smithi066.stdout:2/814: sync 2024-09-12T01:43:24.097 INFO:tasks.workunit.client.0.smithi066.stdout:2/815: write de/d13/d1e/d25/f99 [966299,28384] 0 2024-09-12T01:43:24.099 INFO:tasks.workunit.client.0.smithi066.stdout:2/816: rmdir de/d13/d28/d3d 39 2024-09-12T01:43:24.125 INFO:tasks.workunit.client.0.smithi066.stdout:2/817: dwrite de/d13/d28/d3a/f4d [4194304,4194304] 0 2024-09-12T01:43:24.127 INFO:tasks.workunit.client.0.smithi066.stdout:2/818: rmdir de/d3c/d8f/dcf/dfc 0 2024-09-12T01:43:24.128 INFO:tasks.workunit.client.0.smithi066.stdout:2/819: truncate de/d13/d1e/d22/f8c 4071319 0 2024-09-12T01:43:24.128 INFO:tasks.workunit.client.0.smithi066.stdout:2/820: mknod de/d13/d28/d3a/dfd/c103 0 2024-09-12T01:43:24.129 INFO:tasks.workunit.client.0.smithi066.stdout:2/821: rename de/d13/d1e/l88 to de/d13/d28/d3a/dd4/l104 0 2024-09-12T01:43:24.131 INFO:tasks.workunit.client.0.smithi066.stdout:2/822: symlink de/d13/d28/d3a/dfd/l105 0 2024-09-12T01:43:24.138 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:23 smithi066 ceph-mon[27875]: pgmap v11: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 235 MiB/s rd, 304 MiB/s wr, 484 op/s 2024-09-12T01:43:24.148 INFO:tasks.workunit.client.0.smithi066.stdout:2/823: dwrite de/d13/d1e/d25/d5e/fa1 [0,4194304] 0 2024-09-12T01:43:24.151 INFO:tasks.workunit.client.0.smithi066.stdout:2/824: creat de/d13/d28/d3a/dfd/da8/f106 x:0 0 0 2024-09-12T01:43:24.152 INFO:tasks.workunit.client.0.smithi066.stdout:2/825: write de/d13/d28/d3a/dfd/d58/f73 [1646410,83919] 0 2024-09-12T01:43:24.152 INFO:tasks.workunit.client.0.smithi066.stdout:2/826: chown de/d13/d28/f56 3591400 1 2024-09-12T01:43:24.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:23 smithi153 ceph-mon[34713]: pgmap v11: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 235 MiB/s rd, 304 MiB/s wr, 484 op/s 2024-09-12T01:43:24.170 INFO:tasks.workunit.client.0.smithi066.stdout:2/827: dwrite de/d13/d1e/d25/f33 [0,4194304] 0 2024-09-12T01:43:24.172 INFO:tasks.workunit.client.0.smithi066.stdout:2/828: mknod de/d13/d1e/d25/deb/c107 0 2024-09-12T01:43:24.173 INFO:tasks.workunit.client.0.smithi066.stdout:2/829: symlink de/d13/d1e/da3/l108 0 2024-09-12T01:43:24.185 INFO:tasks.workunit.client.0.smithi066.stdout:2/830: dread de/d13/d1e/d25/f29 [0,4194304] 0 2024-09-12T01:43:24.185 INFO:tasks.workunit.client.0.smithi066.stdout:2/831: chown de/d13/d1e/d22/de5 6983785 1 2024-09-12T01:43:24.213 INFO:tasks.workunit.client.0.smithi066.stdout:2/832: dwrite de/d13/d1e/d25/f99 [0,4194304] 0 2024-09-12T01:43:24.272 INFO:tasks.workunit.client.0.smithi066.stdout:2/833: rmdir de/d13/d1e/d25/da2 39 2024-09-12T01:43:24.314 INFO:tasks.workunit.client.0.smithi066.stdout:9/832: sync 2024-09-12T01:43:24.315 INFO:tasks.workunit.client.0.smithi066.stdout:3/941: sync 2024-09-12T01:43:24.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/833: write d0/d6/d17/d4f/d12/fb1 [177703,130584] 0 2024-09-12T01:43:24.315 INFO:tasks.workunit.client.0.smithi066.stdout:9/834: stat d0/d6/d17/d1b/d4c/d42/d10c/f10e 0 2024-09-12T01:43:24.315 INFO:tasks.workunit.client.0.smithi066.stdout:1/873: sync 2024-09-12T01:43:24.315 INFO:tasks.workunit.client.0.smithi066.stdout:1/874: write d5/d52/d60/fa6 [652094,53099] 0 2024-09-12T01:43:24.316 INFO:tasks.workunit.client.0.smithi066.stdout:1/875: dread d5/d15/d4d/d86/dc7/fe7 [0,4194304] 0 2024-09-12T01:43:24.316 INFO:tasks.workunit.client.0.smithi066.stdout:3/942: mkdir d5/d35/d103/d1b/d45/d66/d67/d7f/da8/df6/d14f 0 2024-09-12T01:43:24.316 INFO:tasks.workunit.client.0.smithi066.stdout:3/943: creat d5/d35/d103/d1b/d45/d66/dae/ddc/f150 x:0 0 0 2024-09-12T01:43:24.318 INFO:tasks.workunit.client.0.smithi066.stdout:9/835: mkdir d0/d6/d7f/d127 0 2024-09-12T01:43:24.318 INFO:tasks.workunit.client.0.smithi066.stdout:9/836: readlink d0/d6/d17/d1b/d4c/d4b/l58 0 2024-09-12T01:43:24.321 INFO:tasks.workunit.client.0.smithi066.stdout:3/944: symlink d5/d35/d103/d1b/d45/d66/d67/d7f/da8/df6/l151 0 2024-09-12T01:43:24.323 INFO:tasks.workunit.client.0.smithi066.stdout:3/945: dread d5/d35/d103/d1b/d77/dd5/dbd/d112/f120 [0,4194304] 0 2024-09-12T01:43:24.323 INFO:tasks.workunit.client.0.smithi066.stdout:3/946: chown d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/l10e 135755 1 2024-09-12T01:43:24.324 INFO:tasks.workunit.client.0.smithi066.stdout:9/837: truncate d0/d6/f8e 2004037 0 2024-09-12T01:43:24.325 INFO:tasks.workunit.client.0.smithi066.stdout:3/947: mknod d5/d35/d103/d1b/d77/c152 0 2024-09-12T01:43:24.328 INFO:tasks.workunit.client.0.smithi066.stdout:9/838: unlink d0/d6/d37/feb 0 2024-09-12T01:43:24.329 INFO:tasks.workunit.client.0.smithi066.stdout:3/948: link d5/d35/fb6 d5/d35/d103/d1b/d45/d66/d67/d7f/d84/f153 0 2024-09-12T01:43:24.329 INFO:tasks.workunit.client.0.smithi066.stdout:3/949: dread - d5/d35/d103/d1b/d45/d66/d67/d75/f104 zero size 2024-09-12T01:43:24.332 INFO:tasks.workunit.client.0.smithi066.stdout:3/950: link d5/d35/d103/d1b/d45/d66/d5c/d101/c14e d5/d35/d103/d1b/d45/d66/d67/d75/d8e/c154 0 2024-09-12T01:43:24.332 INFO:tasks.workunit.client.0.smithi066.stdout:3/951: dread - d5/d35/d103/d1b/d45/d66/d67/d7f/f127 zero size 2024-09-12T01:43:24.336 INFO:tasks.workunit.client.0.smithi066.stdout:3/952: creat d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/d5e/f155 x:0 0 0 2024-09-12T01:43:24.336 INFO:tasks.workunit.client.0.smithi066.stdout:3/953: write d5/d35/d103/d1b/d45/d66/dae/dd7/f13a [920694,87117] 0 2024-09-12T01:43:24.336 INFO:tasks.workunit.client.0.smithi066.stdout:3/954: read - d5/d35/d103/d1b/d45/d66/d5c/dee/ff0 zero size 2024-09-12T01:43:24.344 INFO:tasks.workunit.client.0.smithi066.stdout:9/839: dwrite d0/d6/d17/d28/f100 [0,4194304] 0 2024-09-12T01:43:24.346 INFO:tasks.workunit.client.0.smithi066.stdout:9/840: mknod d0/d6/d17/d4f/d9/de/c128 0 2024-09-12T01:43:24.348 INFO:tasks.workunit.client.0.smithi066.stdout:9/841: write d0/d6/d17/d1b/d4c/f2b [4215283,32272] 0 2024-09-12T01:43:24.348 INFO:tasks.workunit.client.0.smithi066.stdout:9/842: truncate d0/d6/d17/d28/f77 132186 0 2024-09-12T01:43:24.351 INFO:tasks.workunit.client.0.smithi066.stdout:3/955: dwrite d5/d35/d103/d1b/d65/d89/fea [0,4194304] 0 2024-09-12T01:43:24.355 INFO:tasks.workunit.client.0.smithi066.stdout:3/956: creat d5/d35/d103/d1b/d77/d8b/d132/f156 x:0 0 0 2024-09-12T01:43:24.357 INFO:tasks.workunit.client.0.smithi066.stdout:3/957: creat d5/d35/d103/d48/d9c/f157 x:0 0 0 2024-09-12T01:43:24.357 INFO:tasks.workunit.client.0.smithi066.stdout:3/958: chown d5/d35/d103/d1b/d77/c152 2 1 2024-09-12T01:43:24.358 INFO:tasks.workunit.client.0.smithi066.stdout:3/959: rename d5/d35/d103/d1b/d65/d89/d50/fa4 to d5/d35/f158 0 2024-09-12T01:43:24.359 INFO:tasks.workunit.client.0.smithi066.stdout:3/960: creat d5/d35/d103/d1b/d45/d85/dd2/f159 x:0 0 0 2024-09-12T01:43:24.361 INFO:tasks.workunit.client.0.smithi066.stdout:3/961: link d5/d35/d103/d1b/d45/d66/d67/d6d/fa1 d5/d35/d103/d1b/d45/d66/d67/f15a 0 2024-09-12T01:43:24.362 INFO:tasks.workunit.client.0.smithi066.stdout:3/962: truncate d5/d35/d103/d1b/d45/d66/d67/f69 9251713 0 2024-09-12T01:43:24.362 INFO:tasks.workunit.client.0.smithi066.stdout:3/963: chown d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f 57358328 1 2024-09-12T01:43:24.364 INFO:tasks.workunit.client.0.smithi066.stdout:3/964: creat d5/d35/d103/d1b/d45/d66/d67/d6d/f15b x:0 0 0 2024-09-12T01:43:24.365 INFO:tasks.workunit.client.0.smithi066.stdout:9/843: dwrite d0/d6/d17/d4f/d12/f27 [0,4194304] 0 2024-09-12T01:43:24.366 INFO:tasks.workunit.client.0.smithi066.stdout:9/844: write d0/d6/d17/d1b/d4c/d4b/d86/de0/f102 [304001,119153] 0 2024-09-12T01:43:24.366 INFO:tasks.workunit.client.0.smithi066.stdout:9/845: chown d0/d6/d7f/lc4 1336757 1 2024-09-12T01:43:24.366 INFO:tasks.workunit.client.0.smithi066.stdout:9/846: chown d0/d6/d17/d1b 243080333 1 2024-09-12T01:43:24.366 INFO:tasks.workunit.client.0.smithi066.stdout:9/847: creat d0/d6/d17/d4f/d12/d84/f129 x:0 0 0 2024-09-12T01:43:24.367 INFO:tasks.workunit.client.0.smithi066.stdout:3/965: truncate d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/f2b 2989329 0 2024-09-12T01:43:24.367 INFO:tasks.workunit.client.0.smithi066.stdout:3/966: readlink d5/d35/d103/d1b/d45/d66/l5f 0 2024-09-12T01:43:24.371 INFO:tasks.workunit.client.0.smithi066.stdout:9/848: link d0/d6/d17/d4f/d12/dbe/fde d0/d6/d7f/f12a 0 2024-09-12T01:43:24.374 INFO:tasks.workunit.client.0.smithi066.stdout:9/849: dread d0/d6/d17/d1b/d4c/d42/fa5 [0,4194304] 0 2024-09-12T01:43:24.374 INFO:tasks.workunit.client.0.smithi066.stdout:9/850: creat d0/d6/d17/d4f/d12/f12b x:0 0 0 2024-09-12T01:43:24.375 INFO:tasks.workunit.client.0.smithi066.stdout:9/851: creat d0/d6/d7f/dd2/f12c x:0 0 0 2024-09-12T01:43:24.375 INFO:tasks.workunit.client.0.smithi066.stdout:3/967: mkdir d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4/d105/d15c 0 2024-09-12T01:43:24.375 INFO:tasks.workunit.client.0.smithi066.stdout:3/968: stat d5/d35/d103/d1b/d45/d66/d67/f15a 0 2024-09-12T01:43:24.389 INFO:tasks.workunit.client.0.smithi066.stdout:3/969: dread d5/d35/d103/d1b/d45/d85/f9e [0,4194304] 0 2024-09-12T01:43:24.402 INFO:tasks.workunit.client.0.smithi066.stdout:3/970: dread d5/d35/d103/d1b/d45/d66/d5c/fe2 [0,4194304] 0 2024-09-12T01:43:24.419 INFO:tasks.workunit.client.0.smithi066.stdout:3/971: dwrite d5/d35/d103/d48/fa9 [0,4194304] 0 2024-09-12T01:43:24.424 INFO:tasks.workunit.client.0.smithi066.stdout:3/972: link d5/d35/d103/d1b/d77/dd5/fa7 d5/d35/d103/d1b/d77/dd5/dcf/f15d 0 2024-09-12T01:43:24.424 INFO:tasks.workunit.client.0.smithi066.stdout:3/973: chown d5/d35/d103/d1b/d45/d66/d67/d6d/f7a 56 1 2024-09-12T01:43:24.428 INFO:tasks.workunit.client.0.smithi066.stdout:3/974: truncate d5/d35/d103/d48/f68 3139472 0 2024-09-12T01:43:24.442 INFO:tasks.workunit.client.0.smithi066.stdout:3/975: dread d5/d35/f4d [0,4194304] 0 2024-09-12T01:43:24.455 INFO:tasks.workunit.client.0.smithi066.stdout:3/976: read d5/d35/d103/d1b/d77/f7c [255927,88461] 0 2024-09-12T01:43:24.455 INFO:tasks.workunit.client.0.smithi066.stdout:3/977: creat d5/d35/f15e x:0 0 0 2024-09-12T01:43:24.460 INFO:tasks.workunit.client.0.smithi066.stdout:5/974: sync 2024-09-12T01:43:24.460 INFO:tasks.workunit.client.0.smithi066.stdout:5/975: fdatasync d0/dd/d18/d36/dbf/dce/da4/df4/f12b 0 2024-09-12T01:43:24.461 INFO:tasks.workunit.client.0.smithi066.stdout:4/967: sync 2024-09-12T01:43:24.461 INFO:tasks.workunit.client.0.smithi066.stdout:4/968: chown d4/d15/d33 0 1 2024-09-12T01:43:24.462 INFO:tasks.workunit.client.0.smithi066.stdout:4/969: mknod d4/d6/d8/d110/c146 0 2024-09-12T01:43:24.471 INFO:tasks.workunit.client.0.smithi066.stdout:5/976: write d0/d26/faf [404118,14583] 0 2024-09-12T01:43:24.473 INFO:tasks.workunit.client.0.smithi066.stdout:5/977: symlink d0/dd/d18/d36/dbf/dce/d9a/dad/l13d 0 2024-09-12T01:43:24.477 INFO:tasks.workunit.client.0.smithi066.stdout:3/978: dwrite d5/d35/d103/d48/fa9 [0,4194304] 0 2024-09-12T01:43:24.477 INFO:tasks.workunit.client.0.smithi066.stdout:3/979: write d5/d35/d103/d1b/d45/d66/d67/d7f/da8/fd9 [1632505,9391] 0 2024-09-12T01:43:24.477 INFO:tasks.workunit.client.0.smithi066.stdout:3/980: chown d5/d35/d103/d1b/d77/dd5/fa7 300010 1 2024-09-12T01:43:24.480 INFO:tasks.workunit.client.0.smithi066.stdout:3/981: rename d5/d14b to d5/d35/d103/d1b/d45/d15f 0 2024-09-12T01:43:24.546 INFO:tasks.workunit.client.0.smithi066.stdout:3/982: fdatasync d5/d35/d103/d1b/d45/d66/d67/d6d/f78 0 2024-09-12T01:43:24.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/983: creat d5/d35/d103/d1b/d65/d89/d50/f160 x:0 0 0 2024-09-12T01:43:24.549 INFO:tasks.workunit.client.0.smithi066.stdout:3/984: write d5/d35/d103/d1b/d45/d66/d67/d75/fb7 [505113,26017] 0 2024-09-12T01:43:24.549 INFO:tasks.workunit.client.0.smithi066.stdout:4/970: dwrite d4/d5f/dea/d101/f141 [0,4194304] 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/978: dread d0/d26/de3/fe9 [0,4194304] 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:3/985: symlink d5/d13d/l161 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:4/971: mkdir d4/d6/d62/db0/dd6/dd8/d147 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/979: creat d0/dd/d18/d36/dbf/dce/d3b/d98/dde/f13e x:0 0 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/980: write d0/d26/d2d/d33/d55/d82/d87/f113 [747903,29037] 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:3/986: mknod d5/d35/d103/d1b/d65/d89/d102/c162 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:4/972: dread d4/d5f/f85 [0,4194304] 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:3/987: symlink d5/d35/d103/d1b/d45/d66/dae/dd7/l163 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/981: dread d0/d26/d2d/d42/f89 [0,4194304] 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/982: write d0/dd/d18/d36/dbf/dce/d3b/d98/dde/fef [659120,119786] 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/983: dread - d0/d26/d2d/d33/da2/f104 zero size 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:5/984: truncate d0/d26/d2d/d33/d55/d82/d87/d8e/fc5 1444815 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:4/973: rename d4/d6/d27/f98 to d4/d6/d8/d4a/d118/f148 0 2024-09-12T01:43:24.550 INFO:tasks.workunit.client.0.smithi066.stdout:4/974: write d4/d6/d48/d88/f7a [1320872,127565] 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/985: mknod d0/d26/d12c/c13f 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/986: unlink d0/dd/d18/d36/dbf/dce/d30/l3c 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/987: creat d0/d26/d2d/d33/db0/f140 x:0 0 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/988: dread d0/d26/d2d/d33/d55/d73/f9c [0,4194304] 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/989: creat d0/d26/d2d/d42/d95/dc0/f141 x:0 0 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/990: mkdir d0/d26/d12c/d142 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/991: rename d0/dd/d18/d36/dbf/dce/dd5/dd7/c11c to d0/dd/d18/d36/dbf/dce/d3b/d6b/c143 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/992: dread - d0/d26/d2d/d42/d95/dc0/fff zero size 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/993: chown d0/d21/f44 34510864 1 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/994: fdatasync d0/dd/f8d 0 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/995: rmdir d0/dd/d18/d36/dbf/dce/d3b 39 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/996: chown d0/la 590 1 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/997: chown d0/dd/d18/d36/dbf/dce/d3b/d98/dde/d125 109925039 1 2024-09-12T01:43:24.551 INFO:tasks.workunit.client.0.smithi066.stdout:5/998: mknod d0/d26/de3/c144 0 2024-09-12T01:43:24.552 INFO:tasks.workunit.client.0.smithi066.stdout:5/999: chown d0/dd/d18/d36/dbf/dce/d30/d8b/c107 12973308 1 2024-09-12T01:43:24.552 INFO:tasks.workunit.client.0.smithi066.stdout:4/975: dwrite d4/de5/f122 [0,4194304] 0 2024-09-12T01:43:24.552 INFO:tasks.workunit.client.0.smithi066.stdout:4/976: dwrite d4/d6/d27/f133 [0,4194304] 0 2024-09-12T01:43:24.658 INFO:tasks.workunit.client.0.smithi066.stdout:8/942: sync 2024-09-12T01:43:24.660 INFO:tasks.workunit.client.0.smithi066.stdout:8/943: truncate d12/d21/d2f/d57/d84/d50/d56/db6/dee/fa4 558058 0 2024-09-12T01:43:24.670 INFO:tasks.workunit.client.0.smithi066.stdout:8/944: rmdir d12/d21/d2f/d57/d84/d50/d56/db6 39 2024-09-12T01:43:24.672 INFO:tasks.workunit.client.0.smithi066.stdout:8/945: mkdir d12/d21/d2f/d57/d84/d50/d56/d69/d7d/d140 0 2024-09-12T01:43:24.690 INFO:tasks.workunit.client.0.smithi066.stdout:8/946: dwrite d12/d21/d2f/d57/d84/d50/d56/f75 [0,4194304] 0 2024-09-12T01:43:24.710 INFO:tasks.workunit.client.0.smithi066.stdout:8/947: dwrite d12/d21/d2f/fd0 [0,4194304] 0 2024-09-12T01:43:24.735 INFO:tasks.workunit.client.0.smithi066.stdout:8/948: dwrite d12/d21/d2f/d53/d10f/f139 [0,4194304] 0 2024-09-12T01:43:24.738 INFO:tasks.workunit.client.0.smithi066.stdout:8/949: symlink d12/d21/d2f/d57/d84/d50/d56/db6/dee/l141 0 2024-09-12T01:43:24.738 INFO:tasks.workunit.client.0.smithi066.stdout:8/950: fsync d12/f19 0 2024-09-12T01:43:24.739 INFO:tasks.workunit.client.0.smithi066.stdout:8/951: mkdir d12/d21/d2f/df5/d142 0 2024-09-12T01:43:24.740 INFO:tasks.workunit.client.0.smithi066.stdout:8/952: mknod d12/d21/d2f/d57/c143 0 2024-09-12T01:43:24.740 INFO:tasks.workunit.client.0.smithi066.stdout:8/953: readlink d12/d21/d2f/d57/d43/ldc 0 2024-09-12T01:43:24.768 INFO:tasks.workunit.client.0.smithi066.stdout:0/942: sync 2024-09-12T01:43:24.769 INFO:tasks.workunit.client.0.smithi066.stdout:7/932: sync 2024-09-12T01:43:24.769 INFO:tasks.workunit.client.0.smithi066.stdout:2/834: sync 2024-09-12T01:43:24.769 INFO:tasks.workunit.client.0.smithi066.stdout:8/954: dwrite d12/d21/d2f/f10e [0,4194304] 0 2024-09-12T01:43:24.769 INFO:tasks.workunit.client.0.smithi066.stdout:0/943: write d1/d62/f8e [1357677,87878] 0 2024-09-12T01:43:24.769 INFO:tasks.workunit.client.0.smithi066.stdout:0/944: fdatasync d1/d62/d9f/d4a/d12a/de8/f137 0 2024-09-12T01:43:24.771 INFO:tasks.workunit.client.0.smithi066.stdout:2/835: mknod de/d13/d1e/d25/deb/c109 0 2024-09-12T01:43:24.772 INFO:tasks.workunit.client.0.smithi066.stdout:7/933: symlink d2/d5/da/l13b 0 2024-09-12T01:43:24.777 INFO:tasks.workunit.client.0.smithi066.stdout:0/945: unlink d1/d62/d9f/d4a/d67/d1b/d3b/f107 0 2024-09-12T01:43:24.777 INFO:tasks.workunit.client.0.smithi066.stdout:0/946: read d1/d62/d9f/d4a/d67/f52 [7627740,66866] 0 2024-09-12T01:43:24.778 INFO:tasks.workunit.client.0.smithi066.stdout:8/955: read d12/d21/d2f/d53/d10f/f139 [3866332,10684] 0 2024-09-12T01:43:24.780 INFO:tasks.workunit.client.0.smithi066.stdout:2/836: creat de/d13/d1e/da3/f10a x:0 0 0 2024-09-12T01:43:24.780 INFO:tasks.workunit.client.0.smithi066.stdout:2/837: fsync de/d13/d28/ff6 0 2024-09-12T01:43:24.782 INFO:tasks.workunit.client.0.smithi066.stdout:7/934: mknod d2/d5/da/d3f/da4/d70/c13c 0 2024-09-12T01:43:24.783 INFO:tasks.workunit.client.0.smithi066.stdout:0/947: creat d1/d62/d9f/d7c/f13d x:0 0 0 2024-09-12T01:43:24.783 INFO:tasks.workunit.client.0.smithi066.stdout:0/948: stat d1 0 2024-09-12T01:43:24.789 INFO:tasks.workunit.client.0.smithi066.stdout:8/956: mkdir d12/daf/d144 0 2024-09-12T01:43:24.792 INFO:tasks.workunit.client.0.smithi066.stdout:2/838: unlink de/d13/d1e/d25/c62 0 2024-09-12T01:43:24.793 INFO:tasks.workunit.client.0.smithi066.stdout:7/935: link d2/d5/da/d3f/da4/d6c/cfa d2/d5/da/d3f/da4/d84/c13d 0 2024-09-12T01:43:24.795 INFO:tasks.workunit.client.0.smithi066.stdout:8/957: mkdir d12/d21/d2f/d57/d13b/d145 0 2024-09-12T01:43:24.795 INFO:tasks.workunit.client.0.smithi066.stdout:8/958: creat d12/d21/d2f/d57/d84/d50/ded/f146 x:0 0 0 2024-09-12T01:43:24.796 INFO:tasks.workunit.client.0.smithi066.stdout:7/936: mknod d2/d5/d6/d22/d75/d2f/c13e 0 2024-09-12T01:43:24.796 INFO:tasks.workunit.client.0.smithi066.stdout:7/937: chown d2/d5/da/d3f/da4/d70/c13c 15 1 2024-09-12T01:43:24.797 INFO:tasks.workunit.client.0.smithi066.stdout:0/949: getdents d1/d62/d9f/d120 0 2024-09-12T01:43:24.799 INFO:tasks.workunit.client.0.smithi066.stdout:8/959: symlink d12/d21/d2f/df5/l147 0 2024-09-12T01:43:24.800 INFO:tasks.workunit.client.0.smithi066.stdout:8/960: creat d12/d21/d2f/d57/d43/d82/f148 x:0 0 0 2024-09-12T01:43:24.800 INFO:tasks.workunit.client.0.smithi066.stdout:8/961: write d12/d21/d2f/d57/d3c/fc1 [712599,125869] 0 2024-09-12T01:43:24.801 INFO:tasks.workunit.client.0.smithi066.stdout:2/839: read de/d13/d1e/d84/fab [5012129,58230] 0 2024-09-12T01:43:24.801 INFO:tasks.workunit.client.0.smithi066.stdout:2/840: fdatasync de/d13/f87 0 2024-09-12T01:43:24.802 INFO:tasks.workunit.client.0.smithi066.stdout:0/950: mknod d1/d62/d89/da3/dc1/c13e 0 2024-09-12T01:43:24.804 INFO:tasks.workunit.client.0.smithi066.stdout:0/951: dread d1/d62/d9f/d4a/d67/d20/d5e/fa7 [0,4194304] 0 2024-09-12T01:43:24.805 INFO:tasks.workunit.client.0.smithi066.stdout:8/962: mkdir d12/d21/d2f/d57/d84/d50/d56/db6/dc8/d149 0 2024-09-12T01:43:24.806 INFO:tasks.workunit.client.0.smithi066.stdout:7/938: getdents d2/d3c 0 2024-09-12T01:43:24.808 INFO:tasks.workunit.client.0.smithi066.stdout:2/841: symlink de/d13/d28/d3a/dfd/d81/l10b 0 2024-09-12T01:43:24.810 INFO:tasks.workunit.client.0.smithi066.stdout:0/952: creat d1/d62/d9f/d4a/d67/d6e/d105/f13f x:0 0 0 2024-09-12T01:43:24.810 INFO:tasks.workunit.client.0.smithi066.stdout:0/953: read - d1/d62/d9f/d92/db9/ded/f124 zero size 2024-09-12T01:43:24.813 INFO:tasks.workunit.client.0.smithi066.stdout:4/977: sync 2024-09-12T01:43:24.813 INFO:tasks.workunit.client.0.smithi066.stdout:9/852: sync 2024-09-12T01:43:24.813 INFO:tasks.workunit.client.0.smithi066.stdout:1/876: sync 2024-09-12T01:43:24.813 INFO:tasks.workunit.client.0.smithi066.stdout:1/877: dread - d5/dc/d53/dae/fcf zero size 2024-09-12T01:43:24.813 INFO:tasks.workunit.client.0.smithi066.stdout:3/988: sync 2024-09-12T01:43:24.814 INFO:tasks.workunit.client.0.smithi066.stdout:7/939: symlink d2/d5/da/d3f/da4/ddd/l13f 0 2024-09-12T01:43:24.817 INFO:tasks.workunit.client.0.smithi066.stdout:2/842: mkdir de/d13/d28/d3a/dfd/d81/d10c 0 2024-09-12T01:43:24.819 INFO:tasks.workunit.client.0.smithi066.stdout:0/954: creat d1/d62/d9f/d4a/d67/d3e/f140 x:0 0 0 2024-09-12T01:43:24.825 INFO:tasks.workunit.client.0.smithi066.stdout:4/978: rename d4/d6/d27/cbe to d4/d6/d27/d2f/c149 0 2024-09-12T01:43:24.827 INFO:tasks.workunit.client.0.smithi066.stdout:3/989: creat d5/d35/d103/d1b/d65/f164 x:0 0 0 2024-09-12T01:43:24.829 INFO:tasks.workunit.client.0.smithi066.stdout:7/940: unlink d2/d5/da/d3f/d9b/d4d/fe4 0 2024-09-12T01:43:24.829 INFO:tasks.workunit.client.0.smithi066.stdout:7/941: readlink d2/d5/d6/d40/lec 0 2024-09-12T01:43:24.830 INFO:tasks.workunit.client.0.smithi066.stdout:7/942: fdatasync d2/d5/d6/d40/d51/f10e 0 2024-09-12T01:43:24.832 INFO:tasks.workunit.client.0.smithi066.stdout:2/843: rename de/d13/d28/d3a/dfd/d81/l10b to de/d3c/d8f/l10d 0 2024-09-12T01:43:24.832 INFO:tasks.workunit.client.0.smithi066.stdout:2/844: stat de/f15 0 2024-09-12T01:43:24.840 INFO:tasks.workunit.client.0.smithi066.stdout:3/990: rename d5/d35/d103/d1b/d45/d66/d67/d75/d8e/db4/de4 to d5/d35/d103/d1b/d45/d66/d67/d7f/d84/dc6/d165 0 2024-09-12T01:43:24.840 INFO:tasks.workunit.client.0.smithi066.stdout:3/991: fsync d5/d35/d103/d1b/d65/d89/f72 0 2024-09-12T01:43:24.844 INFO:tasks.workunit.client.0.smithi066.stdout:9/853: write d0/d6/d17/d28/f77 [1138144,2278] 0 2024-09-12T01:43:24.844 INFO:tasks.workunit.client.0.smithi066.stdout:9/854: dread - d0/d6/d7f/d90/f11f zero size 2024-09-12T01:43:24.845 INFO:tasks.workunit.client.0.smithi066.stdout:9/855: write d0/d6/d17/f74 [157140,23222] 0 2024-09-12T01:43:24.851 INFO:tasks.workunit.client.0.smithi066.stdout:1/878: dwrite d5/dc/d36/d57/dac/dd5/f10a [0,4194304] 0 2024-09-12T01:43:24.853 INFO:tasks.workunit.client.0.smithi066.stdout:0/955: dwrite d1/d62/d9f/d92/d95/fb2 [0,4194304] 0 2024-09-12T01:43:24.854 INFO:tasks.workunit.client.0.smithi066.stdout:0/956: mknod d1/d72/de/c141 0 2024-09-12T01:43:24.854 INFO:tasks.workunit.client.0.smithi066.stdout:0/957: chown d1/d62/d6c/fbf 4 1 2024-09-12T01:43:24.854 INFO:tasks.workunit.client.0.smithi066.stdout:0/958: readlink d1/d62/d9f/d4a/d67/d1b/d3b/le1 0 2024-09-12T01:43:24.854 INFO:tasks.workunit.client.0.smithi066.stdout:0/959: fsync d1/d62/d9f/fcf 0 2024-09-12T01:43:24.856 INFO:tasks.workunit.client.0.smithi066.stdout:0/960: creat d1/d62/d9f/d4a/d67/d20/dc9/d118/f142 x:0 0 0 2024-09-12T01:43:24.859 INFO:tasks.workunit.client.0.smithi066.stdout:7/943: dwrite d2/d5/da/d3f/da4/d70/f9f [0,4194304] 0 2024-09-12T01:43:24.861 INFO:tasks.workunit.client.0.smithi066.stdout:2/845: dwrite de/d13/f87 [0,4194304] 0 2024-09-12T01:43:24.863 INFO:tasks.workunit.client.0.smithi066.stdout:7/944: link d2/d5/d6/d40/d51/c13a d2/d5/da/d3f/d9b/df7/d11b/c140 0 2024-09-12T01:43:24.863 INFO:tasks.workunit.client.0.smithi066.stdout:7/945: read - d2/d5/da/d3f/da4/d6c/d80/d5f/d129/f12c zero size 2024-09-12T01:43:24.863 INFO:tasks.workunit.client.0.smithi066.stdout:7/946: chown d2/d5/d6/d22/d75/d2f 2082832098 1 2024-09-12T01:43:24.876 INFO:tasks.workunit.client.0.smithi066.stdout:2/846: dread de/fec [0,4194304] 0 2024-09-12T01:43:24.876 INFO:tasks.workunit.client.0.smithi066.stdout:2/847: truncate de/d3c/d8f/fd1 773678 0 2024-09-12T01:43:24.876 INFO:tasks.workunit.client.0.smithi066.stdout:2/848: fsync de/d13/d28/f52 0 2024-09-12T01:43:24.884 INFO:tasks.workunit.client.0.smithi066.stdout:1/879: dwrite d5/d15/d4d/d86/fce [0,4194304] 0 2024-09-12T01:43:24.896 INFO:tasks.workunit.client.0.smithi066.stdout:9/856: dwrite d0/d6/d17/d1b/d4c/d42/f5a [0,4194304] 0 2024-09-12T01:43:24.896 INFO:tasks.workunit.client.0.smithi066.stdout:9/857: dread - d0/d6/d17/d1b/da2/dae/dc2/f101 zero size 2024-09-12T01:43:24.896 INFO:tasks.workunit.client.0.smithi066.stdout:3/992: dwrite f2 [8388608,4194304] 0 2024-09-12T01:43:24.897 INFO:tasks.workunit.client.0.smithi066.stdout:0/961: dwrite d1/f2d [0,4194304] 0 2024-09-12T01:43:24.897 INFO:tasks.workunit.client.0.smithi066.stdout:7/947: dwrite d2/d3c/f134 [0,4194304] 0 2024-09-12T01:43:24.897 INFO:tasks.workunit.client.0.smithi066.stdout:7/948: readlink d2/d5/d6/d22/d75/l15 0 2024-09-12T01:43:24.897 INFO:tasks.workunit.client.0.smithi066.stdout:2/849: dwrite de/d13/d28/f59 [0,4194304] 0 2024-09-12T01:43:24.898 INFO:tasks.workunit.client.0.smithi066.stdout:3/993: creat d5/d35/d103/d1b/d77/dd5/d13c/f166 x:0 0 0 2024-09-12T01:43:24.900 INFO:tasks.workunit.client.0.smithi066.stdout:0/962: symlink d1/d62/d9f/d4a/d67/d20/dc9/d118/l143 0 2024-09-12T01:43:24.904 INFO:tasks.workunit.client.0.smithi066.stdout:1/880: dwrite d5/dc/f12 [4194304,4194304] 0 2024-09-12T01:43:24.906 INFO:tasks.workunit.client.0.smithi066.stdout:1/881: dread d5/dc/d36/de8/d8e/de2/dbc/fd9 [0,4194304] 0 2024-09-12T01:43:24.909 INFO:tasks.workunit.client.0.smithi066.stdout:2/850: creat de/d13/d1e/f10e x:0 0 0 2024-09-12T01:43:24.909 INFO:tasks.workunit.client.0.smithi066.stdout:9/858: dread d0/d6/d17/d1b/da2/dae/f70 [0,4194304] 0 2024-09-12T01:43:24.909 INFO:tasks.workunit.client.0.smithi066.stdout:9/859: chown d0/d6/d17/d4f/d9/lb8 3655464 1 2024-09-12T01:43:24.911 INFO:tasks.workunit.client.0.smithi066.stdout:0/963: write d1/d62/d9f/d64/fbe [557965,126256] 0 2024-09-12T01:43:24.911 INFO:tasks.workunit.client.0.smithi066.stdout:7/949: link d2/d5/da/d3f/da4/d6c/ddf/f11d d2/d5/da/d3f/d9b/df7/d11b/f141 0 2024-09-12T01:43:24.914 INFO:tasks.workunit.client.0.smithi066.stdout:3/994: unlink d5/d35/d103/d1b/d45/d66/d67/d6d/dc7/d4f/f51 0 2024-09-12T01:43:24.914 INFO:tasks.workunit.client.0.smithi066.stdout:3/995: stat d5/d35/d103/d1b/d45/d66/d5c/dee/f116 0 2024-09-12T01:43:24.918 INFO:tasks.workunit.client.0.smithi066.stdout:1/882: symlink d5/d52/l10b 0 2024-09-12T01:43:24.920 INFO:tasks.workunit.client.0.smithi066.stdout:9/860: mkdir d0/d6/d17/d1b/d4c/d4b/d86/de0/d12d 0 2024-09-12T01:43:24.922 INFO:tasks.workunit.client.0.smithi066.stdout:0/964: symlink d1/d62/d9f/d4a/d67/d20/da8/l144 0 2024-09-12T01:43:24.923 INFO:tasks.workunit.client.0.smithi066.stdout:0/965: fsync d1/d62/d6c/dad/df0/ff4 0 2024-09-12T01:43:24.927 INFO:tasks.workunit.client.0.smithi066.stdout:7/950: unlink d2/d5/d6/d40/d51/d121/d53/l137 0 2024-09-12T01:43:24.927 INFO:tasks.workunit.client.0.smithi066.stdout:7/951: write d2/d5/da/d3f/d9b/d4d/f60 [378033,28086] 0 2024-09-12T01:43:24.928 INFO:tasks.workunit.client.0.smithi066.stdout:7/952: truncate d2/d5/d6/d40/d63/db4/ff2 635962 0 2024-09-12T01:43:24.928 INFO:tasks.workunit.client.0.smithi066.stdout:7/953: chown d2/d5/d6/cee 86846 1 2024-09-12T01:43:24.928 INFO:tasks.workunit.client.0.smithi066.stdout:3/996: creat d5/d13d/f167 x:0 0 0 2024-09-12T01:43:24.928 INFO:tasks.workunit.client.0.smithi066.stdout:3/997: truncate d5/d35/d103/d1b/d65/d89/fb1 81357 0 2024-09-12T01:43:24.928 INFO:tasks.workunit.client.0.smithi066.stdout:3/998: write d5/d35/d103/d1b/d45/d66/d67/d6d/f78 [4440573,41149] 0 2024-09-12T01:43:24.929 INFO:tasks.workunit.client.0.smithi066.stdout:7/954: unlink d2/d5/d6/d40/d51/d121/fbf 0 2024-09-12T01:43:24.931 INFO:tasks.workunit.client.0.smithi066.stdout:3/999: mknod d5/d35/d103/d1b/d45/d66/d67/d7f/da8/df6/d14f/c168 0 2024-09-12T01:43:24.932 INFO:tasks.workunit.client.0.smithi066.stdout:0/966: write d1/d62/d6c/fbf [413128,109497] 0 2024-09-12T01:43:24.933 INFO:tasks.workunit.client.0.smithi066.stdout:7/955: mknod d2/d5/da/d3f/da4/ddd/c142 0 2024-09-12T01:43:24.935 INFO:tasks.workunit.client.0.smithi066.stdout:0/967: mknod d1/d62/d9f/db4/c145 0 2024-09-12T01:43:24.935 INFO:tasks.workunit.client.0.smithi066.stdout:0/968: write d1/d62/d9f/d4a/d67/d1b/d3b/fcc [223550,70292] 0 2024-09-12T01:43:24.937 INFO:tasks.workunit.client.0.smithi066.stdout:0/969: creat d1/d62/d89/d83/d8b/f146 x:0 0 0 2024-09-12T01:43:24.943 INFO:tasks.workunit.client.0.smithi066.stdout:2/851: dwrite de/d13/d5c/f78 [0,4194304] 0 2024-09-12T01:43:24.943 INFO:tasks.workunit.client.0.smithi066.stdout:9/861: dwrite d0/d6/d17/d28/fd7 [0,4194304] 0 2024-09-12T01:43:24.951 INFO:tasks.workunit.client.0.smithi066.stdout:2/852: symlink de/d3c/l10f 0 2024-09-12T01:43:24.957 INFO:tasks.workunit.client.0.smithi066.stdout:9/862: mknod d0/d6/d43/df7/c12e 0 2024-09-12T01:43:24.957 INFO:tasks.workunit.client.0.smithi066.stdout:0/970: rmdir d1/d62/d89/d83/d8b 39 2024-09-12T01:43:24.962 INFO:tasks.workunit.client.0.smithi066.stdout:2/853: creat de/f110 x:0 0 0 2024-09-12T01:43:24.965 INFO:tasks.workunit.client.0.smithi066.stdout:9/863: mkdir d0/d6/d7f/d12f 0 2024-09-12T01:43:24.965 INFO:tasks.workunit.client.0.smithi066.stdout:9/864: fsync d0/d6/d17/d4f/d9/fc7 0 2024-09-12T01:43:24.965 INFO:tasks.workunit.client.0.smithi066.stdout:9/865: stat d0/d6/d17/d1b/de9/df9/d10f 0 2024-09-12T01:43:24.969 INFO:tasks.workunit.client.0.smithi066.stdout:9/866: rename d0/d6/d17/d1b/d4c/d42/c7c to d0/d6/d17/d4f/d9/de/c130 0 2024-09-12T01:43:24.970 INFO:tasks.workunit.client.0.smithi066.stdout:1/883: dwrite d5/dc/f8f [0,4194304] 0 2024-09-12T01:43:24.971 INFO:tasks.workunit.client.0.smithi066.stdout:1/884: write d5/dc/d53/d9b/f108 [337602,80240] 0 2024-09-12T01:43:24.971 INFO:tasks.workunit.client.0.smithi066.stdout:1/885: truncate d5/dc/d36/de8/dc6/fd1 374601 0 2024-09-12T01:43:24.973 INFO:tasks.workunit.client.0.smithi066.stdout:1/886: mknod d5/dc/d36/d57/c10c 0 2024-09-12T01:43:24.975 INFO:tasks.workunit.client.0.smithi066.stdout:1/887: readlink d5/d15/l18 0 2024-09-12T01:43:24.975 INFO:tasks.workunit.client.0.smithi066.stdout:1/888: truncate d5/dc/d53/dae/fcf 589294 0 2024-09-12T01:43:24.976 INFO:tasks.workunit.client.0.smithi066.stdout:0/971: dwrite d1/d72/f4f [0,4194304] 0 2024-09-12T01:43:24.976 INFO:tasks.workunit.client.0.smithi066.stdout:0/972: write d1/d62/d9f/d64/fbe [2868384,28935] 0 2024-09-12T01:43:24.977 INFO:tasks.workunit.client.0.smithi066.stdout:2/854: write f8 [1738137,35707] 0 2024-09-12T01:43:24.979 INFO:tasks.workunit.client.0.smithi066.stdout:0/973: creat d1/d62/d9f/d4a/d67/d20/f147 x:0 0 0 2024-09-12T01:43:24.985 INFO:tasks.workunit.client.0.smithi066.stdout:1/889: write d5/dc/d53/f94 [1021312,84735] 0 2024-09-12T01:43:24.987 INFO:tasks.workunit.client.0.smithi066.stdout:1/890: creat d5/dc/f10d x:0 0 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/855: dwrite de/d13/d28/f59 [0,4194304] 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/856: truncate de/d13/d7f/fc4 519656 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/857: creat de/d13/d5c/f111 x:0 0 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/858: truncate de/d13/d28/d3a/dfd/d58/f61 273960 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:2/859: write de/d13/f6a [8447,42725] 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:0/974: dwrite d1/d62/d89/da3/dc1/de2/f103 [0,4194304] 0 2024-09-12T01:43:25.012 INFO:tasks.workunit.client.0.smithi066.stdout:1/891: dwrite f4 [0,4194304] 0 2024-09-12T01:43:25.016 INFO:tasks.workunit.client.0.smithi066.stdout:0/975: creat d1/d62/d9f/de6/f148 x:0 0 0 2024-09-12T01:43:25.021 INFO:tasks.workunit.client.0.smithi066.stdout:2/860: rename de/d13/d1e/d22 to de/d13/d28/d3a/dfd/d58/d112 0 2024-09-12T01:43:25.021 INFO:tasks.workunit.client.0.smithi066.stdout:2/861: chown de/d13/d1e/fbf 5836 1 2024-09-12T01:43:25.022 INFO:tasks.workunit.client.0.smithi066.stdout:1/892: dread d5/dc/d36/de8/d8e/de2/da1/fb3 [0,4194304] 0 2024-09-12T01:43:25.022 INFO:tasks.workunit.client.0.smithi066.stdout:1/893: write d5/dc/d36/d4b/f2b [2333634,20763] 0 2024-09-12T01:43:25.028 INFO:tasks.workunit.client.0.smithi066.stdout:2/862: mkdir de/d13/d28/d3a/dfd/d113 0 2024-09-12T01:43:25.029 INFO:tasks.workunit.client.0.smithi066.stdout:2/863: readlink de/l19 0 2024-09-12T01:43:25.049 INFO:tasks.workunit.client.0.smithi066.stdout:2/864: dwrite de/d13/f80 [4194304,4194304] 0 2024-09-12T01:43:25.050 INFO:tasks.workunit.client.0.smithi066.stdout:1/894: dwrite d5/dc/f10d [0,4194304] 0 2024-09-12T01:43:25.053 INFO:tasks.workunit.client.0.smithi066.stdout:1/895: chown d5/f73 6581750 1 2024-09-12T01:43:25.057 INFO:tasks.workunit.client.0.smithi066.stdout:1/896: dread d5/f47 [0,4194304] 0 2024-09-12T01:43:25.058 INFO:tasks.workunit.client.0.smithi066.stdout:1/897: unlink d5/dc/d36/de8/l80 0 2024-09-12T01:43:25.060 INFO:tasks.workunit.client.0.smithi066.stdout:1/898: mkdir d5/dc/d36/d4b/da7/d10e 0 2024-09-12T01:43:25.061 INFO:tasks.workunit.client.0.smithi066.stdout:2/865: truncate de/d13/d28/f59 3226013 0 2024-09-12T01:43:25.062 INFO:tasks.workunit.client.0.smithi066.stdout:1/899: getdents d5/d52/d60/dfb 0 2024-09-12T01:43:25.066 INFO:tasks.workunit.client.0.smithi066.stdout:2/866: symlink de/l114 0 2024-09-12T01:43:25.069 INFO:tasks.workunit.client.0.smithi066.stdout:2/867: truncate de/d3c/f4a 3143564 0 2024-09-12T01:43:25.072 INFO:tasks.workunit.client.0.smithi066.stdout:2/868: creat de/d13/d28/d3a/dfd/d81/d10c/f115 x:0 0 0 2024-09-12T01:43:25.073 INFO:tasks.workunit.client.0.smithi066.stdout:2/869: mkdir de/d13/d28/d3d/dff/d116 0 2024-09-12T01:43:25.077 INFO:tasks.workunit.client.0.smithi066.stdout:1/900: dwrite f1 [0,4194304] 0 2024-09-12T01:43:25.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/901: dwrite d5/d52/d60/f79 [0,4194304] 0 2024-09-12T01:43:25.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/902: stat d5/dc/f9c 0 2024-09-12T01:43:25.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/903: getdents d5/d52/d60/dfb 0 2024-09-12T01:43:25.096 INFO:tasks.workunit.client.0.smithi066.stdout:1/904: mknod d5/dc/d36/de8/c10f 0 2024-09-12T01:43:25.107 INFO:tasks.workunit.client.0.smithi066.stdout:1/905: write d5/d15/d4d/d86/f99 [731595,26705] 0 2024-09-12T01:43:25.122 INFO:tasks.workunit.client.0.smithi066.stdout:1/906: dwrite d5/d52/d60/fbb [0,4194304] 0 2024-09-12T01:43:25.132 INFO:tasks.workunit.client.0.smithi066.stdout:1/907: dread d5/d15/d4d/d86/f88 [0,4194304] 0 2024-09-12T01:43:25.144 INFO:tasks.workunit.client.0.smithi066.stdout:1/908: creat d5/dc/d53/f110 x:0 0 0 2024-09-12T01:43:25.146 INFO:tasks.workunit.client.0.smithi066.stdout:1/909: truncate d5/f3b 1072837 0 2024-09-12T01:43:25.167 INFO:tasks.workunit.client.0.smithi066.stdout:1/910: dwrite d5/d15/d4d/d86/fce [4194304,4194304] 0 2024-09-12T01:43:25.167 INFO:tasks.workunit.client.0.smithi066.stdout:1/911: fsync d5/dc/d53/dae/fcf 0 2024-09-12T01:43:25.170 INFO:tasks.workunit.client.0.smithi066.stdout:1/912: creat d5/dc/d36/de8/d8e/de2/dbc/f111 x:0 0 0 2024-09-12T01:43:25.170 INFO:tasks.workunit.client.0.smithi066.stdout:1/913: truncate d5/dc/d36/f89 83664 0 2024-09-12T01:43:25.172 INFO:tasks.workunit.client.0.smithi066.stdout:1/914: unlink d5/dc/d36/ce0 0 2024-09-12T01:43:25.173 INFO:tasks.workunit.client.0.smithi066.stdout:1/915: write d5/dc/d53/dae/fcf [561391,76523] 0 2024-09-12T01:43:25.173 INFO:tasks.workunit.client.0.smithi066.stdout:1/916: write d5/d15/d4d/d86/fe1 [265838,5050] 0 2024-09-12T01:43:25.175 INFO:tasks.workunit.client.0.smithi066.stdout:1/917: unlink d5/f9e 0 2024-09-12T01:43:25.175 INFO:tasks.workunit.client.0.smithi066.stdout:1/918: read d5/dc/d36/ddd/fa5 [2802458,96200] 0 2024-09-12T01:43:25.190 INFO:tasks.workunit.client.0.smithi066.stdout:1/919: dwrite d5/f47 [0,4194304] 0 2024-09-12T01:43:25.190 INFO:tasks.workunit.client.0.smithi066.stdout:1/920: truncate d5/dc/d36/d4b/f11 1048323 0 2024-09-12T01:43:25.205 INFO:tasks.workunit.client.0.smithi066.stdout:1/921: dwrite d5/dc/d36/de8/d8e/f91 [0,4194304] 0 2024-09-12T01:43:25.211 INFO:tasks.workunit.client.0.smithi066.stdout:1/922: getdents d5/dc/d53/d9b 0 2024-09-12T01:43:25.213 INFO:tasks.workunit.client.0.smithi066.stdout:1/923: mknod d5/d15/d4d/d86/dfe/c112 0 2024-09-12T01:43:25.214 INFO:tasks.workunit.client.0.smithi066.stdout:1/924: creat d5/dc/d53/d9b/f113 x:0 0 0 2024-09-12T01:43:25.228 INFO:tasks.workunit.client.0.smithi066.stdout:1/925: dwrite d5/f73 [4194304,4194304] 0 2024-09-12T01:43:25.228 INFO:tasks.workunit.client.0.smithi066.stdout:1/926: creat d5/dc/d53/dae/f114 x:0 0 0 2024-09-12T01:43:25.244 INFO:tasks.workunit.client.0.smithi066.stdout:1/927: dwrite f4 [8388608,4194304] 0 2024-09-12T01:43:25.254 INFO:tasks.workunit.client.0.smithi066.stdout:1/928: read d5/dc/f106 [779736,2894] 0 2024-09-12T01:43:25.263 INFO:tasks.workunit.client.0.smithi066.stdout:1/929: dread f4 [8388608,4194304] 0 2024-09-12T01:43:25.287 INFO:tasks.workunit.client.0.smithi066.stdout:1/930: mkdir d5/d15/d4d/dd3/d115 0 2024-09-12T01:43:25.287 INFO:tasks.workunit.client.0.smithi066.stdout:1/931: readlink d5/d15/d4d/lb4 0 2024-09-12T01:43:25.300 INFO:tasks.workunit.client.0.smithi066.stdout:1/932: link d5/d15/l65 d5/d15/d4d/d86/dc7/l116 0 2024-09-12T01:43:25.301 INFO:tasks.workunit.client.0.smithi066.stdout:1/933: mknod d5/dc/d36/d4b/da7/d10e/c117 0 2024-09-12T01:43:25.317 INFO:tasks.workunit.client.0.smithi066.stdout:1/934: dwrite d5/dc/d36/df7/f90 [0,4194304] 0 2024-09-12T01:43:25.317 INFO:tasks.workunit.client.0.smithi066.stdout:1/935: chown d5 1 1 2024-09-12T01:43:25.321 INFO:tasks.workunit.client.0.smithi066.stdout:1/936: mkdir d5/d15/d118 0 2024-09-12T01:43:25.322 INFO:tasks.workunit.client.0.smithi066.stdout:1/937: getdents d5/d52/d60 0 2024-09-12T01:43:25.322 INFO:tasks.workunit.client.0.smithi066.stdout:1/938: chown d5/d15/d4d 7675686 1 2024-09-12T01:43:25.331 INFO:tasks.workunit.client.0.smithi066.stdout:1/939: read d5/dc/d36/de8/d8e/de2/da1/fb2 [3455988,50528] 0 2024-09-12T01:43:25.332 INFO:tasks.workunit.client.0.smithi066.stdout:1/940: creat d5/d15/d4d/dd3/d115/f119 x:0 0 0 2024-09-12T01:43:25.341 INFO:tasks.workunit.client.0.smithi066.stdout:1/941: dread d5/dc/d53/f35 [0,4194304] 0 2024-09-12T01:43:25.343 INFO:tasks.workunit.client.0.smithi066.stdout:1/942: rename d5/d15/c2f to d5/d15/d4d/dd3/c11a 0 2024-09-12T01:43:25.344 INFO:tasks.workunit.client.0.smithi066.stdout:1/943: link d5/d15/d4d/d86/fce d5/d15/f11b 0 2024-09-12T01:43:25.346 INFO:tasks.workunit.client.0.smithi066.stdout:1/944: symlink d5/dc/d36/d57/dac/dc4/l11c 0 2024-09-12T01:43:25.346 INFO:tasks.workunit.client.0.smithi066.stdout:1/945: chown d5/dc/d36/l82 1682 1 2024-09-12T01:43:25.346 INFO:tasks.workunit.client.0.smithi066.stdout:1/946: write d5/dc/d53/fbd [661626,130823] 0 2024-09-12T01:43:25.347 INFO:tasks.workunit.client.0.smithi066.stdout:1/947: unlink d5/dc/d36/f96 0 2024-09-12T01:43:25.348 INFO:tasks.workunit.client.0.smithi066.stdout:1/948: mkdir d5/dc/d36/de8/d8e/de2/dbc/d11d 0 2024-09-12T01:43:25.367 INFO:tasks.workunit.client.0.smithi066.stdout:1/949: getdents d5/d15 0 2024-09-12T01:43:25.382 INFO:tasks.workunit.client.0.smithi066.stdout:4/979: sync 2024-09-12T01:43:25.383 INFO:tasks.workunit.client.0.smithi066.stdout:4/980: chown d4/d6/d27/d2f/d72/l82 494 1 2024-09-12T01:43:25.383 INFO:tasks.workunit.client.0.smithi066.stdout:4/981: read - d4/d84/dba/f10d zero size 2024-09-12T01:43:25.383 INFO:tasks.workunit.client.0.smithi066.stdout:4/982: creat d4/d6/d27/d66/d6c/d75/f14a x:0 0 0 2024-09-12T01:43:25.385 INFO:tasks.workunit.client.0.smithi066.stdout:4/983: mknod d4/d6/d8/d4a/c14b 0 2024-09-12T01:43:25.385 INFO:tasks.workunit.client.0.smithi066.stdout:4/984: chown d4/d6/d27/l111 1 1 2024-09-12T01:43:25.386 INFO:tasks.workunit.client.0.smithi066.stdout:1/950: dwrite d5/dc/d53/fdc [0,4194304] 0 2024-09-12T01:43:25.388 INFO:tasks.workunit.client.0.smithi066.stdout:4/985: rmdir d4/d6/d62/db0/dd6/dd8/d147 0 2024-09-12T01:43:25.393 INFO:tasks.workunit.client.0.smithi066.stdout:1/951: mknod d5/dc/d36/d4b/c11e 0 2024-09-12T01:43:25.395 INFO:tasks.workunit.client.0.smithi066.stdout:4/986: rename d4/d6/d27/laf to d4/d6/d27/d66/d6c/l14c 0 2024-09-12T01:43:25.395 INFO:tasks.workunit.client.0.smithi066.stdout:4/987: write d4/d6/d8/d110/f95 [1294919,129331] 0 2024-09-12T01:43:25.397 INFO:tasks.workunit.client.0.smithi066.stdout:4/988: mknod d4/d6/d27/d66/d6c/c14d 0 2024-09-12T01:43:25.411 INFO:tasks.workunit.client.0.smithi066.stdout:4/989: write d4/d6/d8/d18/fb7 [3876679,79324] 0 2024-09-12T01:43:25.423 INFO:tasks.workunit.client.0.smithi066.stdout:4/990: read d4/d84/f12a [1225438,128655] 0 2024-09-12T01:43:25.423 INFO:tasks.workunit.client.0.smithi066.stdout:4/991: dread - d4/d6/d48/f13a zero size 2024-09-12T01:43:25.423 INFO:tasks.workunit.client.0.smithi066.stdout:4/992: write d4/d5f/d9a/fc5 [356147,126425] 0 2024-09-12T01:43:25.441 INFO:tasks.workunit.client.0.smithi066.stdout:8/963: sync 2024-09-12T01:43:25.445 INFO:tasks.workunit.client.0.smithi066.stdout:4/993: creat d4/d145/f14e x:0 0 0 2024-09-12T01:43:25.451 INFO:tasks.workunit.client.0.smithi066.stdout:0/976: sync 2024-09-12T01:43:25.451 INFO:tasks.workunit.client.0.smithi066.stdout:9/867: sync 2024-09-12T01:43:25.451 INFO:tasks.workunit.client.0.smithi066.stdout:7/956: sync 2024-09-12T01:43:25.451 INFO:tasks.workunit.client.0.smithi066.stdout:7/957: chown d2/d5/d6/d40/d63/f107 922 1 2024-09-12T01:43:25.451 INFO:tasks.workunit.client.0.smithi066.stdout:4/994: creat d4/d6/d62/db0/f14f x:0 0 0 2024-09-12T01:43:25.452 INFO:tasks.workunit.client.0.smithi066.stdout:8/964: rmdir d12/d21/d2f/df5/d11a 39 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/965: readlink d12/d21/d2f/d57/d84/d50/d56/d69/lc3 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/966: fsync d12/d21/d2f/d57/d43/d66/d98/f134 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/967: readlink d12/d21/d2f/d57/d84/d50/d56/d69/le8 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/968: creat d12/d21/d2f/d57/d3c/f14a x:0 0 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/969: stat l5 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/970: truncate d12/f70 750959 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/971: stat d12/d21/d2f/d57/d43/d66/f68 0 2024-09-12T01:43:25.453 INFO:tasks.workunit.client.0.smithi066.stdout:8/972: chown d12/d21/d2f/d57/d84/d50/d56/d69/le8 1272 1 2024-09-12T01:43:25.456 INFO:tasks.workunit.client.0.smithi066.stdout:0/977: symlink d1/d62/d9f/d92/db9/ded/l149 0 2024-09-12T01:43:25.458 INFO:tasks.workunit.client.0.smithi066.stdout:7/958: symlink d2/d5/da/d3f/d9b/d4d/l143 0 2024-09-12T01:43:25.465 INFO:tasks.workunit.client.0.smithi066.stdout:9/868: dread d0/d6/d43/f6e [0,4194304] 0 2024-09-12T01:43:25.471 INFO:tasks.workunit.client.0.smithi066.stdout:4/995: getdents d4/d5f 0 2024-09-12T01:43:25.471 INFO:tasks.workunit.client.0.smithi066.stdout:4/996: write d4/d6/d27/d66/d6c/d75/f10b [604285,124240] 0 2024-09-12T01:43:25.474 INFO:tasks.workunit.client.0.smithi066.stdout:9/869: getdents d0/d6/d17/d1b/d4c/d4b/d86 0 2024-09-12T01:43:25.474 INFO:tasks.workunit.client.0.smithi066.stdout:9/870: creat d0/f131 x:0 0 0 2024-09-12T01:43:25.474 INFO:tasks.workunit.client.0.smithi066.stdout:7/959: dread d2/d3c/f134 [0,4194304] 0 2024-09-12T01:43:25.474 INFO:tasks.workunit.client.0.smithi066.stdout:7/960: fdatasync d2/d5/d6/fbc 0 2024-09-12T01:43:25.476 INFO:tasks.workunit.client.0.smithi066.stdout:4/997: creat d4/d6/d8/d18/d4d/f150 x:0 0 0 2024-09-12T01:43:25.479 INFO:tasks.workunit.client.0.smithi066.stdout:7/961: symlink d2/d3c/d103/l144 0 2024-09-12T01:43:25.485 INFO:tasks.workunit.client.0.smithi066.stdout:0/978: dwrite d1/d62/d9f/d64/f13a [0,4194304] 0 2024-09-12T01:43:25.485 INFO:tasks.workunit.client.0.smithi066.stdout:7/962: read d2/d5/da/d3f/da4/d70/fb5 [762423,21910] 0 2024-09-12T01:43:25.485 INFO:tasks.workunit.client.0.smithi066.stdout:7/963: readlink d2/l37 0 2024-09-12T01:43:25.485 INFO:tasks.workunit.client.0.smithi066.stdout:7/964: readlink d2/d5/da/d3f/d9b/df7/d11b/l127 0 2024-09-12T01:43:25.485 INFO:tasks.workunit.client.0.smithi066.stdout:4/998: symlink d4/d5f/dea/d10e/l151 0 2024-09-12T01:43:25.485 INFO:tasks.workunit.client.0.smithi066.stdout:4/999: chown d4/d6/d8/d18/c25 498 1 2024-09-12T01:43:25.486 INFO:tasks.workunit.client.0.smithi066.stdout:9/871: dread d0/d6/d17/d4f/d9/de/f5b [0,4194304] 0 2024-09-12T01:43:25.486 INFO:tasks.workunit.client.0.smithi066.stdout:0/979: rmdir d1/d62/d6c/dad 39 2024-09-12T01:43:25.489 INFO:tasks.workunit.client.0.smithi066.stdout:0/980: rmdir d1/d62/d6c/dad 39 2024-09-12T01:43:25.493 INFO:tasks.workunit.client.0.smithi066.stdout:0/981: mknod d1/d62/d9f/d7c/c14a 0 2024-09-12T01:43:25.499 INFO:tasks.workunit.client.0.smithi066.stdout:9/872: dread d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:25.499 INFO:tasks.workunit.client.0.smithi066.stdout:7/965: dread d2/d5/da/d3f/da4/d70/f9f [0,4194304] 0 2024-09-12T01:43:25.505 INFO:tasks.workunit.client.0.smithi066.stdout:9/873: link d0/d6/d17/d4f/d12/f11c d0/d6/d17/d4f/d9/de/f132 0 2024-09-12T01:43:25.505 INFO:tasks.workunit.client.0.smithi066.stdout:9/874: readlink d0/d6/d17/ld1 0 2024-09-12T01:43:25.507 INFO:tasks.workunit.client.0.smithi066.stdout:7/966: creat d2/d5/d6/d40/d51/d121/d53/d12e/f145 x:0 0 0 2024-09-12T01:43:25.507 INFO:tasks.workunit.client.0.smithi066.stdout:7/967: chown d2/d5/da/d3f/da4/d6c 84 1 2024-09-12T01:43:25.514 INFO:tasks.workunit.client.0.smithi066.stdout:2/870: sync 2024-09-12T01:43:25.514 INFO:tasks.workunit.client.0.smithi066.stdout:9/875: dread d0/d6/d37/f10a [0,4194304] 0 2024-09-12T01:43:25.514 INFO:tasks.workunit.client.0.smithi066.stdout:9/876: readlink d0/d6/d17/d1b/d4c/d42/lb9 0 2024-09-12T01:43:25.514 INFO:tasks.workunit.client.0.smithi066.stdout:9/877: truncate d0/d6/d17/d1b/d4c/d4b/d86/de0/f102 1105090 0 2024-09-12T01:43:25.515 INFO:tasks.workunit.client.0.smithi066.stdout:0/982: dwrite d1/d62/d9f/d4a/d67/d6e/fa1 [0,4194304] 0 2024-09-12T01:43:25.516 INFO:tasks.workunit.client.0.smithi066.stdout:2/871: rename de/d13/d28/d3a/dd4/ld7 to de/d13/d28/d3a/dfd/d58/d112/d4f/l117 0 2024-09-12T01:43:25.516 INFO:tasks.workunit.client.0.smithi066.stdout:2/872: stat de/d13/d28/d3a/dfd/d58/d112/f44 0 2024-09-12T01:43:25.522 INFO:tasks.workunit.client.0.smithi066.stdout:0/983: symlink d1/d62/d89/da3/l14b 0 2024-09-12T01:43:25.522 INFO:tasks.workunit.client.0.smithi066.stdout:0/984: truncate d1/d62/d89/fde 5301335 0 2024-09-12T01:43:25.523 INFO:tasks.workunit.client.0.smithi066.stdout:7/968: dread d2/d5/da/d3f/da4/d6c/ddf/f11d [4194304,4194304] 0 2024-09-12T01:43:25.525 INFO:tasks.workunit.client.0.smithi066.stdout:0/985: mkdir d1/d62/d9f/d4a/d67/d1b/d26/d9c/d12b/d14c 0 2024-09-12T01:43:25.526 INFO:tasks.workunit.client.0.smithi066.stdout:0/986: truncate d1/d62/d89/d83/ff9 494863 0 2024-09-12T01:43:25.531 INFO:tasks.workunit.client.0.smithi066.stdout:0/987: getdents d1/d72/de 0 2024-09-12T01:43:25.531 INFO:tasks.workunit.client.0.smithi066.stdout:0/988: fsync d1/d62/d9f/d4a/d67/d1b/d3b/fcc 0 2024-09-12T01:43:25.531 INFO:tasks.workunit.client.0.smithi066.stdout:0/989: write d1/d62/d89/da3/dc1/de2/f103 [4483830,110380] 0 2024-09-12T01:43:25.531 INFO:tasks.workunit.client.0.smithi066.stdout:7/969: write d2/d5/da/d3f/d9b/f48 [3085429,76133] 0 2024-09-12T01:43:25.541 INFO:tasks.workunit.client.0.smithi066.stdout:9/878: dwrite d0/d6/d17/d1b/d4c/f103 [0,4194304] 0 2024-09-12T01:43:25.542 INFO:tasks.workunit.client.0.smithi066.stdout:2/873: dwrite de/d13/d1e/fc7 [0,4194304] 0 2024-09-12T01:43:25.542 INFO:tasks.workunit.client.0.smithi066.stdout:0/990: write d1/d62/f94 [3348762,61081] 0 2024-09-12T01:43:25.542 INFO:tasks.workunit.client.0.smithi066.stdout:0/991: stat d1/d62/d9f/d4a/d67/d11d/f12d 0 2024-09-12T01:43:25.544 INFO:tasks.workunit.client.0.smithi066.stdout:9/879: mkdir d0/d6/d17/d1b/d4c/d133 0 2024-09-12T01:43:25.546 INFO:tasks.workunit.client.0.smithi066.stdout:2/874: dread de/d13/d28/f52 [0,4194304] 0 2024-09-12T01:43:25.546 INFO:tasks.workunit.client.0.smithi066.stdout:2/875: chown de/d13/d5c/fd0 75 1 2024-09-12T01:43:25.547 INFO:tasks.workunit.client.0.smithi066.stdout:2/876: link de/d13/d28/d3a/dfd/d58/d112/l4b de/d13/d28/d3a/dfd/da8/l118 0 2024-09-12T01:43:25.549 INFO:tasks.workunit.client.0.smithi066.stdout:2/877: creat de/d13/d28/d3a/dfd/d113/f119 x:0 0 0 2024-09-12T01:43:25.550 INFO:tasks.workunit.client.0.smithi066.stdout:2/878: creat de/d13/d1e/da3/f11a x:0 0 0 2024-09-12T01:43:25.550 INFO:tasks.workunit.client.0.smithi066.stdout:2/879: readlink de/d13/d28/d3a/lfa 0 2024-09-12T01:43:25.554 INFO:tasks.workunit.client.0.smithi066.stdout:0/992: dread d1/d62/d9f/d4a/d67/d6e/fa1 [0,4194304] 0 2024-09-12T01:43:25.557 INFO:tasks.workunit.client.0.smithi066.stdout:9/880: read d0/d6/d7f/d90/d9a/fba [559154,4709] 0 2024-09-12T01:43:25.557 INFO:tasks.workunit.client.0.smithi066.stdout:0/993: truncate d1/d62/d9f/d4a/d67/d3e/f75 460513 0 2024-09-12T01:43:25.558 INFO:tasks.workunit.client.0.smithi066.stdout:9/881: creat d0/d6/d7f/d12f/f134 x:0 0 0 2024-09-12T01:43:25.559 INFO:tasks.workunit.client.0.smithi066.stdout:0/994: getdents d1/d62/d9f/d4a/d67/d1b 0 2024-09-12T01:43:25.559 INFO:tasks.workunit.client.0.smithi066.stdout:0/995: write d1/d62/d9f/d4a/d67/d1b/d61/dec/f12c [604632,92408] 0 2024-09-12T01:43:25.559 INFO:tasks.workunit.client.0.smithi066.stdout:0/996: chown d1/d62/d9f/d4a/d67/d1b/d61/f7f 1096190 1 2024-09-12T01:43:25.559 INFO:tasks.workunit.client.0.smithi066.stdout:0/997: chown d1/d62/d9f/d92/db9/ded/f124 459 1 2024-09-12T01:43:25.562 INFO:tasks.workunit.client.0.smithi066.stdout:0/998: unlink d1/d62/d89/da3/dc1/lc3 0 2024-09-12T01:43:25.562 INFO:tasks.workunit.client.0.smithi066.stdout:0/999: fdatasync d1/d72/fd3 0 2024-09-12T01:43:25.566 INFO:tasks.workunit.client.0.smithi066.stdout:2/880: dwrite de/d13/d28/f93 [0,4194304] 0 2024-09-12T01:43:25.566 INFO:tasks.workunit.client.0.smithi066.stdout:2/881: dread - de/f110 zero size 2024-09-12T01:43:25.566 INFO:tasks.workunit.client.0.smithi066.stdout:2/882: getdents de/d13/d1e/d25/deb 0 2024-09-12T01:43:25.572 INFO:tasks.workunit.client.0.smithi066.stdout:9/882: dread d0/f6a [0,4194304] 0 2024-09-12T01:43:25.572 INFO:tasks.workunit.client.0.smithi066.stdout:9/883: chown d0/d6/d43/c4e 39098104 1 2024-09-12T01:43:25.589 INFO:tasks.workunit.client.0.smithi066.stdout:9/884: dwrite d0/d6/d17/d4f/d12/f27 [0,4194304] 0 2024-09-12T01:43:25.589 INFO:tasks.workunit.client.0.smithi066.stdout:2/883: dwrite de/d13/d1e/f23 [0,4194304] 0 2024-09-12T01:43:25.590 INFO:tasks.workunit.client.0.smithi066.stdout:2/884: fdatasync de/d13/d28/fcd 0 2024-09-12T01:43:25.593 INFO:tasks.workunit.client.0.smithi066.stdout:9/885: getdents d0/d6/d17/d1b/da2 0 2024-09-12T01:43:25.593 INFO:tasks.workunit.client.0.smithi066.stdout:9/886: write d0/d6/d17/f71 [6052589,128551] 0 2024-09-12T01:43:25.594 INFO:tasks.workunit.client.0.smithi066.stdout:9/887: dread - d0/d6/d17/d28/f7a zero size 2024-09-12T01:43:25.600 INFO:tasks.workunit.client.0.smithi066.stdout:9/888: creat d0/d6/d17/f135 x:0 0 0 2024-09-12T01:43:25.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/885: dwrite de/d13/d28/d3a/dfd/d58/fce [0,4194304] 0 2024-09-12T01:43:25.610 INFO:tasks.workunit.client.0.smithi066.stdout:2/886: stat de/d13/d1e/d84/fab 0 2024-09-12T01:43:25.614 INFO:tasks.workunit.client.0.smithi066.stdout:9/889: dwrite d0/d6/d17/d1b/d4c/d42/dab/f109 [0,4194304] 0 2024-09-12T01:43:25.614 INFO:tasks.workunit.client.0.smithi066.stdout:9/890: creat d0/f136 x:0 0 0 2024-09-12T01:43:25.614 INFO:tasks.workunit.client.0.smithi066.stdout:9/891: chown d0/d6/d17/d28/d79/la7 4286636 1 2024-09-12T01:43:25.619 INFO:tasks.workunit.client.0.smithi066.stdout:9/892: symlink d0/d6/d17/d4f/d12/l137 0 2024-09-12T01:43:25.620 INFO:tasks.workunit.client.0.smithi066.stdout:2/887: link de/d13/d28/d3a/dfd/d113/f119 de/d13/d28/d3a/f11b 0 2024-09-12T01:43:25.622 INFO:tasks.workunit.client.0.smithi066.stdout:9/893: rename d0/d6/d17/d1b/de9/df9/d10f to d0/d138 0 2024-09-12T01:43:25.622 INFO:tasks.workunit.client.0.smithi066.stdout:9/894: dread - d0/d6/d17/d4f/fbd zero size 2024-09-12T01:43:25.622 INFO:tasks.workunit.client.0.smithi066.stdout:9/895: dread - d0/d6/d17/f98 zero size 2024-09-12T01:43:25.624 INFO:tasks.workunit.client.0.smithi066.stdout:2/888: rename de/d13/d1e/d25/deb to de/d13/d11c 0 2024-09-12T01:43:25.625 INFO:tasks.workunit.client.0.smithi066.stdout:9/896: rmdir d0/d6/d17/d1b/d4c/d4b/d7d 39 2024-09-12T01:43:25.633 INFO:tasks.workunit.client.0.smithi066.stdout:2/889: write de/d13/d28/f93 [1407551,45594] 0 2024-09-12T01:43:25.634 INFO:tasks.workunit.client.0.smithi066.stdout:2/890: truncate de/d13/d28/f59 684359 0 2024-09-12T01:43:25.634 INFO:tasks.workunit.client.0.smithi066.stdout:2/891: chown de/d13 475 1 2024-09-12T01:43:25.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/892: dread de/d13/d1e/d25/d5e/fa1 [0,4194304] 0 2024-09-12T01:43:25.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/893: write de/d13/d28/d3a/dfd/d58/d112/f44 [4524509,48033] 0 2024-09-12T01:43:25.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/894: creat de/d13/d28/d3a/dfd/da8/f11d x:0 0 0 2024-09-12T01:43:25.644 INFO:tasks.workunit.client.0.smithi066.stdout:2/895: chown de/d13/d28/d3a/dfd/d81/fb8 1048422 1 2024-09-12T01:43:25.660 INFO:tasks.workunit.client.0.smithi066.stdout:2/896: dwrite de/d13/d28/d3a/dfd/da8/fd5 [0,4194304] 0 2024-09-12T01:43:25.660 INFO:tasks.workunit.client.0.smithi066.stdout:2/897: mkdir de/d13/d28/d3a/dfd/d58/d112/d4f/d11e 0 2024-09-12T01:43:25.661 INFO:tasks.workunit.client.0.smithi066.stdout:2/898: creat de/d13/d28/d3a/dfd/da8/f11f x:0 0 0 2024-09-12T01:43:25.661 INFO:tasks.workunit.client.0.smithi066.stdout:2/899: chown fd 54 1 2024-09-12T01:43:25.662 INFO:tasks.workunit.client.0.smithi066.stdout:2/900: mknod de/d13/d11c/c120 0 2024-09-12T01:43:25.666 INFO:tasks.workunit.client.0.smithi066.stdout:2/901: getdents de/d13/d11c 0 2024-09-12T01:43:25.667 INFO:tasks.workunit.client.0.smithi066.stdout:2/902: creat de/d13/d11c/f121 x:0 0 0 2024-09-12T01:43:25.681 INFO:tasks.workunit.client.0.smithi066.stdout:2/903: dwrite de/d3c/f4a [0,4194304] 0 2024-09-12T01:43:25.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/904: write de/d13/d28/d3a/dfd/d113/f119 [131432,124857] 0 2024-09-12T01:43:25.682 INFO:tasks.workunit.client.0.smithi066.stdout:2/905: mkdir de/d13/d28/d3d/dff/d116/d122 0 2024-09-12T01:43:25.683 INFO:tasks.workunit.client.0.smithi066.stdout:2/906: getdents de/d13/d28/d3a/dfd/d58/d112/de5 0 2024-09-12T01:43:25.684 INFO:tasks.workunit.client.0.smithi066.stdout:2/907: mknod de/d13/d28/d3d/dff/c123 0 2024-09-12T01:43:25.834 INFO:tasks.workunit.client.0.smithi066.stdout:1/952: sync 2024-09-12T01:43:25.835 INFO:tasks.workunit.client.0.smithi066.stdout:1/953: unlink d5/dc/d36/ddd/cea 0 2024-09-12T01:43:25.835 INFO:tasks.workunit.client.0.smithi066.stdout:1/954: dread - d5/dc/d36/de8/f83 zero size 2024-09-12T01:43:25.836 INFO:tasks.workunit.client.0.smithi066.stdout:1/955: symlink d5/dc/d36/de8/d8e/de2/dbc/l11f 0 2024-09-12T01:43:25.837 INFO:tasks.workunit.client.0.smithi066.stdout:1/956: mkdir d5/dc/d36/de8/d8e/de2/dbc/d11d/d120 0 2024-09-12T01:43:25.838 INFO:tasks.workunit.client.0.smithi066.stdout:1/957: creat d5/dc/d36/df7/df0/f121 x:0 0 0 2024-09-12T01:43:25.838 INFO:tasks.workunit.client.0.smithi066.stdout:1/958: read d5/dc/d36/d57/dac/dd5/f10a [1410577,39684] 0 2024-09-12T01:43:25.846 INFO:tasks.workunit.client.0.smithi066.stdout:1/959: read d5/f6d [9955177,59780] 0 2024-09-12T01:43:25.847 INFO:tasks.workunit.client.0.smithi066.stdout:1/960: creat d5/dc/d36/d57/dac/dd5/dfc/f122 x:0 0 0 2024-09-12T01:43:25.847 INFO:tasks.workunit.client.0.smithi066.stdout:1/961: chown d5/dc/d36/de8/d8e/de2/dbc/cd2 70973275 1 2024-09-12T01:43:25.847 INFO:tasks.workunit.client.0.smithi066.stdout:1/962: creat d5/dc/f123 x:0 0 0 2024-09-12T01:43:25.850 INFO:tasks.workunit.client.0.smithi066.stdout:1/963: rename d5/d52/c63 to d5/dc/d36/de8/dc6/c124 0 2024-09-12T01:43:25.853 INFO:tasks.workunit.client.0.smithi066.stdout:1/964: rename d5/dc/c32 to d5/dc/d36/ddd/c125 0 2024-09-12T01:43:25.853 INFO:tasks.workunit.client.0.smithi066.stdout:1/965: fsync d5/dc/d36/de8/d8e/de2/ff9 0 2024-09-12T01:43:25.853 INFO:tasks.workunit.client.0.smithi066.stdout:1/966: write d5/dc/d36/d57/f8a [1027983,86005] 0 2024-09-12T01:43:25.853 INFO:tasks.workunit.client.0.smithi066.stdout:1/967: write d5/dc/d53/dae/f114 [30506,59024] 0 2024-09-12T01:43:25.861 INFO:tasks.workunit.client.0.smithi066.stdout:1/968: rmdir d5/dc/d36/d57/dac/dd5/dfc 39 2024-09-12T01:43:25.870 INFO:tasks.workunit.client.0.smithi066.stdout:1/969: dread d5/dc/f106 [0,4194304] 0 2024-09-12T01:43:25.870 INFO:tasks.workunit.client.0.smithi066.stdout:1/970: dread - d5/d15/d4d/dd3/f105 zero size 2024-09-12T01:43:25.870 INFO:tasks.workunit.client.0.smithi066.stdout:1/971: fsync d5/dc/d36/de8/fc8 0 2024-09-12T01:43:25.871 INFO:tasks.workunit.client.0.smithi066.stdout:1/972: creat d5/dc/d36/d57/dac/dd5/f126 x:0 0 0 2024-09-12T01:43:25.873 INFO:tasks.workunit.client.0.smithi066.stdout:1/973: symlink d5/d15/d118/l127 0 2024-09-12T01:43:25.876 INFO:tasks.workunit.client.0.smithi066.stdout:1/974: getdents d5/d15/d4d/dd3 0 2024-09-12T01:43:25.876 INFO:tasks.workunit.client.0.smithi066.stdout:1/975: creat d5/dc/d36/de8/d8e/de2/dbc/f128 x:0 0 0 2024-09-12T01:43:25.892 INFO:tasks.workunit.client.0.smithi066.stdout:1/976: dwrite d5/dc/d53/d9b/f108 [0,4194304] 0 2024-09-12T01:43:25.913 INFO:tasks.workunit.client.0.smithi066.stdout:1/977: dwrite d5/d52/f7e [0,4194304] 0 2024-09-12T01:43:25.924 INFO:tasks.workunit.client.0.smithi066.stdout:7/970: sync 2024-09-12T01:43:25.924 INFO:tasks.workunit.client.0.smithi066.stdout:8/973: sync 2024-09-12T01:43:25.924 INFO:tasks.workunit.client.0.smithi066.stdout:8/974: write d12/d21/d2f/d57/d43/d66/d98/f12d [420809,20499] 0 2024-09-12T01:43:25.936 INFO:tasks.workunit.client.0.smithi066.stdout:1/978: dwrite d5/dc/d53/d9b/f108 [0,4194304] 0 2024-09-12T01:43:25.950 INFO:tasks.workunit.client.0.smithi066.stdout:1/979: dwrite d5/d15/f11b [8388608,4194304] 0 2024-09-12T01:43:26.058 INFO:tasks.workunit.client.0.smithi066.stdout:1/980: truncate d5/dc/d36/de8/d8e/de2/f93 3389522 0 2024-09-12T01:43:26.064 INFO:tasks.workunit.client.0.smithi066.stdout:1/981: creat d5/d15/f129 x:0 0 0 2024-09-12T01:43:26.066 INFO:tasks.workunit.client.0.smithi066.stdout:1/982: creat d5/dc/d53/dae/df4/f12a x:0 0 0 2024-09-12T01:43:26.068 INFO:tasks.workunit.client.0.smithi066.stdout:1/983: link d5/dc/d36/de8/dc6/ld4 d5/dc/d36/d4b/da7/d10e/l12b 0 2024-09-12T01:43:26.116 INFO:tasks.workunit.client.0.smithi066.stdout:9/897: sync 2024-09-12T01:43:26.116 INFO:tasks.workunit.client.0.smithi066.stdout:2/908: sync 2024-09-12T01:43:26.116 INFO:tasks.workunit.client.0.smithi066.stdout:2/909: read - de/d13/d28/d3a/dfd/d58/d112/d4f/f8b zero size 2024-09-12T01:43:26.116 INFO:tasks.workunit.client.0.smithi066.stdout:9/898: write d0/d6/d37/f10a [968038,124583] 0 2024-09-12T01:43:26.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/899: creat d0/d6/d17/d1b/d4c/d42/dab/f139 x:0 0 0 2024-09-12T01:43:26.117 INFO:tasks.workunit.client.0.smithi066.stdout:9/900: creat d0/d6/d43/f13a x:0 0 0 2024-09-12T01:43:26.140 INFO:tasks.workunit.client.0.smithi066.stdout:9/901: dwrite d0/d6/d37/d85/fcf [0,4194304] 0 2024-09-12T01:43:26.140 INFO:tasks.workunit.client.0.smithi066.stdout:2/910: dwrite de/f110 [0,4194304] 0 2024-09-12T01:43:26.140 INFO:tasks.workunit.client.0.smithi066.stdout:9/902: dread - d0/d6/d17/d1b/da2/dae/dc2/f101 zero size 2024-09-12T01:43:26.140 INFO:tasks.workunit.client.0.smithi066.stdout:9/903: read d0/d6/d17/d1b/d4c/f2a [2089724,45566] 0 2024-09-12T01:43:26.143 INFO:tasks.workunit.client.0.smithi066.stdout:2/911: link de/d13/d7f/lbe de/d13/d28/d3a/ded/l124 0 2024-09-12T01:43:26.144 INFO:tasks.workunit.client.0.smithi066.stdout:9/904: truncate d0/d6/d43/fa4 2053802 0 2024-09-12T01:43:26.144 INFO:tasks.workunit.client.0.smithi066.stdout:9/905: chown d0/d6/d17/d1b/d4c/d42/lb9 264021 1 2024-09-12T01:43:26.148 INFO:tasks.workunit.client.0.smithi066.stdout:9/906: creat d0/d6/f13b x:0 0 0 2024-09-12T01:43:26.150 INFO:tasks.workunit.client.0.smithi066.stdout:9/907: mknod d0/d6/d17/d1b/d4c/d42/dab/c13c 0 2024-09-12T01:43:26.150 INFO:tasks.workunit.client.0.smithi066.stdout:9/908: getdents d0/d6/d17/d1b/de9/df9/dfd/d104 0 2024-09-12T01:43:26.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:25 smithi153 ceph-mon[34713]: pgmap v12: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 207 MiB/s rd, 255 MiB/s wr, 399 op/s 2024-09-12T01:43:26.162 INFO:tasks.workunit.client.0.smithi066.stdout:9/909: write d0/d6/f8e [56193,58920] 0 2024-09-12T01:43:26.164 INFO:tasks.workunit.client.0.smithi066.stdout:2/912: dwrite de/d13/d28/fcd [0,4194304] 0 2024-09-12T01:43:26.164 INFO:tasks.workunit.client.0.smithi066.stdout:9/910: symlink d0/d6/d7f/dd2/l13d 0 2024-09-12T01:43:26.164 INFO:tasks.workunit.client.0.smithi066.stdout:9/911: write d0/d6/d43/f6e [4805384,94720] 0 2024-09-12T01:43:26.164 INFO:tasks.workunit.client.0.smithi066.stdout:2/913: write de/d13/d1e/d25/d5e/f85 [156371,91632] 0 2024-09-12T01:43:26.181 INFO:tasks.workunit.client.0.smithi066.stdout:2/914: dwrite de/d13/d28/d3a/dfd/d58/d112/f44 [4194304,4194304] 0 2024-09-12T01:43:26.182 INFO:tasks.workunit.client.0.smithi066.stdout:2/915: read de/d13/d28/f8e [1464263,2086] 0 2024-09-12T01:43:26.197 INFO:tasks.workunit.client.0.smithi066.stdout:9/912: dwrite d0/d6/d17/d1b/f1c [0,4194304] 0 2024-09-12T01:43:26.200 INFO:tasks.workunit.client.0.smithi066.stdout:2/916: dwrite de/d13/d28/d3a/dfd/d58/d112/f89 [0,4194304] 0 2024-09-12T01:43:26.205 INFO:tasks.workunit.client.0.smithi066.stdout:9/913: dread d0/d6/d17/d1b/da2/dae/f70 [0,4194304] 0 2024-09-12T01:43:26.205 INFO:tasks.workunit.client.0.smithi066.stdout:9/914: write d0/d6/d17/d1b/d4c/d4b/f111 [222622,74094] 0 2024-09-12T01:43:26.206 INFO:tasks.workunit.client.0.smithi066.stdout:2/917: creat de/d13/d1e/d84/f125 x:0 0 0 2024-09-12T01:43:26.211 INFO:tasks.workunit.client.0.smithi066.stdout:8/975: sync 2024-09-12T01:43:26.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/971: sync 2024-09-12T01:43:26.211 INFO:tasks.workunit.client.0.smithi066.stdout:8/976: creat d12/d21/d2f/d57/d43/d66/d98/d10c/f14b x:0 0 0 2024-09-12T01:43:26.211 INFO:tasks.workunit.client.0.smithi066.stdout:8/977: fdatasync d12/db2/fb8 0 2024-09-12T01:43:26.211 INFO:tasks.workunit.client.0.smithi066.stdout:7/972: truncate d2/d5/d6/d22/f131 3529256 0 2024-09-12T01:43:26.214 INFO:tasks.workunit.client.0.smithi066.stdout:7/973: symlink d2/d5/da/d3f/da4/d84/l146 0 2024-09-12T01:43:26.216 INFO:tasks.workunit.client.0.smithi066.stdout:7/974: rename d2/d71/dad/f130 to d2/f147 0 2024-09-12T01:43:26.216 INFO:tasks.workunit.client.0.smithi066.stdout:7/975: creat d2/d115/f148 x:0 0 0 2024-09-12T01:43:26.265 INFO:tasks.workunit.client.0.smithi066.stdout:9/915: dwrite d0/d6/d17/f135 [0,4194304] 0 2024-09-12T01:43:26.266 INFO:tasks.workunit.client.0.smithi066.stdout:9/916: chown d0/d6/d17/d1b/da2/dae 18981 1 2024-09-12T01:43:26.266 INFO:tasks.workunit.client.0.smithi066.stdout:7/976: dwrite d2/d5/d6/d40/d51/d121/d123/f126 [0,4194304] 0 2024-09-12T01:43:26.271 INFO:tasks.workunit.client.0.smithi066.stdout:7/977: creat d2/d5/d6/d40/d51/d121/d53/f149 x:0 0 0 2024-09-12T01:43:26.273 INFO:tasks.workunit.client.0.smithi066.stdout:9/917: getdents d0/d6/d17/d1b/d4c 0 2024-09-12T01:43:26.274 INFO:tasks.workunit.client.0.smithi066.stdout:9/918: creat d0/d6/d17/d1b/d4c/f13e x:0 0 0 2024-09-12T01:43:26.274 INFO:tasks.workunit.client.0.smithi066.stdout:9/919: chown d0/f131 268281 1 2024-09-12T01:43:26.275 INFO:tasks.workunit.client.0.smithi066.stdout:9/920: truncate d0/d6/d17/d4f/d9/fbf 421381 0 2024-09-12T01:43:26.277 INFO:tasks.workunit.client.0.smithi066.stdout:9/921: stat d0/d6/d17/d1b/d4c/d42/c7b 0 2024-09-12T01:43:26.279 INFO:tasks.workunit.client.0.smithi066.stdout:1/984: sync 2024-09-12T01:43:26.282 INFO:tasks.workunit.client.0.smithi066.stdout:7/978: dread d2/d5/d6/d81/fa2 [0,4194304] 0 2024-09-12T01:43:26.282 INFO:tasks.workunit.client.0.smithi066.stdout:7/979: dread - d2/d5/da/d3f/da4/d6c/d8e/f105 zero size 2024-09-12T01:43:26.292 INFO:tasks.workunit.client.0.smithi066.stdout:7/980: dread d2/d3c/d103/f110 [0,4194304] 0 2024-09-12T01:43:26.294 INFO:tasks.workunit.client.0.smithi066.stdout:7/981: rename d2/lab to d2/d5/da/d3f/d9b/df7/l14a 0 2024-09-12T01:43:26.296 INFO:tasks.workunit.client.0.smithi066.stdout:9/922: dwrite d0/d6/d17/d4f/d12/fb1 [0,4194304] 0 2024-09-12T01:43:26.300 INFO:tasks.workunit.client.0.smithi066.stdout:9/923: mknod d0/d6/d17/d28/d79/c13f 0 2024-09-12T01:43:26.302 INFO:tasks.workunit.client.0.smithi066.stdout:9/924: mknod d0/d6/d17/d1b/d4c/d133/c140 0 2024-09-12T01:43:26.303 INFO:tasks.workunit.client.0.smithi066.stdout:7/982: dread d2/d5/d6/d22/f59 [0,4194304] 0 2024-09-12T01:43:26.306 INFO:tasks.workunit.client.0.smithi066.stdout:7/983: mknod d2/d5/da/d3f/da4/d6c/d80/d5f/d129/c14b 0 2024-09-12T01:43:26.308 INFO:tasks.workunit.client.0.smithi066.stdout:7/984: unlink d2/d5/da/d3f/da4/f4b 0 2024-09-12T01:43:26.309 INFO:tasks.workunit.client.0.smithi066.stdout:7/985: mknod d2/d5/da/d3f/d10d/c14c 0 2024-09-12T01:43:26.313 INFO:tasks.workunit.client.0.smithi066.stdout:7/986: dread d2/d5/da/d3f/da4/f4c [0,4194304] 0 2024-09-12T01:43:26.313 INFO:tasks.workunit.client.0.smithi066.stdout:7/987: creat d2/d71/dad/d10f/f14d x:0 0 0 2024-09-12T01:43:26.320 INFO:tasks.workunit.client.0.smithi066.stdout:7/988: write d2/d5/d6/d22/f131 [2638365,97064] 0 2024-09-12T01:43:26.321 INFO:tasks.workunit.client.0.smithi066.stdout:7/989: symlink d2/d71/dad/l14e 0 2024-09-12T01:43:26.322 INFO:tasks.workunit.client.0.smithi066.stdout:7/990: mkdir d2/d5/d6/d22/d75/db6/d14f 0 2024-09-12T01:43:26.323 INFO:tasks.workunit.client.0.smithi066.stdout:9/925: dwrite d0/d6/d17/d1b/d4c/d4b/f111 [0,4194304] 0 2024-09-12T01:43:26.323 INFO:tasks.workunit.client.0.smithi066.stdout:9/926: readlink d0/d6/d7f/lc4 0 2024-09-12T01:43:26.327 INFO:tasks.workunit.client.0.smithi066.stdout:9/927: symlink d0/d6/d17/d4f/d12/l141 0 2024-09-12T01:43:26.332 INFO:tasks.workunit.client.0.smithi066.stdout:7/991: write d2/d5/d6/d40/d63/fa1 [6477954,129523] 0 2024-09-12T01:43:26.346 INFO:tasks.workunit.client.0.smithi066.stdout:7/992: dwrite d2/d5/d6/d40/d51/d121/d53/fd6 [0,4194304] 0 2024-09-12T01:43:26.346 INFO:tasks.workunit.client.0.smithi066.stdout:7/993: write d2/d5/da/d3f/d9b/d4d/f60 [5067961,55803] 0 2024-09-12T01:43:26.351 INFO:tasks.workunit.client.0.smithi066.stdout:7/994: dread d2/d5/da/d3f/da4/d70/f9f [0,4194304] 0 2024-09-12T01:43:26.351 INFO:tasks.workunit.client.0.smithi066.stdout:7/995: write d2/d5/d6/d22/d75/db6/dd8/fe1 [827087,83784] 0 2024-09-12T01:43:26.352 INFO:tasks.workunit.client.0.smithi066.stdout:7/996: mkdir d2/d5/d6/d22/d75/db6/dd8/d150 0 2024-09-12T01:43:26.358 INFO:tasks.workunit.client.0.smithi066.stdout:7/997: dread d2/d5/d6/d22/feb [0,4194304] 0 2024-09-12T01:43:26.360 INFO:tasks.workunit.client.0.smithi066.stdout:7/998: mknod d2/d115/c151 0 2024-09-12T01:43:26.362 INFO:tasks.workunit.client.0.smithi066.stdout:7/999: rename d2/d5/d6/d22/d75/db6/dd8/fed to d2/d5/da/d3f/da4/d84/f152 0 2024-09-12T01:43:26.376 INFO:tasks.workunit.client.0.smithi066.stdout:9/928: write d0/d6/f50 [4208364,26213] 0 2024-09-12T01:43:26.376 INFO:tasks.workunit.client.0.smithi066.stdout:9/929: chown d0/d6/d17/d28/f100 1823718 1 2024-09-12T01:43:26.379 INFO:tasks.workunit.client.0.smithi066.stdout:9/930: creat d0/d6/d17/d1b/da2/f142 x:0 0 0 2024-09-12T01:43:26.379 INFO:tasks.workunit.client.0.smithi066.stdout:9/931: creat d0/d6/d17/d4f/d9/f143 x:0 0 0 2024-09-12T01:43:26.383 INFO:tasks.workunit.client.0.smithi066.stdout:9/932: creat d0/d6/d17/d1b/d4c/d4b/d7d/f144 x:0 0 0 2024-09-12T01:43:26.384 INFO:tasks.workunit.client.0.smithi066.stdout:9/933: getdents d0/d6/d17/d1b/de9/df9/dfd/d104 0 2024-09-12T01:43:26.384 INFO:tasks.workunit.client.0.smithi066.stdout:9/934: chown d0/d6/d17/fa0 686115134 1 2024-09-12T01:43:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:25 smithi066 ceph-mon[27875]: pgmap v12: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 207 MiB/s rd, 255 MiB/s wr, 399 op/s 2024-09-12T01:43:26.397 INFO:tasks.workunit.client.0.smithi066.stdout:9/935: dread d0/d6/d17/d28/d79/fc6 [0,4194304] 0 2024-09-12T01:43:26.399 INFO:tasks.workunit.client.0.smithi066.stdout:9/936: symlink d0/d6/d17/d1b/d4c/d4b/d86/de0/d12d/l145 0 2024-09-12T01:43:26.399 INFO:tasks.workunit.client.0.smithi066.stdout:9/937: truncate d0/d6/d37/d85/fcf 4444362 0 2024-09-12T01:43:26.399 INFO:tasks.workunit.client.0.smithi066.stdout:9/938: creat d0/d6/d17/d4f/d12/d46/f146 x:0 0 0 2024-09-12T01:43:26.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/939: mknod d0/d6/d17/d1b/d4c/d4b/c147 0 2024-09-12T01:43:26.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/940: fdatasync d0/f7 0 2024-09-12T01:43:26.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/941: stat d0/d6/d7f/dd2/l13d 0 2024-09-12T01:43:26.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/942: chown d0/d6 48 1 2024-09-12T01:43:26.403 INFO:tasks.workunit.client.0.smithi066.stdout:9/943: dread - d0/d6/d17/d4f/d9/fc7 zero size 2024-09-12T01:43:26.404 INFO:tasks.workunit.client.0.smithi066.stdout:9/944: fsync d0/d6/d17/d4f/f81 0 2024-09-12T01:43:26.404 INFO:tasks.workunit.client.0.smithi066.stdout:9/945: creat d0/d6/d17/d1b/d4c/d4b/f148 x:0 0 0 2024-09-12T01:43:26.404 INFO:tasks.workunit.client.0.smithi066.stdout:9/946: truncate d0/d6/d7f/dd2/ff3 5054162 0 2024-09-12T01:43:26.404 INFO:tasks.workunit.client.0.smithi066.stdout:9/947: creat d0/d6/d17/d1b/d4c/d42/dab/f149 x:0 0 0 2024-09-12T01:43:26.581 INFO:tasks.workunit.client.0.smithi066.stdout:2/918: sync 2024-09-12T01:43:26.581 INFO:tasks.workunit.client.0.smithi066.stdout:2/919: chown de/d13/d1e/d84/f125 16595 1 2024-09-12T01:43:26.598 INFO:tasks.workunit.client.0.smithi066.stdout:2/920: dwrite de/d13/d1e/d25/f29 [0,4194304] 0 2024-09-12T01:43:26.602 INFO:tasks.workunit.client.0.smithi066.stdout:2/921: getdents de/d13/d1e 0 2024-09-12T01:43:26.605 INFO:tasks.workunit.client.0.smithi066.stdout:2/922: rmdir de/d3c 39 2024-09-12T01:43:26.607 INFO:tasks.workunit.client.0.smithi066.stdout:2/923: creat de/d3c/d8f/dcf/ddb/f126 x:0 0 0 2024-09-12T01:43:26.607 INFO:tasks.workunit.client.0.smithi066.stdout:2/924: fdatasync de/d13/f9f 0 2024-09-12T01:43:26.612 INFO:tasks.workunit.client.0.smithi066.stdout:2/925: stat de/d13/d28/d3a/dfd/d58/d112/d4f/l117 0 2024-09-12T01:43:26.621 INFO:tasks.workunit.client.0.smithi066.stdout:2/926: rename de/d3c/d8f/dcf/cfe to de/d13/d28/d3a/c127 0 2024-09-12T01:43:26.625 INFO:tasks.workunit.client.0.smithi066.stdout:2/927: stat de/d3c/d8f/l10d 0 2024-09-12T01:43:26.625 INFO:tasks.workunit.client.0.smithi066.stdout:2/928: dread - de/d13/d28/d3a/dfd/da8/ff0 zero size 2024-09-12T01:43:26.625 INFO:tasks.workunit.client.0.smithi066.stdout:2/929: chown de/d13/d5c/f111 0 1 2024-09-12T01:43:26.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/930: rename de/d3c/d8f/dcf/ddb to de/d13/d128 0 2024-09-12T01:43:26.629 INFO:tasks.workunit.client.0.smithi066.stdout:2/931: chown de/d13/d28/d3a/dfd/d58/d112/f8c 5599 1 2024-09-12T01:43:26.647 INFO:tasks.workunit.client.0.smithi066.stdout:2/932: dwrite de/d13/d28/f93 [0,4194304] 0 2024-09-12T01:43:26.650 INFO:tasks.workunit.client.0.smithi066.stdout:2/933: dread de/fec [0,4194304] 0 2024-09-12T01:43:26.650 INFO:tasks.workunit.client.0.smithi066.stdout:2/934: dread - de/d13/d28/d3a/dfd/d81/fb8 zero size 2024-09-12T01:43:26.657 INFO:tasks.workunit.client.0.smithi066.stdout:2/935: write de/d13/d28/f93 [1933110,52966] 0 2024-09-12T01:43:26.657 INFO:tasks.workunit.client.0.smithi066.stdout:2/936: chown de/d13/d28/d3a/dfd/fc9 1 1 2024-09-12T01:43:26.658 INFO:tasks.workunit.client.0.smithi066.stdout:2/937: truncate de/d13/d28/f52 1939366 0 2024-09-12T01:43:26.660 INFO:tasks.workunit.client.0.smithi066.stdout:2/938: dread de/d13/d1e/fb0 [0,4194304] 0 2024-09-12T01:43:26.660 INFO:tasks.workunit.client.0.smithi066.stdout:8/978: sync 2024-09-12T01:43:26.664 INFO:tasks.workunit.client.0.smithi066.stdout:2/939: creat de/d13/d1e/d25/d5e/f129 x:0 0 0 2024-09-12T01:43:26.666 INFO:tasks.workunit.client.0.smithi066.stdout:8/979: symlink d12/d21/d2f/d57/d84/l14c 0 2024-09-12T01:43:26.666 INFO:tasks.workunit.client.0.smithi066.stdout:8/980: dread - d12/d21/d2f/d57/d84/d50/d56/db6/dee/f9e zero size 2024-09-12T01:43:26.668 INFO:tasks.workunit.client.0.smithi066.stdout:2/940: creat de/d13/d28/d3d/dff/d116/f12a x:0 0 0 2024-09-12T01:43:26.669 INFO:tasks.workunit.client.0.smithi066.stdout:1/985: sync 2024-09-12T01:43:26.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/948: sync 2024-09-12T01:43:26.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/949: chown d0/d6/d17/d4f/d9/de/fb7 13 1 2024-09-12T01:43:26.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/950: fdatasync d0/d6/d37/f11e 0 2024-09-12T01:43:26.669 INFO:tasks.workunit.client.0.smithi066.stdout:9/951: write d0/f3c [5110416,36400] 0 2024-09-12T01:43:26.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/952: mknod d0/d6/d17/d4f/d12/dbe/c14a 0 2024-09-12T01:43:26.672 INFO:tasks.workunit.client.0.smithi066.stdout:9/953: chown d0/d6/d17/d4f/d12/dbe 53349772 1 2024-09-12T01:43:26.673 INFO:tasks.workunit.client.0.smithi066.stdout:2/941: mknod de/c12b 0 2024-09-12T01:43:26.674 INFO:tasks.workunit.client.0.smithi066.stdout:9/954: readlink d0/d6/d17/d4f/l64 0 2024-09-12T01:43:26.674 INFO:tasks.workunit.client.0.smithi066.stdout:9/955: chown d0/d6/d37/l65 91326964 1 2024-09-12T01:43:26.674 INFO:tasks.workunit.client.0.smithi066.stdout:9/956: fsync d0/d6/d17/d1b/d4c/d4b/d86/f91 0 2024-09-12T01:43:26.674 INFO:tasks.workunit.client.0.smithi066.stdout:2/942: mkdir de/d13/d28/d3a/dfd/d58/d112/de5/d12c 0 2024-09-12T01:43:26.674 INFO:tasks.workunit.client.0.smithi066.stdout:2/943: fsync de/d13/d28/d3a/dfd/d81/fb8 0 2024-09-12T01:43:26.675 INFO:tasks.workunit.client.0.smithi066.stdout:9/957: symlink d0/d6/d17/d4f/d12/l14b 0 2024-09-12T01:43:26.688 INFO:tasks.workunit.client.0.smithi066.stdout:9/958: dread d0/fe4 [0,4194304] 0 2024-09-12T01:43:26.690 INFO:tasks.workunit.client.0.smithi066.stdout:9/959: link d0/d6/d17/d1b/d4c/d42/c7b d0/d6/d43/c14c 0 2024-09-12T01:43:26.690 INFO:tasks.workunit.client.0.smithi066.stdout:9/960: fdatasync d0/d6/d17/f4d 0 2024-09-12T01:43:26.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/961: symlink d0/d6/d17/d1b/l14d 0 2024-09-12T01:43:26.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/962: chown d0/d6/d7f/d12f/f134 1 1 2024-09-12T01:43:26.691 INFO:tasks.workunit.client.0.smithi066.stdout:9/963: truncate d0/d6/d17/d1b/d4c/d42/d10c/f10e 48053 0 2024-09-12T01:43:26.693 INFO:tasks.workunit.client.0.smithi066.stdout:9/964: rename d0/d6/d7f/caa to d0/d6/d17/d1b/da2/dae/dc2/c14e 0 2024-09-12T01:43:26.694 INFO:tasks.workunit.client.0.smithi066.stdout:8/981: dwrite d12/d21/d2f/f45 [4194304,4194304] 0 2024-09-12T01:43:26.695 INFO:tasks.workunit.client.0.smithi066.stdout:9/965: rename d0/d6/d17/d4f/d12/d84/dd4/c105 to d0/d6/d17/d1b/d4c/d42/dab/c14f 0 2024-09-12T01:43:26.695 INFO:tasks.workunit.client.0.smithi066.stdout:1/986: dwrite d5/dc/f106 [0,4194304] 0 2024-09-12T01:43:26.696 INFO:tasks.workunit.client.0.smithi066.stdout:2/944: dwrite de/d13/d1e/f10e [0,4194304] 0 2024-09-12T01:43:26.696 INFO:tasks.workunit.client.0.smithi066.stdout:2/945: stat de/d13/d28/ff6 0 2024-09-12T01:43:26.697 INFO:tasks.workunit.client.0.smithi066.stdout:8/982: truncate d12/d21/d2f/d53/d10f/f121 2497865 0 2024-09-12T01:43:26.697 INFO:tasks.workunit.client.0.smithi066.stdout:8/983: write d12/d21/d2f/df5/d11a/f12a [404703,100071] 0 2024-09-12T01:43:26.697 INFO:tasks.workunit.client.0.smithi066.stdout:9/966: symlink d0/d6/d17/d1b/de9/df9/l150 0 2024-09-12T01:43:26.699 INFO:tasks.workunit.client.0.smithi066.stdout:1/987: mkdir d5/d15/d4d/d86/dc7/d12c 0 2024-09-12T01:43:26.702 INFO:tasks.workunit.client.0.smithi066.stdout:8/984: fdatasync d12/d21/d2f/d57/d84/d50/d56/d69/d7d/f11b 0 2024-09-12T01:43:26.702 INFO:tasks.workunit.client.0.smithi066.stdout:9/967: write d0/d6/d17/d1b/da2/dae/f70 [1902056,55721] 0 2024-09-12T01:43:26.703 INFO:tasks.workunit.client.0.smithi066.stdout:1/988: symlink d5/d15/d4d/d86/dc7/l12d 0 2024-09-12T01:43:26.704 INFO:tasks.workunit.client.0.smithi066.stdout:1/989: creat d5/d15/d4d/d86/dc7/f12e x:0 0 0 2024-09-12T01:43:26.705 INFO:tasks.workunit.client.0.smithi066.stdout:9/968: symlink d0/d6/d17/d1b/d4c/d4b/d86/l151 0 2024-09-12T01:43:26.707 INFO:tasks.workunit.client.0.smithi066.stdout:1/990: mkdir d5/dc/d36/df7/db6/d12f 0 2024-09-12T01:43:26.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/969: truncate d0/d6/d17/d1b/de9/ff6 18636 0 2024-09-12T01:43:26.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/970: chown d0/d6/d17/d1b/da2/dae/dc2 59875423 1 2024-09-12T01:43:26.709 INFO:tasks.workunit.client.0.smithi066.stdout:9/971: write d0/d6/d17/d4f/d12/d46/f146 [932790,89598] 0 2024-09-12T01:43:26.712 INFO:tasks.workunit.client.0.smithi066.stdout:1/991: creat d5/dc/d36/de8/d8e/de2/dbc/d11d/f130 x:0 0 0 2024-09-12T01:43:26.712 INFO:tasks.workunit.client.0.smithi066.stdout:1/992: fdatasync d5/d15/d4d/dd3/d115/f119 0 2024-09-12T01:43:26.712 INFO:tasks.workunit.client.0.smithi066.stdout:1/993: write d5/dc/f29 [1672256,120264] 0 2024-09-12T01:43:26.715 INFO:tasks.workunit.client.0.smithi066.stdout:1/994: rename d5/dc/d36/d57/dac/dc4/lf5 to d5/dc/d36/l131 0 2024-09-12T01:43:26.716 INFO:tasks.workunit.client.0.smithi066.stdout:1/995: dread d5/dc/d36/df7/fc3 [0,4194304] 0 2024-09-12T01:43:26.716 INFO:tasks.workunit.client.0.smithi066.stdout:2/946: dwrite f8 [0,4194304] 0 2024-09-12T01:43:26.717 INFO:tasks.workunit.client.0.smithi066.stdout:9/972: unlink d0/d6/d17/d1b/d4c/f2b 0 2024-09-12T01:43:26.718 INFO:tasks.workunit.client.0.smithi066.stdout:1/996: symlink d5/dc/d53/dae/df4/l132 0 2024-09-12T01:43:26.721 INFO:tasks.workunit.client.0.smithi066.stdout:2/947: rename de/d13/d28/f56 to de/d13/d28/d3a/dfd/d58/d112/f12d 0 2024-09-12T01:43:26.723 INFO:tasks.workunit.client.0.smithi066.stdout:1/997: creat d5/dc/d36/d57/dac/dd5/dfc/f133 x:0 0 0 2024-09-12T01:43:26.724 INFO:tasks.workunit.client.0.smithi066.stdout:8/985: dwrite d12/d21/d2f/d57/d43/f46 [4194304,4194304] 0 2024-09-12T01:43:26.725 INFO:tasks.workunit.client.0.smithi066.stdout:2/948: unlink de/d13/d7f/fc4 0 2024-09-12T01:43:26.725 INFO:tasks.workunit.client.0.smithi066.stdout:2/949: getdents de/d13/d28/d3a/dfd/d58/d112/de5/d12c 0 2024-09-12T01:43:26.729 INFO:tasks.workunit.client.0.smithi066.stdout:9/973: write d0/d6/d17/d1b/d4c/d4b/d86/f91 [2073031,106739] 0 2024-09-12T01:43:26.729 INFO:tasks.workunit.client.0.smithi066.stdout:2/950: link de/cbd de/d13/d1e/d92/c12e 0 2024-09-12T01:43:26.734 INFO:tasks.workunit.client.0.smithi066.stdout:8/986: write d12/d21/d2f/d57/d3c/f6c [20581007,26338] 0 2024-09-12T01:43:26.738 INFO:tasks.workunit.client.0.smithi066.stdout:1/998: rmdir d5/dc/d36/de8 39 2024-09-12T01:43:26.742 INFO:tasks.workunit.client.0.smithi066.stdout:8/987: truncate d12/d21/d2f/d53/dde/dfa/f11f 1707626 0 2024-09-12T01:43:26.742 INFO:tasks.workunit.client.0.smithi066.stdout:2/951: dread de/d13/d11c/ff3 [0,4194304] 0 2024-09-12T01:43:26.747 INFO:tasks.workunit.client.0.smithi066.stdout:8/988: mknod d12/d21/d2f/d57/d84/d50/d56/db6/dee/c14d 0 2024-09-12T01:43:26.754 INFO:tasks.workunit.client.0.smithi066.stdout:1/999: write d5/dc/f9c [69053,44416] 0 2024-09-12T01:43:26.757 INFO:tasks.workunit.client.0.smithi066.stdout:8/989: write d12/d21/d2f/d57/d84/d50/d56/db6/fd7 [255164,102404] 0 2024-09-12T01:43:26.759 INFO:tasks.workunit.client.0.smithi066.stdout:8/990: mkdir d12/d21/d2f/d57/d84/d50/d56/d69/d7d/d140/d14e 0 2024-09-12T01:43:26.759 INFO:tasks.workunit.client.0.smithi066.stdout:8/991: readlink d12/d21/d2f/d57/ld3 0 2024-09-12T01:43:26.760 INFO:tasks.workunit.client.0.smithi066.stdout:8/992: unlink d12/d21/d2f/d57/d84/d50/d56/db6/dc8/fec 0 2024-09-12T01:43:26.763 INFO:tasks.workunit.client.0.smithi066.stdout:8/993: unlink d12/d21/d2f/f95 0 2024-09-12T01:43:26.770 INFO:tasks.workunit.client.0.smithi066.stdout:8/994: rename d12/d21/d2f/d57/d43/d82 to d12/daf/d144/d14f 0 2024-09-12T01:43:26.771 INFO:tasks.workunit.client.0.smithi066.stdout:8/995: dread d12/d21/d2f/d57/d84/d50/d56/db6/dc8/d104/f114 [0,4194304] 0 2024-09-12T01:43:26.771 INFO:tasks.workunit.client.0.smithi066.stdout:8/996: chown d12/lb3 380384 1 2024-09-12T01:43:26.774 INFO:tasks.workunit.client.0.smithi066.stdout:8/997: mknod d12/d21/d2f/d57/d84/d50/d56/db6/dc8/c150 0 2024-09-12T01:43:26.777 INFO:tasks.workunit.client.0.smithi066.stdout:8/998: creat d12/d21/d2f/d57/d84/d50/d56/d69/d7d/dc7/d11e/f151 x:0 0 0 2024-09-12T01:43:26.779 INFO:tasks.workunit.client.0.smithi066.stdout:9/974: dwrite d0/d6/d43/fa4 [0,4194304] 0 2024-09-12T01:43:26.782 INFO:tasks.workunit.client.0.smithi066.stdout:8/999: creat d12/d21/d2f/d57/d3c/de4/f152 x:0 0 0 2024-09-12T01:43:26.785 INFO:tasks.workunit.client.0.smithi066.stdout:9/975: dread d0/d6/f10 [0,4194304] 0 2024-09-12T01:43:26.785 INFO:tasks.workunit.client.0.smithi066.stdout:9/976: chown d0/d6/d17/d1b/d4c/d4b/d86/l151 1053120 1 2024-09-12T01:43:26.785 INFO:tasks.workunit.client.0.smithi066.stdout:9/977: creat d0/d6/d17/d1b/d4c/d42/d10c/f152 x:0 0 0 2024-09-12T01:43:26.792 INFO:tasks.workunit.client.0.smithi066.stdout:9/978: rmdir d0/d6/d17/d1b/da2/dae 39 2024-09-12T01:43:26.792 INFO:tasks.workunit.client.0.smithi066.stdout:9/979: chown d0/d6/d17/d28/f100 5 1 2024-09-12T01:43:26.792 INFO:tasks.workunit.client.0.smithi066.stdout:9/980: truncate d0/d6/d17/d4f/d9/fc7 988808 0 2024-09-12T01:43:26.805 INFO:tasks.workunit.client.0.smithi066.stdout:9/981: dwrite d0/d6/d7f/d12f/f134 [0,4194304] 0 2024-09-12T01:43:26.805 INFO:tasks.workunit.client.0.smithi066.stdout:9/982: dread - d0/f131 zero size 2024-09-12T01:43:26.805 INFO:tasks.workunit.client.0.smithi066.stdout:9/983: fdatasync d0/d6/d43/df7/f107 0 2024-09-12T01:43:26.818 INFO:tasks.workunit.client.0.smithi066.stdout:9/984: dwrite d0/d6/d17/d28/d79/ffb [4194304,4194304] 0 2024-09-12T01:43:26.819 INFO:tasks.workunit.client.0.smithi066.stdout:9/985: link d0/d6/l3a d0/d6/d17/d1b/d4c/d4b/dec/l153 0 2024-09-12T01:43:26.828 INFO:tasks.workunit.client.0.smithi066.stdout:9/986: dread d0/d6/d7f/d90/fcc [0,4194304] 0 2024-09-12T01:43:26.829 INFO:tasks.workunit.client.0.smithi066.stdout:9/987: unlink d0/d6/d17/d28/d79/la7 0 2024-09-12T01:43:26.831 INFO:tasks.workunit.client.0.smithi066.stdout:9/988: write d0/d6/d17/d4f/d12/d84/fac [17240,24247] 0 2024-09-12T01:43:26.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/989: dwrite d0/d6/d17/d1b/f76 [0,4194304] 0 2024-09-12T01:43:26.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/990: dread - d0/d6/d7f/f12a zero size 2024-09-12T01:43:26.850 INFO:tasks.workunit.client.0.smithi066.stdout:9/991: fdatasync d0/d6/d17/d28/f77 0 2024-09-12T01:43:26.861 INFO:tasks.workunit.client.0.smithi066.stdout:9/992: write d0/d6/d17/d4f/d12/fb1 [1738277,127304] 0 2024-09-12T01:43:26.866 INFO:tasks.workunit.client.0.smithi066.stdout:9/993: dread d0/d6/f8e [0,4194304] 0 2024-09-12T01:43:26.868 INFO:tasks.workunit.client.0.smithi066.stdout:9/994: mkdir d0/d6/d17/d1b/d4c/d4b/dec/d154 0 2024-09-12T01:43:26.884 INFO:tasks.workunit.client.0.smithi066.stdout:9/995: dwrite d0/d6/d17/d4f/d9/fc7 [0,4194304] 0 2024-09-12T01:43:26.885 INFO:tasks.workunit.client.0.smithi066.stdout:9/996: fsync d0/d6/d17/d28/fdf 0 2024-09-12T01:43:26.895 INFO:tasks.workunit.client.0.smithi066.stdout:9/997: dread d0/d6/d17/d1b/d4c/d42/f5a [0,4194304] 0 2024-09-12T01:43:26.897 INFO:tasks.workunit.client.0.smithi066.stdout:9/998: symlink d0/d6/d7f/d90/d9a/l155 0 2024-09-12T01:43:26.897 INFO:tasks.workunit.client.0.smithi066.stdout:9/999: chown d0/d6/d37/f10a 116484 1 2024-09-12T01:43:27.102 INFO:tasks.workunit.client.0.smithi066.stdout:2/952: sync 2024-09-12T01:43:27.102 INFO:tasks.workunit.client.0.smithi066.stdout:2/953: creat de/d13/d1e/d84/f12f x:0 0 0 2024-09-12T01:43:27.102 INFO:tasks.workunit.client.0.smithi066.stdout:2/954: chown de/d13/d28/d3a/dfd/da8/daa 225 1 2024-09-12T01:43:27.415 INFO:tasks.workunit.client.0.smithi066.stdout:2/955: sync 2024-09-12T01:43:27.415 INFO:tasks.workunit.client.0.smithi066.stdout:2/956: fdatasync de/d13/d28/d3a/dfd/d58/f73 0 2024-09-12T01:43:27.416 INFO:tasks.workunit.client.0.smithi066.stdout:2/957: creat de/d13/f130 x:0 0 0 2024-09-12T01:43:27.416 INFO:tasks.workunit.client.0.smithi066.stdout:2/958: readlink de/d13/d28/d3a/dd4/l104 0 2024-09-12T01:43:27.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/959: dread de/d13/d1e/d25/f33 [4194304,4194304] 0 2024-09-12T01:43:27.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/960: chown de/d13/d1e/d92/l9e 4393670 1 2024-09-12T01:43:27.426 INFO:tasks.workunit.client.0.smithi066.stdout:2/961: truncate de/d13/d28/d3a/f11b 1141587 0 2024-09-12T01:43:27.427 INFO:tasks.workunit.client.0.smithi066.stdout:2/962: dread de/d13/d28/d3a/f11b [0,4194304] 0 2024-09-12T01:43:27.437 INFO:tasks.workunit.client.0.smithi066.stdout:2/963: dread de/d13/d1e/d84/fab [4194304,4194304] 0 2024-09-12T01:43:27.437 INFO:tasks.workunit.client.0.smithi066.stdout:2/964: truncate de/d13/d28/d3a/fe3 252302 0 2024-09-12T01:43:27.443 INFO:tasks.workunit.client.0.smithi066.stdout:2/965: write de/d13/d28/d3a/dfd/d58/f61 [181976,79466] 0 2024-09-12T01:43:27.443 INFO:tasks.workunit.client.0.smithi066.stdout:2/966: read - de/d13/d28/d3a/dfd/d58/d112/fd2 zero size 2024-09-12T01:43:27.444 INFO:tasks.workunit.client.0.smithi066.stdout:2/967: mkdir de/d13/d28/d3a/dfd/da8/d131 0 2024-09-12T01:43:27.445 INFO:tasks.workunit.client.0.smithi066.stdout:2/968: rmdir de/d13/d1e 39 2024-09-12T01:43:27.445 INFO:tasks.workunit.client.0.smithi066.stdout:2/969: readlink de/d13/d1e/l27 0 2024-09-12T01:43:27.445 INFO:tasks.workunit.client.0.smithi066.stdout:2/970: write de/d13/d28/d3a/dfd/da8/f106 [455469,93646] 0 2024-09-12T01:43:27.461 INFO:tasks.workunit.client.0.smithi066.stdout:2/971: dwrite de/d13/d11c/f121 [0,4194304] 0 2024-09-12T01:43:27.461 INFO:tasks.workunit.client.0.smithi066.stdout:2/972: chown de/d13/d5c/l6c 258487023 1 2024-09-12T01:43:27.475 INFO:tasks.workunit.client.0.smithi066.stdout:2/973: dwrite de/d13/d28/d3a/dfd/fc9 [0,4194304] 0 2024-09-12T01:43:27.475 INFO:tasks.workunit.client.0.smithi066.stdout:2/974: write de/d13/d7f/ff7 [38067,122804] 0 2024-09-12T01:43:27.480 INFO:tasks.workunit.client.0.smithi066.stdout:2/975: getdents de/d13/d28/d3a/dfd/d81 0 2024-09-12T01:43:27.483 INFO:tasks.workunit.client.0.smithi066.stdout:2/976: mkdir de/d13/d28/d3a/dfd/d58/d132 0 2024-09-12T01:43:27.483 INFO:tasks.workunit.client.0.smithi066.stdout:2/977: chown de/d13/d9c/lf1 496 1 2024-09-12T01:43:27.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/978: mknod de/d13/d28/c133 0 2024-09-12T01:43:27.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/979: chown de/d3c/d8f 210884 1 2024-09-12T01:43:27.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/980: write de/d13/d11c/ff3 [147737,82343] 0 2024-09-12T01:43:27.485 INFO:tasks.workunit.client.0.smithi066.stdout:2/981: write de/d13/f9f [5220210,100542] 0 2024-09-12T01:43:27.486 INFO:tasks.workunit.client.0.smithi066.stdout:2/982: chown de/l1b 1799 1 2024-09-12T01:43:27.486 INFO:tasks.workunit.client.0.smithi066.stdout:2/983: readlink de/d13/d28/d3d/lc8 0 2024-09-12T01:43:27.501 INFO:tasks.workunit.client.0.smithi066.stdout:2/984: dwrite de/d13/d1e/d25/f5b [0,4194304] 0 2024-09-12T01:43:27.502 INFO:tasks.workunit.client.0.smithi066.stdout:2/985: mkdir de/d13/d28/d3a/dfd/d58/d112/de5/d12c/d134 0 2024-09-12T01:43:27.503 INFO:tasks.workunit.client.0.smithi066.stdout:2/986: truncate de/d13/d5c/f78 1585321 0 2024-09-12T01:43:27.505 INFO:tasks.workunit.client.0.smithi066.stdout:2/987: write de/d13/d1e/fb0 [629335,122047] 0 2024-09-12T01:43:27.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/988: mkdir de/d13/d7f/d135 0 2024-09-12T01:43:27.506 INFO:tasks.workunit.client.0.smithi066.stdout:2/989: write de/d13/d28/d3a/dfd/d58/d112/fd2 [633207,60096] 0 2024-09-12T01:43:27.510 INFO:tasks.workunit.client.0.smithi066.stdout:2/990: rename de/d13/d11c to de/d13/d7f/d135/d136 0 2024-09-12T01:43:27.520 INFO:tasks.workunit.client.0.smithi066.stdout:2/991: dread de/d13/d1e/d25/f5b [0,4194304] 0 2024-09-12T01:43:27.528 INFO:tasks.workunit.client.0.smithi066.stdout:2/992: dread f5 [0,4194304] 0 2024-09-12T01:43:27.529 INFO:tasks.workunit.client.0.smithi066.stdout:2/993: getdents de/d13/d28/d3a/dfd/d58 0 2024-09-12T01:43:27.530 INFO:tasks.workunit.client.0.smithi066.stdout:2/994: mkdir de/d13/d128/d137 0 2024-09-12T01:43:27.532 INFO:tasks.workunit.client.0.smithi066.stdout:2/995: rename de/d13/d28/d3a/dd4/l104 to de/d13/d1e/d84/l138 0 2024-09-12T01:43:27.534 INFO:tasks.workunit.client.0.smithi066.stdout:2/996: creat de/d13/d28/d3a/dfd/d58/d112/d4f/d11e/f139 x:0 0 0 2024-09-12T01:43:27.534 INFO:tasks.workunit.client.0.smithi066.stdout:2/997: creat de/d13/d128/f13a x:0 0 0 2024-09-12T01:43:27.536 INFO:tasks.workunit.client.0.smithi066.stdout:2/998: mknod de/d13/d1e/da3/c13b 0 2024-09-12T01:43:27.536 INFO:tasks.workunit.client.0.smithi066.stdout:2/999: stat de/d13/d28/d3a/dfd/d58/d112/f54 0 2024-09-12T01:43:27.540 INFO:tasks.workunit.client.0.smithi066.stderr:+ rm -rf -- ./tmp.zYu16165RL 2024-09-12T01:43:28.079 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:27 smithi066 ceph-mon[27875]: pgmap v13: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 170 MiB/s rd, 205 MiB/s wr, 327 op/s 2024-09-12T01:43:28.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:27 smithi153 ceph-mon[34713]: pgmap v13: 65 pgs: 65 active+clean; 3.8 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 170 MiB/s rd, 205 MiB/s wr, 327 op/s 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:29.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:29 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:43:29.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:29 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: pgmap v14: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 206 MiB/s rd, 252 MiB/s wr, 447 op/s 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: Adjusting osd_memory_target on smithi066 to 1557M 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:30 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: pgmap v14: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 206 MiB/s rd, 252 MiB/s wr, 447 op/s 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: Adjusting osd_memory_target on smithi066 to 1557M 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.796 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.797 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.797 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.797 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:30.797 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:30 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:31.739 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:31 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:31.739 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:31 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:31.739 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:31 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:31.740 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:31 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:31.740 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:31 smithi066 ceph-mon[27875]: Reconfiguring node-exporter.smithi066 (dependencies changed)... 2024-09-12T01:43:31.740 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:31 smithi066 ceph-mon[27875]: Reconfiguring daemon node-exporter.smithi066 on smithi066 2024-09-12T01:43:31.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:31 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:31.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:31 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:43:31.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:31 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:31.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:31 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:43:31.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:31 smithi153 ceph-mon[34713]: Reconfiguring node-exporter.smithi066 (dependencies changed)... 2024-09-12T01:43:31.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:31 smithi153 ceph-mon[34713]: Reconfiguring daemon node-exporter.smithi066 on smithi066 2024-09-12T01:43:32.459 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:32 smithi066 ceph-mon[27875]: pgmap v15: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 127 MiB/s wr, 268 op/s 2024-09-12T01:43:32.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:32 smithi153 ceph-mon[34713]: pgmap v15: 65 pgs: 65 active+clean; 3.3 GiB data, 12 GiB used, 525 GiB / 536 GiB avail; 103 MiB/s rd, 127 MiB/s wr, 268 op/s 2024-09-12T01:43:32.921 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:43:32.921 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-12T01:43:34.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:33 smithi066 ceph-mon[27875]: pgmap v16: 65 pgs: 65 active+clean; 2.6 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 128 MiB/s wr, 308 op/s 2024-09-12T01:43:34.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:34.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:34.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:33 smithi066 ceph-mon[27875]: Reconfiguring alertmanager.smithi066 (dependencies changed)... 2024-09-12T01:43:34.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:33 smithi066 ceph-mon[27875]: Reconfiguring daemon alertmanager.smithi066 on smithi066 2024-09-12T01:43:34.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:33 smithi153 ceph-mon[34713]: pgmap v16: 65 pgs: 65 active+clean; 2.6 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 128 MiB/s wr, 308 op/s 2024-09-12T01:43:34.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:34.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:34.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:33 smithi153 ceph-mon[34713]: Reconfiguring alertmanager.smithi066 (dependencies changed)... 2024-09-12T01:43:34.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:33 smithi153 ceph-mon[34713]: Reconfiguring daemon alertmanager.smithi066 on smithi066 2024-09-12T01:43:36.001 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:35 smithi066 ceph-mon[27875]: pgmap v17: 65 pgs: 65 active+clean; 1.9 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 85 MiB/s wr, 255 op/s 2024-09-12T01:43:36.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:35 smithi153 ceph-mon[34713]: pgmap v17: 65 pgs: 65 active+clean; 1.9 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 85 MiB/s wr, 255 op/s 2024-09-12T01:43:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:37 smithi066 ceph-mon[27875]: pgmap v18: 65 pgs: 65 active+clean; 1.9 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 47 MiB/s wr, 215 op/s 2024-09-12T01:43:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:37 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:37 smithi153 ceph-mon[34713]: pgmap v18: 65 pgs: 65 active+clean; 1.9 GiB data, 7.9 GiB used, 528 GiB / 536 GiB avail; 36 MiB/s rd, 47 MiB/s wr, 215 op/s 2024-09-12T01:43:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:37 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:39.602 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:39 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:39.602 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:39 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:39.602 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:39 smithi066 ceph-mon[27875]: Reconfiguring grafana.smithi066 (dependencies changed)... 2024-09-12T01:43:39.602 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:39 smithi066 ceph-mon[27875]: Reconfiguring daemon grafana.smithi066 on smithi066 2024-09-12T01:43:39.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:39 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:39.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:39 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:39.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:39 smithi153 ceph-mon[34713]: Reconfiguring grafana.smithi066 (dependencies changed)... 2024-09-12T01:43:39.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:39 smithi153 ceph-mon[34713]: Reconfiguring daemon grafana.smithi066 on smithi066 2024-09-12T01:43:40.810 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:40 smithi066 ceph-mon[27875]: pgmap v19: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 36 MiB/s rd, 48 MiB/s wr, 331 op/s 2024-09-12T01:43:40.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:40 smithi153 ceph-mon[34713]: pgmap v19: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 36 MiB/s rd, 48 MiB/s wr, 331 op/s 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 -- 172.21.15.66:0/4221959488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df40ff6f0 msgr2=0x7f8df4101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/4221959488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df40ff6f0 0x7f8df4101ad0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8de80048d0 tx=0x7f8de8009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 -- 172.21.15.66:0/4221959488 shutdown_connections 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/4221959488 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df40ff6f0 0x7f8df4101ad0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/4221959488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df4066650 0x7f8df40ff1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 -- 172.21.15.66:0/4221959488 >> 172.21.15.66:0/4221959488 conn(0x7f8df40f6c20 msgr2=0x7f8df40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 -- 172.21.15.66:0/4221959488 shutdown_connections 2024-09-12T01:43:41.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.136+0000 7f8df8cd7640 1 -- 172.21.15.66:0/4221959488 wait complete. 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df8cd7640 1 Processor -- start 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df8cd7640 1 -- start start 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df8cd7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 0x7f8df410d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df8cd7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df40ff6f0 0x7f8df410d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df8cd7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df410dc60 con 0x7f8df4066650 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df8cd7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df410e480 con 0x7f8df40ff6f0 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 0x7f8df410d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 0x7f8df410d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36904/0 (socket says 172.21.15.66:36904) 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df259c640 1 -- 172.21.15.66:0/2581696755 learned_addr learned my addr 172.21.15.66:0/2581696755 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.137+0000 7f8df1d9b640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df40ff6f0 0x7f8df410d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df259c640 1 -- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df40ff6f0 msgr2=0x7f8df410d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df259c640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df40ff6f0 0x7f8df410d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df259c640 1 -- 172.21.15.66:0/2581696755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de8005040 con 0x7f8df4066650 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df1d9b640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df40ff6f0 0x7f8df410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:41.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df259c640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 0x7f8df410d0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8de400eb70 tx=0x7f8de400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8de4007c30 con 0x7f8df4066650 2024-09-12T01:43:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8de400f040 con 0x7f8df4066650 2024-09-12T01:43:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df410e710 con 0x7f8df4066650 2024-09-12T01:43:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8de400cb00 con 0x7f8df4066650 2024-09-12T01:43:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.138+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df410ec80 con 0x7f8df4066650 2024-09-12T01:43:41.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.139+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df40fa8a0 con 0x7f8df4066650 2024-09-12T01:43:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.141+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f8de4009110 con 0x7f8df4066650 2024-09-12T01:43:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.141+0000 7f8de2ffd640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8ddc06e4a0 0x7f8ddc070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.141+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8de408e4f0 con 0x7f8df4066650 2024-09-12T01:43:41.141 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.142+0000 7f8df1d9b640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8ddc06e4a0 0x7f8ddc070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.142+0000 7f8df1d9b640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8ddc06e4a0 0x7f8ddc070950 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009ac0 tx=0x7f8de8035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.148+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8de4058030 con 0x7f8df4066650 2024-09-12T01:43:41.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.368+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8df410f0b0 con 0x7f8ddc06e4a0 2024-09-12T01:43:41.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.370+0000 7f8de2ffd640 1 -- 172.21.15.66:0/2581696755 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f8df410f0b0 con 0x7f8ddc06e4a0 2024-09-12T01:43:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8ddc06e4a0 msgr2=0x7f8ddc070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8ddc06e4a0 0x7f8ddc070950 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009ac0 tx=0x7f8de8035040 comp rx=0 tx=0).stop 2024-09-12T01:43:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 msgr2=0x7f8df410d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 0x7f8df410d0d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8de400eb70 tx=0x7f8de400b040 comp rx=0 tx=0).stop 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 shutdown_connections 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8ddc06e4a0 0x7f8ddc070950 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8df40ff6f0 0x7f8df410d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 --2- 172.21.15.66:0/2581696755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8df4066650 0x7f8df410d0d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 >> 172.21.15.66:0/2581696755 conn(0x7f8df40f6c20 msgr2=0x7f8df40f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 shutdown_connections 2024-09-12T01:43:41.374 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.373+0000 7f8df8cd7640 1 -- 172.21.15.66:0/2581696755 wait complete. 2024-09-12T01:43:41.384 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:43:41.487 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 -- 172.21.15.66:0/2355428150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 msgr2=0x7f4f600fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 --2- 172.21.15.66:0/2355428150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f600fc930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009c50 tx=0x7f4f5c004d10 comp rx=0 tx=0).stop 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 -- 172.21.15.66:0/2355428150 shutdown_connections 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 --2- 172.21.15.66:0/2355428150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 0x7f4f600fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 --2- 172.21.15.66:0/2355428150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f600fc930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 -- 172.21.15.66:0/2355428150 >> 172.21.15.66:0/2355428150 conn(0x7f4f600f7ce0 msgr2=0x7f4f600fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 -- 172.21.15.66:0/2355428150 shutdown_connections 2024-09-12T01:43:41.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.487+0000 7f4f6774d640 1 -- 172.21.15.66:0/2355428150 wait complete. 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f6774d640 1 Processor -- start 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f6774d640 1 -- start start 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f6774d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f6010f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f6774d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 0x7f4f6010f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f6774d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6010fde0 con 0x7f4f600fc520 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f6774d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60110600 con 0x7f4f600fd7f0 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f654e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f6010f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f654e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f6010f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36916/0 (socket says 172.21.15.66:36916) 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.488+0000 7f4f654e9640 1 -- 172.21.15.66:0/151793093 learned_addr learned my addr 172.21.15.66:0/151793093 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:41.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f64ce8640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 0x7f4f6010f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f654e9640 1 -- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 msgr2=0x7f4f6010f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f654e9640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 0x7f4f6010f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f654e9640 1 -- 172.21.15.66:0/151793093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c0098b0 con 0x7f4f600fc520 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f64ce8640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 0x7f4f6010f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f654e9640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f6010f250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c004750 tx=0x7f4f5c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f5c009710 con 0x7f4f600fc520 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f5c032b10 con 0x7f4f600fc520 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f60110830 con 0x7f4f600fc520 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.489+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f5c03db10 con 0x7f4f600fc520 2024-09-12T01:43:41.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.490+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f60110d10 con 0x7f4f600fc520 2024-09-12T01:43:41.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.491+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f600fb980 con 0x7f4f600fc520 2024-09-12T01:43:41.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.492+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f4f5c02f030 con 0x7f4f600fc520 2024-09-12T01:43:41.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.492+0000 7f4f55ffb640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f4f4c06e4a0 0x7f4f4c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.492+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4f5c0af120 con 0x7f4f600fc520 2024-09-12T01:43:41.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.493+0000 7f4f64ce8640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f4f4c06e4a0 0x7f4f4c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.493+0000 7f4f64ce8640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f4f4c06e4a0 0x7f4f4c070950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f50004fd0 tx=0x7f4f5000b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.498+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4f5c078c60 con 0x7f4f600fc520 2024-09-12T01:43:41.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.847+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f60111090 con 0x7f4f4c06e4a0 2024-09-12T01:43:41.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.849+0000 7f4f55ffb640 1 -- 172.21.15.66:0/151793093 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4f60111090 con 0x7f4f4c06e4a0 2024-09-12T01:43:41.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f4f4c06e4a0 msgr2=0x7f4f4c070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f4f4c06e4a0 0x7f4f4c070950 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f50004fd0 tx=0x7f4f5000b040 comp rx=0 tx=0).stop 2024-09-12T01:43:41.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 msgr2=0x7f4f6010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f6010f250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c004750 tx=0x7f4f5c004d10 comp rx=0 tx=0).stop 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 shutdown_connections 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f4f4c06e4a0 0x7f4f4c070950 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f600fd7f0 0x7f4f6010f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.851+0000 7f4f6774d640 1 --2- 172.21.15.66:0/151793093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f600fc520 0x7f4f6010f250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.852+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 >> 172.21.15.66:0/151793093 conn(0x7f4f600f7ce0 msgr2=0x7f4f600f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.852+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 shutdown_connections 2024-09-12T01:43:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.852+0000 7f4f6774d640 1 -- 172.21.15.66:0/151793093 wait complete. 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.951+0000 7f7c578a7640 1 -- 172.21.15.66:0/935575597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fba50 msgr2=0x7f7c500fbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.951+0000 7f7c578a7640 1 --2- 172.21.15.66:0/935575597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fba50 0x7f7c500fbe60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0048d0 tx=0x7f7c4c009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 -- 172.21.15.66:0/935575597 shutdown_connections 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 --2- 172.21.15.66:0/935575597 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fc3a0 0x7f7c500fc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 --2- 172.21.15.66:0/935575597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fba50 0x7f7c500fbe60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 -- 172.21.15.66:0/935575597 >> 172.21.15.66:0/935575597 conn(0x7f7c500f63a0 msgr2=0x7f7c500f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 -- 172.21.15.66:0/935575597 shutdown_connections 2024-09-12T01:43:41.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 -- 172.21.15.66:0/935575597 wait complete. 2024-09-12T01:43:41.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 Processor -- start 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.952+0000 7f7c578a7640 1 -- start start 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c578a7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 0x7f7c5010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c578a7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fc3a0 0x7f7c5010d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c578a7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5010dc90 con 0x7f7c500fba50 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c578a7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5010e4b0 con 0x7f7c500fc3a0 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c55643640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 0x7f7c5010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c55643640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 0x7f7c5010d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36930/0 (socket says 172.21.15.66:36930) 2024-09-12T01:43:41.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.953+0000 7f7c55643640 1 -- 172.21.15.66:0/15735755 learned_addr learned my addr 172.21.15.66:0/15735755 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.954+0000 7f7c54e42640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fc3a0 0x7f7c5010d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.954+0000 7f7c55643640 1 -- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fc3a0 msgr2=0x7f7c5010d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.954+0000 7f7c55643640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fc3a0 0x7f7c5010d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.954+0000 7f7c55643640 1 -- 172.21.15.66:0/15735755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c005040 con 0x7f7c500fba50 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.954+0000 7f7c54e42640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fc3a0 0x7f7c5010d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.954+0000 7f7c55643640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 0x7f7c5010d100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0048a0 tx=0x7f7c4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.955+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c4c038070 con 0x7f7c500fba50 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.955+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7c4c004290 con 0x7f7c500fba50 2024-09-12T01:43:41.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.955+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c4c03e650 con 0x7f7c500fba50 2024-09-12T01:43:41.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.955+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5010e6e0 con 0x7f7c500fba50 2024-09-12T01:43:41.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.955+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5010ec80 con 0x7f7c500fba50 2024-09-12T01:43:41.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.956+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c500fa040 con 0x7f7c500fba50 2024-09-12T01:43:41.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.957+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f7c4c030020 con 0x7f7c500fba50 2024-09-12T01:43:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.958+0000 7f7c45ffb640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f7c3c06e570 0x7f7c3c070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.958+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7c4c0adba0 con 0x7f7c500fba50 2024-09-12T01:43:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.958+0000 7f7c54e42640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f7c3c06e570 0x7f7c3c070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.958 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.958+0000 7f7c54e42640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f7c3c06e570 0x7f7c3c070a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c5010ceb0 tx=0x7f7c4000b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:41.962+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7c4c0778b0 con 0x7f7c500fba50 2024-09-12T01:43:42.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.173+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c50103f80 con 0x7f7c3c06e570 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.182+0000 7f7c45ffb640 1 -- 172.21.15.66:0/15735755 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7c50103f80 con 0x7f7c3c06e570 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 starting - - - - 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (8m) 13s ago 8m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (7m) 26s ago 7m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (6m) 13s ago 8m 84.5M - 9.4.7 954c08fa6188 a6ff5cae127b 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (2m) 13s ago 2m 11.8M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:43:42.182 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (2m) 13s ago 2m 209M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (2m) 26s ago 2m 15.0M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (2m) 26s ago 2m 14.9M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:9283,8765,8443 running (9m) 13s ago 9m 187M - 17.2.7-1609-g554ba93e d4c538e492e4 d4facfef752d 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (51s) 26s ago 7m 480M - 19.1.1-298-gb53b6d3e 54467abc55f8 514739a269bf 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (9m) 13s ago 9m 53.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (7m) 26s ago 7m 40.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 starting - - - - 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (7m) 26s ago 7m 16.8M - 1.5.0 0da6a335fe13 6391262c1a15 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (6m) 13s ago 6m 233M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (6m) 13s ago 6m 240M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (5m) 13s ago 5m 208M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (5m) 26s ago 5m 270M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:43:42.183 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (4m) 26s ago 4m 221M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:43:42.184 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (4m) 26s ago 4m 250M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:43:42.184 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (6m) 13s ago 7m 57.6M - 2.43.0 a07b618ecd1d 25c9c1516174 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f7c3c06e570 msgr2=0x7f7c3c070a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f7c3c06e570 0x7f7c3c070a20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c5010ceb0 tx=0x7f7c4000b040 comp rx=0 tx=0).stop 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 msgr2=0x7f7c5010d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 0x7f7c5010d100 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0048a0 tx=0x7f7c4c009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 shutdown_connections 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f7c3c06e570 0x7f7c3c070a20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c500fc3a0 0x7f7c5010d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.184+0000 7f7c578a7640 1 --2- 172.21.15.66:0/15735755 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c500fba50 0x7f7c5010d100 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.185+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 >> 172.21.15.66:0/15735755 conn(0x7f7c500f63a0 msgr2=0x7f7c500f7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.185+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 shutdown_connections 2024-09-12T01:43:42.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.185+0000 7f7c578a7640 1 -- 172.21.15.66:0/15735755 wait complete. 2024-09-12T01:43:42.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 -- 172.21.15.66:0/4136371529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb40ff6e0 msgr2=0x7ffbb4101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 --2- 172.21.15.66:0/4136371529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb40ff6e0 0x7ffbb4101ac0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ffba40048d0 tx=0x7ffba4009da0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 -- 172.21.15.66:0/4136371529 shutdown_connections 2024-09-12T01:43:42.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 --2- 172.21.15.66:0/4136371529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb40ff6e0 0x7ffbb4101ac0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 --2- 172.21.15.66:0/4136371529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbb4065be0 0x7ffbb40ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 -- 172.21.15.66:0/4136371529 >> 172.21.15.66:0/4136371529 conn(0x7ffbb40f6c10 msgr2=0x7ffbb40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:42.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 -- 172.21.15.66:0/4136371529 shutdown_connections 2024-09-12T01:43:42.304 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.303+0000 7ffbbb405640 1 -- 172.21.15.66:0/4136371529 wait complete. 2024-09-12T01:43:42.305 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbbb405640 1 Processor -- start 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbbb405640 1 -- start start 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbbb405640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 0x7ffbb40fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbbb405640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbb40ff6e0 0x7ffbb40fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbbb405640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40fb630 con 0x7ffbb4065be0 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbbb405640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40fb770 con 0x7ffbb40ff6e0 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbb91a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 0x7ffbb40fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbb91a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 0x7ffbb40fcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:50134/0 (socket says 172.21.15.66:50134) 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbb91a1640 1 -- 172.21.15.66:0/1192370533 learned_addr learned my addr 172.21.15.66:0/1192370533 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.304+0000 7ffbb89a0640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbb40ff6e0 0x7ffbb40fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffbb91a1640 1 -- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbb40ff6e0 msgr2=0x7ffbb40fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffbb91a1640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbb40ff6e0 0x7ffbb40fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffbb91a1640 1 -- 172.21.15.66:0/1192370533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4005040 con 0x7ffbb4065be0 2024-09-12T01:43:42.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffbb91a1640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 0x7ffbb40fcbb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0002840 tx=0x7ffbb0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb0007c30 con 0x7ffbb4065be0 2024-09-12T01:43:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffbb000f040 con 0x7ffbb4065be0 2024-09-12T01:43:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb40fba50 con 0x7ffbb4065be0 2024-09-12T01:43:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.305+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbb000d990 con 0x7ffbb4065be0 2024-09-12T01:43:42.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.306+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb41150a0 con 0x7ffbb4065be0 2024-09-12T01:43:42.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.307+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb40fa890 con 0x7ffbb4065be0 2024-09-12T01:43:42.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.307+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7ffbb0009600 con 0x7ffbb4065be0 2024-09-12T01:43:42.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.307+0000 7ffba9ffb640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7ffba006e4a0 0x7ffba0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.308+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7ffbb008d960 con 0x7ffbb4065be0 2024-09-12T01:43:42.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.308+0000 7ffbb89a0640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7ffba006e4a0 0x7ffba0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.308+0000 7ffbb89a0640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7ffba006e4a0 0x7ffba0070950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffba40043d0 tx=0x7ffba4035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.313 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.313+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ffbb00574a0 con 0x7ffbb4065be0 2024-09-12T01:43:42.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.672+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffbb4104f60 con 0x7ffbb4065be0 2024-09-12T01:43:42.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.673+0000 7ffba9ffb640 1 -- 172.21.15.66:0/1192370533 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7ffbb005ab60 con 0x7ffbb4065be0 2024-09-12T01:43:42.673 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:43:42.673 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 1, 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:43:42.674 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 13, 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:43:42.675 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:43:42.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7ffba006e4a0 msgr2=0x7ffba0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7ffba006e4a0 0x7ffba0070950 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffba40043d0 tx=0x7ffba4035040 comp rx=0 tx=0).stop 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 msgr2=0x7ffbb40fcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 0x7ffbb40fcbb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0002840 tx=0x7ffbb0004570 comp rx=0 tx=0).stop 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 shutdown_connections 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7ffba006e4a0 0x7ffba0070950 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbb40ff6e0 0x7ffbb40fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 --2- 172.21.15.66:0/1192370533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffbb4065be0 0x7ffbb40fcbb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.676+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 >> 172.21.15.66:0/1192370533 conn(0x7ffbb40f6c10 msgr2=0x7ffbb40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.677+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 shutdown_connections 2024-09-12T01:43:42.677 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.677+0000 7ffbbb405640 1 -- 172.21.15.66:0/1192370533 wait complete. 2024-09-12T01:43:42.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.811+0000 7f0685152640 1 -- 172.21.15.66:0/75873868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 msgr2=0x7f068006da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.811+0000 7f0685152640 1 --2- 172.21.15.66:0/75873868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068006da30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0678009c50 tx=0x7f0678004d10 comp rx=0 tx=0).stop 2024-09-12T01:43:42.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.811+0000 7f0685152640 1 -- 172.21.15.66:0/75873868 shutdown_connections 2024-09-12T01:43:42.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.811+0000 7f0685152640 1 --2- 172.21.15.66:0/75873868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.811+0000 7f0685152640 1 --2- 172.21.15.66:0/75873868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068006da30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.812 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:42 smithi066 ceph-mon[27875]: pgmap v20: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 211 op/s 2024-09-12T01:43:42.812 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:42 smithi066 ceph-mon[27875]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:42.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.811+0000 7f0685152640 1 -- 172.21.15.66:0/75873868 >> 172.21.15.66:0/75873868 conn(0x7f06800693e0 msgr2=0x7f068006b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:42.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.812+0000 7f0685152640 1 -- 172.21.15.66:0/75873868 shutdown_connections 2024-09-12T01:43:42.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.812+0000 7f0685152640 1 -- 172.21.15.66:0/75873868 wait complete. 2024-09-12T01:43:42.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.813+0000 7f0685152640 1 Processor -- start 2024-09-12T01:43:42.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.813+0000 7f0685152640 1 -- start start 2024-09-12T01:43:42.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.813+0000 7f0685152640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068011bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.813+0000 7f0685152640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068011c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.813+0000 7f0685152640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068011d030 con 0x7f068006f370 2024-09-12T01:43:42.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.813+0000 7f0685152640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068011d1a0 con 0x7f068006df70 2024-09-12T01:43:42.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.814+0000 7f067ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068011bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.814+0000 7f067ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068011bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:44366/0 (socket says 172.21.15.66:44366) 2024-09-12T01:43:42.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.814+0000 7f067ffff640 1 -- 172.21.15.66:0/4075599503 learned_addr learned my addr 172.21.15.66:0/4075599503 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:43:42.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.814+0000 7f067f7fe640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068011c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.814+0000 7f067ffff640 1 -- 172.21.15.66:0/4075599503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 msgr2=0x7f068011c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.815+0000 7f067ffff640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068011c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.815+0000 7f067ffff640 1 -- 172.21.15.66:0/4075599503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06780098b0 con 0x7f068006df70 2024-09-12T01:43:42.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.815+0000 7f067f7fe640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068011c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:42.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.815+0000 7f067ffff640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068011bd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0678004a30 tx=0x7f0678004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.816+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0678007a70 con 0x7f068006df70 2024-09-12T01:43:42.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.816+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0678033030 con 0x7f068006df70 2024-09-12T01:43:42.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.817+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0678032ab0 con 0x7f068006df70 2024-09-12T01:43:42.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.817+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068011d2e0 con 0x7f068006df70 2024-09-12T01:43:42.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.817+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068011d780 con 0x7f068006df70 2024-09-12T01:43:42.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.819+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068006cff0 con 0x7f068006df70 2024-09-12T01:43:42.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.820+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f067802f030 con 0x7f068006df70 2024-09-12T01:43:42.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.821+0000 7f067cff9640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f066806e320 0x7f06680707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.821+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f06780ae8b0 con 0x7f068006df70 2024-09-12T01:43:42.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.822+0000 7f067f7fe640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f066806e320 0x7f06680707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.824+0000 7f067f7fe640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f066806e320 0x7f06680707d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f067000a920 tx=0x7f0670008040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:42.828+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f06780783f0 con 0x7f068006df70 2024-09-12T01:43:42.900 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:43:42.900 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:43:42.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:42 smithi153 ceph-mon[34713]: pgmap v20: 65 pgs: 65 active+clean; 1.1 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 211 op/s 2024-09-12T01:43:42.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:42 smithi153 ceph-mon[34713]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:43.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.086+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f068011db50 con 0x7f066806e320 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [], 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "1/2 daemons upgraded", 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "", 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:43:43.087 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:43:43.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.087+0000 7f067cff9640 1 -- 172.21.15.66:0/4075599503 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f068011db50 con 0x7f066806e320 2024-09-12T01:43:43.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f066806e320 msgr2=0x7f06680707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f066806e320 0x7f06680707d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f067000a920 tx=0x7f0670008040 comp rx=0 tx=0).stop 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 msgr2=0x7f068011bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068011bd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0678004a30 tx=0x7f0678004d10 comp rx=0 tx=0).stop 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 shutdown_connections 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f066806e320 0x7f06680707d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068006f370 0x7f068011c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 --2- 172.21.15.66:0/4075599503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f068006df70 0x7f068011bd60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.090+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 >> 172.21.15.66:0/4075599503 conn(0x7f06800693e0 msgr2=0x7f068006ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.091+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 shutdown_connections 2024-09-12T01:43:43.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:43:43.091+0000 7f0685152640 1 -- 172.21.15.66:0/4075599503 wait complete. 2024-09-12T01:43:43.744 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:43 smithi066 ceph-mon[27875]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:43.744 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:43 smithi066 ceph-mon[27875]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:43.744 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:43 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1192370533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:43:43.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:43 smithi153 ceph-mon[34713]: from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:43.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:43 smithi153 ceph-mon[34713]: from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:43.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:43 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1192370533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:43:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:44 smithi066 ceph-mon[27875]: pgmap v21: 65 pgs: 65 active+clean; 783 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 259 op/s 2024-09-12T01:43:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:44 smithi066 ceph-mon[27875]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:44 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:44 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:44.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:44 smithi153 ceph-mon[34713]: pgmap v21: 65 pgs: 65 active+clean; 783 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 259 op/s 2024-09-12T01:43:44.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:44 smithi153 ceph-mon[34713]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:43:44.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:44 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:44.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:44 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:45 smithi066 ceph-mon[27875]: Reconfiguring prometheus.smithi066 (dependencies changed)... 2024-09-12T01:43:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:45 smithi066 ceph-mon[27875]: Reconfiguring daemon prometheus.smithi066 on smithi066 2024-09-12T01:43:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:45 smithi153 ceph-mon[34713]: Reconfiguring prometheus.smithi066 (dependencies changed)... 2024-09-12T01:43:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:45 smithi153 ceph-mon[34713]: Reconfiguring daemon prometheus.smithi066 on smithi066 2024-09-12T01:43:46.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:46 smithi066 ceph-mon[27875]: pgmap v22: 65 pgs: 65 active+clean; 440 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.9 MiB/s wr, 305 op/s 2024-09-12T01:43:46.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:46 smithi153 ceph-mon[34713]: pgmap v22: 65 pgs: 65 active+clean; 440 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 45 KiB/s rd, 1.9 MiB/s wr, 305 op/s 2024-09-12T01:43:48.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:48 smithi066 ceph-mon[27875]: pgmap v23: 65 pgs: 65 active+clean; 440 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 249 op/s 2024-09-12T01:43:48.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:48 smithi153 ceph-mon[34713]: pgmap v23: 65 pgs: 65 active+clean; 440 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 249 op/s 2024-09-12T01:43:50.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:50 smithi066 ceph-mon[27875]: pgmap v24: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 412 op/s 2024-09-12T01:43:50.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:50 smithi153 ceph-mon[34713]: pgmap v24: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 412 op/s 2024-09-12T01:43:52.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:52 smithi066 ceph-mon[27875]: pgmap v25: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 297 op/s 2024-09-12T01:43:52.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:52 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:52.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:52 smithi153 ceph-mon[34713]: pgmap v25: 65 pgs: 65 active+clean; 304 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 297 op/s 2024-09-12T01:43:52.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:52 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:43:54.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:54 smithi066 ceph-mon[27875]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.8 MiB/s wr, 377 op/s 2024-09-12T01:43:54.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:54 smithi153 ceph-mon[34713]: pgmap v26: 65 pgs: 65 active+clean; 303 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.8 MiB/s wr, 377 op/s 2024-09-12T01:43:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:56 smithi066 ceph-mon[27875]: pgmap v27: 65 pgs: 65 active+clean; 302 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 423 op/s 2024-09-12T01:43:56.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:56 smithi153 ceph-mon[34713]: pgmap v27: 65 pgs: 65 active+clean; 302 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 423 op/s 2024-09-12T01:43:58.859 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:58 smithi153 ceph-mon[34713]: pgmap v28: 65 pgs: 65 active+clean; 302 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 338 op/s 2024-09-12T01:43:58.859 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:58 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:58.859 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:58 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:58.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:58 smithi066 ceph-mon[27875]: pgmap v28: 65 pgs: 65 active+clean; 302 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 338 op/s 2024-09-12T01:43:58.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:58 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:58.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:58 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:43:59.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:59 smithi153 ceph-mon[34713]: Reconfiguring node-exporter.smithi153 (dependencies changed)... 2024-09-12T01:43:59.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:43:59 smithi153 ceph-mon[34713]: Reconfiguring daemon node-exporter.smithi153 on smithi153 2024-09-12T01:43:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:59 smithi066 ceph-mon[27875]: Reconfiguring node-exporter.smithi153 (dependencies changed)... 2024-09-12T01:43:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:43:59 smithi066 ceph-mon[27875]: Reconfiguring daemon node-exporter.smithi153 on smithi153 2024-09-12T01:44:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: pgmap v29: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 429 op/s 2024-09-12T01:44:00.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:00.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:00.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:44:00.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:44:00.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:00.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:00 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:00.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: pgmap v29: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 2.5 MiB/s wr, 429 op/s 2024-09-12T01:44:00.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:00.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:00.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:44:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:44:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:00 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:01 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:44:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:01 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:44:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:01 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:01 smithi066 ceph-mon[27875]: Upgrade: Need to upgrade myself (mgr.smithi153.jpnqza) 2024-09-12T01:44:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:01 smithi066 ceph-mon[27875]: Upgrade: Need to upgrade myself (mgr.smithi153.jpnqza) 2024-09-12T01:44:01.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:01 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:44:01.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:01 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:44:01.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:01 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:01.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:01 smithi153 ceph-mon[34713]: Upgrade: Need to upgrade myself (mgr.smithi153.jpnqza) 2024-09-12T01:44:01.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:01 smithi153 ceph-mon[34713]: Upgrade: Need to upgrade myself (mgr.smithi153.jpnqza) 2024-09-12T01:44:02.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:02 smithi066 ceph-mon[27875]: pgmap v30: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.7 MiB/s wr, 266 op/s 2024-09-12T01:44:02.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:02 smithi153 ceph-mon[34713]: pgmap v30: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.7 MiB/s wr, 266 op/s 2024-09-12T01:44:04.856 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:04 smithi066 ceph-mon[27875]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.7 MiB/s wr, 331 op/s 2024-09-12T01:44:04.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:04 smithi153 ceph-mon[34713]: pgmap v31: 65 pgs: 65 active+clean; 300 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 1.7 MiB/s wr, 331 op/s 2024-09-12T01:44:06.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:06 smithi066 ceph-mon[27875]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 350 op/s 2024-09-12T01:44:06.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:06 smithi153 ceph-mon[34713]: pgmap v32: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 39 KiB/s rd, 2.3 MiB/s wr, 350 op/s 2024-09-12T01:44:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2024-09-12T01:44:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: Upgrade: Updating mgr.smithi066.qdwcrh 2024-09-12T01:44:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:08.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:08.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:08.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: Deploying daemon mgr.smithi066.qdwcrh on smithi066 2024-09-12T01:44:08.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:08 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: pgmap v33: 65 pgs: 65 active+clean; 307 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 1.9 MiB/s wr, 255 op/s 2024-09-12T01:44:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: Upgrade: Updating mgr.smithi066.qdwcrh 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: Deploying daemon mgr.smithi066.qdwcrh on smithi066 2024-09-12T01:44:08.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:08 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:10.195 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:10 smithi066 ceph-mon[27875]: pgmap v34: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 3.1 MiB/s wr, 353 op/s 2024-09-12T01:44:10.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:10 smithi153 ceph-mon[34713]: pgmap v34: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 3.1 MiB/s wr, 353 op/s 2024-09-12T01:44:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:12 smithi066 ceph-mon[27875]: pgmap v35: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 2.1 MiB/s wr, 262 op/s 2024-09-12T01:44:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:12 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:12 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:12 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:12.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:12 smithi153 ceph-mon[34713]: pgmap v35: 65 pgs: 65 active+clean; 317 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 2.1 MiB/s wr, 262 op/s 2024-09-12T01:44:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:12 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:12 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:12 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 -- 172.21.15.66:0/3081290409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 msgr2=0x7f93b40fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/3081290409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b40fb840 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f93b00048d0 tx=0x7f93b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 -- 172.21.15.66:0/3081290409 shutdown_connections 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/3081290409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 0x7f93b40fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/3081290409 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b40fb840 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 -- 172.21.15.66:0/3081290409 >> 172.21.15.66:0/3081290409 conn(0x7f93b40f6c10 msgr2=0x7f93b40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 -- 172.21.15.66:0/3081290409 shutdown_connections 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.209+0000 7f93bc6ab640 1 -- 172.21.15.66:0/3081290409 wait complete. 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.210+0000 7f93bc6ab640 1 Processor -- start 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.210+0000 7f93bc6ab640 1 -- start start 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.210+0000 7f93bc6ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b4113650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.210+0000 7f93bc6ab640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 0x7f93b4113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93bc6ab640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b41141e0 con 0x7f93b40fb430 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93bc6ab640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b4114a00 con 0x7f93b40fc700 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93ba447640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b4113650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93ba447640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b4113650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42022/0 (socket says 172.21.15.66:42022) 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93ba447640 1 -- 172.21.15.66:0/2103832739 learned_addr learned my addr 172.21.15.66:0/2103832739 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93b9c46640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 0x7f93b4113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93b9c46640 1 -- 172.21.15.66:0/2103832739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 msgr2=0x7f93b4113650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93b9c46640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b4113650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93b9c46640 1 -- 172.21.15.66:0/2103832739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b0005040 con 0x7f93b40fc700 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.211+0000 7f93b9c46640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 0x7f93b4113b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93a400e910 tx=0x7f93a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.212+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a4007c30 con 0x7f93b40fc700 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.212+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4114c30 con 0x7f93b40fc700 2024-09-12T01:44:13.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.212+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f93a400f040 con 0x7f93b40fc700 2024-09-12T01:44:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.212+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93a400ca20 con 0x7f93b40fc700 2024-09-12T01:44:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.212+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b41151d0 con 0x7f93b40fc700 2024-09-12T01:44:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.214+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b40fa890 con 0x7f93b40fc700 2024-09-12T01:44:13.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.214+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f93a400cb80 con 0x7f93b40fc700 2024-09-12T01:44:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.215+0000 7f93aaffd640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f93a006e4a0 0x7f93a0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.215+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f93a408d730 con 0x7f93b40fc700 2024-09-12T01:44:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.215+0000 7f93ba447640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f93a006e4a0 0x7f93a0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.215+0000 7f93ba447640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f93a006e4a0 0x7f93a0070950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93b000b020 tx=0x7f93b0035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:13.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.220+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f93a4050670 con 0x7f93b40fc700 2024-09-12T01:44:13.488 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.487+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93b4115550 con 0x7f93a006e4a0 2024-09-12T01:44:13.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.488+0000 7f93aaffd640 1 -- 172.21.15.66:0/2103832739 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f93b4115550 con 0x7f93a006e4a0 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f93a006e4a0 msgr2=0x7f93a0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f93a006e4a0 0x7f93a0070950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f93b000b020 tx=0x7f93b0035040 comp rx=0 tx=0).stop 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 msgr2=0x7f93b4113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 0x7f93b4113b90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f93a400e910 tx=0x7f93a400b040 comp rx=0 tx=0).stop 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 shutdown_connections 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f93a006e4a0 0x7f93a0070950 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93b40fc700 0x7f93b4113b90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 --2- 172.21.15.66:0/2103832739 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93b40fb430 0x7f93b4113650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 >> 172.21.15.66:0/2103832739 conn(0x7f93b40f6c10 msgr2=0x7f93b40f8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 shutdown_connections 2024-09-12T01:44:13.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.491+0000 7f93bc6ab640 1 -- 172.21.15.66:0/2103832739 wait complete. 2024-09-12T01:44:13.504 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.603+0000 7fbddc3dd640 1 -- 172.21.15.66:0/1946732414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd4066730 msgr2=0x7fbdd40ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.603+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/1946732414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd4066730 0x7fbdd40ff160 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00048d0 tx=0x7fbdd0009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 -- 172.21.15.66:0/1946732414 shutdown_connections 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/1946732414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd4101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/1946732414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd4066730 0x7fbdd40ff160 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 -- 172.21.15.66:0/1946732414 >> 172.21.15.66:0/1946732414 conn(0x7fbdd40f6c10 msgr2=0x7fbdd40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 -- 172.21.15.66:0/1946732414 shutdown_connections 2024-09-12T01:44:13.605 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 -- 172.21.15.66:0/1946732414 wait complete. 2024-09-12T01:44:13.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 Processor -- start 2024-09-12T01:44:13.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.604+0000 7fbddc3dd640 1 -- start start 2024-09-12T01:44:13.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbddc3dd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd4066730 0x7fbdd410d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbddc3dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd410d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbddc3dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd410dcd0 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbddc3dd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd410e4f0 con 0x7fbdd4066730 2024-09-12T01:44:13.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdd9978640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd410d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdda179640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd4066730 0x7fbdd410d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdd9978640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd410d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42040/0 (socket says 172.21.15.66:42040) 2024-09-12T01:44:13.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdd9978640 1 -- 172.21.15.66:0/852066049 learned_addr learned my addr 172.21.15.66:0/852066049 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdd9978640 1 -- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd4066730 msgr2=0x7fbdd410d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdd9978640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd4066730 0x7fbdd410d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.605+0000 7fbdd9978640 1 -- 172.21.15.66:0/852066049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0005040 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.606+0000 7fbdd9978640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd410d680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400eb70 tx=0x7fbdc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:13.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.606+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc4007c30 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.606+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd410e770 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.606+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd410ec90 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.606+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbdc400f040 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.607+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdc40092b0 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.608+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb8005240 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.609+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fbdc40094d0 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.609+0000 7fbdcaffd640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fbdc006e4a0 0x7fbdc0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.609+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbdc408d7d0 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.609+0000 7fbdda179640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fbdc006e4a0 0x7fbdc0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.610+0000 7fbdda179640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fbdc006e4a0 0x7fbdc0070950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000c00 tx=0x7fbdd0035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:13.615 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.614+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbdc4050670 con 0x7fbdd40ff6a0 2024-09-12T01:44:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.850+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdb8000bf0 con 0x7fbdc006e4a0 2024-09-12T01:44:13.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.851+0000 7fbdcaffd640 1 -- 172.21.15.66:0/852066049 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7fbdb8000bf0 con 0x7fbdc006e4a0 2024-09-12T01:44:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fbdc006e4a0 msgr2=0x7fbdc0070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fbdc006e4a0 0x7fbdc0070950 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0000c00 tx=0x7fbdd0035040 comp rx=0 tx=0).stop 2024-09-12T01:44:13.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 msgr2=0x7fbdd410d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd410d680 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400eb70 tx=0x7fbdc400b040 comp rx=0 tx=0).stop 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 shutdown_connections 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fbdc006e4a0 0x7fbdc0070950 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdd40ff6a0 0x7fbdd410d680 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 --2- 172.21.15.66:0/852066049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdd4066730 0x7fbdd410d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 >> 172.21.15.66:0/852066049 conn(0x7fbdd40f6c10 msgr2=0x7fbdd40f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.854+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 shutdown_connections 2024-09-12T01:44:13.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.855+0000 7fbddc3dd640 1 -- 172.21.15.66:0/852066049 wait complete. 2024-09-12T01:44:13.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 -- 172.21.15.66:0/319342062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 msgr2=0x7fb3c80ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 --2- 172.21.15.66:0/319342062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c80ff1b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80048d0 tx=0x7fb3b8009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 -- 172.21.15.66:0/319342062 shutdown_connections 2024-09-12T01:44:13.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 --2- 172.21.15.66:0/319342062 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c8101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 --2- 172.21.15.66:0/319342062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c80ff1b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 -- 172.21.15.66:0/319342062 >> 172.21.15.66:0/319342062 conn(0x7fb3c80f6c00 msgr2=0x7fb3c80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:13.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 -- 172.21.15.66:0/319342062 shutdown_connections 2024-09-12T01:44:13.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 -- 172.21.15.66:0/319342062 wait complete. 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.974+0000 7fb3ce543640 1 Processor -- start 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3ce543640 1 -- start start 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3ce543640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3ce543640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3ce543640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c810dc30 con 0x7fb3c8066450 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3ce543640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c810e450 con 0x7fb3c80ff6f0 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3c77fe640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c810d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:34528/0 (socket says 172.21.15.66:34528) 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.975+0000 7fb3c77fe640 1 -- 172.21.15.66:0/1868116796 learned_addr learned my addr 172.21.15.66:0/1868116796 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c7fff640 1 -- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 msgr2=0x7fb3c810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c7fff640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:13.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c7fff640 1 -- 172.21.15.66:0/1868116796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b8005040 con 0x7fb3c8066450 2024-09-12T01:44:13.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c77fe640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:13.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c7fff640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c810d0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80048a0 tx=0x7fb3b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:13.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b8038070 con 0x7fb3c8066450 2024-09-12T01:44:13.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c810e680 con 0x7fb3c8066450 2024-09-12T01:44:13.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c810ebf0 con 0x7fb3c8066450 2024-09-12T01:44:13.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb3b802ae90 con 0x7fb3c8066450 2024-09-12T01:44:13.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.976+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3b8038070 con 0x7fb3c8066450 2024-09-12T01:44:13.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.978+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c80fa880 con 0x7fb3c8066450 2024-09-12T01:44:13.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.978+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fb3b8030020 con 0x7fb3c8066450 2024-09-12T01:44:13.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.979+0000 7fb3c4ff9640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fb3b006e560 0x7fb3b0070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:13.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.979+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb3b80ad8e0 con 0x7fb3c8066450 2024-09-12T01:44:13.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.979+0000 7fb3c77fe640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fb3b006e560 0x7fb3b0070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:13.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.980+0000 7fb3c77fe640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fb3b006e560 0x7fb3b0070a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb3c810ce50 tx=0x7fb3bc00b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:13.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:13.985+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb3b8077560 con 0x7fb3c8066450 2024-09-12T01:44:14.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.290+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3c810f060 con 0x7fb3b006e560 2024-09-12T01:44:14.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.298+0000 7fb3c4ff9640 1 -- 172.21.15.66:0/1868116796 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb3c810f060 con 0x7fb3b006e560 2024-09-12T01:44:14.299 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:44:14.299 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 starting - - - - 2024-09-12T01:44:14.299 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (8m) 45s ago 8m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (8m) 0s ago 8m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 starting - - - - 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (3m) 45s ago 3m 11.8M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (3m) 45s ago 3m 209M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (3m) 0s ago 3m 15.4M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (3m) 0s ago 3m 14.9M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 starting - - - - 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (83s) 0s ago 7m 500M - 19.1.1-298-gb53b6d3e 54467abc55f8 514739a269bf 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (10m) 45s ago 10m 53.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (7m) 0s ago 7m 42.5M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 starting - - - - 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (14s) 0s ago 7m 7994k - 1.5.0 0da6a335fe13 0e1969830d8f 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (7m) 45s ago 7m 233M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (6m) 45s ago 6m 240M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:44:14.300 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (6m) 45s ago 6m 208M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:44:14.301 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (5m) 0s ago 5m 244M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:44:14.301 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (5m) 0s ago 5m 219M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:44:14.301 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (4m) 0s ago 4m 201M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:44:14.301 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 starting - - - - 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fb3b006e560 msgr2=0x7fb3b0070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fb3b006e560 0x7fb3b0070a10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb3c810ce50 tx=0x7fb3bc00b040 comp rx=0 tx=0).stop 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 msgr2=0x7fb3c810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c810d0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3b80048a0 tx=0x7fb3b8009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 shutdown_connections 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fb3b006e560 0x7fb3b0070a10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c80ff6f0 0x7fb3c810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.302 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 --2- 172.21.15.66:0/1868116796 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3c8066450 0x7fb3c810d0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.301+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 >> 172.21.15.66:0/1868116796 conn(0x7fb3c80f6c00 msgr2=0x7fb3c80f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:14.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.302+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 shutdown_connections 2024-09-12T01:44:14.303 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.302+0000 7fb3ce543640 1 -- 172.21.15.66:0/1868116796 wait complete. 2024-09-12T01:44:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:14 smithi066 ceph-mon[27875]: pgmap v36: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 2.7 MiB/s wr, 553 op/s 2024-09-12T01:44:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:14 smithi066 ceph-mon[27875]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:14 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:14 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.412+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2192792407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 msgr2=0x7fdbf40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.412+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2192792407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf40fdc60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00048d0 tx=0x7fdbe0009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2192792407 shutdown_connections 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2192792407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf40fdc60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2192792407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf40fc520 0x7fdbf40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2192792407 >> 172.21.15.66:0/2192792407 conn(0x7fdbf40f7ce0 msgr2=0x7fdbf40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:14.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2192792407 shutdown_connections 2024-09-12T01:44:14.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2192792407 wait complete. 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.413+0000 7fdbfaad8640 1 Processor -- start 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbfaad8640 1 -- start start 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbfaad8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf40fc520 0x7fdbf410f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbfaad8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf410f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbfaad8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf410fe40 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbfaad8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4110660 con 0x7fdbf40fc520 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbf3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf410f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbf3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf410f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42068/0 (socket says 172.21.15.66:42068) 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.414+0000 7fdbf3fff640 1 -- 172.21.15.66:0/2429373159 learned_addr learned my addr 172.21.15.66:0/2429373159 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf3fff640 1 -- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf40fc520 msgr2=0x7fdbf410f2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf3fff640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf40fc520 0x7fdbf410f2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf3fff640 1 -- 172.21.15.66:0/2429373159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe0005040 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf3fff640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf410f7f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00048a0 tx=0x7fdbe0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe0038070 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf4110890 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf4110e30 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.421 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdbe0004290 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.415+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe0033420 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.417+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd8005210 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.417+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7fdbe0030020 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.418+0000 7fdbf17fa640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fdbe406e4a0 0x7fdbe4070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.418+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fdbe00adb10 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.419+0000 7fdbf8874640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fdbe406e4a0 0x7fdbe4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:14.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.419+0000 7fdbf8874640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fdbe406e4a0 0x7fdbe4070950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8004d40 tx=0x7fdbe800b040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:14.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.423+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdbe0077760 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:14 smithi153 ceph-mon[34713]: pgmap v36: 65 pgs: 65 active+clean; 319 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 22 KiB/s rd, 2.7 MiB/s wr, 553 op/s 2024-09-12T01:44:14.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:14 smithi153 ceph-mon[34713]: from='client.24419 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:14.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:14 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:14.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:14 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.737+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdbd8005790 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.738 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.737+0000 7fdbf17fa640 1 -- 172.21.15.66:0/2429373159 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fdbe007ae20 con 0x7fdbf40fd7f0 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 1, 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:14.739 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 13, 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:44:14.740 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:44:14.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fdbe406e4a0 msgr2=0x7fdbe4070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fdbe406e4a0 0x7fdbe4070950 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8004d40 tx=0x7fdbe800b040 comp rx=0 tx=0).stop 2024-09-12T01:44:14.741 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 msgr2=0x7fdbf410f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf410f7f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00048a0 tx=0x7fdbe0009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 shutdown_connections 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7fdbe406e4a0 0x7fdbe4070950 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbf40fd7f0 0x7fdbf410f7f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 --2- 172.21.15.66:0/2429373159 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdbf40fc520 0x7fdbf410f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 >> 172.21.15.66:0/2429373159 conn(0x7fdbf40f7ce0 msgr2=0x7fdbf40f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 shutdown_connections 2024-09-12T01:44:14.742 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.740+0000 7fdbfaad8640 1 -- 172.21.15.66:0/2429373159 wait complete. 2024-09-12T01:44:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 -- 172.21.15.66:0/441476891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fc520 msgr2=0x7f8b180fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/441476891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fc520 0x7f8b180fc930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8b140048d0 tx=0x7f8b14009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 -- 172.21.15.66:0/441476891 shutdown_connections 2024-09-12T01:44:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/441476891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180fd7f0 0x7f8b180fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/441476891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fc520 0x7f8b180fc930 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 -- 172.21.15.66:0/441476891 >> 172.21.15.66:0/441476891 conn(0x7f8b180f7ce0 msgr2=0x7f8b180fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 -- 172.21.15.66:0/441476891 shutdown_connections 2024-09-12T01:44:14.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.851+0000 7f8b1f62b640 1 -- 172.21.15.66:0/441476891 wait complete. 2024-09-12T01:44:14.854 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1f62b640 1 Processor -- start 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1f62b640 1 -- start start 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1f62b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180fc520 0x7f8b1810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1f62b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 0x7f8b1810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1f62b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1810dc10 con 0x7f8b180fd7f0 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1f62b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1810e430 con 0x7f8b180fc520 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1cbc6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 0x7f8b1810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1cbc6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 0x7f8b1810d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42082/0 (socket says 172.21.15.66:42082) 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.852+0000 7f8b1cbc6640 1 -- 172.21.15.66:0/4100970816 learned_addr learned my addr 172.21.15.66:0/4100970816 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b1d3c7640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180fc520 0x7f8b1810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b1cbc6640 1 -- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180fc520 msgr2=0x7f8b1810d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b1cbc6640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180fc520 0x7f8b1810d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:14.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b1cbc6640 1 -- 172.21.15.66:0/4100970816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14005040 con 0x7f8b180fd7f0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b1cbc6640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 0x7f8b1810d5c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8b08011f10 tx=0x7f8b08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b08002df0 con 0x7f8b180fd7f0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b080090d0 con 0x7f8b180fd7f0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1810e660 con 0x7f8b180fd7f0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.853+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b08019620 con 0x7f8b180fd7f0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.854+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1810eac0 con 0x7f8b180fd7f0 2024-09-12T01:44:14.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.855+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b180fb980 con 0x7f8b180fd7f0 2024-09-12T01:44:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.856+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 25) v1 ==== 91488+0+0 (secure 0 0 0) 0x7f8b08009240 con 0x7f8b180fd7f0 2024-09-12T01:44:14.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.856+0000 7f8b0dffb640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8b0406e4a0 0x7f8b04070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.857+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8b080921a0 con 0x7f8b180fd7f0 2024-09-12T01:44:14.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.857+0000 7f8b1d3c7640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8b0406e4a0 0x7f8b04070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:14.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.858+0000 7f8b1d3c7640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8b0406e4a0 0x7f8b04070950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007ac0 tx=0x7f8b14035040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:14.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:14.862+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8b0805bce0 con 0x7f8b180fd7f0 2024-09-12T01:44:15.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.116+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 --> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b1810ee80 con 0x7f8b0406e4a0 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.118+0000 7f8b0dffb640 1 -- 172.21.15.66:0/4100970816 <== mgr.24357 v2:172.21.15.153:6828/1307305426 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+321 (secure 0 0 0) 0x7f8b1810ee80 con 0x7f8b0406e4a0 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [], 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "", 2024-09-12T01:44:15.119 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading mgr daemons", 2024-09-12T01:44:15.120 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:44:15.120 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.121+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8b0406e4a0 msgr2=0x7f8b04070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8b0406e4a0 0x7f8b04070950 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007ac0 tx=0x7f8b14035040 comp rx=0 tx=0).stop 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 msgr2=0x7f8b1810d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 0x7f8b1810d5c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8b08011f10 tx=0x7f8b08004600 comp rx=0 tx=0).stop 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 shutdown_connections 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:6828/1307305426,v1:172.21.15.153:6829/1307305426] conn(0x7f8b0406e4a0 0x7f8b04070950 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b180fd7f0 0x7f8b1810d5c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:15.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 --2- 172.21.15.66:0/4100970816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180fc520 0x7f8b1810d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:15.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 >> 172.21.15.66:0/4100970816 conn(0x7f8b180f7ce0 msgr2=0x7f8b180f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:15.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 shutdown_connections 2024-09-12T01:44:15.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:15.122+0000 7f8b1f62b640 1 -- 172.21.15.66:0/4100970816 wait complete. 2024-09-12T01:44:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:15 smithi066 ceph-mon[27875]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:15 smithi066 ceph-mon[27875]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:15 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2429373159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:44:15.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:15 smithi153 ceph-mon[34713]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:15.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:15 smithi153 ceph-mon[34713]: from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:15.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:15 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2429373159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:44:16.637 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:16 smithi066 ceph-mon[27875]: pgmap v37: 65 pgs: 65 active+clean; 321 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 3.0 MiB/s wr, 615 op/s 2024-09-12T01:44:16.637 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:16 smithi066 ceph-mon[27875]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:16 smithi153 ceph-mon[34713]: pgmap v37: 65 pgs: 65 active+clean; 321 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 3.0 MiB/s wr, 615 op/s 2024-09-12T01:44:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:16 smithi153 ceph-mon[34713]: from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: pgmap v38: 65 pgs: 65 active+clean; 321 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 2.1 MiB/s wr, 517 op/s 2024-09-12T01:44:18.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: pgmap v38: 65 pgs: 65 active+clean; 321 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 2.1 MiB/s wr, 517 op/s 2024-09-12T01:44:18.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: Standby manager daemon smithi066.qdwcrh restarted 2024-09-12T01:44:18.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: Standby manager daemon smithi066.qdwcrh started 2024-09-12T01:44:18.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/crt"}]: dispatch 2024-09-12T01:44:18.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:18.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/key"}]: dispatch 2024-09-12T01:44:18.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:18 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:18.659 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: Standby manager daemon smithi066.qdwcrh restarted 2024-09-12T01:44:18.659 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: Standby manager daemon smithi066.qdwcrh started 2024-09-12T01:44:18.659 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/crt"}]: dispatch 2024-09-12T01:44:18.659 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:18.659 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi066.qdwcrh/key"}]: dispatch 2024-09-12T01:44:18.659 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:18 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:19 smithi066 ceph-mon[27875]: mgrmap e26: smithi153.jpnqza(active, since 71s), standbys: smithi066.qdwcrh 2024-09-12T01:44:19.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:19 smithi153 ceph-mon[34713]: mgrmap e26: smithi153.jpnqza(active, since 71s), standbys: smithi066.qdwcrh 2024-09-12T01:44:20.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:20 smithi066 ceph-mon[27875]: pgmap v39: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.8 MiB/s wr, 895 op/s 2024-09-12T01:44:20.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:20 smithi153 ceph-mon[34713]: pgmap v39: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 2.8 MiB/s wr, 895 op/s 2024-09-12T01:44:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:22 smithi066 ceph-mon[27875]: pgmap v40: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 796 op/s 2024-09-12T01:44:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:22 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:22.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:22 smithi153 ceph-mon[34713]: pgmap v40: 65 pgs: 65 active+clean; 299 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.6 MiB/s wr, 796 op/s 2024-09-12T01:44:22.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:22 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:24.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:24 smithi066 ceph-mon[27875]: pgmap v41: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 959 op/s 2024-09-12T01:44:24.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:24 smithi153 ceph-mon[34713]: pgmap v41: 65 pgs: 65 active+clean; 287 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 2.2 MiB/s wr, 959 op/s 2024-09-12T01:44:26.027 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:25 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.027 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:25 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.027 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:25 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.027 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:25 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:25 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:25 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:25 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:26.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:25 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:27.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:26 smithi066 ceph-mon[27875]: pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.9 MiB/s wr, 706 op/s 2024-09-12T01:44:27.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:26 smithi153 ceph-mon[34713]: pgmap v42: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 1.9 MiB/s wr, 706 op/s 2024-09-12T01:44:29.134 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:28 smithi066 ceph-mon[27875]: pgmap v43: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 578 op/s 2024-09-12T01:44:29.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:28 smithi153 ceph-mon[34713]: pgmap v43: 65 pgs: 65 active+clean; 288 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 578 op/s 2024-09-12T01:44:31.028 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:30 smithi066 ceph-mon[27875]: pgmap v44: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 899 op/s 2024-09-12T01:44:31.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:30 smithi153 ceph-mon[34713]: pgmap v44: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 899 op/s 2024-09-12T01:44:33.005 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:32 smithi153 ceph-mon[34713]: pgmap v45: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 521 op/s 2024-09-12T01:44:33.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:32 smithi066 ceph-mon[27875]: pgmap v45: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 1.7 MiB/s wr, 521 op/s 2024-09-12T01:44:33.827 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:33.827 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:33.827 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:33.827 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr fail", "who": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr fail", "who": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: osdmap e46: 6 total, 6 up, 6 in 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd='[{"prefix": "mgr fail", "who": "smithi153.jpnqza"}]': finished 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: mgrmap e27: smithi066.qdwcrh(active, starting, since 0.0091504s) 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:44:33.828 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:44:33.829 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.830 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:33.830 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:44:33.830 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:44:33.830 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:44:33.830 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:33 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 172.21.15.153:0/1265922151' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr fail", "who": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:44:33.950 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "mgr fail", "who": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: osdmap e46: 6 total, 6 up, 6 in 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.24357 ' entity='mgr.smithi153.jpnqza' cmd='[{"prefix": "mgr fail", "who": "smithi153.jpnqza"}]': finished 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: mgrmap e27: smithi066.qdwcrh(active, starting, since 0.0091504s) 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:44:33.951 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:44:33.952 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:33 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:44:35.024 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:34 smithi153 ceph-mon[34713]: mgrmap e28: smithi066.qdwcrh(active, since 1.00932s) 2024-09-12T01:44:35.024 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:34 smithi153 ceph-mon[34713]: pgmap v3: 65 pgs: 65 active+clean; 261 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:44:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:34 smithi066 ceph-mon[27875]: mgrmap e28: smithi066.qdwcrh(active, since 1.00932s) 2024-09-12T01:44:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:34 smithi066 ceph-mon[27875]: pgmap v3: 65 pgs: 65 active+clean; 261 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:44:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:35 smithi066 ceph-mon[27875]: pgmap v4: 65 pgs: 65 active+clean; 261 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:44:36.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:35 smithi066 ceph-mon[27875]: mgrmap e29: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:44:36.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:35 smithi153 ceph-mon[34713]: pgmap v4: 65 pgs: 65 active+clean; 261 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:44:36.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:35 smithi153 ceph-mon[34713]: mgrmap e29: smithi066.qdwcrh(active, since 2s) 2024-09-12T01:44:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:36 smithi066 ceph-mon[27875]: [12/Sep/2024:01:44:36] ENGINE Bus STARTING 2024-09-12T01:44:37.147 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:36 smithi153 ceph-mon[34713]: [12/Sep/2024:01:44:36] ENGINE Bus STARTING 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:37 smithi066 ceph-mon[27875]: [12/Sep/2024:01:44:36] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:37 smithi066 ceph-mon[27875]: [12/Sep/2024:01:44:36] ENGINE Error in HTTPServer.serve 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Traceback (most recent call last): 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:44:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._run(expiration_interval) 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s = self.context.wrap_socket( 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: return self.sslsocket_class._create( 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self.do_handshake() 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._sslobj.do_handshake() 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:44:38.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:37 smithi066 ceph-mon[27875]: [12/Sep/2024:01:44:36] ENGINE Serving on http://172.21.15.66:8765 2024-09-12T01:44:38.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:37 smithi066 ceph-mon[27875]: [12/Sep/2024:01:44:36] ENGINE Bus STARTED 2024-09-12T01:44:38.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:37 smithi066 ceph-mon[27875]: pgmap v5: 65 pgs: 65 active+clean; 261 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:44:38.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:37 smithi066 ceph-mon[27875]: mgrmap e30: smithi066.qdwcrh(active, since 4s) 2024-09-12T01:44:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:37 smithi153 ceph-mon[34713]: [12/Sep/2024:01:44:36] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:44:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:37 smithi153 ceph-mon[34713]: [12/Sep/2024:01:44:36] ENGINE Error in HTTPServer.serve 2024-09-12T01:44:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Traceback (most recent call last): 2024-09-12T01:44:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._run(expiration_interval) 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s = self.context.wrap_socket( 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: return self.sslsocket_class._create( 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self.do_handshake() 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._sslobj.do_handshake() 2024-09-12T01:44:38.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:44:38.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:37 smithi153 ceph-mon[34713]: [12/Sep/2024:01:44:36] ENGINE Serving on http://172.21.15.66:8765 2024-09-12T01:44:38.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:37 smithi153 ceph-mon[34713]: [12/Sep/2024:01:44:36] ENGINE Bus STARTED 2024-09-12T01:44:38.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:37 smithi153 ceph-mon[34713]: pgmap v5: 65 pgs: 65 active+clean; 261 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:44:38.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:37 smithi153 ceph-mon[34713]: mgrmap e30: smithi066.qdwcrh(active, since 4s) 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:38 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:44:39.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:44:39.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:44:39.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:44:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/1138059212' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:44:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:38 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:40.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:39 smithi066 ceph-mon[27875]: pgmap v6: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 886 KiB/s wr, 107 op/s 2024-09-12T01:44:40.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:39 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:44:40.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:39 smithi066 ceph-mon[27875]: mgrmap e31: smithi066.qdwcrh(active, since 6s), standbys: smithi153.jpnqza 2024-09-12T01:44:40.314 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:39 smithi153 ceph-mon[34713]: pgmap v6: 65 pgs: 65 active+clean; 265 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 886 KiB/s wr, 107 op/s 2024-09-12T01:44:40.315 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:39 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:44:40.315 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:39 smithi153 ceph-mon[34713]: mgrmap e31: smithi066.qdwcrh(active, since 6s), standbys: smithi153.jpnqza 2024-09-12T01:44:42.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:41 smithi066 ceph-mon[27875]: pgmap v7: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.2 MiB/s wr, 390 op/s 2024-09-12T01:44:42.183 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:41 smithi153 ceph-mon[34713]: pgmap v7: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 54 KiB/s rd, 1.2 MiB/s wr, 390 op/s 2024-09-12T01:44:43.895 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-12T01:44:43.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-12T01:44:44.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:43 smithi153 ceph-mon[34713]: pgmap v8: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 931 KiB/s wr, 303 op/s 2024-09-12T01:44:44.183 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:44.232 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:43 smithi066 ceph-mon[27875]: pgmap v8: 65 pgs: 65 active+clean; 251 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 931 KiB/s wr, 303 op/s 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.247+0000 7faf64bf2640 1 -- 172.21.15.66:0/2250809779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 msgr2=0x7faf600fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.247+0000 7faf64bf2640 1 --2- 172.21.15.66:0/2250809779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 0x7faf600fdc60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faf54004810 tx=0x7faf54009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 -- 172.21.15.66:0/2250809779 shutdown_connections 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 --2- 172.21.15.66:0/2250809779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 0x7faf600fdc60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 --2- 172.21.15.66:0/2250809779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf600fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 -- 172.21.15.66:0/2250809779 >> 172.21.15.66:0/2250809779 conn(0x7faf600f7ce0 msgr2=0x7faf600fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:45.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 -- 172.21.15.66:0/2250809779 shutdown_connections 2024-09-12T01:44:45.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 -- 172.21.15.66:0/2250809779 wait complete. 2024-09-12T01:44:45.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 Processor -- start 2024-09-12T01:44:45.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.248+0000 7faf64bf2640 1 -- start start 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf64bf2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf6010cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf64bf2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 0x7faf6010d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf64bf2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6010e160 con 0x7faf600fc520 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf64bf2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6010e2d0 con 0x7faf600fd7f0 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf6010cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf6010cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33726/0 (socket says 172.21.15.66:33726) 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5e59c640 1 -- 172.21.15.66:0/4094427917 learned_addr learned my addr 172.21.15.66:0/4094427917 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5dd9b640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 0x7faf6010d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5e59c640 1 -- 172.21.15.66:0/4094427917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 msgr2=0x7faf6010d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5e59c640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 0x7faf6010d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.249+0000 7faf5e59c640 1 -- 172.21.15.66:0/4094427917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54005040 con 0x7faf600fc520 2024-09-12T01:44:45.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.250+0000 7faf5e59c640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf6010cef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf5000eb40 tx=0x7faf5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:45.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.250+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf50007c30 con 0x7faf600fc520 2024-09-12T01:44:45.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.250+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6010e550 con 0x7faf600fc520 2024-09-12T01:44:45.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.250+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6010ea70 con 0x7faf600fc520 2024-09-12T01:44:45.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.250+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faf5000f040 con 0x7faf600fc520 2024-09-12T01:44:45.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.250+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf5000ca00 con 0x7faf600fc520 2024-09-12T01:44:45.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.251+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60105740 con 0x7faf600fc520 2024-09-12T01:44:45.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.252+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7faf5000cc70 con 0x7faf600fc520 2024-09-12T01:44:45.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.252+0000 7faf4effd640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7faf4806dae0 0x7faf4806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:45.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.252+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7faf5005eb70 con 0x7faf600fc520 2024-09-12T01:44:45.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.252+0000 7faf5dd9b640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7faf4806dae0 0x7faf4806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:45.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.253+0000 7faf5dd9b640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7faf4806dae0 0x7faf4806ff90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf6010cca0 tx=0x7faf54035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.261+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7faf500572a0 con 0x7faf600fc520 2024-09-12T01:44:45.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.591+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faf6010ed50 con 0x7faf4806dae0 2024-09-12T01:44:45.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.595+0000 7faf4effd640 1 -- 172.21.15.66:0/4094427917 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7faf6010ed50 con 0x7faf4806dae0 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7faf4806dae0 msgr2=0x7faf4806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7faf4806dae0 0x7faf4806ff90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf6010cca0 tx=0x7faf54035040 comp rx=0 tx=0).stop 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 msgr2=0x7faf6010cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf6010cef0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf5000eb40 tx=0x7faf5000b040 comp rx=0 tx=0).stop 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 shutdown_connections 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7faf4806dae0 0x7faf4806ff90 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf6010cca0 tx=0x7faf54035040 comp rx=0 tx=0).stop 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf600fd7f0 0x7faf6010d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 --2- 172.21.15.66:0/4094427917 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600fc520 0x7faf6010cef0 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf5000eb40 tx=0x7faf5000b040 comp rx=0 tx=0).stop 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.601+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 >> 172.21.15.66:0/4094427917 conn(0x7faf600f7ce0 msgr2=0x7faf600f92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:45.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.603+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 shutdown_connections 2024-09-12T01:44:45.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.603+0000 7faf64bf2640 1 -- 172.21.15.66:0/4094427917 wait complete. 2024-09-12T01:44:45.614 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.696+0000 7f5dbcea6640 1 -- 172.21.15.66:0/697670326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 msgr2=0x7f5db80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.696+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/697670326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db80fc930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5da80048d0 tx=0x7f5da8009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 -- 172.21.15.66:0/697670326 shutdown_connections 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/697670326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 0x7f5db80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/697670326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db80fc930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 -- 172.21.15.66:0/697670326 >> 172.21.15.66:0/697670326 conn(0x7f5db80f7ce0 msgr2=0x7f5db80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 -- 172.21.15.66:0/697670326 shutdown_connections 2024-09-12T01:44:45.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 -- 172.21.15.66:0/697670326 wait complete. 2024-09-12T01:44:45.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 Processor -- start 2024-09-12T01:44:45.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.697+0000 7f5dbcea6640 1 -- start start 2024-09-12T01:44:45.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5dbcea6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:45.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5dbcea6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 0x7f5db806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:45.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5dbcea6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8110d40 con 0x7f5db80fc520 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5dbcea6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8110e80 con 0x7f5db80fd7f0 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db5d9b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 0x7f5db806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db8071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33750/0 (socket says 172.21.15.66:33750) 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db659c640 1 -- 172.21.15.66:0/4143595329 learned_addr learned my addr 172.21.15.66:0/4143595329 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db5d9b640 1 -- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 msgr2=0x7f5db8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db5d9b640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db8071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db5d9b640 1 -- 172.21.15.66:0/4143595329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da8005040 con 0x7f5db80fd7f0 2024-09-12T01:44:45.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.698+0000 7f5db5d9b640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 0x7f5db806fa60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00eb40 tx=0x7f5dac00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:45.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.699+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dac007c30 con 0x7f5db80fd7f0 2024-09-12T01:44:45.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.699+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db8070000 con 0x7f5db80fd7f0 2024-09-12T01:44:45.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.699+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5dac00f040 con 0x7f5db80fd7f0 2024-09-12T01:44:45.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.699+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dac00cac0 con 0x7f5db80fd7f0 2024-09-12T01:44:45.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.699+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db80705a0 con 0x7f5db80fd7f0 2024-09-12T01:44:45.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.700+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db80fb980 con 0x7f5db80fd7f0 2024-09-12T01:44:45.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.701+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f5dac009700 con 0x7f5db80fd7f0 2024-09-12T01:44:45.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.702+0000 7f5da6ffd640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f5da006dae0 0x7f5da006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:45.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.702+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f5dac08d5e0 con 0x7f5db80fd7f0 2024-09-12T01:44:45.702 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.702+0000 7f5db659c640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f5da006dae0 0x7f5da006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:45.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.703+0000 7f5db659c640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f5da006dae0 0x7f5da006ff90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5da8000c00 tx=0x7f5da8035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:45.705 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.705+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5dac056fd0 con 0x7f5db80fd7f0 2024-09-12T01:44:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:45 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:45 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:45 smithi066 ceph-mon[27875]: pgmap v9: 65 pgs: 65 active+clean; 234 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.6 MiB/s wr, 587 op/s 2024-09-12T01:44:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:45 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:45 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:45.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.987+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5db8101c50 con 0x7f5da006dae0 2024-09-12T01:44:45.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.988+0000 7f5da6ffd640 1 -- 172.21.15.66:0/4143595329 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f5db8101c50 con 0x7f5da006dae0 2024-09-12T01:44:45.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f5da006dae0 msgr2=0x7f5da006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f5da006dae0 0x7f5da006ff90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5da8000c00 tx=0x7f5da8035040 comp rx=0 tx=0).stop 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 msgr2=0x7f5db806fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 0x7f5db806fa60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00eb40 tx=0x7f5dac00b040 comp rx=0 tx=0).stop 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 shutdown_connections 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f5da006dae0 0x7f5da006ff90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5db80fd7f0 0x7f5db806fa60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 --2- 172.21.15.66:0/4143595329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db80fc520 0x7f5db8071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.990+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 >> 172.21.15.66:0/4143595329 conn(0x7f5db80f7ce0 msgr2=0x7f5db80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.991+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 shutdown_connections 2024-09-12T01:44:45.991 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:45.991+0000 7f5dbcea6640 1 -- 172.21.15.66:0/4143595329 wait complete. 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 -- 172.21.15.66:0/1146889713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fc520 msgr2=0x7f91ec0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 --2- 172.21.15.66:0/1146889713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fc520 0x7f91ec0fc930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f91e80048d0 tx=0x7f91e8009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 -- 172.21.15.66:0/1146889713 shutdown_connections 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 --2- 172.21.15.66:0/1146889713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 --2- 172.21.15.66:0/1146889713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fc520 0x7f91ec0fc930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 -- 172.21.15.66:0/1146889713 >> 172.21.15.66:0/1146889713 conn(0x7f91ec0f7ce0 msgr2=0x7f91ec0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 -- 172.21.15.66:0/1146889713 shutdown_connections 2024-09-12T01:44:46.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.092+0000 7f91f444e640 1 -- 172.21.15.66:0/1146889713 wait complete. 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.093+0000 7f91f444e640 1 Processor -- start 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.093+0000 7f91f444e640 1 -- start start 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.093+0000 7f91f444e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fc520 0x7f91ec10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.093+0000 7f91f444e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.093+0000 7f91f444e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec10dc40 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.093+0000 7f91f444e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec10e460 con 0x7f91ec0fc520 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33766/0 (socket says 172.21.15.66:33766) 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f21ea640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fc520 0x7f91ec10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 -- 172.21.15.66:0/4178812366 learned_addr learned my addr 172.21.15.66:0/4178812366 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:46.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 -- 172.21.15.66:0/4178812366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fc520 msgr2=0x7f91ec10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fc520 0x7f91ec10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 -- 172.21.15.66:0/4178812366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8005040 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f21ea640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fc520 0x7f91ec10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.094+0000 7f91f19e9640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec10d5f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00eb70 tx=0x7f91dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.095+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91dc007c30 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.095+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec10e690 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.095+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f91dc00f040 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.095+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91dc009420 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.095+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec10ec30 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.096+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec0fb980 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.097+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f91dc009690 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.098+0000 7f91e2ffd640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f91d806dae0 0x7f91d806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.098+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f91dc08d160 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.098+0000 7f91f21ea640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f91d806dae0 0x7f91d806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.099+0000 7f91f21ea640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f91d806dae0 0x7f91d806ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91e8000c00 tx=0x7f91e8039040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.105 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.105+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f91dc056b70 con 0x7f91ec0fd7f0 2024-09-12T01:44:46.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:45 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:46.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:45 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:46.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:45 smithi153 ceph-mon[34713]: pgmap v9: 65 pgs: 65 active+clean; 234 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 51 KiB/s rd, 1.6 MiB/s wr, 587 op/s 2024-09-12T01:44:46.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:45 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:46.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:45 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:46.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.296+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f91ec10ef90 con 0x7f91d806dae0 2024-09-12T01:44:46.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.312+0000 7f91e2ffd640 1 -- 172.21.15.66:0/4178812366 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f91ec10ef90 con 0x7f91d806dae0 2024-09-12T01:44:46.312 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:44:46.312 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (68s) 1s ago 9m 25.7M - 0.25.0 c8568f914cd2 853e1519bd6e 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (9m) 1s ago 9m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (8m) 8s ago 8m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (63s) 1s ago 9m 77.1M - 9.4.7 954c08fa6188 ae3a15d0872d 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (4m) 1s ago 4m 12.4M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (3m) 1s ago 3m 192M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (3m) 8s ago 3m 15.5M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (3m) 8s ago 3m 15.0M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (35s) 1s ago 10m 473M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283 running (115s) 8s ago 8m 130M - 19.1.1-298-gb53b6d3e 54467abc55f8 514739a269bf 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (10m) 1s ago 10m 57.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (8m) 8s ago 8m 44.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:44:46.313 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (73s) 1s ago 9m 15.8M - 1.5.0 0da6a335fe13 2c6e0d9e4637 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (46s) 8s ago 8m 8136k - 1.5.0 0da6a335fe13 0e1969830d8f 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (7m) 1s ago 7m 234M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (7m) 1s ago 7m 248M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (6m) 1s ago 6m 203M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (6m) 8s ago 6m 266M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (5m) 8s ago 5m 244M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (5m) 8s ago 5m 221M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:44:46.314 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (52s) 1s ago 8m 46.7M - 2.43.0 a07b618ecd1d adc1125c530b 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f91d806dae0 msgr2=0x7f91d806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f91d806dae0 0x7f91d806ff90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f91e8000c00 tx=0x7f91e8039040 comp rx=0 tx=0).stop 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 msgr2=0x7f91ec10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec10d5f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f91dc00eb70 tx=0x7f91dc00b040 comp rx=0 tx=0).stop 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 shutdown_connections 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f91d806dae0 0x7f91d806ff90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91ec0fd7f0 0x7f91ec10d5f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 --2- 172.21.15.66:0/4178812366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91ec0fc520 0x7f91ec10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 >> 172.21.15.66:0/4178812366 conn(0x7f91ec0f7ce0 msgr2=0x7f91ec0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 shutdown_connections 2024-09-12T01:44:46.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.314+0000 7f91f444e640 1 -- 172.21.15.66:0/4178812366 wait complete. 2024-09-12T01:44:46.412 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 -- 172.21.15.66:0/3218221187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fc700 msgr2=0x7f08540fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 --2- 172.21.15.66:0/3218221187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fc700 0x7f08540fcb70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08440048d0 tx=0x7f0844009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 -- 172.21.15.66:0/3218221187 shutdown_connections 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 --2- 172.21.15.66:0/3218221187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fc700 0x7f08540fcb70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 --2- 172.21.15.66:0/3218221187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fb430 0x7f08540fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 -- 172.21.15.66:0/3218221187 >> 172.21.15.66:0/3218221187 conn(0x7f08540f6c10 msgr2=0x7f08540f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 -- 172.21.15.66:0/3218221187 shutdown_connections 2024-09-12T01:44:46.413 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.412+0000 7f085b68f640 1 -- 172.21.15.66:0/3218221187 wait complete. 2024-09-12T01:44:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085b68f640 1 Processor -- start 2024-09-12T01:44:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085b68f640 1 -- start start 2024-09-12T01:44:46.414 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085b68f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 0x7f085410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085b68f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fc700 0x7f085410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085b68f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085410dbd0 con 0x7f08540fb430 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085b68f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085410e3f0 con 0x7f08540fc700 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085942b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 0x7f085410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085942b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 0x7f085410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33784/0 (socket says 172.21.15.66:33784) 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f085942b640 1 -- 172.21.15.66:0/1211046455 learned_addr learned my addr 172.21.15.66:0/1211046455 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.413+0000 7f0858c2a640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fc700 0x7f085410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f085942b640 1 -- 172.21.15.66:0/1211046455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fc700 msgr2=0x7f085410d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f085942b640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fc700 0x7f085410d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f085942b640 1 -- 172.21.15.66:0/1211046455 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0844005040 con 0x7f08540fb430 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f0858c2a640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fc700 0x7f085410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f085942b640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 0x7f085410d040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f085000eb70 tx=0x7f085000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0850007c30 con 0x7f08540fb430 2024-09-12T01:44:46.415 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f085000f040 con 0x7f08540fb430 2024-09-12T01:44:46.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0850009550 con 0x7f08540fb430 2024-09-12T01:44:46.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085410e620 con 0x7f08540fb430 2024-09-12T01:44:46.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.414+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085410ebc0 con 0x7f08540fb430 2024-09-12T01:44:46.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.416+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08540fa890 con 0x7f08540fb430 2024-09-12T01:44:46.416 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.416+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f08500097c0 con 0x7f08540fb430 2024-09-12T01:44:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.417+0000 7f0849ffb640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f084006dae0 0x7f084006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.417+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f085008d1d0 con 0x7f08540fb430 2024-09-12T01:44:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.417+0000 7f0858c2a640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f084006dae0 0x7f084006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.417 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.417+0000 7f0858c2a640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f084006dae0 0x7f084006ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f085410cdf0 tx=0x7f0844035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.423+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0850056be0 con 0x7f08540fb430 2024-09-12T01:44:46.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.774+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f085404b720 con 0x7f08540fb430 2024-09-12T01:44:46.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.775+0000 7f0849ffb640 1 -- 172.21.15.66:0/1211046455 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f085005a2a0 con 0x7f08540fb430 2024-09-12T01:44:46.775 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:44:46.775 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 12, 2024-09-12T01:44:46.776 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:44:46.777 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:44:46.777 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f084006dae0 msgr2=0x7f084006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f084006dae0 0x7f084006ff90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f085410cdf0 tx=0x7f0844035040 comp rx=0 tx=0).stop 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 msgr2=0x7f085410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 0x7f085410d040 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f085000eb70 tx=0x7f085000b040 comp rx=0 tx=0).stop 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 shutdown_connections 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f084006dae0 0x7f084006ff90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f08540fc700 0x7f085410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 --2- 172.21.15.66:0/1211046455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08540fb430 0x7f085410d040 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.777+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 >> 172.21.15.66:0/1211046455 conn(0x7f08540f6c10 msgr2=0x7f08540655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.778+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 shutdown_connections 2024-09-12T01:44:46.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.778+0000 7f085b68f640 1 -- 172.21.15.66:0/1211046455 wait complete. 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.863+0000 7f6c836ff640 1 -- 172.21.15.66:0/3883177758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fdba0 msgr2=0x7f6c7c0fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.863+0000 7f6c836ff640 1 --2- 172.21.15.66:0/3883177758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fdba0 0x7f6c7c0fdfb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6c700048d0 tx=0x7f6c70009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.863+0000 7f6c836ff640 1 -- 172.21.15.66:0/3883177758 shutdown_connections 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.863+0000 7f6c836ff640 1 --2- 172.21.15.66:0/3883177758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c0fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.863+0000 7f6c836ff640 1 --2- 172.21.15.66:0/3883177758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fdba0 0x7f6c7c0fdfb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.863+0000 7f6c836ff640 1 -- 172.21.15.66:0/3883177758 >> 172.21.15.66:0/3883177758 conn(0x7f6c7c0f63a0 msgr2=0x7f6c7c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.864+0000 7f6c836ff640 1 -- 172.21.15.66:0/3883177758 shutdown_connections 2024-09-12T01:44:46.864 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.864+0000 7f6c836ff640 1 -- 172.21.15.66:0/3883177758 wait complete. 2024-09-12T01:44:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.864+0000 7f6c836ff640 1 Processor -- start 2024-09-12T01:44:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.864+0000 7f6c836ff640 1 -- start start 2024-09-12T01:44:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.864+0000 7f6c836ff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c0fdba0 0x7f6c7c10d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.864+0000 7f6c836ff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c10d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c836ff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c10dc60 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c836ff640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c10e430 con 0x7f6c7c0fdba0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c10d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c8149b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c0fdba0 0x7f6c7c10d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c10d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33804/0 (socket says 172.21.15.66:33804) 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 -- 172.21.15.66:0/1676476778 learned_addr learned my addr 172.21.15.66:0/1676476778 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 -- 172.21.15.66:0/1676476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c0fdba0 msgr2=0x7f6c7c10d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c0fdba0 0x7f6c7c10d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 -- 172.21.15.66:0/1676476778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78005040 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c80c9a640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c10d610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6c780093d0 tx=0x7f6c78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.865+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c78017070 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.866+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c7800f040 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.866+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c70005040 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.866+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c78013bb0 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.866+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c10ea70 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.867+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c0fa040 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.867+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 31) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f6c7800e8b0 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.868+0000 7f6c6dffb640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f6c6806dae0 0x7f6c6806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.868+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f6c7808d260 con 0x7f6c7c0fe4f0 2024-09-12T01:44:46.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.868+0000 7f6c8149b640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f6c6806dae0 0x7f6c6806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.869+0000 7f6c8149b640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f6c6806dae0 0x7f6c6806ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6c70004540 tx=0x7f6c70035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.875 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:46.875+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f6c78056bc0 con 0x7f6c7c0fe4f0 2024-09-12T01:44:47.083 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:46 smithi066 ceph-mon[27875]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:47.084 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:46 smithi066 ceph-mon[27875]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:47.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:46 smithi153 ceph-mon[34713]: from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:47.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:46 smithi153 ceph-mon[34713]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:47.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.156+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c7c10eda0 con 0x7f6c6806dae0 2024-09-12T01:44:47.159 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:44:47.159 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:44:47.159 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:44:47.159 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr" 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "2/2 daemons upgraded", 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "", 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:44:47.160 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.159+0000 7f6c6dffb640 1 -- 172.21.15.66:0/1676476778 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f6c7c10eda0 con 0x7f6c6806dae0 2024-09-12T01:44:47.161 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f6c6806dae0 msgr2=0x7f6c6806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f6c6806dae0 0x7f6c6806ff90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6c70004540 tx=0x7f6c70035040 comp rx=0 tx=0).stop 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 msgr2=0x7f6c7c10d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c10d610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6c780093d0 tx=0x7f6c78009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 shutdown_connections 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f6c6806dae0 0x7f6c6806ff90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c7c0fe4f0 0x7f6c7c10d610 secure :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6c780093d0 tx=0x7f6c78009da0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 --2- 172.21.15.66:0/1676476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c7c0fdba0 0x7f6c7c10d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.161+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 >> 172.21.15.66:0/1676476778 conn(0x7f6c7c0f63a0 msgr2=0x7f6c7c0f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.162+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 shutdown_connections 2024-09-12T01:44:47.162 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:44:47.162+0000 7f6c836ff640 1 -- 172.21.15.66:0/1676476778 wait complete. 2024-09-12T01:44:48.035 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:47 smithi066 ceph-mon[27875]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:48.035 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:47 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1211046455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:44:48.035 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:47 smithi066 ceph-mon[27875]: pgmap v10: 65 pgs: 65 active+clean; 234 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-09-12T01:44:48.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:47 smithi153 ceph-mon[34713]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:48.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:47 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1211046455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:44:48.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:47 smithi153 ceph-mon[34713]: pgmap v10: 65 pgs: 65 active+clean; 234 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-09-12T01:44:48.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:48 smithi066 ceph-mon[27875]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:48.862 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:48 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:49.133 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-12T01:44:49.133 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:44:49.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:48 smithi153 ceph-mon[34713]: from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:44:49.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:48 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:44:49.494 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:49.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:44:49.530 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:44:49.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-12T01:44:49.558 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-12T01:44:49.558 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:49.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:49 smithi153 ceph-mon[34713]: pgmap v11: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 1.6 MiB/s wr, 577 op/s 2024-09-12T01:44:50.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:49 smithi066 ceph-mon[27875]: pgmap v11: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 1.6 MiB/s wr, 577 op/s 2024-09-12T01:44:52.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:51 smithi066 ceph-mon[27875]: pgmap v12: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 749 op/s 2024-09-12T01:44:52.181 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:51 smithi153 ceph-mon[34713]: pgmap v12: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 749 op/s 2024-09-12T01:44:53.504 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.504 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: pgmap v13: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 566 op/s 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.505 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.506 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.506 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:53 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: pgmap v13: 65 pgs: 65 active+clean; 220 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 566 op/s 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:53 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:54 smithi066 ceph-mon[27875]: Reconfiguring prometheus.smithi066 (dependencies changed)... 2024-09-12T01:44:54.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:54 smithi066 ceph-mon[27875]: Reconfiguring daemon prometheus.smithi066 on smithi066 2024-09-12T01:44:54.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:54 smithi153 ceph-mon[34713]: Reconfiguring prometheus.smithi066 (dependencies changed)... 2024-09-12T01:44:54.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:54 smithi153 ceph-mon[34713]: Reconfiguring daemon prometheus.smithi066 on smithi066 2024-09-12T01:44:55.626 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:55 smithi066 ceph-mon[27875]: pgmap v14: 65 pgs: 65 active+clean; 207 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 598 op/s 2024-09-12T01:44:55.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:55 smithi153 ceph-mon[34713]: pgmap v14: 65 pgs: 65 active+clean; 207 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 33 KiB/s rd, 1.6 MiB/s wr, 598 op/s 2024-09-12T01:44:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:57 smithi066 ceph-mon[27875]: pgmap v15: 65 pgs: 65 active+clean; 207 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 785 KiB/s wr, 287 op/s 2024-09-12T01:44:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:57 smithi153 ceph-mon[34713]: pgmap v15: 65 pgs: 65 active+clean; 207 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 785 KiB/s wr, 287 op/s 2024-09-12T01:44:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:59 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:59 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:59.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:59 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:59.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:59 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:59.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:59 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:59.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:44:59 smithi066 ceph-mon[27875]: pgmap v16: 65 pgs: 65 active+clean; 207 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 785 KiB/s wr, 287 op/s 2024-09-12T01:44:59.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:59 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:59.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:59 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:44:59.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:59 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:59.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:59 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:44:59.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:59 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:44:59.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:44:59 smithi153 ceph-mon[34713]: pgmap v16: 65 pgs: 65 active+clean; 207 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 18 KiB/s rd, 785 KiB/s wr, 287 op/s 2024-09-12T01:45:00.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:00 smithi153 ceph-mon[34713]: Upgrade: Updating mgr.smithi153.jpnqza 2024-09-12T01:45:00.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:45:00.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:00 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:45:00.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:45:00.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:00.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:00 smithi153 ceph-mon[34713]: Deploying daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:45:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:00 smithi066 ceph-mon[27875]: Upgrade: Updating mgr.smithi153.jpnqza 2024-09-12T01:45:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:45:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:00 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:45:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:45:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:00 smithi066 ceph-mon[27875]: Deploying daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:45:01.792 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:01 smithi153 ceph-mon[34713]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 655 KiB/s wr, 248 op/s 2024-09-12T01:45:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:01 smithi066 ceph-mon[27875]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 655 KiB/s wr, 248 op/s 2024-09-12T01:45:04.201 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-12T01:45:04.201 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:04.201 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.201 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.201 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:04.202 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.202 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:03 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:04.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:03 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:06.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:05 smithi066 ceph-mon[27875]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-12T01:45:06.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:05 smithi153 ceph-mon[34713]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 3.2 KiB/s rd, 53 KiB/s wr, 32 op/s 2024-09-12T01:45:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:07 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:07 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:07 smithi066 ceph-mon[27875]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 511 B/s wr, 0 op/s 2024-09-12T01:45:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:07 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:07 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.535 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:07 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.535 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:07 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.535 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:07 smithi153 ceph-mon[34713]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 511 B/s wr, 0 op/s 2024-09-12T01:45:07.535 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:07 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:07.535 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:07 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:08.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:08 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza restarted 2024-09-12T01:45:08.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:08 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:45:08.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:08 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:45:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:08 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:45:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:08 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:45:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:08 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:45:08.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:08 smithi066 ceph-mon[27875]: Standby manager daemon smithi153.jpnqza restarted 2024-09-12T01:45:08.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:08 smithi066 ceph-mon[27875]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:45:08.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:08 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:45:08.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:08 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:45:08.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:08 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:45:08.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:08 smithi066 ceph-mon[27875]: from='mgr.? 172.21.15.153:0/2901399290' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:45:09.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:09 smithi153 ceph-mon[34713]: mgrmap e32: smithi066.qdwcrh(active, since 35s), standbys: smithi153.jpnqza 2024-09-12T01:45:09.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:09 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:09.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:09 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:09.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:09 smithi153 ceph-mon[34713]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 511 B/s wr, 0 op/s 2024-09-12T01:45:09.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:09 smithi066 ceph-mon[27875]: mgrmap e32: smithi066.qdwcrh(active, since 35s), standbys: smithi153.jpnqza 2024-09-12T01:45:09.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:09 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:09.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:09 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:09.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:09 smithi066 ceph-mon[27875]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 511 B/s wr, 0 op/s 2024-09-12T01:45:11.498 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.498 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all mgr 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi066.qdwcrh"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi066.qdwcrh"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi066.qdwcrh"}]': finished 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.jpnqza"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.jpnqza"}]: dispatch 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.jpnqza"}]': finished 2024-09-12T01:45:11.499 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all rgw 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all rbd-mirror 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all ceph-exporter 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.500 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all iscsi 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all nfs 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all nvmeof 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:11 smithi066 ceph-mon[27875]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:45:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all mgr 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi066.qdwcrh"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi066.qdwcrh"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi066.qdwcrh"}]': finished 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.jpnqza"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.jpnqza"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi153.jpnqza"}]': finished 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all rgw 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all rbd-mirror 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all ceph-exporter 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all iscsi 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all nfs 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:11.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all nvmeof 2024-09-12T01:45:11.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:11.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:11 smithi153 ceph-mon[34713]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-12T01:45:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:12 smithi066 ceph-mon[27875]: Upgrade: Updating node-exporter.smithi066 (1/2) 2024-09-12T01:45:12.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:12 smithi066 ceph-mon[27875]: Deploying daemon node-exporter.smithi066 on smithi066 2024-09-12T01:45:12.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:12 smithi153 ceph-mon[34713]: Upgrade: Updating node-exporter.smithi066 (1/2) 2024-09-12T01:45:12.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:12 smithi153 ceph-mon[34713]: Deploying daemon node-exporter.smithi066 on smithi066 2024-09-12T01:45:13.575 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:13 smithi066 ceph-mon[27875]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:13.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:13 smithi153 ceph-mon[34713]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:15.634 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:15 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:15.635 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:15 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:15.635 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:15 smithi153 ceph-mon[34713]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:15 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:15 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:15 smithi066 ceph-mon[27875]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:16.626 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:16 smithi066 ceph-mon[27875]: Upgrade: Updating node-exporter.smithi153 (2/2) 2024-09-12T01:45:16.627 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:16 smithi066 ceph-mon[27875]: Deploying daemon node-exporter.smithi153 on smithi153 2024-09-12T01:45:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:16 smithi153 ceph-mon[34713]: Upgrade: Updating node-exporter.smithi153 (2/2) 2024-09-12T01:45:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:16 smithi153 ceph-mon[34713]: Deploying daemon node-exporter.smithi153 on smithi153 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 -- 172.21.15.66:0/2130339510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 msgr2=0x7f3c400fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 --2- 172.21.15.66:0/2130339510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400fb890 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c300048d0 tx=0x7f3c30009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 -- 172.21.15.66:0/2130339510 shutdown_connections 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 --2- 172.21.15.66:0/2130339510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 0x7f3c400fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 --2- 172.21.15.66:0/2130339510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400fb890 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 -- 172.21.15.66:0/2130339510 >> 172.21.15.66:0/2130339510 conn(0x7f3c400f6c40 msgr2=0x7f3c400f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:17.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 -- 172.21.15.66:0/2130339510 shutdown_connections 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 -- 172.21.15.66:0/2130339510 wait complete. 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 Processor -- start 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.261+0000 7f3c45f43640 1 -- start start 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c45f43640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400ff500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c45f43640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 0x7f3c400fda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c45f43640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400fe060 con 0x7f3c400fb480 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c45f43640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400fe1d0 con 0x7f3c400fc750 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400ff500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400ff500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57656/0 (socket says 172.21.15.66:57656) 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 -- 172.21.15.66:0/72913345 learned_addr learned my addr 172.21.15.66:0/72913345 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c37fff640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 0x7f3c400fda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 -- 172.21.15.66:0/72913345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 msgr2=0x7f3c400fda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 0x7f3c400fda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 -- 172.21.15.66:0/72913345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30005040 con 0x7f3c400fb480 2024-09-12T01:45:17.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c37fff640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 0x7f3c400fda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:45:17.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.262+0000 7f3c3f7fe640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400ff500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3c30000c00 tx=0x7f3c30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:17.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.263+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c30038070 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.263+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c400fe450 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.263+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c3002ae90 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.263+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3003d440 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.263+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c400fe910 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.264+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c400fa8e0 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.264+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f3c30030020 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.265+0000 7f3c3cff9640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3c2c06dae0 0x7f3c2c06ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.265+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3c300adaa0 con 0x7f3c400fb480 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.265+0000 7f3c37fff640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3c2c06dae0 0x7f3c2c06ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.266 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.266+0000 7f3c37fff640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3c2c06dae0 0x7f3c2c06ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c28006fd0 tx=0x7f3c28008040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:17.270 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.270+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3c30077510 con 0x7f3c400fb480 2024-09-12T01:45:17.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.462+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c40104060 con 0x7f3c2c06dae0 2024-09-12T01:45:17.463 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.464+0000 7f3c3cff9640 1 -- 172.21.15.66:0/72913345 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f3c40104060 con 0x7f3c2c06dae0 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.465+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3c2c06dae0 msgr2=0x7f3c2c06ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.465+0000 7f3c45f43640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3c2c06dae0 0x7f3c2c06ff90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c28006fd0 tx=0x7f3c28008040 comp rx=0 tx=0).stop 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.465+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 msgr2=0x7f3c400ff500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.465+0000 7f3c45f43640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400ff500 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3c30000c00 tx=0x7f3c30009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 shutdown_connections 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3c2c06dae0 0x7f3c2c06ff90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fc750 0x7f3c400fda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 --2- 172.21.15.66:0/72913345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fb480 0x7f3c400ff500 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 >> 172.21.15.66:0/72913345 conn(0x7f3c400f6c40 msgr2=0x7f3c400661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:17.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 shutdown_connections 2024-09-12T01:45:17.467 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.466+0000 7f3c45f43640 1 -- 172.21.15.66:0/72913345 wait complete. 2024-09-12T01:45:17.475 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:45:17.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 -- 172.21.15.66:0/3632717846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fc750 msgr2=0x7f57580fcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 --2- 172.21.15.66:0/3632717846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fc750 0x7f57580fcbc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f574c0048d0 tx=0x7f574c009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:17 smithi066 ceph-mon[27875]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:17.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 -- 172.21.15.66:0/3632717846 shutdown_connections 2024-09-12T01:45:17.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 --2- 172.21.15.66:0/3632717846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fc750 0x7f57580fcbc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 --2- 172.21.15.66:0/3632717846 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fb480 0x7f57580fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.550 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 -- 172.21.15.66:0/3632717846 >> 172.21.15.66:0/3632717846 conn(0x7f57580f6c40 msgr2=0x7f57580f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 -- 172.21.15.66:0/3632717846 shutdown_connections 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.548+0000 7f575e04f640 1 -- 172.21.15.66:0/3632717846 wait complete. 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f575e04f640 1 Processor -- start 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f575e04f640 1 -- start start 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f575e04f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 0x7f575810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f575e04f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fc750 0x7f575810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f575e04f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575810dc40 con 0x7f57580fb480 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f575e04f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575810e460 con 0x7f57580fc750 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f57577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 0x7f575810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f57577fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 0x7f575810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57668/0 (socket says 172.21.15.66:57668) 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f57577fe640 1 -- 172.21.15.66:0/865893824 learned_addr learned my addr 172.21.15.66:0/865893824 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.549+0000 7f5756ffd640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fc750 0x7f575810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f57577fe640 1 -- 172.21.15.66:0/865893824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fc750 msgr2=0x7f575810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f57577fe640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fc750 0x7f575810d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f57577fe640 1 -- 172.21.15.66:0/865893824 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c005040 con 0x7f57580fb480 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f5756ffd640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fc750 0x7f575810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f57577fe640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 0x7f575810d0b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5748002a80 tx=0x7f5748004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5748007c30 con 0x7f57580fb480 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f574800f040 con 0x7f57580fb480 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575810e6f0 con 0x7f57580fb480 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5748009530 con 0x7f57580fb480 2024-09-12T01:45:17.552 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.550+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575810ec10 con 0x7f57580fb480 2024-09-12T01:45:17.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.551+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57580fa8e0 con 0x7f57580fb480 2024-09-12T01:45:17.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.552+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f5748009690 con 0x7f57580fb480 2024-09-12T01:45:17.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.552+0000 7f573ffff640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f574006dae0 0x7f574006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.552+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f574808cdd0 con 0x7f57580fb480 2024-09-12T01:45:17.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.552+0000 7f5756ffd640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f574006dae0 0x7f574006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.553 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.553+0000 7f5756ffd640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f574006dae0 0x7f574006ff90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f574c007ac0 tx=0x7f574c035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:17.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.557+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f57480567b0 con 0x7f57580fb480 2024-09-12T01:45:17.614 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:17 smithi153 ceph-mon[34713]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:17.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.747+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f575810f010 con 0x7f574006dae0 2024-09-12T01:45:17.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.748+0000 7f573ffff640 1 -- 172.21.15.66:0/865893824 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f575810f010 con 0x7f574006dae0 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f574006dae0 msgr2=0x7f574006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f574006dae0 0x7f574006ff90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f574c007ac0 tx=0x7f574c035040 comp rx=0 tx=0).stop 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 msgr2=0x7f575810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 0x7f575810d0b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5748002a80 tx=0x7f5748004600 comp rx=0 tx=0).stop 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 shutdown_connections 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f574006dae0 0x7f574006ff90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57580fc750 0x7f575810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 --2- 172.21.15.66:0/865893824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57580fb480 0x7f575810d0b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 >> 172.21.15.66:0/865893824 conn(0x7f57580f6c40 msgr2=0x7f57580f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:17.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 shutdown_connections 2024-09-12T01:45:17.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.750+0000 7f575e04f640 1 -- 172.21.15.66:0/865893824 wait complete. 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 -- 172.21.15.66:0/278712246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 msgr2=0x7fb6300fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 --2- 172.21.15.66:0/278712246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb6300fdc60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb6240048d0 tx=0x7fb624009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 -- 172.21.15.66:0/278712246 shutdown_connections 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 --2- 172.21.15.66:0/278712246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb6300fdc60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 --2- 172.21.15.66:0/278712246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6300fc520 0x7fb6300fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 -- 172.21.15.66:0/278712246 >> 172.21.15.66:0/278712246 conn(0x7fb6300f7ce0 msgr2=0x7fb6300fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:17.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 -- 172.21.15.66:0/278712246 shutdown_connections 2024-09-12T01:45:17.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 -- 172.21.15.66:0/278712246 wait complete. 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 Processor -- start 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.831+0000 7fb63650d640 1 -- start start 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb63650d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6300fc520 0x7fb630071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb63650d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb63006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb63650d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63006fff0 con 0x7fb6300fd7f0 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb63650d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb630070130 con 0x7fb6300fc520 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb63006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb63006fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57692/0 (socket says 172.21.15.66:57692) 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 -- 172.21.15.66:0/1943256729 learned_addr learned my addr 172.21.15.66:0/1943256729 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:17.834 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62ffff640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6300fc520 0x7fb630071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 -- 172.21.15.66:0/1943256729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6300fc520 msgr2=0x7fb630071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6300fc520 0x7fb630071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 -- 172.21.15.66:0/1943256729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624005040 con 0x7fb6300fd7f0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.832+0000 7fb62f7fe640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb63006fa60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb6240048a0 tx=0x7fb624009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.833+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb624038070 con 0x7fb6300fd7f0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.833+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb624004290 con 0x7fb6300fd7f0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.833+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6300703b0 con 0x7fb6300fd7f0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.833+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb624033660 con 0x7fb6300fd7f0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.833+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6301150d0 con 0x7fb6300fd7f0 2024-09-12T01:45:17.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.834+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6300fb980 con 0x7fb6300fd7f0 2024-09-12T01:45:17.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.834+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fb624030020 con 0x7fb6300fd7f0 2024-09-12T01:45:17.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.835+0000 7fb62cff9640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fb61806dae0 0x7fb61806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:17.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.835+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fb6240ad630 con 0x7fb6300fd7f0 2024-09-12T01:45:17.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.835+0000 7fb62ffff640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fb61806dae0 0x7fb61806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:17.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.836+0000 7fb62ffff640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fb61806dae0 0x7fb61806ff90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb630071320 tx=0x7fb62000b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:17.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:17.840+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb624077000 con 0x7fb6300fd7f0 2024-09-12T01:45:18.022 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.022+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb630101c00 con 0x7fb61806dae0 2024-09-12T01:45:18.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.031+0000 7fb62cff9640 1 -- 172.21.15.66:0/1943256729 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb630101c00 con 0x7fb61806dae0 2024-09-12T01:45:18.031 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:45:18.031 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (100s) 9s ago 9m 27.9M - 0.25.0 c8568f914cd2 853e1519bd6e 2024-09-12T01:45:18.031 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (10m) 9s ago 10m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (9m) 11s ago 9m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (94s) 9s ago 9m 80.4M - 9.4.7 954c08fa6188 ae3a15d0872d 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (4m) 9s ago 4m 12.5M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (4m) 9s ago 4m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (4m) 11s ago 4m 15.8M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (4m) 11s ago 4m 15.1M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (67s) 9s ago 11m 491M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (15s) 11s ago 8m 69.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (11m) 9s ago 11m 58.4M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (8m) 11s ago 8m 44.2M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 starting - - - - 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (78s) 11s ago 9m 15.9M - 1.5.0 0da6a335fe13 0e1969830d8f 2024-09-12T01:45:18.032 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (8m) 9s ago 8m 246M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:45:18.033 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (7m) 9s ago 7m 257M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:45:18.033 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (7m) 9s ago 7m 212M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:45:18.033 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (6m) 11s ago 6m 273M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:45:18.033 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (6m) 11s ago 6m 250M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:45:18.033 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (6m) 11s ago 6m 229M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:45:18.033 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (19s) 9s ago 9m 44.2M - 2.43.0 a07b618ecd1d f5fbb796637d 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fb61806dae0 msgr2=0x7fb61806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fb61806dae0 0x7fb61806ff90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb630071320 tx=0x7fb62000b040 comp rx=0 tx=0).stop 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 msgr2=0x7fb63006fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb63006fa60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb6240048a0 tx=0x7fb624009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 shutdown_connections 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fb61806dae0 0x7fb61806ff90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6300fd7f0 0x7fb63006fa60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 --2- 172.21.15.66:0/1943256729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6300fc520 0x7fb630071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 >> 172.21.15.66:0/1943256729 conn(0x7fb6300f7ce0 msgr2=0x7fb6300f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:18.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 shutdown_connections 2024-09-12T01:45:18.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.033+0000 7fb63650d640 1 -- 172.21.15.66:0/1943256729 wait complete. 2024-09-12T01:45:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 -- 172.21.15.66:0/3168961049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 msgr2=0x7f35e80fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 --2- 172.21.15.66:0/3168961049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e80fc960 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f35d80048d0 tx=0x7f35d8009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 -- 172.21.15.66:0/3168961049 shutdown_connections 2024-09-12T01:45:18.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 --2- 172.21.15.66:0/3168961049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e80fd820 0x7f35e80fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 --2- 172.21.15.66:0/3168961049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e80fc960 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 -- 172.21.15.66:0/3168961049 >> 172.21.15.66:0/3168961049 conn(0x7f35e80f7d30 msgr2=0x7f35e80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 -- 172.21.15.66:0/3168961049 shutdown_connections 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.116+0000 7f35ed416640 1 -- 172.21.15.66:0/3168961049 wait complete. 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.117+0000 7f35ed416640 1 Processor -- start 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.117+0000 7f35ed416640 1 -- start start 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.117+0000 7f35ed416640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.117+0000 7f35ed416640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e80fd820 0x7f35e810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.117+0000 7f35ed416640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e810dc10 con 0x7f35e80fc550 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35ed416640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e810e430 con 0x7f35e80fd820 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57714/0 (socket says 172.21.15.66:57714) 2024-09-12T01:45:18.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 -- 172.21.15.66:0/2403196655 learned_addr learned my addr 172.21.15.66:0/2403196655 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:18.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e67fc640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e80fd820 0x7f35e810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:18.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 -- 172.21.15.66:0/2403196655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e80fd820 msgr2=0x7f35e810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e80fd820 0x7f35e810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 -- 172.21.15.66:0/2403196655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc005040 con 0x7f35e80fc550 2024-09-12T01:45:18.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35e6ffd640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e810d080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35d80048a0 tx=0x7f35d8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.118+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d8038070 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.119+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f35d8004290 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.119+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35d8033660 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.119+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d8005040 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.119+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e810ea70 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.120+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e8105760 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.121+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f35d8030020 con 0x7f35e80fc550 2024-09-12T01:45:18.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.121+0000 7f35cf7fe640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f35d006dae0 0x7f35d006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:18.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.121+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f35d80ad3f0 con 0x7f35e80fc550 2024-09-12T01:45:18.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.121+0000 7f35e67fc640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f35d006dae0 0x7f35d006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:18.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.122+0000 7f35e67fc640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f35d006dae0 0x7f35d006ff90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35e810ce30 tx=0x7f35dc00b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:18.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.126+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f35d8076f90 con 0x7f35e80fc550 2024-09-12T01:45:18.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.388+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f35e804b720 con 0x7f35e80fc550 2024-09-12T01:45:18.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.388+0000 7f35cf7fe640 1 -- 172.21.15.66:0/2403196655 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f35d802c870 con 0x7f35e80fc550 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:45:18.389 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 12, 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:45:18.390 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:45:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f35d006dae0 msgr2=0x7f35d006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f35d006dae0 0x7f35d006ff90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f35e810ce30 tx=0x7f35dc00b040 comp rx=0 tx=0).stop 2024-09-12T01:45:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 msgr2=0x7f35e810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e810d080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35d80048a0 tx=0x7f35d8009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 shutdown_connections 2024-09-12T01:45:18.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f35d006dae0 0x7f35d006ff90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f35e80fd820 0x7f35e810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 --2- 172.21.15.66:0/2403196655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35e80fc550 0x7f35e810d080 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 >> 172.21.15.66:0/2403196655 conn(0x7f35e80f7d30 msgr2=0x7f35e80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:18.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 shutdown_connections 2024-09-12T01:45:18.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.391+0000 7f35ed416640 1 -- 172.21.15.66:0/2403196655 wait complete. 2024-09-12T01:45:18.497 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 -- 172.21.15.66:0/726566980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 msgr2=0x7fc9f00fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 --2- 172.21.15.66:0/726566980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f00fdc60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc9e40048d0 tx=0x7fc9e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 -- 172.21.15.66:0/726566980 shutdown_connections 2024-09-12T01:45:18.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 --2- 172.21.15.66:0/726566980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f00fdc60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 --2- 172.21.15.66:0/726566980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f00fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.498 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 -- 172.21.15.66:0/726566980 >> 172.21.15.66:0/726566980 conn(0x7fc9f00f7ce0 msgr2=0x7fc9f00fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:18.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 -- 172.21.15.66:0/726566980 shutdown_connections 2024-09-12T01:45:18.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.495+0000 7fc9f5381640 1 -- 172.21.15.66:0/726566980 wait complete. 2024-09-12T01:45:18.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9f5381640 1 Processor -- start 2024-09-12T01:45:18.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9f5381640 1 -- start start 2024-09-12T01:45:18.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9f5381640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:18.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9f5381640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:18.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9f5381640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f010dc10 con 0x7fc9f00fd7f0 2024-09-12T01:45:18.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9f5381640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f010e430 con 0x7fc9f00fc520 2024-09-12T01:45:18.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9ee7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:18.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:18.500 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:52420/0 (socket says 172.21.15.66:52420) 2024-09-12T01:45:18.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9eeffd640 1 -- 172.21.15.66:0/3093874879 learned_addr learned my addr 172.21.15.66:0/3093874879 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:18.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.496+0000 7fc9ee7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57734/0 (socket says 172.21.15.66:57734) 2024-09-12T01:45:18.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9eeffd640 1 -- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 msgr2=0x7fc9f010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9eeffd640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.501 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9eeffd640 1 -- 172.21.15.66:0/3093874879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4005040 con 0x7fc9f00fc520 2024-09-12T01:45:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9eeffd640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f010d080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0002a50 tx=0x7fc9e0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e0007c30 con 0x7fc9f00fc520 2024-09-12T01:45:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f010e6c0 con 0x7fc9f00fc520 2024-09-12T01:45:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc9e000f040 con 0x7fc9f00fc520 2024-09-12T01:45:18.502 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9e000da10 con 0x7fc9f00fc520 2024-09-12T01:45:18.503 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.497+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f010ec60 con 0x7fc9f00fc520 2024-09-12T01:45:18.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.498+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f00fb980 con 0x7fc9f00fc520 2024-09-12T01:45:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.499+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fc9e000dc80 con 0x7fc9f00fc520 2024-09-12T01:45:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.499+0000 7fc9d77fe640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fc9d806dae0 0x7fc9d806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.499+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc9e008cc70 con 0x7fc9f00fc520 2024-09-12T01:45:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.499+0000 7fc9ee7fc640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fc9d806dae0 0x7fc9d806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:18.505 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.500+0000 7fc9ee7fc640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fc9d806dae0 0x7fc9d806ff90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9f010ce30 tx=0x7fc9e4035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:18.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.504+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc9e0056680 con 0x7fc9f00fc520 2024-09-12T01:45:18.695 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.694+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9f010efc0 con 0x7fc9d806dae0 2024-09-12T01:45:18.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.696+0000 7fc9d77fe640 1 -- 172.21.15.66:0/3093874879 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fc9f010efc0 con 0x7fc9d806dae0 2024-09-12T01:45:18.696 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:45:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:45:18.696 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:45:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:45:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:45:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr" 2024-09-12T01:45:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:45:18.697 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "2/2 daemons upgraded", 2024-09-12T01:45:18.698 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-12T01:45:18.698 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:45:18.698 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:45:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fc9d806dae0 msgr2=0x7fc9d806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.699 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fc9d806dae0 0x7fc9d806ff90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc9f010ce30 tx=0x7fc9e4035040 comp rx=0 tx=0).stop 2024-09-12T01:45:18.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 msgr2=0x7fc9f010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:18.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f010d080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc9e0002a50 tx=0x7fc9e0004600 comp rx=0 tx=0).stop 2024-09-12T01:45:18.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 shutdown_connections 2024-09-12T01:45:18.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fc9d806dae0 0x7fc9d806ff90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9f00fd7f0 0x7fc9f010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.700 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 --2- 172.21.15.66:0/3093874879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9f00fc520 0x7fc9f010d080 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:18.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 >> 172.21.15.66:0/3093874879 conn(0x7fc9f00f7ce0 msgr2=0x7fc9f00f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:18.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 shutdown_connections 2024-09-12T01:45:18.701 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:18.698+0000 7fc9f5381640 1 -- 172.21.15.66:0/3093874879 wait complete. 2024-09-12T01:45:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:19.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:19.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2403196655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:19.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:19 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:19.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2403196655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:19.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:19 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:20.356 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:20 smithi066 ceph-mon[27875]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:20.356 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:20 smithi066 ceph-mon[27875]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:20 smithi153 ceph-mon[34713]: from='client.24493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:20 smithi153 ceph-mon[34713]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:21.809 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:21 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:21.809 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:21 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:21.809 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:21 smithi153 ceph-mon[34713]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:21.809 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:21 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:21.809 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:21 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:21 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:21 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:21 smithi066 ceph-mon[27875]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:21 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:21 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.241 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:24 smithi153 ceph-mon[34713]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:24.241 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:24 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.241 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:24 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.241 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:24 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.242 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:24 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.317 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:24 smithi066 ceph-mon[27875]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:24.317 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:24 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.317 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:24 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.317 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:24 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:24.317 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:24 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:25.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:25 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:25.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:25 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:25.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:25 smithi066 ceph-mon[27875]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:25.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:25 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:25.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:25 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:25.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:25 smithi153 ceph-mon[34713]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:28.016 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:28.017 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:28.017 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:28.017 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:28.017 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:28.017 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:28.017 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.018 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:28.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:30.220 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:29 smithi066 ceph-mon[27875]: Upgrade: Updating prometheus.smithi066 2024-09-12T01:45:30.220 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:29 smithi066 ceph-mon[27875]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:30.220 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:29 smithi066 ceph-mon[27875]: Deploying daemon prometheus.smithi066 on smithi066 2024-09-12T01:45:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:29 smithi153 ceph-mon[34713]: Upgrade: Updating prometheus.smithi066 2024-09-12T01:45:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:29 smithi153 ceph-mon[34713]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:29 smithi153 ceph-mon[34713]: Deploying daemon prometheus.smithi066 on smithi066 2024-09-12T01:45:32.223 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:31 smithi066 ceph-mon[27875]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:32.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:31 smithi153 ceph-mon[34713]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:34.198 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:33 smithi066 ceph-mon[27875]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:34.198 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:33 smithi153 ceph-mon[34713]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:34.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:35.630 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:35 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:35.630 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:35 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:35.630 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:35 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:35.630 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:35 smithi066 ceph-mon[27875]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:35 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:35 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:35 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:35 smithi153 ceph-mon[34713]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:37 smithi066 ceph-mon[27875]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:38.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:37 smithi153 ceph-mon[34713]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:40.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:39 smithi153 ceph-mon[34713]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:40.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:39 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:39 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:39 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.207 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:39 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:39 smithi066 ceph-mon[27875]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:40.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:39 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:39 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:39 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:40.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:39 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:42.284 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:41 smithi066 ceph-mon[27875]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:41 smithi153 ceph-mon[34713]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:44 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: pgmap v38: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:45:44.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:44.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:44 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:46.286 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:46 smithi066 ceph-mon[27875]: Upgrade: Updating alertmanager.smithi066 2024-09-12T01:45:46.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:46 smithi066 ceph-mon[27875]: Deploying daemon alertmanager.smithi066 on smithi066 2024-09-12T01:45:46.287 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:46 smithi066 ceph-mon[27875]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:46 smithi153 ceph-mon[34713]: Upgrade: Updating alertmanager.smithi066 2024-09-12T01:45:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:46 smithi153 ceph-mon[34713]: Deploying daemon alertmanager.smithi066 on smithi066 2024-09-12T01:45:46.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:46 smithi153 ceph-mon[34713]: pgmap v39: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:48 smithi066 ceph-mon[27875]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:48 smithi153 ceph-mon[34713]: pgmap v40: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 -- 172.21.15.66:0/4058780403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 msgr2=0x7f3e140fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 --2- 172.21.15.66:0/4058780403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e140fb840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3e100048d0 tx=0x7f3e10009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 -- 172.21.15.66:0/4058780403 shutdown_connections 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 --2- 172.21.15.66:0/4058780403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 0x7f3e140fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 --2- 172.21.15.66:0/4058780403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e140fb840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 -- 172.21.15.66:0/4058780403 >> 172.21.15.66:0/4058780403 conn(0x7f3e140f6c10 msgr2=0x7f3e140f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 -- 172.21.15.66:0/4058780403 shutdown_connections 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.785+0000 7f3e1b916640 1 -- 172.21.15.66:0/4058780403 wait complete. 2024-09-12T01:45:48.788 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e1b916640 1 Processor -- start 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e1b916640 1 -- start start 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e1b916640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e1410fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e1b916640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 0x7f3e14112290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e1b916640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14065cc0 con 0x7f3e140fb430 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e1b916640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14065e30 con 0x7f3e140fc700 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e196b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e1410fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e196b2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e1410fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45908/0 (socket says 172.21.15.66:45908) 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e196b2640 1 -- 172.21.15.66:0/1323904699 learned_addr learned my addr 172.21.15.66:0/1323904699 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e196b2640 1 -- 172.21.15.66:0/1323904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 msgr2=0x7f3e14112290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:48.789 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.786+0000 7f3e18eb1640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 0x7f3e14112290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e196b2640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 0x7f3e14112290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e196b2640 1 -- 172.21.15.66:0/1323904699 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10005040 con 0x7f3e140fb430 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e18eb1640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 0x7f3e14112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e196b2640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e1410fd40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e10003080 tx=0x7f3e10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e10038070 con 0x7f3e140fb430 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e14112830 con 0x7f3e140fb430 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e1002abd0 con 0x7f3e140fb430 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e1003e670 con 0x7f3e140fb430 2024-09-12T01:45:48.790 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.787+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e14112da0 con 0x7f3e140fb430 2024-09-12T01:45:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.788+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e140fa890 con 0x7f3e140fb430 2024-09-12T01:45:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.789+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f3e10030020 con 0x7f3e140fb430 2024-09-12T01:45:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.789+0000 7f3e09ffb640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3e0006dae0 0x7f3e0006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.789+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3e100ad780 con 0x7f3e140fb430 2024-09-12T01:45:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.789+0000 7f3e18eb1640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3e0006dae0 0x7f3e0006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:48.791 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.790+0000 7f3e18eb1640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3e0006dae0 0x7f3e0006ff90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e040041d0 tx=0x7f3e04009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:48.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:48.794+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3e100771f0 con 0x7f3e140fb430 2024-09-12T01:45:49.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.007+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e14100b60 con 0x7f3e0006dae0 2024-09-12T01:45:49.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.008+0000 7f3e09ffb640 1 -- 172.21.15.66:0/1323904699 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3e14100b60 con 0x7f3e0006dae0 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3e0006dae0 msgr2=0x7f3e0006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3e0006dae0 0x7f3e0006ff90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3e040041d0 tx=0x7f3e04009040 comp rx=0 tx=0).stop 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 msgr2=0x7f3e1410fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e1410fd40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3e10003080 tx=0x7f3e10009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 shutdown_connections 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3e0006dae0 0x7f3e0006ff90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e140fc700 0x7f3e14112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 --2- 172.21.15.66:0/1323904699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e140fb430 0x7f3e1410fd40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 >> 172.21.15.66:0/1323904699 conn(0x7f3e140f6c10 msgr2=0x7f3e140f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 shutdown_connections 2024-09-12T01:45:49.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.010+0000 7f3e1b916640 1 -- 172.21.15.66:0/1323904699 wait complete. 2024-09-12T01:45:49.020 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 -- 172.21.15.66:0/3316832387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 msgr2=0x7f40040fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3316832387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f40040fc7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80048d0 tx=0x7f3ff8009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 -- 172.21.15.66:0/3316832387 shutdown_connections 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3316832387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40040fd660 0x7f40040fdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3316832387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f40040fc7a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 -- 172.21.15.66:0/3316832387 >> 172.21.15.66:0/3316832387 conn(0x7f40040f7b70 msgr2=0x7f40040f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 -- 172.21.15.66:0/3316832387 shutdown_connections 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 -- 172.21.15.66:0/3316832387 wait complete. 2024-09-12T01:45:49.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 Processor -- start 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.095+0000 7f4009b9f640 1 -- start start 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4009b9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f400410cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4009b9f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40040fd660 0x7f400410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4009b9f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400410da70 con 0x7f40040fc390 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4009b9f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400410e290 con 0x7f40040fd660 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f400410cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f400410cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45928/0 (socket says 172.21.15.66:45928) 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 -- 172.21.15.66:0/3057232574 learned_addr learned my addr 172.21.15.66:0/3057232574 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4003fff640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40040fd660 0x7f400410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 -- 172.21.15.66:0/3057232574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40040fd660 msgr2=0x7f400410d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40040fd660 0x7f400410d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 -- 172.21.15.66:0/3057232574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8005040 con 0x7f40040fc390 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.096+0000 7f4008b9d640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f400410cee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80043d0 tx=0x7f3ff8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.097+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ff8038070 con 0x7f40040fc390 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.097+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ff802ae90 con 0x7f40040fc390 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.097+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400410e4c0 con 0x7f40040fc390 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.097+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ff803e670 con 0x7f40040fc390 2024-09-12T01:45:49.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.097+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400410ea60 con 0x7f40040fc390 2024-09-12T01:45:49.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.098+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400405ed70 con 0x7f40040fc390 2024-09-12T01:45:49.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.098+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f3ff8030020 con 0x7f40040fc390 2024-09-12T01:45:49.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.099+0000 7f40017fa640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3ff406dad0 0x7f3ff406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.099+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3ff80ad5c0 con 0x7f40040fc390 2024-09-12T01:45:49.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.099+0000 7f4003fff640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3ff406dad0 0x7f3ff406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.099+0000 7f4003fff640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3ff406dad0 0x7f3ff406ff80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f400410cc90 tx=0x7f3ff000b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:49.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.103+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3ff80770e0 con 0x7f40040fc390 2024-09-12T01:45:49.280 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:49 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:49.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.296+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f400410ed90 con 0x7f3ff406dad0 2024-09-12T01:45:49.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.297+0000 7f40017fa640 1 -- 172.21.15.66:0/3057232574 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f400410ed90 con 0x7f3ff406dad0 2024-09-12T01:45:49.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3ff406dad0 msgr2=0x7f3ff406ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3ff406dad0 0x7f3ff406ff80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f400410cc90 tx=0x7f3ff000b040 comp rx=0 tx=0).stop 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 msgr2=0x7f400410cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f400410cee0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80043d0 tx=0x7f3ff8009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 shutdown_connections 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f3ff406dad0 0x7f3ff406ff80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40040fd660 0x7f400410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 --2- 172.21.15.66:0/3057232574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40040fc390 0x7f400410cee0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 >> 172.21.15.66:0/3057232574 conn(0x7f40040f7b70 msgr2=0x7f40040f9310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 shutdown_connections 2024-09-12T01:45:49.300 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.299+0000 7f4009b9f640 1 -- 172.21.15.66:0/3057232574 wait complete. 2024-09-12T01:45:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 -- 172.21.15.66:0/3286647897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f980ff720 msgr2=0x7f7f98101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 --2- 172.21.15.66:0/3286647897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f980ff720 0x7f7f98101b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7f880048d0 tx=0x7f7f88009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 -- 172.21.15.66:0/3286647897 shutdown_connections 2024-09-12T01:45:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 --2- 172.21.15.66:0/3286647897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f980ff720 0x7f7f98101b00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 --2- 172.21.15.66:0/3286647897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f98065ba0 0x7f7f980ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 -- 172.21.15.66:0/3286647897 >> 172.21.15.66:0/3286647897 conn(0x7f7f980f6c10 msgr2=0x7f7f980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 -- 172.21.15.66:0/3286647897 shutdown_connections 2024-09-12T01:45:49.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.387+0000 7f7f9f674640 1 -- 172.21.15.66:0/3286647897 wait complete. 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9f674640 1 Processor -- start 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9f674640 1 -- start start 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9f674640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 0x7f7f9810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9f674640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f980ff720 0x7f7f9810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9f674640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9810dc10 con 0x7f7f98065ba0 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9f674640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9810e430 con 0x7f7f980ff720 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9d410640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 0x7f7f9810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9d410640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 0x7f7f9810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45950/0 (socket says 172.21.15.66:45950) 2024-09-12T01:45:49.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9d410640 1 -- 172.21.15.66:0/2430719766 learned_addr learned my addr 172.21.15.66:0/2430719766 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9cc0f640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f980ff720 0x7f7f9810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9d410640 1 -- 172.21.15.66:0/2430719766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f980ff720 msgr2=0x7f7f9810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9d410640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f980ff720 0x7f7f9810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.388+0000 7f7f9d410640 1 -- 172.21.15.66:0/2430719766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88005040 con 0x7f7f98065ba0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.389+0000 7f7f9d410640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 0x7f7f9810d080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7f94002a80 tx=0x7f7f94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.389+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f94007c30 con 0x7f7f98065ba0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.389+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f9400f040 con 0x7f7f98065ba0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.389+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9810e6c0 con 0x7f7f98065ba0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.389+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9400db10 con 0x7f7f98065ba0 2024-09-12T01:45:49.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.389+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9810eb90 con 0x7f7f98065ba0 2024-09-12T01:45:49.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.390+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980fa890 con 0x7f7f98065ba0 2024-09-12T01:45:49.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.391+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7f7f9400dc70 con 0x7f7f98065ba0 2024-09-12T01:45:49.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.391+0000 7f7f8dffb640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f8406dae0 0x7f7f8406ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.392+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7f9408d270 con 0x7f7f98065ba0 2024-09-12T01:45:49.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.392+0000 7f7f9cc0f640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f8406dae0 0x7f7f8406ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.392+0000 7f7f9cc0f640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f8406dae0 0x7f7f8406ff90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f9810ce30 tx=0x7f7f88035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:49.396 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.396+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7f94056bd0 con 0x7f7f98065ba0 2024-09-12T01:45:49.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:49 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:45:49.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.609+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f9810ef70 con 0x7f7f8406dae0 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.619+0000 7f7f8dffb640 1 -- 172.21.15.66:0/2430719766 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7f9810ef70 con 0x7f7f8406dae0 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (2m) 10s ago 10m 27.9M - 0.25.0 c8568f914cd2 853e1519bd6e 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (10m) 10s ago 10m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (9m) 28s ago 9m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (2m) 10s ago 10m 80.5M - 9.4.7 954c08fa6188 ae3a15d0872d 2024-09-12T01:45:49.619 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (5m) 10s ago 5m 12.7M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (4m) 10s ago 4m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (4m) 28s ago 4m 15.9M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (5m) 28s ago 5m 15.1M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (98s) 10s ago 11m 495M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (46s) 28s ago 9m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (11m) 10s ago 11m 58.9M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (9m) 28s ago 9m 44.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:45:49.620 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (35s) 10s ago 10m 8070k - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (32s) 28s ago 9m 3581k - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (8m) 10s ago 8m 247M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (8m) 10s ago 8m 258M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (7m) 10s ago 7m 213M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (7m) 28s ago 7m 274M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (7m) 28s ago 6m 251M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (6m) 28s ago 6m 229M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:45:49.621 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (15s) 10s ago 9m 42.7M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:45:49.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f8406dae0 msgr2=0x7f7f8406ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f8406dae0 0x7f7f8406ff90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7f9810ce30 tx=0x7f7f88035040 comp rx=0 tx=0).stop 2024-09-12T01:45:49.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 msgr2=0x7f7f9810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.622 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 0x7f7f9810d080 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7f94002a80 tx=0x7f7f94004600 comp rx=0 tx=0).stop 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 shutdown_connections 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f8406dae0 0x7f7f8406ff90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f980ff720 0x7f7f9810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 --2- 172.21.15.66:0/2430719766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f98065ba0 0x7f7f9810d080 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 >> 172.21.15.66:0/2430719766 conn(0x7f7f980f6c10 msgr2=0x7f7f980f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 shutdown_connections 2024-09-12T01:45:49.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.621+0000 7f7f9f674640 1 -- 172.21.15.66:0/2430719766 wait complete. 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 -- 172.21.15.66:0/3168609571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fb430 msgr2=0x7ff8640fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/3168609571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fb430 0x7ff8640fb840 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff8600048d0 tx=0x7ff860009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 -- 172.21.15.66:0/3168609571 shutdown_connections 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/3168609571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8640fc700 0x7ff8640fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/3168609571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fb430 0x7ff8640fb840 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 -- 172.21.15.66:0/3168609571 >> 172.21.15.66:0/3168609571 conn(0x7ff8640f6c10 msgr2=0x7ff8640f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 -- 172.21.15.66:0/3168609571 shutdown_connections 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 -- 172.21.15.66:0/3168609571 wait complete. 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 Processor -- start 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.704+0000 7ff86c6bd640 1 -- start start 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff86c6bd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8640fb430 0x7ff8640ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff86c6bd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 0x7ff8640fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff86c6bd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640fdfd0 con 0x7ff8640fc700 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff86c6bd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8640fe110 con 0x7ff8640fb430 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 0x7ff8640fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 0x7ff8640fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45962/0 (socket says 172.21.15.66:45962) 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 -- 172.21.15.66:0/1109140432 learned_addr learned my addr 172.21.15.66:0/1109140432 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:49.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff86a459640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8640fb430 0x7ff8640ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 -- 172.21.15.66:0/1109140432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8640fb430 msgr2=0x7ff8640ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8640fb430 0x7ff8640ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 -- 172.21.15.66:0/1109140432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860005040 con 0x7ff8640fc700 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff869c58640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 0x7ff8640fda40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff854002a80 tx=0x7ff854004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff854007c30 con 0x7ff8640fc700 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8640fe3f0 con 0x7ff8640fc700 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff85400f040 con 0x7ff8640fc700 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.705+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff854009530 con 0x7ff8640fc700 2024-09-12T01:45:49.708 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.706+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8641150b0 con 0x7ff8640fc700 2024-09-12T01:45:49.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.707+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8640fa890 con 0x7ff8640fc700 2024-09-12T01:45:49.709 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.707+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7ff8540097a0 con 0x7ff8640fc700 2024-09-12T01:45:49.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.708+0000 7ff85affd640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff85006dae0 0x7ff85006ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:49.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.708+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff85408cec0 con 0x7ff8640fc700 2024-09-12T01:45:49.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.708+0000 7ff86a459640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff85006dae0 0x7ff85006ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:49.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.709+0000 7ff86a459640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff85006dae0 0x7ff85006ff90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff860007ac0 tx=0x7ff860035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:49.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.713+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff854056820 con 0x7ff8640fc700 2024-09-12T01:45:49.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.961+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff86404b720 con 0x7ff8640fc700 2024-09-12T01:45:49.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.962+0000 7ff85affd640 1 -- 172.21.15.66:0/1109140432 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7ff854059ee0 con 0x7ff8640fc700 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:49.963 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 12, 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:45:49.964 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff85006dae0 msgr2=0x7ff85006ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff85006dae0 0x7ff85006ff90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff860007ac0 tx=0x7ff860035040 comp rx=0 tx=0).stop 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 msgr2=0x7ff8640fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 0x7ff8640fda40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff854002a80 tx=0x7ff854004600 comp rx=0 tx=0).stop 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 shutdown_connections 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff85006dae0 0x7ff85006ff90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8640fc700 0x7ff8640fda40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 --2- 172.21.15.66:0/1109140432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8640fb430 0x7ff8640ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 >> 172.21.15.66:0/1109140432 conn(0x7ff8640f6c10 msgr2=0x7ff864065620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 shutdown_connections 2024-09-12T01:45:49.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:49.964+0000 7ff86c6bd640 1 -- 172.21.15.66:0/1109140432 wait complete. 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 -- 172.21.15.66:0/867939780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 msgr2=0x7fd10c0fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 --2- 172.21.15.66:0/867939780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fcb80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40048d0 tx=0x7fd0f4009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 -- 172.21.15.66:0/867939780 shutdown_connections 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 --2- 172.21.15.66:0/867939780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fcb80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 --2- 172.21.15.66:0/867939780 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 0x7fd10c0fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 -- 172.21.15.66:0/867939780 >> 172.21.15.66:0/867939780 conn(0x7fd10c0f6c20 msgr2=0x7fd10c0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.046+0000 7fd110b42640 1 -- 172.21.15.66:0/867939780 shutdown_connections 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 -- 172.21.15.66:0/867939780 wait complete. 2024-09-12T01:45:50.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 Processor -- start 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 -- start start 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 0x7fd10c0ff560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0fdfe0 con 0x7fd10c0fc710 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd110b42640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0fe120 con 0x7fd10c0fb440 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd109d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd109d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45984/0 (socket says 172.21.15.66:45984) 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd109d9b640 1 -- 172.21.15.66:0/2914523868 learned_addr learned my addr 172.21.15.66:0/2914523868 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.047+0000 7fd10a59c640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 0x7fd10c0ff560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd109d9b640 1 -- 172.21.15.66:0/2914523868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 msgr2=0x7fd10c0ff560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:50.050 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd109d9b640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 0x7fd10c0ff560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd109d9b640 1 -- 172.21.15.66:0/2914523868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4005040 con 0x7fd10c0fc710 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd10a59c640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 0x7fd10c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd109d9b640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fda50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000c00 tx=0x7fd0f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f4038070 con 0x7fd10c0fc710 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0f402ae90 con 0x7fd10c0fc710 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c0fe3a0 con 0x7fd10c0fc710 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0f403d420 con 0x7fd10c0fc710 2024-09-12T01:45:50.051 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.048+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c115170 con 0x7fd10c0fc710 2024-09-12T01:45:50.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.049+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0fa8a0 con 0x7fd10c0fc710 2024-09-12T01:45:50.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.050+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 32) v1 ==== 92027+0+0 (secure 0 0 0) 0x7fd0f4030020 con 0x7fd10c0fc710 2024-09-12T01:45:50.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.051+0000 7fd102ffd640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd0f806dae0 0x7fd0f806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:50.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.051+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd0f40adb50 con 0x7fd10c0fc710 2024-09-12T01:45:50.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.051+0000 7fd10a59c640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd0f806dae0 0x7fd0f806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:50.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.051+0000 7fd10a59c640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd0f806dae0 0x7fd0f806ff90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004550 tx=0x7fd0fc009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:50.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.055+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd0f40775a0 con 0x7fd10c0fc710 2024-09-12T01:45:50.241 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:50 smithi066 ceph-mon[27875]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:50.241 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:50 smithi066 ceph-mon[27875]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:50.241 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:50 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1109140432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:50.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.256+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd10c103f70 con 0x7fd0f806dae0 2024-09-12T01:45:50.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.257+0000 7fd102ffd640 1 -- 172.21.15.66:0/2914523868 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd10c103f70 con 0x7fd0f806dae0 2024-09-12T01:45:50.257 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:45:50.257 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr" 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "2/2 daemons upgraded", 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:45:50.258 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:45:50.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd0f806dae0 msgr2=0x7fd0f806ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd0f806dae0 0x7fd0f806ff90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc004550 tx=0x7fd0fc009040 comp rx=0 tx=0).stop 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 msgr2=0x7fd10c0fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fda50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4000c00 tx=0x7fd0f4009da0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 shutdown_connections 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd0f806dae0 0x7fd0f806ff90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd10c0fc710 0x7fd10c0fda50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 --2- 172.21.15.66:0/2914523868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd10c0fb440 0x7fd10c0ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 >> 172.21.15.66:0/2914523868 conn(0x7fd10c0f6c20 msgr2=0x7fd10c0660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 shutdown_connections 2024-09-12T01:45:50.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:45:50.259+0000 7fd110b42640 1 -- 172.21.15.66:0/2914523868 wait complete. 2024-09-12T01:45:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:50 smithi153 ceph-mon[34713]: pgmap v41: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:50 smithi153 ceph-mon[34713]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:50 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1109140432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:45:51.296 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:51 smithi066 ceph-mon[27875]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:51.297 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:51 smithi066 ceph-mon[27875]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:51.297 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:51 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:51.297 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:51 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:51.297 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:51 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:51.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:51 smithi153 ceph-mon[34713]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:51.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:51 smithi153 ceph-mon[34713]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:51.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:51 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:51.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:51 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:51.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:51 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:45:52.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:52 smithi066 ceph-mon[27875]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:52.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:52 smithi066 ceph-mon[27875]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:52 smithi153 ceph-mon[34713]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:45:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:52 smithi153 ceph-mon[34713]: pgmap v42: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:54 smithi066 ceph-mon[27875]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:54.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:54 smithi153 ceph-mon[34713]: pgmap v43: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:56.348 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:56 smithi066 ceph-mon[27875]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:56.348 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:56 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.348 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:56 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.348 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:56 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.348 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:56 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:56 smithi153 ceph-mon[34713]: pgmap v44: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:56.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:56 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:56 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:56 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:56.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:56 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:45:58.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:45:58 smithi066 ceph-mon[27875]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:45:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:45:58 smithi153 ceph-mon[34713]: pgmap v45: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:00.259 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:00.259 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:00.259 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.260 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.261 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:00 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: pgmap v46: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:46:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:00 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:01.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:01 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:46:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:01 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-12T01:46:02.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:02 smithi066 ceph-mon[27875]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:02.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:02 smithi066 ceph-mon[27875]: Upgrade: Updating grafana.smithi066 2024-09-12T01:46:02.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:02 smithi066 ceph-mon[27875]: Deploying daemon grafana.smithi066 on smithi066 2024-09-12T01:46:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:02 smithi153 ceph-mon[34713]: pgmap v47: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:02.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:02 smithi153 ceph-mon[34713]: Upgrade: Updating grafana.smithi066 2024-09-12T01:46:02.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:02 smithi153 ceph-mon[34713]: Deploying daemon grafana.smithi066 on smithi066 2024-09-12T01:46:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:04 smithi066 ceph-mon[27875]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:04 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:04 smithi153 ceph-mon[34713]: pgmap v48: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:04 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:06 smithi066 ceph-mon[27875]: pgmap v49: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:06 smithi066 ceph-mon[27875]: mgrmap e33: smithi066.qdwcrh(active, since 92s), standbys: smithi153.jpnqza 2024-09-12T01:46:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:06 smithi153 ceph-mon[34713]: pgmap v49: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:06 smithi153 ceph-mon[34713]: mgrmap e33: smithi066.qdwcrh(active, since 92s), standbys: smithi153.jpnqza 2024-09-12T01:46:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:08 smithi066 ceph-mon[27875]: pgmap v50: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:08 smithi153 ceph-mon[34713]: pgmap v50: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:10 smithi066 ceph-mon[27875]: pgmap v51: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:10.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:10 smithi153 ceph-mon[34713]: pgmap v51: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:12.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:12 smithi066 ceph-mon[27875]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:12.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:12 smithi153 ceph-mon[34713]: pgmap v52: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:14 smithi066 ceph-mon[27875]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:14 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:14 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:14 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:14 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:14 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:14 smithi153 ceph-mon[34713]: pgmap v53: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:14 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:14 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:14 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:14 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:14 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:16.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:16 smithi066 ceph-mon[27875]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:16.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:16 smithi153 ceph-mon[34713]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:46:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:18 smithi066 ceph-mon[27875]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:18 smithi153 ceph-mon[34713]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:19 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:19 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:19 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:19 smithi066 ceph-mon[27875]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:19 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:19 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:19 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:19 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:19 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:19.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:19 smithi153 ceph-mon[34713]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:19.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:19 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:19.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:19 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 -- 172.21.15.66:0/3004883353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 msgr2=0x7f78bc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 --2- 172.21.15.66:0/3004883353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc0fcb70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f78a40048d0 tx=0x7f78a4009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 -- 172.21.15.66:0/3004883353 shutdown_connections 2024-09-12T01:46:20.349 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 --2- 172.21.15.66:0/3004883353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc0fcb70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 --2- 172.21.15.66:0/3004883353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78bc0fb430 0x7f78bc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 -- 172.21.15.66:0/3004883353 >> 172.21.15.66:0/3004883353 conn(0x7f78bc0f6c10 msgr2=0x7f78bc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 -- 172.21.15.66:0/3004883353 shutdown_connections 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 -- 172.21.15.66:0/3004883353 wait complete. 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 Processor -- start 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.346+0000 7f78c16f9640 1 -- start start 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78c16f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78bc0fb430 0x7f78bc10fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78c16f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc1122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78c16f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc065c60 con 0x7f78bc0fc700 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78c16f9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc065dd0 con 0x7f78bc0fb430 2024-09-12T01:46:20.350 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc1122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc1122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51584/0 (socket says 172.21.15.66:51584) 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 -- 172.21.15.66:0/1173917317 learned_addr learned my addr 172.21.15.66:0/1173917317 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78baffd640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78bc0fb430 0x7f78bc10fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 -- 172.21.15.66:0/1173917317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78bc0fb430 msgr2=0x7f78bc10fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78bc0fb430 0x7f78bc10fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 -- 172.21.15.66:0/1173917317 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4005040 con 0x7f78bc0fc700 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.347+0000 7f78b3fff640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc1122d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f78a4003080 tx=0x7f78a4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.348+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a4038070 con 0x7f78bc0fc700 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.348+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc112810 con 0x7f78bc0fc700 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.348+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78a4009800 con 0x7f78bc0fc700 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.348+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78a4033660 con 0x7f78bc0fc700 2024-09-12T01:46:20.351 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.348+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc112d20 con 0x7f78bc0fc700 2024-09-12T01:46:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.349+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0fa890 con 0x7f78bc0fc700 2024-09-12T01:46:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.349+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f78a4030020 con 0x7f78bc0fc700 2024-09-12T01:46:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.350+0000 7f78b37fe640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f78a806d9b0 0x7f78a806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.350+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f78a40ad380 con 0x7f78bc0fc700 2024-09-12T01:46:20.352 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.350+0000 7f78baffd640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f78a806d9b0 0x7f78a806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.353 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.350+0000 7f78baffd640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f78a806d9b0 0x7f78a806fe60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0041d0 tx=0x7f78ac009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.354+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f78a4076f00 con 0x7f78bc0fc700 2024-09-12T01:46:20.547 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.546+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f78bc100bb0 con 0x7f78a806d9b0 2024-09-12T01:46:20.548 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.547+0000 7f78b37fe640 1 -- 172.21.15.66:0/1173917317 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f78bc100bb0 con 0x7f78a806d9b0 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f78a806d9b0 msgr2=0x7f78a806fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f78a806d9b0 0x7f78a806fe60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78ac0041d0 tx=0x7f78ac009040 comp rx=0 tx=0).stop 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 msgr2=0x7f78bc1122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc1122d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f78a4003080 tx=0x7f78a4009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 shutdown_connections 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f78a806d9b0 0x7f78a806fe60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78bc0fc700 0x7f78bc1122d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 --2- 172.21.15.66:0/1173917317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78bc0fb430 0x7f78bc10fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.549+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 >> 172.21.15.66:0/1173917317 conn(0x7f78bc0f6c10 msgr2=0x7f78bc0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.550+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 shutdown_connections 2024-09-12T01:46:20.551 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.550+0000 7f78c16f9640 1 -- 172.21.15.66:0/1173917317 wait complete. 2024-09-12T01:46:20.560 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:46:20.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 -- 172.21.15.66:0/3681296529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 msgr2=0x7fe3040fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3681296529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe3040fdc80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0048d0 tx=0x7fe2ec009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 -- 172.21.15.66:0/3681296529 shutdown_connections 2024-09-12T01:46:20.647 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3681296529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe3040fdc80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3681296529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3040fc540 0x7fe3040fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 -- 172.21.15.66:0/3681296529 >> 172.21.15.66:0/3681296529 conn(0x7fe3040f7d00 msgr2=0x7fe3040fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 -- 172.21.15.66:0/3681296529 shutdown_connections 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.645+0000 7fe308ffb640 1 -- 172.21.15.66:0/3681296529 wait complete. 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe308ffb640 1 Processor -- start 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe308ffb640 1 -- start start 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe308ffb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3040fc540 0x7fe30410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe308ffb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe30410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe308ffb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30410dc40 con 0x7fe3040fd810 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe308ffb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30410e410 con 0x7fe3040fc540 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe2fbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe30410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe2fbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe30410d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51592/0 (socket says 172.21.15.66:51592) 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe2fbfff640 1 -- 172.21.15.66:0/3991804751 learned_addr learned my addr 172.21.15.66:0/3991804751 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:20.648 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe30259c640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3040fc540 0x7fe30410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe2fbfff640 1 -- 172.21.15.66:0/3991804751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3040fc540 msgr2=0x7fe30410d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.649 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe2fbfff640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3040fc540 0x7fe30410d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.646+0000 7fe2fbfff640 1 -- 172.21.15.66:0/3991804751 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec005040 con 0x7fe3040fd810 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.647+0000 7fe2fbfff640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe30410d5f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0043d0 tx=0x7fe2ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.647+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec038070 con 0x7fe3040fd810 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.647+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe2ec009800 con 0x7fe3040fd810 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.647+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30410e640 con 0x7fe3040fd810 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.647+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2ec03e670 con 0x7fe3040fd810 2024-09-12T01:46:20.650 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.647+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30410ebe0 con 0x7fe3040fd810 2024-09-12T01:46:20.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.649+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3040fb9a0 con 0x7fe3040fd810 2024-09-12T01:46:20.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.649+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fe2ec030020 con 0x7fe3040fd810 2024-09-12T01:46:20.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.650+0000 7fe2faffd640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe2f006d9b0 0x7fe2f006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.650+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe2ec0ace90 con 0x7fe3040fd810 2024-09-12T01:46:20.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.650+0000 7fe30259c640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe2f006d9b0 0x7fe2f006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.650+0000 7fe30259c640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe2f006d9b0 0x7fe2f006fe60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4007fd0 tx=0x7fe2f4009e90 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.655 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.654+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe2ec076a10 con 0x7fe3040fd810 2024-09-12T01:46:20.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.845+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe30410eea0 con 0x7fe2f006d9b0 2024-09-12T01:46:20.847 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.846+0000 7fe2faffd640 1 -- 172.21.15.66:0/3991804751 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7fe30410eea0 con 0x7fe2f006d9b0 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe2f006d9b0 msgr2=0x7fe2f006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe2f006d9b0 0x7fe2f006fe60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4007fd0 tx=0x7fe2f4009e90 comp rx=0 tx=0).stop 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 msgr2=0x7fe30410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe30410d5f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0043d0 tx=0x7fe2ec009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 shutdown_connections 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe2f006d9b0 0x7fe2f006fe60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3040fd810 0x7fe30410d5f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 --2- 172.21.15.66:0/3991804751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3040fc540 0x7fe30410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 >> 172.21.15.66:0/3991804751 conn(0x7fe3040f7d00 msgr2=0x7fe3040f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 shutdown_connections 2024-09-12T01:46:20.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.849+0000 7fe308ffb640 1 -- 172.21.15.66:0/3991804751 wait complete. 2024-09-12T01:46:20.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 -- 172.21.15.66:0/3825872552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 msgr2=0x7f9b880fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/3825872552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b880fc970 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9b780048d0 tx=0x7f9b78009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.933 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 -- 172.21.15.66:0/3825872552 shutdown_connections 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/3825872552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 0x7f9b880fdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/3825872552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b880fc970 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 -- 172.21.15.66:0/3825872552 >> 172.21.15.66:0/3825872552 conn(0x7f9b880f7d40 msgr2=0x7f9b880fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 -- 172.21.15.66:0/3825872552 shutdown_connections 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.930+0000 7f9b8d83b640 1 -- 172.21.15.66:0/3825872552 wait complete. 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b8d83b640 1 Processor -- start 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b8d83b640 1 -- start start 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b8d83b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b8810f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b8d83b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 0x7f9b8810f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b8d83b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8810fde0 con 0x7f9b880fc560 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b8d83b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88110600 con 0x7f9b880fd830 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b86ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b8810f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b86ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b8810f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51612/0 (socket says 172.21.15.66:51612) 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.931+0000 7f9b86ffd640 1 -- 172.21.15.66:0/2665905228 learned_addr learned my addr 172.21.15.66:0/2665905228 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b867fc640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 0x7f9b8810f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b86ffd640 1 -- 172.21.15.66:0/2665905228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 msgr2=0x7f9b8810f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b86ffd640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 0x7f9b8810f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b86ffd640 1 -- 172.21.15.66:0/2665905228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78005040 con 0x7f9b880fc560 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b867fc640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 0x7f9b8810f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b86ffd640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b8810f250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9b780043d0 tx=0x7f9b78009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b78038070 con 0x7f9b880fc560 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9b7802ae90 con 0x7f9b880fc560 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88110830 con 0x7f9b880fc560 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b7803e670 con 0x7f9b880fc560 2024-09-12T01:46:20.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.932+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88110dd0 con 0x7f9b880fc560 2024-09-12T01:46:20.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.933+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b880fb9c0 con 0x7f9b880fc560 2024-09-12T01:46:20.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.934+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f9b78030020 con 0x7f9b880fc560 2024-09-12T01:46:20.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.934+0000 7f9b7f7fe640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f9b7406d9b0 0x7f9b7406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:20.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.934+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f9b780ad4a0 con 0x7f9b880fc560 2024-09-12T01:46:20.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.934+0000 7f9b867fc640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f9b7406d9b0 0x7f9b7406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:20.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.935+0000 7f9b867fc640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f9b7406d9b0 0x7f9b7406fe60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009fd0 tx=0x7f9b70009e50 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:20.940 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:20.939+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f9b78077020 con 0x7f9b880fc560 2024-09-12T01:46:21.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.123+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b881050c0 con 0x7f9b7406d9b0 2024-09-12T01:46:21.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.133+0000 7f9b7f7fe640 1 -- 172.21.15.66:0/2665905228 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9b881050c0 con 0x7f9b7406d9b0 2024-09-12T01:46:21.134 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:46:21.134 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (31s) 2s ago 10m 16.4M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:46:21.134 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (11m) 2s ago 11m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:46:21.134 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (10m) 60s ago 10m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (9s) 2s ago 10m 45.5M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (5m) 2s ago 5m 12.8M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (5m) 2s ago 5m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (5m) 60s ago 5m 15.9M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (5m) 60s ago 5m 15.1M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (2m) 2s ago 12m 503M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (78s) 60s ago 10m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (12m) 2s ago 12m 59.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (9m) 60s ago 9m 44.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (67s) 2s ago 11m 12.6M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (63s) 60s ago 10m 3581k - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (9m) 2s ago 9m 247M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (8m) 2s ago 8m 259M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:46:21.135 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (8m) 2s ago 8m 214M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:46:21.136 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (7m) 60s ago 7m 274M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:46:21.136 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (7m) 60s ago 7m 251M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:46:21.136 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (7m) 60s ago 7m 229M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:46:21.136 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (47s) 2s ago 10m 49.2M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:46:21.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f9b7406d9b0 msgr2=0x7f9b7406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f9b7406d9b0 0x7f9b7406fe60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009fd0 tx=0x7f9b70009e50 comp rx=0 tx=0).stop 2024-09-12T01:46:21.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 msgr2=0x7f9b8810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b8810f250 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9b780043d0 tx=0x7f9b78009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 shutdown_connections 2024-09-12T01:46:21.137 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f9b7406d9b0 0x7f9b7406fe60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b880fd830 0x7f9b8810f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 --2- 172.21.15.66:0/2665905228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b880fc560 0x7f9b8810f250 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 >> 172.21.15.66:0/2665905228 conn(0x7f9b880f7d40 msgr2=0x7f9b880f94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:21.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 shutdown_connections 2024-09-12T01:46:21.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.136+0000 7f9b8d83b640 1 -- 172.21.15.66:0/2665905228 wait complete. 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 -- 172.21.15.66:0/4254917342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 msgr2=0x7fe1440fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/4254917342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe1440fb840 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe134009c50 tx=0x7fe134004d10 comp rx=0 tx=0).stop 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 -- 172.21.15.66:0/4254917342 shutdown_connections 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/4254917342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 0x7fe1440fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/4254917342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe1440fb840 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 -- 172.21.15.66:0/4254917342 >> 172.21.15.66:0/4254917342 conn(0x7fe1440f6c10 msgr2=0x7fe1440f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 -- 172.21.15.66:0/4254917342 shutdown_connections 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 -- 172.21.15.66:0/4254917342 wait complete. 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.218+0000 7fe14a0f9640 1 Processor -- start 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe14a0f9640 1 -- start start 2024-09-12T01:46:21.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe14a0f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe14410fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:21.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe14a0f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 0x7fe144112370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:21.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe14a0f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144065cf0 con 0x7fe1440fb430 2024-09-12T01:46:21.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe14a0f9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe144065e60 con 0x7fe1440fc700 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe14410fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe1437fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe14410fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51632/0 (socket says 172.21.15.66:51632) 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe1437fe640 1 -- 172.21.15.66:0/199121346 learned_addr learned my addr 172.21.15.66:0/199121346 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe142ffd640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 0x7fe144112370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe1437fe640 1 -- 172.21.15.66:0/199121346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 msgr2=0x7fe144112370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe1437fe640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 0x7fe144112370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe1437fe640 1 -- 172.21.15.66:0/199121346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340098b0 con 0x7fe1440fb430 2024-09-12T01:46:21.222 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.219+0000 7fe142ffd640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 0x7fe144112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.220+0000 7fe1437fe640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe14410fe20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe134004a30 tx=0x7fe134004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.220+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe134032670 con 0x7fe1440fb430 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.220+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe134032c70 con 0x7fe1440fb430 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.220+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe144112970 con 0x7fe1440fb430 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.220+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe13403dbc0 con 0x7fe1440fb430 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.220+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe144112e90 con 0x7fe1440fb430 2024-09-12T01:46:21.223 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.221+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1440fa890 con 0x7fe1440fb430 2024-09-12T01:46:21.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.221+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fe13402f030 con 0x7fe1440fb430 2024-09-12T01:46:21.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.222+0000 7fe13bfff640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe13006d9b0 0x7fe13006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:21.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.222+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe1340ae880 con 0x7fe1440fb430 2024-09-12T01:46:21.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.222+0000 7fe142ffd640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe13006d9b0 0x7fe13006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:21.224 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.223+0000 7fe142ffd640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe13006d9b0 0x7fe13006fe60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009a80 tx=0x7fe12c008040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:21.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.227+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe134078480 con 0x7fe1440fb430 2024-09-12T01:46:21.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.477+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe144103eb0 con 0x7fe1440fb430 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.478+0000 7fe13bfff640 1 -- 172.21.15.66:0/199121346 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fe13407bb40 con 0x7fe1440fb430 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:46:21.479 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 12, 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:46:21.480 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:46:21.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe13006d9b0 msgr2=0x7fe13006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe13006d9b0 0x7fe13006fe60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009a80 tx=0x7fe12c008040 comp rx=0 tx=0).stop 2024-09-12T01:46:21.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 msgr2=0x7fe14410fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe14410fe20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe134004a30 tx=0x7fe134004d10 comp rx=0 tx=0).stop 2024-09-12T01:46:21.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 shutdown_connections 2024-09-12T01:46:21.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe13006d9b0 0x7fe13006fe60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1440fc700 0x7fe144112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 --2- 172.21.15.66:0/199121346 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1440fb430 0x7fe14410fe20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 >> 172.21.15.66:0/199121346 conn(0x7fe1440f6c10 msgr2=0x7fe1440f83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:21.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 shutdown_connections 2024-09-12T01:46:21.483 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.481+0000 7fe14a0f9640 1 -- 172.21.15.66:0/199121346 wait complete. 2024-09-12T01:46:21.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2419535219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 msgr2=0x7f4b7c0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.565 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2419535219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c0ff160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0048d0 tx=0x7f4b6c009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2419535219 shutdown_connections 2024-09-12T01:46:21.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2419535219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b7c0ff6a0 0x7f4b7c101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2419535219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c0ff160 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2419535219 >> 172.21.15.66:0/2419535219 conn(0x7f4b7c0f6c10 msgr2=0x7f4b7c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:21.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2419535219 shutdown_connections 2024-09-12T01:46:21.566 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.564+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2419535219 wait complete. 2024-09-12T01:46:21.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b80cc1640 1 Processor -- start 2024-09-12T01:46:21.567 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b80cc1640 1 -- start start 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b80cc1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c10f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b80cc1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b7c0ff6a0 0x7f4b7c10f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b80cc1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c10fea0 con 0x7f4b7c066790 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b80cc1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c110670 con 0x7f4b7c0ff6a0 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b7a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c10f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b7a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c10f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51654/0 (socket says 172.21.15.66:51654) 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b7a59c640 1 -- 172.21.15.66:0/2845075419 learned_addr learned my addr 172.21.15.66:0/2845075419 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b79d9b640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b7c0ff6a0 0x7f4b7c10f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b7a59c640 1 -- 172.21.15.66:0/2845075419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b7c0ff6a0 msgr2=0x7f4b7c10f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b7a59c640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b7c0ff6a0 0x7f4b7c10f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.565+0000 7f4b7a59c640 1 -- 172.21.15.66:0/2845075419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c005040 con 0x7f4b7c066790 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.566+0000 7f4b7a59c640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c10f310 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0043d0 tx=0x7f4b6c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:21.568 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.566+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6c038070 con 0x7f4b7c066790 2024-09-12T01:46:21.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.566+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b6c02ae90 con 0x7f4b7c066790 2024-09-12T01:46:21.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.566+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c1108a0 con 0x7f4b7c066790 2024-09-12T01:46:21.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.566+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c110e40 con 0x7f4b7c066790 2024-09-12T01:46:21.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.566+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b6c03e670 con 0x7f4b7c066790 2024-09-12T01:46:21.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.567+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c0fa8b0 con 0x7f4b7c066790 2024-09-12T01:46:21.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.568+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f4b6c030020 con 0x7f4b7c066790 2024-09-12T01:46:21.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.568+0000 7f4b6affd640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f4b6406d9b0 0x7f4b6406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:21.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.568+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f4b6c0ad450 con 0x7f4b7c066790 2024-09-12T01:46:21.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.568+0000 7f4b79d9b640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f4b6406d9b0 0x7f4b6406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:21.570 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.569+0000 7f4b79d9b640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f4b6406d9b0 0x7f4b6406fe60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009fd0 tx=0x7f4b70009e50 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:21.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.573+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4b6c076fd0 con 0x7f4b7c066790 2024-09-12T01:46:21.766 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.765+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b7c1050c0 con 0x7f4b6406d9b0 2024-09-12T01:46:21.767 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.766+0000 7f4b6affd640 1 -- 172.21.15.66:0/2845075419 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f4b7c1050c0 con 0x7f4b6406d9b0 2024-09-12T01:46:21.767 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:46:21.767 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr" 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "2/2 daemons upgraded", 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading grafana daemons", 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:46:21.768 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.768+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f4b6406d9b0 msgr2=0x7f4b6406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.768+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f4b6406d9b0 0x7f4b6406fe60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009fd0 tx=0x7f4b70009e50 comp rx=0 tx=0).stop 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.768+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 msgr2=0x7f4b7c10f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.768+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c10f310 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0043d0 tx=0x7f4b6c009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.768+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 shutdown_connections 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.768+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f4b6406d9b0 0x7f4b6406fe60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.769+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b7c0ff6a0 0x7f4b7c10f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.769+0000 7f4b80cc1640 1 --2- 172.21.15.66:0/2845075419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b7c066790 0x7f4b7c10f310 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:21.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.769+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 >> 172.21.15.66:0/2845075419 conn(0x7f4b7c0f6c10 msgr2=0x7f4b7c0fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:21.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.769+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 shutdown_connections 2024-09-12T01:46:21.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:21.769+0000 7f4b80cc1640 1 -- 172.21.15.66:0/2845075419 wait complete. 2024-09-12T01:46:22.094 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:21 smithi066 ceph-mon[27875]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:22.094 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:21 smithi066 ceph-mon[27875]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:22.095 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:21 smithi066 ceph-mon[27875]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:22.095 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:21 smithi066 ceph-mon[27875]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:22.095 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:21 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/199121346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:21 smithi153 ceph-mon[34713]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:21 smithi153 ceph-mon[34713]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:21 smithi153 ceph-mon[34713]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:21 smithi153 ceph-mon[34713]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:21 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/199121346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-12T01:46:23.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-12T01:46:23.393 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.394 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-12T01:46:23.395 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:22 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:23.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-12T01:46:23.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-12T01:46:23.408 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.409 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-12T01:46:23.410 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:22 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:46:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: Upgrade: Finalizing container_image settings 2024-09-12T01:46:24.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: Upgrade: Complete! 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:24.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:23 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: Upgrade: Finalizing container_image settings 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: Upgrade: Complete! 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:46:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:24.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:23 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:46:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:25 smithi066 ceph-mon[27875]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:25 smithi153 ceph-mon[34713]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:28.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:27 smithi066 ceph-mon[27875]: pgmap v60: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:28.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:27 smithi153 ceph-mon[34713]: pgmap v60: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:29 smithi066 ceph-mon[27875]: pgmap v61: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:29 smithi153 ceph-mon[34713]: pgmap v61: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:32.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:31 smithi066 ceph-mon[27875]: pgmap v62: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:31 smithi153 ceph-mon[34713]: pgmap v62: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:34.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:33 smithi066 ceph-mon[27875]: pgmap v63: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:34.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:33 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:34.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:33 smithi153 ceph-mon[34713]: pgmap v63: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:34.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:33 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:36.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:35 smithi066 ceph-mon[27875]: pgmap v64: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:35 smithi153 ceph-mon[34713]: pgmap v64: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:38.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:37 smithi066 ceph-mon[27875]: pgmap v65: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:38.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:37 smithi153 ceph-mon[34713]: pgmap v65: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:39 smithi066 ceph-mon[27875]: pgmap v66: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:40.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:39 smithi153 ceph-mon[34713]: pgmap v66: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:42.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:41 smithi066 ceph-mon[27875]: pgmap v67: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:42.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:41 smithi153 ceph-mon[34713]: pgmap v67: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:44.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:43 smithi066 ceph-mon[27875]: pgmap v68: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:43 smithi153 ceph-mon[34713]: pgmap v68: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:45 smithi066 ceph-mon[27875]: pgmap v69: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:45 smithi153 ceph-mon[34713]: pgmap v69: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:48.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:47 smithi066 ceph-mon[27875]: pgmap v70: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:48.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:47 smithi153 ceph-mon[34713]: pgmap v70: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:49.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:48 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:49.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:48 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:46:50.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:49 smithi066 ceph-mon[27875]: pgmap v71: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:50.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:49 smithi153 ceph-mon[34713]: pgmap v71: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:51.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 -- 172.21.15.66:0/130542402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 msgr2=0x7f36800ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:51.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 --2- 172.21.15.66:0/130542402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f36800ff210 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f36700048d0 tx=0x7f3670009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:51.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 -- 172.21.15.66:0/130542402 shutdown_connections 2024-09-12T01:46:51.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 --2- 172.21.15.66:0/130542402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36800ff750 0x7f3680101b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:51.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 --2- 172.21.15.66:0/130542402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f36800ff210 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 -- 172.21.15.66:0/130542402 >> 172.21.15.66:0/130542402 conn(0x7f36800f6c40 msgr2=0x7f36800f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 -- 172.21.15.66:0/130542402 shutdown_connections 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.864+0000 7f368632a640 1 -- 172.21.15.66:0/130542402 wait complete. 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.865+0000 7f368632a640 1 Processor -- start 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.865+0000 7f368632a640 1 -- start start 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.865+0000 7f368632a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f368010d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.865+0000 7f368632a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36800ff750 0x7f368010d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.865+0000 7f368632a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368010dd60 con 0x7f3680066690 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.865+0000 7f368632a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368010e530 con 0x7f36800ff750 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f368010d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f368010d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39282/0 (socket says 172.21.15.66:39282) 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 -- 172.21.15.66:0/2608876196 learned_addr learned my addr 172.21.15.66:0/2608876196 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367f7fe640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36800ff750 0x7f368010d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:51.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 -- 172.21.15.66:0/2608876196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36800ff750 msgr2=0x7f368010d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:51.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36800ff750 0x7f368010d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:51.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 -- 172.21.15.66:0/2608876196 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670005040 con 0x7f3680066690 2024-09-12T01:46:51.868 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367ffff640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f368010d1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f36700043d0 tx=0x7f3670009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3670038070 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368010e760 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f367002ae90 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f367003e670 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.866+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f368010ed00 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.867+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36800fa8e0 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.868+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f3670030020 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.869+0000 7f367cff9640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f366806d9b0 0x7f366806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.869+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f36700ad3b0 con 0x7f3680066690 2024-09-12T01:46:51.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.869+0000 7f367f7fe640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f366806d9b0 0x7f366806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:51.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.869+0000 7f367f7fe640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f366806d9b0 0x7f366806fe60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f368010cf80 tx=0x7f367400b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:51.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:51.874+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3670076fe0 con 0x7f3680066690 2024-09-12T01:46:52.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.067+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f368010f0d0 con 0x7f366806d9b0 2024-09-12T01:46:52.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.068+0000 7f367cff9640 1 -- 172.21.15.66:0/2608876196 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f368010f0d0 con 0x7f366806d9b0 2024-09-12T01:46:52.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f366806d9b0 msgr2=0x7f366806fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:52.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f366806d9b0 0x7f366806fe60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f368010cf80 tx=0x7f367400b040 comp rx=0 tx=0).stop 2024-09-12T01:46:52.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 msgr2=0x7f368010d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f368010d1d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f36700043d0 tx=0x7f3670009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 shutdown_connections 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f366806d9b0 0x7f366806fe60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f36800ff750 0x7f368010d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 --2- 172.21.15.66:0/2608876196 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3680066690 0x7f368010d1d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 >> 172.21.15.66:0/2608876196 conn(0x7f36800f6c40 msgr2=0x7f36800f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 shutdown_connections 2024-09-12T01:46:52.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:52.070+0000 7f368632a640 1 -- 172.21.15.66:0/2608876196 wait complete. 2024-09-12T01:46:52.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:51 smithi066 ceph-mon[27875]: pgmap v72: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:52.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:51 smithi153 ceph-mon[34713]: pgmap v72: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:52.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-12T01:46:53.236 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:46:53.358 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:52 smithi066 ceph-mon[27875]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:53.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:53 smithi153 ceph-mon[34713]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:46:54.349 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:54 smithi066 ceph-mon[27875]: pgmap v73: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:54.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:54 smithi153 ceph-mon[34713]: pgmap v73: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:54.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 -- 172.21.15.66:0/47400771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fe100 msgr2=0x7fd7941065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:54.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 --2- 172.21.15.66:0/47400771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fe100 0x7fd7941065a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd7880048d0 tx=0x7fd788009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:54.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 -- 172.21.15.66:0/47400771 shutdown_connections 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 --2- 172.21.15.66:0/47400771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fe100 0x7fd7941065a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 --2- 172.21.15.66:0/47400771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fd760 0x7fd7940fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 -- 172.21.15.66:0/47400771 >> 172.21.15.66:0/47400771 conn(0x7fd7940f7030 msgr2=0x7fd7940f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 -- 172.21.15.66:0/47400771 shutdown_connections 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.881+0000 7fd7991a1640 1 -- 172.21.15.66:0/47400771 wait complete. 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd7991a1640 1 Processor -- start 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd7991a1640 1 -- start start 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd7991a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 0x7fd7941133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd7991a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fe100 0x7fd7941138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd7991a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794113f70 con 0x7fd7940fd760 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd7991a1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79410d320 con 0x7fd7940fe100 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd792d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 0x7fd7941133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd792d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 0x7fd7941133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59722/0 (socket says 172.21.15.66:59722) 2024-09-12T01:46:54.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd792d9d640 1 -- 172.21.15.66:0/1814071068 learned_addr learned my addr 172.21.15.66:0/1814071068 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.882+0000 7fd79259c640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fe100 0x7fd7941138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd792d9d640 1 -- 172.21.15.66:0/1814071068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fe100 msgr2=0x7fd7941138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd792d9d640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fe100 0x7fd7941138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd792d9d640 1 -- 172.21.15.66:0/1814071068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd788005040 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd79259c640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fe100 0x7fd7941138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd792d9d640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 0x7fd7941133a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd78400b790 tx=0x7fd7840091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd78400c700 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd78400cd00 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79410d600 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd784015e70 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.883+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79410daf0 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.884+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7940fac90 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.885+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fd784012070 con 0x7fd7940fd760 2024-09-12T01:46:54.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.885+0000 7fd77b7fe640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd77c06d9b0 0x7fd77c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:54.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.886+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fd78408ce40 con 0x7fd7940fd760 2024-09-12T01:46:54.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.886+0000 7fd79259c640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd77c06d9b0 0x7fd77c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:54.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.886+0000 7fd79259c640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd77c06d9b0 0x7fd77c06fe60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd788000c00 tx=0x7fd788035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:54.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:54.890+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd7840569c0 con 0x7fd7940fd760 2024-09-12T01:46:55.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.132+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd79410ea70 con 0x7fd7940fd760 2024-09-12T01:46:55.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.132+0000 7fd77b7fe640 1 -- 172.21.15.66:0/1814071068 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fd78405a080 con 0x7fd7940fd760 2024-09-12T01:46:55.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd77c06d9b0 msgr2=0x7fd77c06fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd77c06d9b0 0x7fd77c06fe60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd788000c00 tx=0x7fd788035040 comp rx=0 tx=0).stop 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 msgr2=0x7fd7941133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 0x7fd7941133a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd78400b790 tx=0x7fd7840091d0 comp rx=0 tx=0).stop 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 shutdown_connections 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fd77c06d9b0 0x7fd77c06fe60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7940fe100 0x7fd7941138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 --2- 172.21.15.66:0/1814071068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7940fd760 0x7fd7941133a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 >> 172.21.15.66:0/1814071068 conn(0x7fd7940f7030 msgr2=0x7fd7940f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 shutdown_connections 2024-09-12T01:46:55.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:55.135+0000 7fd7991a1640 1 -- 172.21.15.66:0/1814071068 wait complete. 2024-09-12T01:46:55.145 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:46:55.815 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-12T01:46:56.075 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:46:56.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:56 smithi066 ceph-mon[27875]: pgmap v74: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:56.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:56 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1814071068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:56.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:56 smithi153 ceph-mon[34713]: pgmap v74: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:56.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:56 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1814071068' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:57.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 -- 172.21.15.66:0/3916145447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 msgr2=0x7fe6f0102a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:57.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/3916145447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f0102a50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00048d0 tx=0x7fe6e0009da0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 -- 172.21.15.66:0/3916145447 shutdown_connections 2024-09-12T01:46:57.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/3916145447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6f00fabd0 0x7fe6f00fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/3916145447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f0102a50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.696 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 -- 172.21.15.66:0/3916145447 >> 172.21.15.66:0/3916145447 conn(0x7fe6f0071ac0 msgr2=0x7fe6f0071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 -- 172.21.15.66:0/3916145447 shutdown_connections 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.665+0000 7fe6f5e45640 1 -- 172.21.15.66:0/3916145447 wait complete. 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.666+0000 7fe6f5e45640 1 Processor -- start 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.666+0000 7fe6f5e45640 1 -- start start 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6f5e45640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6f00fabd0 0x7fe6f0113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6f5e45640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f01137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6f5e45640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0113dd0 con 0x7fe6f0102680 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6f5e45640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f010d210 con 0x7fe6f00fabd0 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f01137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f01137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59738/0 (socket says 172.21.15.66:59738) 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 -- 172.21.15.66:0/2476826611 learned_addr learned my addr 172.21.15.66:0/2476826611 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6ef7fe640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6f00fabd0 0x7fe6f0113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 -- 172.21.15.66:0/2476826611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6f00fabd0 msgr2=0x7fe6f0113290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:57.697 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6f00fabd0 0x7fe6f0113290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 -- 172.21.15.66:0/2476826611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0005040 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6eeffd640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f01137d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8002a80 tx=0x7fe6d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.667+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6d8007c30 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.668+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe6d800f040 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.668+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f010d4f0 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.668+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6d800dab0 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.668+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f010da10 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.669+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00725d0 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.669+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fe6d800dc10 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.670+0000 7fe6e7fff640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe6dc06d9b0 0x7fe6dc06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.670+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe6d808cab0 con 0x7fe6f0102680 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.670+0000 7fe6ef7fe640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe6dc06d9b0 0x7fe6dc06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.670+0000 7fe6ef7fe640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe6dc06d9b0 0x7fe6dc06fe60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009ac0 tx=0x7fe6e0035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:46:57.698 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.674+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe6d80566e0 con 0x7fe6f0102680 2024-09-12T01:46:57.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.919+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe6f0109610 con 0x7fe6f0102680 2024-09-12T01:46:57.920 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.920+0000 7fe6e7fff640 1 -- 172.21.15.66:0/2476826611 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fe6d8059da0 con 0x7fe6f0102680 2024-09-12T01:46:57.922 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.922+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe6dc06d9b0 msgr2=0x7fe6dc06fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.922+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe6dc06d9b0 0x7fe6dc06fe60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009ac0 tx=0x7fe6e0035040 comp rx=0 tx=0).stop 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.922+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 msgr2=0x7fe6f01137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.922+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f01137d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8002a80 tx=0x7fe6d8004600 comp rx=0 tx=0).stop 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 shutdown_connections 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fe6dc06d9b0 0x7fe6dc06fe60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f0102680 0x7fe6f01137d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 --2- 172.21.15.66:0/2476826611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6f00fabd0 0x7fe6f0113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 >> 172.21.15.66:0/2476826611 conn(0x7fe6f0071ac0 msgr2=0x7fe6f0105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 shutdown_connections 2024-09-12T01:46:57.923 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:46:57.923+0000 7fe6f5e45640 1 -- 172.21.15.66:0/2476826611 wait complete. 2024-09-12T01:46:57.931 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)" 2024-09-12T01:46:58.228 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:58 smithi066 ceph-mon[27875]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:58.229 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:46:58 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2476826611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:58.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:58 smithi153 ceph-mon[34713]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:46:58.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:46:58 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2476826611' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:46:58.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-12T01:46:58.937 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:00.363 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:00 smithi066 ceph-mon[27875]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:00.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:00 smithi153 ceph-mon[34713]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:00.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 -- 172.21.15.66:0/1432701848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc101510 msgr2=0x7f41bc1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:00.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 --2- 172.21.15.66:0/1432701848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc101510 0x7f41bc1018e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f41ac0048d0 tx=0x7f41ac009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 -- 172.21.15.66:0/1432701848 shutdown_connections 2024-09-12T01:47:00.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 --2- 172.21.15.66:0/1432701848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 --2- 172.21.15.66:0/1432701848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc101510 0x7f41bc1018e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 -- 172.21.15.66:0/1432701848 >> 172.21.15.66:0/1432701848 conn(0x7f41bc0f7090 msgr2=0x7f41bc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:00.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 -- 172.21.15.66:0/1432701848 shutdown_connections 2024-09-12T01:47:00.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.721+0000 7f41c2390640 1 -- 172.21.15.66:0/1432701848 wait complete. 2024-09-12T01:47:00.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41c2390640 1 Processor -- start 2024-09-12T01:47:00.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41c2390640 1 -- start start 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41c2390640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41c2390640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41bc101510 0x7f41bc113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41c2390640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc113db0 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41c2390640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc10d1a0 con 0x7f41bc101510 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59758/0 (socket says 172.21.15.66:59758) 2024-09-12T01:47:00.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.722+0000 7f41bbfff640 1 -- 172.21.15.66:0/4201012487 learned_addr learned my addr 172.21.15.66:0/4201012487 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41bbfff640 1 -- 172.21.15.66:0/4201012487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41bc101510 msgr2=0x7f41bc113720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41bbfff640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41bc101510 0x7f41bc113720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41bbfff640 1 -- 172.21.15.66:0/4201012487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac005040 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41bbfff640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc1131e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f41ac003080 tx=0x7f41ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41ac02acd0 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc10d420 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f41ac009860 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41ac038450 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.723+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc10d940 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.725+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc0fcc10 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.725+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f41ac030020 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.726+0000 7f41b8ff9640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f41a406d9b0 0x7f41a406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.726+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f41ac0b1130 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.726+0000 7f41bb7fe640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f41a406d9b0 0x7f41a406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:00.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.726+0000 7f41bb7fe640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f41a406d9b0 0x7f41a406fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41bc10eae0 tx=0x7f41b0006ca0 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:00.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.730+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f41ac07ad30 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.972+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f41bc04b720 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.972+0000 7f41b8ff9640 1 -- 172.21.15.66:0/4201012487 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f41ac07e3f0 con 0x7f41bc0fb4d0 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.974+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f41a406d9b0 msgr2=0x7f41a406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.974+0000 7f41c2390640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f41a406d9b0 0x7f41a406fe60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f41bc10eae0 tx=0x7f41b0006ca0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.974+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 msgr2=0x7f41bc1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.974+0000 7f41c2390640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc1131e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f41ac003080 tx=0x7f41ac009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.974+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 shutdown_connections 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.975+0000 7f41c2390640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f41a406d9b0 0x7f41a406fe60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.975+0000 7f41c2390640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41bc101510 0x7f41bc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.975+0000 7f41c2390640 1 --2- 172.21.15.66:0/4201012487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f41bc0fb4d0 0x7f41bc1131e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:00.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.975+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 >> 172.21.15.66:0/4201012487 conn(0x7f41bc0f7090 msgr2=0x7f41bc0659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:00.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.975+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 shutdown_connections 2024-09-12T01:47:00.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:00.975+0000 7f41c2390640 1 -- 172.21.15.66:0/4201012487 wait complete. 2024-09-12T01:47:00.983 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:47:01.302 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:01 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/4201012487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:01 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/4201012487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:01.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-12T01:47:01.916 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:02.305 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:02 smithi066 ceph-mon[27875]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:02.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:02 smithi153 ceph-mon[34713]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:03.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 -- 172.21.15.66:0/903519070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 msgr2=0x7f2ab80fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:03.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 --2- 172.21.15.66:0/903519070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab80fc5e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0048d0 tx=0x7f2aac009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 -- 172.21.15.66:0/903519070 shutdown_connections 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 --2- 172.21.15.66:0/903519070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab80fc5e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 --2- 172.21.15.66:0/903519070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab8102580 0x7f2ab8102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 -- 172.21.15.66:0/903519070 >> 172.21.15.66:0/903519070 conn(0x7f2ab80f81a0 msgr2=0x7f2ab80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 -- 172.21.15.66:0/903519070 shutdown_connections 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 -- 172.21.15.66:0/903519070 wait complete. 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 Processor -- start 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.748+0000 7f2abeac8640 1 -- start start 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2abeac8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab8102580 0x7f2ab81131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2abeac8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab8113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2abeac8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab8113d00 con 0x7f2ab8102f20 2024-09-12T01:47:03.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2abeac8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab810d140 con 0x7f2ab8102580 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab8113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab8113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58766/0 (socket says 172.21.15.66:58766) 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 -- 172.21.15.66:0/3045630621 learned_addr learned my addr 172.21.15.66:0/3045630621 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2abc864640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab8102580 0x7f2ab81131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 -- 172.21.15.66:0/3045630621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab8102580 msgr2=0x7f2ab81131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab8102580 0x7f2ab81131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 -- 172.21.15.66:0/3045630621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac005040 con 0x7f2ab8102f20 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab7fff640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab8113700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0043d0 tx=0x7f2aac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aac038070 con 0x7f2ab8102f20 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.749+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2aac0096e0 con 0x7f2ab8102f20 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.750+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab810d3c0 con 0x7f2ab8102f20 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.750+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aac02c8a0 con 0x7f2ab8102f20 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.750+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab810d900 con 0x7f2ab8102f20 2024-09-12T01:47:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.751+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab80fdd00 con 0x7f2ab8102f20 2024-09-12T01:47:03.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.751+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f2aac030020 con 0x7f2ab8102f20 2024-09-12T01:47:03.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.752+0000 7f2ab57fa640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f2aa006d9b0 0x7f2aa006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:03.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.752+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f2aac0acf40 con 0x7f2ab8102f20 2024-09-12T01:47:03.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.752+0000 7f2abc864640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f2aa006d9b0 0x7f2aa006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:03.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.752+0000 7f2abc864640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f2aa006d9b0 0x7f2aa006fe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8004ed0 tx=0x7f2aa800b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:03.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.756+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f2aac0e1670 con 0x7f2ab8102f20 2024-09-12T01:47:03.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:03.947+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ab81095b0 con 0x7f2aa006d9b0 2024-09-12T01:47:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:04 smithi066 ceph-mon[27875]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:04.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:04 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:04 smithi153 ceph-mon[34713]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:04.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:04 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:05 smithi066 ceph-mon[27875]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:05.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:05 smithi153 ceph-mon[34713]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:06.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:06 smithi066 ceph-mon[27875]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:06.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:06 smithi153 ceph-mon[34713]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:08.384 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:08 smithi066 ceph-mon[27875]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:08.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:08 smithi153 ceph-mon[34713]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:09.593 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.593+0000 7f2ab57fa640 1 -- 172.21.15.66:0/3045630621 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5108 (secure 0 0 0) 0x7f2ab81095b0 con 0x7f2aa006d9b0 2024-09-12T01:47:09.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f2aa006d9b0 msgr2=0x7f2aa006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f2aa006d9b0 0x7f2aa006fe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2aa8004ed0 tx=0x7f2aa800b040 comp rx=0 tx=0).stop 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 msgr2=0x7f2ab8113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab8113700 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0043d0 tx=0x7f2aac009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 shutdown_connections 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f2aa006d9b0 0x7f2aa006fe60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ab8102f20 0x7f2ab8113700 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 --2- 172.21.15.66:0/3045630621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ab8102580 0x7f2ab81131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 >> 172.21.15.66:0/3045630621 conn(0x7f2ab80f81a0 msgr2=0x7f2ab80f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 shutdown_connections 2024-09-12T01:47:09.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:09.596+0000 7f2abeac8640 1 -- 172.21.15.66:0/3045630621 wait complete. 2024-09-12T01:47:09.607 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:47:10.184 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:10 smithi066 ceph-mon[27875]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:10.217 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch ps' 2024-09-12T01:47:10.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:10 smithi153 ceph-mon[34713]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:10.484 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:11.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 -- 172.21.15.66:0/2707044201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 msgr2=0x7f53400fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:11.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 --2- 172.21.15.66:0/2707044201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fd940 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f533c0048d0 tx=0x7f533c009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:11.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 -- 172.21.15.66:0/2707044201 shutdown_connections 2024-09-12T01:47:11.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 --2- 172.21.15.66:0/2707044201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53400fdf10 0x7f53401065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 --2- 172.21.15.66:0/2707044201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fd940 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 -- 172.21.15.66:0/2707044201 >> 172.21.15.66:0/2707044201 conn(0x7f53400f7030 msgr2=0x7f53400f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 -- 172.21.15.66:0/2707044201 shutdown_connections 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 -- 172.21.15.66:0/2707044201 wait complete. 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.982+0000 7f534788b640 1 Processor -- start 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f534788b640 1 -- start start 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f534788b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f534788b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53400fdf10 0x7f53400fb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f534788b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400fbeb0 con 0x7f53400fd570 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f534788b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53400fc020 con 0x7f53400fdf10 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:11.985 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:58782/0 (socket says 172.21.15.66:58782) 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 -- 172.21.15.66:0/293664243 learned_addr learned my addr 172.21.15.66:0/293664243 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 -- 172.21.15.66:0/293664243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53400fdf10 msgr2=0x7f53400fb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53400fdf10 0x7f53400fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 -- 172.21.15.66:0/293664243 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c005040 con 0x7f53400fd570 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.983+0000 7f5345627640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fb430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f533c000c00 tx=0x7f533c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.984+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533c038070 con 0x7f53400fd570 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.984+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53400fc250 con 0x7f53400fd570 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.984+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f533c02ade0 con 0x7f53400fd570 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.984+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533c02c770 con 0x7f53400fd570 2024-09-12T01:47:11.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.984+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5340119810 con 0x7f53400fd570 2024-09-12T01:47:11.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.985+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5340066050 con 0x7f53400fd570 2024-09-12T01:47:11.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.985+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f533c030020 con 0x7f53400fd570 2024-09-12T01:47:11.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.986+0000 7f5335ffb640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f532c06d9b0 0x7f532c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:11.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.986+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f533c0acf10 con 0x7f53400fd570 2024-09-12T01:47:11.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.986+0000 7f5344e26640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f532c06d9b0 0x7f532c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:11.988 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.987+0000 7f5344e26640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f532c06d9b0 0x7f532c06fe60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53400fcd70 tx=0x7f5330009c50 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:11.990 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:11.990+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f533c076b40 con 0x7f53400fd570 2024-09-12T01:47:12.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.175+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f534004b720 con 0x7f532c06d9b0 2024-09-12T01:47:12.184 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.184+0000 7f5335ffb640 1 -- 172.21.15.66:0/293664243 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f534004b720 con 0x7f532c06d9b0 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (82s) 53s ago 11m 16.4M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (11m) 53s ago 11m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (11m) 111s ago 11m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (60s) 53s ago 11m 45.5M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (6m) 53s ago 6m 12.8M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (6m) 53s ago 6m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (6m) 111s ago 6m 15.9M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (6m) 111s ago 6m 15.1M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (3m) 53s ago 13m 503M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:47:12.185 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (2m) 111s ago 10m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (13m) 53s ago 13m 59.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (10m) 111s ago 10m 44.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (118s) 53s ago 11m 12.6M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (114s) 111s ago 10m 3581k - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (10m) 53s ago 10m 247M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (9m) 53s ago 9m 259M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (9m) 53s ago 9m 214M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (8m) 111s ago 8m 274M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (8m) 111s ago 8m 251M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (7m) 111s ago 7m 229M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:47:12.186 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (98s) 53s ago 11m 49.2M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f532c06d9b0 msgr2=0x7f532c06fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f532c06d9b0 0x7f532c06fe60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f53400fcd70 tx=0x7f5330009c50 comp rx=0 tx=0).stop 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 msgr2=0x7f53400fb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fb430 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f533c000c00 tx=0x7f533c009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 shutdown_connections 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f532c06d9b0 0x7f532c06fe60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.186+0000 7f534788b640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53400fdf10 0x7f53400fb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.187+0000 7f534788b640 1 --2- 172.21.15.66:0/293664243 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53400fd570 0x7f53400fb430 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.187+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 >> 172.21.15.66:0/293664243 conn(0x7f53400f7030 msgr2=0x7f53400f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:12.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.187+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 shutdown_connections 2024-09-12T01:47:12.188 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:12.187+0000 7f534788b640 1 -- 172.21.15.66:0/293664243 wait complete. 2024-09-12T01:47:12.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:12 smithi066 ceph-mon[27875]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:12.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:12 smithi153 ceph-mon[34713]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:12.843 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-12T01:47:12.844 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:47:12.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-12T01:47:13.107 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:14 smithi066 ceph-mon[27875]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:14.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:14 smithi066 ceph-mon[27875]: pgmap v83: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:14 smithi153 ceph-mon[34713]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:14 smithi153 ceph-mon[34713]: pgmap v83: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 -- 172.21.15.66:0/1125284681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc0fac80 msgr2=0x7f32bc0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 --2- 172.21.15.66:0/1125284681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc0fac80 0x7f32bc0fb0f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f32b00048d0 tx=0x7f32b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 -- 172.21.15.66:0/1125284681 shutdown_connections 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 --2- 172.21.15.66:0/1125284681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc0fac80 0x7f32bc0fb0f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 --2- 172.21.15.66:0/1125284681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc102620 0x7f32bc1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 -- 172.21.15.66:0/1125284681 >> 172.21.15.66:0/1125284681 conn(0x7f32bc070ce0 msgr2=0x7f32bc0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:14.793 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 -- 172.21.15.66:0/1125284681 shutdown_connections 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.767+0000 7f32c17d1640 1 -- 172.21.15.66:0/1125284681 wait complete. 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32c17d1640 1 Processor -- start 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32c17d1640 1 -- start start 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32c17d1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc0fac80 0x7f32bc113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32c17d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 0x7f32bc113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32c17d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc113df0 con 0x7f32bc102620 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32c17d1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc10d1a0 con 0x7f32bc0fac80 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32ba7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 0x7f32bc113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32ba7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 0x7f32bc113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46596/0 (socket says 172.21.15.66:46596) 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.768+0000 7f32ba7fc640 1 -- 172.21.15.66:0/2941334644 learned_addr learned my addr 172.21.15.66:0/2941334644 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32baffd640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc0fac80 0x7f32bc113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:14.794 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32ba7fc640 1 -- 172.21.15.66:0/2941334644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc0fac80 msgr2=0x7f32bc113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32ba7fc640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc0fac80 0x7f32bc113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32ba7fc640 1 -- 172.21.15.66:0/2941334644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0005040 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32ba7fc640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 0x7f32bc113760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f32b0003080 tx=0x7f32b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b0038070 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc10d420 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f32b00097e0 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32b003d420 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.769+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc10d8e0 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.770+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc0657b0 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.771+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f32b0030020 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.771+0000 7f32a37fe640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f32a406d9b0 0x7f32a406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.771+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f32b00ad7e0 con 0x7f32bc102620 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.771+0000 7f32baffd640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f32a406d9b0 0x7f32a406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:14.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.772+0000 7f32baffd640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f32a406d9b0 0x7f32a406fe60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32ac001250 tx=0x7f32ac009620 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:14.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.776+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f32b0077360 con 0x7f32bc102620 2024-09-12T01:47:14.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.949+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f32bc1095f0 con 0x7f32bc102620 2024-09-12T01:47:14.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.953+0000 7f32a37fe640 1 -- 172.21.15.66:0/2941334644 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v47)=0 v47) v1 ==== 125+0+0 (secure 0 0 0) 0x7f32b007aa20 con 0x7f32bc102620 2024-09-12T01:47:14.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f32a406d9b0 msgr2=0x7f32a406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:14.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f32a406d9b0 0x7f32a406fe60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f32ac001250 tx=0x7f32ac009620 comp rx=0 tx=0).stop 2024-09-12T01:47:14.956 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 msgr2=0x7f32bc113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 0x7f32bc113760 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f32b0003080 tx=0x7f32b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 shutdown_connections 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f32a406d9b0 0x7f32a406fe60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32bc102620 0x7f32bc113760 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 --2- 172.21.15.66:0/2941334644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc0fac80 0x7f32bc113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 >> 172.21.15.66:0/2941334644 conn(0x7f32bc070ce0 msgr2=0x7f32bc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 shutdown_connections 2024-09-12T01:47:14.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:14.956+0000 7f32c17d1640 1 -- 172.21.15.66:0/2941334644 wait complete. 2024-09-12T01:47:15.649 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-12T01:47:15.649 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:47:15.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-12T01:47:15.909 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:16.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:15 smithi066 ceph-mon[27875]: pgmap v84: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:16.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:15 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/2941334644' entity='client.admin' 2024-09-12T01:47:16.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:15 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:16.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:15 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:16.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:15 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:16.293 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:15 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:16.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:15 smithi153 ceph-mon[34713]: pgmap v84: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:16.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:15 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/2941334644' entity='client.admin' 2024-09-12T01:47:16.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:15 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:16.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:15 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:16.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:15 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:16.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:15 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 -- 172.21.15.66:0/1501457716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a80fac80 msgr2=0x7f01a80fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 --2- 172.21.15.66:0/1501457716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a80fac80 0x7f01a80fb0f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f01980048d0 tx=0x7f0198009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 -- 172.21.15.66:0/1501457716 shutdown_connections 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 --2- 172.21.15.66:0/1501457716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a80fac80 0x7f01a80fb0f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 --2- 172.21.15.66:0/1501457716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01a8102620 0x7f01a81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 -- 172.21.15.66:0/1501457716 >> 172.21.15.66:0/1501457716 conn(0x7f01a8070ce0 msgr2=0x7f01a80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:17.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 -- 172.21.15.66:0/1501457716 shutdown_connections 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 -- 172.21.15.66:0/1501457716 wait complete. 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 Processor -- start 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.626+0000 7f01b03f0640 1 -- start start 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01b03f0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01a80fac80 0x7f01a8113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01b03f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 0x7f01a8113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01b03f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8113d60 con 0x7f01a8102620 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01b03f0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a810d1a0 con 0x7f01a80fac80 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 0x7f01a8113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 0x7f01a8113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46610/0 (socket says 172.21.15.66:46610) 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 -- 172.21.15.66:0/3261021059 learned_addr learned my addr 172.21.15.66:0/3261021059 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:17.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ae18c640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01a80fac80 0x7f01a8113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 -- 172.21.15.66:0/3261021059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01a80fac80 msgr2=0x7f01a8113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01a80fac80 0x7f01a8113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 -- 172.21.15.66:0/3261021059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0198005040 con 0x7f01a8102620 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01ad98b640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 0x7f01a8113760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0198003080 tx=0x7f0198009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0198038070 con 0x7f01a8102620 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f01980097e0 con 0x7f01a8102620 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a810d420 con 0x7f01a8102620 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f019803d420 con 0x7f01a8102620 2024-09-12T01:47:17.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.627+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a810d960 con 0x7f01a8102620 2024-09-12T01:47:17.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.628+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a80657b0 con 0x7f01a8102620 2024-09-12T01:47:17.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.629+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f0198030020 con 0x7f01a8102620 2024-09-12T01:47:17.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.630+0000 7f019effd640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f019406d9b0 0x7f019406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:17.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.630+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f01980ad800 con 0x7f01a8102620 2024-09-12T01:47:17.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.630+0000 7f01ae18c640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f019406d9b0 0x7f019406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:17.631 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.630+0000 7f01ae18c640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f019406d9b0 0x7f019406fe60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01a40041d0 tx=0x7f01a4009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:17.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.634+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f0198077380 con 0x7f01a8102620 2024-09-12T01:47:17.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.808+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f01a8109590 con 0x7f01a8102620 2024-09-12T01:47:17.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.809+0000 7f019effd640 1 -- 172.21.15.66:0/3261021059 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v47)=0 v47) v1 ==== 155+0+0 (secure 0 0 0) 0x7f019807aa40 con 0x7f01a8102620 2024-09-12T01:47:17.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f019406d9b0 msgr2=0x7f019406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:17.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f019406d9b0 0x7f019406fe60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01a40041d0 tx=0x7f01a4009040 comp rx=0 tx=0).stop 2024-09-12T01:47:17.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 msgr2=0x7f01a8113760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:17.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 0x7f01a8113760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0198003080 tx=0x7f0198009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 shutdown_connections 2024-09-12T01:47:17.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f019406d9b0 0x7f019406fe60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a8102620 0x7f01a8113760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 --2- 172.21.15.66:0/3261021059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01a80fac80 0x7f01a8113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:17.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 >> 172.21.15.66:0/3261021059 conn(0x7f01a8070ce0 msgr2=0x7f01a8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:17.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 shutdown_connections 2024-09-12T01:47:17.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:17.811+0000 7f01b03f0640 1 -- 172.21.15.66:0/3261021059 wait complete. 2024-09-12T01:47:18.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:17 smithi066 ceph-mon[27875]: pgmap v85: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:17 smithi153 ceph-mon[34713]: pgmap v85: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:18.457 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-12T01:47:18.717 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:19.098 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:18 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:19.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:18 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:20.127 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:19 smithi066 ceph-mon[27875]: pgmap v86: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 -- 172.21.15.66:0/3586015804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc0fb4d0 msgr2=0x7f71dc0fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 --2- 172.21.15.66:0/3586015804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc0fb4d0 0x7f71dc0fb940 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0048d0 tx=0x7f71cc009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 -- 172.21.15.66:0/3586015804 shutdown_connections 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 --2- 172.21.15.66:0/3586015804 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc0fb4d0 0x7f71dc0fb940 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 --2- 172.21.15.66:0/3586015804 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71dc101510 0x7f71dc1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 -- 172.21.15.66:0/3586015804 >> 172.21.15.66:0/3586015804 conn(0x7f71dc0f7090 msgr2=0x7f71dc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 -- 172.21.15.66:0/3586015804 shutdown_connections 2024-09-12T01:47:20.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.318+0000 7f71e3822640 1 -- 172.21.15.66:0/3586015804 wait complete. 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e3822640 1 Processor -- start 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e3822640 1 -- start start 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e3822640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71dc0fb4d0 0x7f71dc113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e3822640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 0x7f71dc113670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e3822640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc113c70 con 0x7f71dc101510 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e3822640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc113de0 con 0x7f71dc0fb4d0 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e0dbd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 0x7f71dc113670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e0dbd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 0x7f71dc113670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:46640/0 (socket says 172.21.15.66:46640) 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e0dbd640 1 -- 172.21.15.66:0/1951954386 learned_addr learned my addr 172.21.15.66:0/1951954386 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.319+0000 7f71e15be640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71dc0fb4d0 0x7f71dc113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71e0dbd640 1 -- 172.21.15.66:0/1951954386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71dc0fb4d0 msgr2=0x7f71dc113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:20.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71e0dbd640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71dc0fb4d0 0x7f71dc113130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71e0dbd640 1 -- 172.21.15.66:0/1951954386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc005040 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71e0dbd640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 0x7f71dc113670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f71cc003080 tx=0x7f71cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71cc038070 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc10d200 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71cc0097e0 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71cc03d420 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.320+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc10d740 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.322+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc0fcc10 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.323+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f71cc030020 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.328+0000 7f71d1ffb640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f71c806d9b0 0x7f71c806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.328+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f71cc0ad7e0 con 0x7f71dc101510 2024-09-12T01:47:20.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.328+0000 7f71e15be640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f71c806d9b0 0x7f71c806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:20.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.329+0000 7f71e15be640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f71c806d9b0 0x7f71c806fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71d80041d0 tx=0x7f71d8009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:20.344 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.330+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f71cc077360 con 0x7f71dc101510 2024-09-12T01:47:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:19 smithi153 ceph-mon[34713]: pgmap v86: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:20.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.508+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f71dc0fac90 con 0x7f71dc101510 2024-09-12T01:47:20.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.509+0000 7f71d1ffb640 1 -- 172.21.15.66:0/1951954386 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v47)=0 v47) v1 ==== 163+0+0 (secure 0 0 0) 0x7f71cc07aa20 con 0x7f71dc101510 2024-09-12T01:47:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f71c806d9b0 msgr2=0x7f71c806fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f71c806d9b0 0x7f71c806fe60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f71d80041d0 tx=0x7f71d8009040 comp rx=0 tx=0).stop 2024-09-12T01:47:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 msgr2=0x7f71dc113670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:20.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 0x7f71dc113670 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f71cc003080 tx=0x7f71cc009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 shutdown_connections 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f71c806d9b0 0x7f71c806fe60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71dc101510 0x7f71dc113670 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 --2- 172.21.15.66:0/1951954386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71dc0fb4d0 0x7f71dc113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 >> 172.21.15.66:0/1951954386 conn(0x7f71dc0f7090 msgr2=0x7f71dc0659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 shutdown_connections 2024-09-12T01:47:20.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:20.511+0000 7f71e3822640 1 -- 172.21.15.66:0/1951954386 wait complete. 2024-09-12T01:47:21.199 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-12T01:47:21.464 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:22.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:21 smithi066 ceph-mon[27875]: pgmap v87: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:21 smithi153 ceph-mon[34713]: pgmap v87: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 -- 172.21.15.66:0/1219513180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 msgr2=0x7ff5180fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1219513180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5180fc5e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff5080048d0 tx=0x7ff508009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 -- 172.21.15.66:0/1219513180 shutdown_connections 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1219513180 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5180fc5e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1219513180 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff518102580 0x7ff518102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 -- 172.21.15.66:0/1219513180 >> 172.21.15.66:0/1219513180 conn(0x7ff5180f81a0 msgr2=0x7ff5180fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 -- 172.21.15.66:0/1219513180 shutdown_connections 2024-09-12T01:47:23.090 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 -- 172.21.15.66:0/1219513180 wait complete. 2024-09-12T01:47:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.089+0000 7ff51f92a640 1 Processor -- start 2024-09-12T01:47:23.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51f92a640 1 -- start start 2024-09-12T01:47:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51f92a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff518102580 0x7ff5181153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51f92a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5181158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51f92a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518115ee0 con 0x7ff518102f20 2024-09-12T01:47:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51f92a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff518116050 con 0x7ff518102580 2024-09-12T01:47:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51cec5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5181158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:23.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51cec5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5181158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49488/0 (socket says 172.21.15.66:49488) 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51cec5640 1 -- 172.21.15.66:0/1062020118 learned_addr learned my addr 172.21.15.66:0/1062020118 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51d6c6640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff518102580 0x7ff5181153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51cec5640 1 -- 172.21.15.66:0/1062020118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff518102580 msgr2=0x7ff5181153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51cec5640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff518102580 0x7ff5181153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.090+0000 7ff51cec5640 1 -- 172.21.15.66:0/1062020118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508005040 con 0x7ff518102f20 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.091+0000 7ff51cec5640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5181158e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff5080043d0 tx=0x7ff508009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.091+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff508038070 con 0x7ff518102f20 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.091+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5080096e0 con 0x7ff518102f20 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.091+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51810f470 con 0x7ff518102f20 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.091+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff50802c8a0 con 0x7ff518102f20 2024-09-12T01:47:23.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.091+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51810f9b0 con 0x7ff518102f20 2024-09-12T01:47:23.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.092+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5180fdd00 con 0x7ff518102f20 2024-09-12T01:47:23.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.093+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7ff508030020 con 0x7ff518102f20 2024-09-12T01:47:23.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.093+0000 7ff50dffb640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff50406d9b0 0x7ff50406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:23.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.094+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff5080acf40 con 0x7ff518102f20 2024-09-12T01:47:23.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.094+0000 7ff51d6c6640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff50406d9b0 0x7ff50406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:23.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.094+0000 7ff51d6c6640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff50406d9b0 0x7ff50406fe60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff514004eb0 tx=0x7ff51400b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:23.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.100+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff5080e1670 con 0x7ff518102f20 2024-09-12T01:47:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.274+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7ff5181095c0 con 0x7ff518102f20 2024-09-12T01:47:23.274 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.274+0000 7ff50dffb640 1 -- 172.21.15.66:0/1062020118 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v47)=0 v47) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff508076b70 con 0x7ff518102f20 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff50406d9b0 msgr2=0x7ff50406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff50406d9b0 0x7ff50406fe60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff514004eb0 tx=0x7ff51400b040 comp rx=0 tx=0).stop 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 msgr2=0x7ff5181158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5181158e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff5080043d0 tx=0x7ff508009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 shutdown_connections 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff50406d9b0 0x7ff50406fe60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.277 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff518102f20 0x7ff5181158e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 --2- 172.21.15.66:0/1062020118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff518102580 0x7ff5181153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 >> 172.21.15.66:0/1062020118 conn(0x7ff5180f81a0 msgr2=0x7ff5180f90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 shutdown_connections 2024-09-12T01:47:23.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:23.277+0000 7ff51f92a640 1 -- 172.21.15.66:0/1062020118 wait complete. 2024-09-12T01:47:23.929 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-12T01:47:24.190 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:24.311 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:23 smithi066 ceph-mon[27875]: pgmap v88: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:24.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:23 smithi153 ceph-mon[34713]: pgmap v88: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.877+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/2519188833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f480fac80 msgr2=0x7f7f480fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.877+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/2519188833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f480fac80 0x7f7f480fb0f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f300048d0 tx=0x7f7f30009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/2519188833 shutdown_connections 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/2519188833 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f480fac80 0x7f7f480fb0f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/2519188833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f48102620 0x7f7f481029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/2519188833 >> 172.21.15.66:0/2519188833 conn(0x7f7f48070ce0 msgr2=0x7f7f480710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/2519188833 shutdown_connections 2024-09-12T01:47:25.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/2519188833 wait complete. 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 Processor -- start 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- start start 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f480fac80 0x7f7f481153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 0x7f7f481158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f48115ef0 con 0x7f7f48102620 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.878+0000 7f7f4e2a4640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f4810f330 con 0x7f7f480fac80 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 0x7f7f481158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 0x7f7f481158f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49514/0 (socket says 172.21.15.66:49514) 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f480fac80 0x7f7f481153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 -- 172.21.15.66:0/3354968162 learned_addr learned my addr 172.21.15.66:0/3354968162 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 -- 172.21.15.66:0/3354968162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f480fac80 msgr2=0x7f7f481153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f480fac80 0x7f7f481153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 -- 172.21.15.66:0/3354968162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30005040 con 0x7f7f48102620 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f47fff640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f480fac80 0x7f7f481153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:47:25.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f3ffff640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 0x7f7f481158f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f30000c00 tx=0x7f7f30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f30038070 con 0x7f7f48102620 2024-09-12T01:47:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f3002ade0 con 0x7f7f48102620 2024-09-12T01:47:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4810f5b0 con 0x7f7f48102620 2024-09-12T01:47:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f3002c7b0 con 0x7f7f48102620 2024-09-12T01:47:25.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.879+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f4810faf0 con 0x7f7f48102620 2024-09-12T01:47:25.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.880+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f480657b0 con 0x7f7f48102620 2024-09-12T01:47:25.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.881+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f7f30030020 con 0x7f7f48102620 2024-09-12T01:47:25.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.882+0000 7f7f457fa640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f3406d9b0 0x7f7f3406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:25.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.882+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f7f300ad660 con 0x7f7f48102620 2024-09-12T01:47:25.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.882+0000 7f7f47fff640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f3406d9b0 0x7f7f3406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:25.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.882+0000 7f7f47fff640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f3406d9b0 0x7f7f3406fe60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7f38004fd0 tx=0x7f7f3800b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:25.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:25.887+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7f300771e0 con 0x7f7f48102620 2024-09-12T01:47:26.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.080+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f48109630 con 0x7f7f3406d9b0 2024-09-12T01:47:26.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.089+0000 7f7f457fa640 1 -- 172.21.15.66:0/3354968162 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f7f3800f040 con 0x7f7f3406d9b0 2024-09-12T01:47:26.089 INFO:teuthology.orchestra.run.smithi066.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f3406d9b0 msgr2=0x7f7f3406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f3406d9b0 0x7f7f3406fe60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7f38004fd0 tx=0x7f7f3800b040 comp rx=0 tx=0).stop 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 msgr2=0x7f7f481158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 0x7f7f481158f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f30000c00 tx=0x7f7f30009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 shutdown_connections 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f7f3406d9b0 0x7f7f3406fe60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f48102620 0x7f7f481158f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:26.091 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 --2- 172.21.15.66:0/3354968162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f480fac80 0x7f7f481153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 >> 172.21.15.66:0/3354968162 conn(0x7f7f48070ce0 msgr2=0x7f7f48103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 shutdown_connections 2024-09-12T01:47:26.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:26.091+0000 7f7f4e2a4640 1 -- 172.21.15.66:0/3354968162 wait complete. 2024-09-12T01:47:26.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:25 smithi066 ceph-mon[27875]: pgmap v89: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:26.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:25 smithi153 ceph-mon[34713]: pgmap v89: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:26.928 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-12T01:47:26.929 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:47:26.929 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-12T01:47:27.203 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:47:27.325 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:27.325 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:27.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:27.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:27.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:27.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:27.326 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:27 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:27.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:27 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:28.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:28 smithi066 ceph-mon[27875]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:28.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:28 smithi066 ceph-mon[27875]: pgmap v90: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:28.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:28 smithi153 ceph-mon[34713]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:47:28.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:28 smithi153 ceph-mon[34713]: pgmap v90: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:30.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 -- 172.21.15.66:0/803228946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 msgr2=0x7f54100fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 --2- 172.21.15.66:0/803228946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54100fbbe0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f54040048d0 tx=0x7f5404009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 -- 172.21.15.66:0/803228946 shutdown_connections 2024-09-12T01:47:30.065 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 --2- 172.21.15.66:0/803228946 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 0x7f54100fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 --2- 172.21.15.66:0/803228946 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54100fbbe0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 -- 172.21.15.66:0/803228946 >> 172.21.15.66:0/803228946 conn(0x7f54100723b0 msgr2=0x7f54100727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 -- 172.21.15.66:0/803228946 shutdown_connections 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.064+0000 7f54171d8640 1 -- 172.21.15.66:0/803228946 wait complete. 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f54171d8640 1 Processor -- start 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f54171d8640 1 -- start start 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f54171d8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54101153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f54171d8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 0x7f5410115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f54171d8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410115f00 con 0x7f54100fb810 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f54171d8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5410116070 con 0x7f54100fcf80 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f5414f74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54101153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f5414f74640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54101153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49534/0 (socket says 172.21.15.66:49534) 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f5414f74640 1 -- 172.21.15.66:0/583881441 learned_addr learned my addr 172.21.15.66:0/583881441 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:30.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.065+0000 7f540ffff640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 0x7f5410115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f5414f74640 1 -- 172.21.15.66:0/583881441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 msgr2=0x7f5410115900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f5414f74640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 0x7f5410115900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f5414f74640 1 -- 172.21.15.66:0/583881441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404005040 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f540ffff640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 0x7f5410115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f5414f74640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54101153c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5404003080 tx=0x7f5404009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5404038070 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54040097e0 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541010f490 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f540403d420 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.066+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541010f980 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.067+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54100fcbc0 con 0x7f54100fb810 2024-09-12T01:47:30.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.068+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f5404030020 con 0x7f54100fb810 2024-09-12T01:47:30.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.068+0000 7f540d7fa640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f540006d9b0 0x7f540006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.069+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f54040ad7e0 con 0x7f54100fb810 2024-09-12T01:47:30.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.069+0000 7f540ffff640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f540006d9b0 0x7f540006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.069+0000 7f540ffff640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f540006d9b0 0x7f540006fe60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5410110cc0 tx=0x7f53fc009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.073 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.073+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5404077360 con 0x7f54100fb810 2024-09-12T01:47:30.275 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.275+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5410110a70 con 0x7f540006d9b0 2024-09-12T01:47:30.276 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.276+0000 7f540d7fa640 1 -- 172.21.15.66:0/583881441 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f5410110a70 con 0x7f540006d9b0 2024-09-12T01:47:30.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f540006d9b0 msgr2=0x7f540006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f540006d9b0 0x7f540006fe60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5410110cc0 tx=0x7f53fc009040 comp rx=0 tx=0).stop 2024-09-12T01:47:30.278 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 msgr2=0x7f54101153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54101153c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5404003080 tx=0x7f5404009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 shutdown_connections 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f540006d9b0 0x7f540006fe60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54100fcf80 0x7f5410115900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 --2- 172.21.15.66:0/583881441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54100fb810 0x7f54101153c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 >> 172.21.15.66:0/583881441 conn(0x7f54100723b0 msgr2=0x7f54100f8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 shutdown_connections 2024-09-12T01:47:30.279 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.278+0000 7f54171d8640 1 -- 172.21.15.66:0/583881441 wait complete. 2024-09-12T01:47:30.288 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:47:30.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.362+0000 7f8397188640 1 -- 172.21.15.66:0/4203313626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8390101510 msgr2=0x7f83901018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.362+0000 7f8397188640 1 --2- 172.21.15.66:0/4203313626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8390101510 0x7f83901018e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f83840048d0 tx=0x7f8384009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.362+0000 7f8397188640 1 -- 172.21.15.66:0/4203313626 shutdown_connections 2024-09-12T01:47:30.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.362+0000 7f8397188640 1 --2- 172.21.15.66:0/4203313626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83900fb4d0 0x7f83900fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.362+0000 7f8397188640 1 --2- 172.21.15.66:0/4203313626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8390101510 0x7f83901018e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.363 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.362+0000 7f8397188640 1 -- 172.21.15.66:0/4203313626 >> 172.21.15.66:0/4203313626 conn(0x7f83900f7090 msgr2=0x7f83900f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.363 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:30 smithi066 ceph-mon[27875]: pgmap v91: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:30.363 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:30 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:30.363 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:30 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:30.364 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:30 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:30.364 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:30 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:30.364 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:30 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.363+0000 7f8397188640 1 -- 172.21.15.66:0/4203313626 shutdown_connections 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.363+0000 7f8397188640 1 -- 172.21.15.66:0/4203313626 wait complete. 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.363+0000 7f8397188640 1 Processor -- start 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.363+0000 7f8397188640 1 -- start start 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8397188640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 0x7f8390115470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8397188640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8390101510 0x7f83901159b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8397188640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8390115fb0 con 0x7f83900fb4d0 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8397188640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839010f3c0 con 0x7f8390101510 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 0x7f8390115470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 0x7f8390115470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49556/0 (socket says 172.21.15.66:49556) 2024-09-12T01:47:30.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 -- 172.21.15.66:0/700989267 learned_addr learned my addr 172.21.15.66:0/700989267 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:30.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f838ffff640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8390101510 0x7f83901159b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 -- 172.21.15.66:0/700989267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8390101510 msgr2=0x7f83901159b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8390101510 0x7f83901159b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 -- 172.21.15.66:0/700989267 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384005040 con 0x7f83900fb4d0 2024-09-12T01:47:30.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f838ffff640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8390101510 0x7f83901159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:47:30.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8394f24640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 0x7f8390115470 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8384003080 tx=0x7f8384009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8384038070 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83840097e0 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f839010f640 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.364+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f838403d420 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.365+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839010fb00 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.366+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83900fcc10 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.366+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f8384030020 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.367+0000 7f838d7fa640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f838006d9b0 0x7f838006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.367+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f83840ad700 con 0x7f83900fb4d0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.367+0000 7f838ffff640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f838006d9b0 0x7f838006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.367+0000 7f838ffff640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f838006d9b0 0x7f838006fe60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8390110db0 tx=0x7f837c009040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.371+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8384077300 con 0x7f83900fb4d0 2024-09-12T01:47:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:30 smithi153 ceph-mon[34713]: pgmap v91: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:30.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:30 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:30 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:30 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:30 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:30.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:30 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-12T01:47:30.569 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.569+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8390108540 con 0x7f838006d9b0 2024-09-12T01:47:30.571 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.571+0000 7f838d7fa640 1 -- 172.21.15.66:0/700989267 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f8390108540 con 0x7f838006d9b0 2024-09-12T01:47:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f838006d9b0 msgr2=0x7f838006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f838006d9b0 0x7f838006fe60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8390110db0 tx=0x7f837c009040 comp rx=0 tx=0).stop 2024-09-12T01:47:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 msgr2=0x7f8390115470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 0x7f8390115470 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8384003080 tx=0x7f8384009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 shutdown_connections 2024-09-12T01:47:30.573 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f838006d9b0 0x7f838006fe60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8390101510 0x7f83901159b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 --2- 172.21.15.66:0/700989267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83900fb4d0 0x7f8390115470 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 >> 172.21.15.66:0/700989267 conn(0x7f83900f7090 msgr2=0x7f83900659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 shutdown_connections 2024-09-12T01:47:30.574 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.573+0000 7f8397188640 1 -- 172.21.15.66:0/700989267 wait complete. 2024-09-12T01:47:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 -- 172.21.15.66:0/2369976007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 msgr2=0x7fde60065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 --2- 172.21.15.66:0/2369976007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde60065430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fde480048d0 tx=0x7fde48009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.664 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 -- 172.21.15.66:0/2369976007 shutdown_connections 2024-09-12T01:47:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 --2- 172.21.15.66:0/2369976007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde60065430 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 --2- 172.21.15.66:0/2369976007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 0x7fde600fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 -- 172.21.15.66:0/2369976007 >> 172.21.15.66:0/2369976007 conn(0x7fde600723b0 msgr2=0x7fde600727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 -- 172.21.15.66:0/2369976007 shutdown_connections 2024-09-12T01:47:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 -- 172.21.15.66:0/2369976007 wait complete. 2024-09-12T01:47:30.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.664+0000 7fde65f51640 1 Processor -- start 2024-09-12T01:47:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde65f51640 1 -- start start 2024-09-12T01:47:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde65f51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde601131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde65f51640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 0x7fde60113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde65f51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60113d10 con 0x7fde60064fc0 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde65f51640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6010d1a0 con 0x7fde600fe460 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde601131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde601131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49572/0 (socket says 172.21.15.66:49572) 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5f7fe640 1 -- 172.21.15.66:0/2735997617 learned_addr learned my addr 172.21.15.66:0/2735997617 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5effd640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 0x7fde60113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5f7fe640 1 -- 172.21.15.66:0/2735997617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 msgr2=0x7fde60113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5f7fe640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 0x7fde60113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5f7fe640 1 -- 172.21.15.66:0/2735997617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48005040 con 0x7fde60064fc0 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.665+0000 7fde5effd640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 0x7fde60113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:47:30.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.666+0000 7fde5f7fe640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde601131d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c790 tx=0x7fde500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.666+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde5000a820 con 0x7fde60064fc0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.666+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6010d480 con 0x7fde60064fc0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.666+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fde5000ae20 con 0x7fde60064fc0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.666+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde500113a0 con 0x7fde60064fc0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.666+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6010d9f0 con 0x7fde60064fc0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.667+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600fdcf0 con 0x7fde60064fc0 2024-09-12T01:47:30.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.667+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fde5000a980 con 0x7fde60064fc0 2024-09-12T01:47:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.668+0000 7fde57fff640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fde4c06d9b0 0x7fde4c06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.668+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fde5008d3d0 con 0x7fde60064fc0 2024-09-12T01:47:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.668+0000 7fde5effd640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fde4c06d9b0 0x7fde4c06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.669+0000 7fde5effd640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fde4c06d9b0 0x7fde4c06fe60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde60072d60 tx=0x7fde48035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.672+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fde50056fd0 con 0x7fde60064fc0 2024-09-12T01:47:30.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.854+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fde6004b720 con 0x7fde4c06d9b0 2024-09-12T01:47:30.863 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.863+0000 7fde57fff640 1 -- 172.21.15.66:0/2735997617 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fde6004b720 con 0x7fde4c06d9b0 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (101s) 72s ago 12m 16.4M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (12m) 72s ago 12m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (11m) 2m ago 11m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (79s) 72s ago 11m 45.5M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (6m) 72s ago 6m 12.8M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (6m) 72s ago 6m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (6m) 2m ago 6m 15.9M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (6m) 2m ago 6m 15.1M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (3m) 72s ago 13m 503M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (2m) 2m ago 11m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:47:30.864 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (13m) 72s ago 13m 59.3M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 2554e537271e 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (11m) 2m ago 11m 44.7M 2048M 17.2.7-1609-g554ba93e d4c538e492e4 ee5ee331f3c0 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (2m) 72s ago 12m 12.6M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (2m) 2m ago 11m 3581k - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (10m) 72s ago 10m 247M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (9m) 72s ago 9m 259M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (9m) 72s ago 9m 214M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (9m) 2m ago 9m 274M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (8m) 2m ago 8m 251M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (8m) 2m ago 8m 229M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:47:30.865 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (116s) 72s ago 11m 49.2M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:47:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fde4c06d9b0 msgr2=0x7fde4c06fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fde4c06d9b0 0x7fde4c06fe60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde60072d60 tx=0x7fde48035040 comp rx=0 tx=0).stop 2024-09-12T01:47:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 msgr2=0x7fde601131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde601131d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c790 tx=0x7fde500043c0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 shutdown_connections 2024-09-12T01:47:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fde4c06d9b0 0x7fde4c06fe60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fde600fe460 0x7fde60113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 --2- 172.21.15.66:0/2735997617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde60064fc0 0x7fde601131d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.865+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 >> 172.21.15.66:0/2735997617 conn(0x7fde600723b0 msgr2=0x7fde601053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.866+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 shutdown_connections 2024-09-12T01:47:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.866+0000 7fde65f51640 1 -- 172.21.15.66:0/2735997617 wait complete. 2024-09-12T01:47:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 -- 172.21.15.66:0/1745039731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 msgr2=0x7fbb1c102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 --2- 172.21.15.66:0/1745039731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c102900 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009c50 tx=0x7fbb0c004d10 comp rx=0 tx=0).stop 2024-09-12T01:47:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 -- 172.21.15.66:0/1745039731 shutdown_connections 2024-09-12T01:47:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 --2- 172.21.15.66:0/1745039731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c102ed0 0x7fbb1c0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 --2- 172.21.15.66:0/1745039731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c102900 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 -- 172.21.15.66:0/1745039731 >> 172.21.15.66:0/1745039731 conn(0x7fbb1c0f80f0 msgr2=0x7fbb1c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:30.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 -- 172.21.15.66:0/1745039731 shutdown_connections 2024-09-12T01:47:30.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 -- 172.21.15.66:0/1745039731 wait complete. 2024-09-12T01:47:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 Processor -- start 2024-09-12T01:47:30.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.947+0000 7fbb242a3640 1 -- start start 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb242a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb242a3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c102ed0 0x7fbb1c113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb242a3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c113d80 con 0x7fbb1c102530 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb242a3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c10d1c0 con 0x7fbb1c102ed0 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49582/0 (socket says 172.21.15.66:49582) 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 -- 172.21.15.66:0/3595270898 learned_addr learned my addr 172.21.15.66:0/3595270898 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2183e640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c102ed0 0x7fbb1c113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 -- 172.21.15.66:0/3595270898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c102ed0 msgr2=0x7fbb1c113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c102ed0 0x7fbb1c113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 -- 172.21.15.66:0/3595270898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0098b0 con 0x7fbb1c102530 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb2203f640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c113240 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c004750 tx=0x7fbb0c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.948+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0c009610 con 0x7fbb1c102530 2024-09-12T01:47:30.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.949+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c10d440 con 0x7fbb1c102530 2024-09-12T01:47:30.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.949+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbb0c032b10 con 0x7fbb1c102530 2024-09-12T01:47:30.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.949+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb0c03d990 con 0x7fbb1c102530 2024-09-12T01:47:30.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.949+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c10d9e0 con 0x7fbb1c102530 2024-09-12T01:47:30.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.950+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0fdcb0 con 0x7fbb1c102530 2024-09-12T01:47:30.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.950+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7fbb0c02f030 con 0x7fbb1c102530 2024-09-12T01:47:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.951+0000 7fbb1affd640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fbb0406d9b0 0x7fbb0406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.951+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fbb0c0ae3a0 con 0x7fbb1c102530 2024-09-12T01:47:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.951+0000 7fbb2183e640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fbb0406d9b0 0x7fbb0406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:30.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.951+0000 7fbb2183e640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fbb0406d9b0 0x7fbb0406fe60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c10eb00 tx=0x7fbb1000b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:30.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:30.955+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbb0c077f20 con 0x7fbb1c102530 2024-09-12T01:47:31.200 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.200+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb1c04b720 con 0x7fbb1c102530 2024-09-12T01:47:31.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:31 smithi066 ceph-mon[27875]: Upgrade: Target is version 19.1.1-298-gb53b6d3e (squid) 2024-09-12T01:47:31.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:31 smithi066 ceph-mon[27875]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66'] 2024-09-12T01:47:31.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:31 smithi066 ceph-mon[27875]: Upgrade: Setting container_image for all mgr 2024-09-12T01:47:31.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.200+0000 7fbb1affd640 1 -- 172.21.15.66:0/3595270898 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7fbb0c07b5e0 con 0x7fbb1c102530 2024-09-12T01:47:31.201 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:47:31.201 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:47:31.201 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2 2024-09-12T01:47:31.202 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:47:31.202 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:47:31.202 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:47:31.202 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:47:31.202 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:47:31.202 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 12, 2024-09-12T01:47:31.203 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:47:31.204 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:47:31.204 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:47:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fbb0406d9b0 msgr2=0x7fbb0406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fbb0406d9b0 0x7fbb0406fe60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c10eb00 tx=0x7fbb1000b040 comp rx=0 tx=0).stop 2024-09-12T01:47:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 msgr2=0x7fbb1c113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c113240 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c004750 tx=0x7fbb0c004d10 comp rx=0 tx=0).stop 2024-09-12T01:47:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 shutdown_connections 2024-09-12T01:47:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7fbb0406d9b0 0x7fbb0406fe60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb1c102ed0 0x7fbb1c113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 --2- 172.21.15.66:0/3595270898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb1c102530 0x7fbb1c113240 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 >> 172.21.15.66:0/3595270898 conn(0x7fbb1c0f80f0 msgr2=0x7fbb1c0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 shutdown_connections 2024-09-12T01:47:31.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.203+0000 7fbb242a3640 1 -- 172.21.15.66:0/3595270898 wait complete. 2024-09-12T01:47:31.285 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 -- 172.21.15.66:0/337461438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 msgr2=0x7ff78006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 --2- 172.21.15.66:0/337461438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff78006fe80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff77c0048d0 tx=0x7ff77c009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 -- 172.21.15.66:0/337461438 shutdown_connections 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 --2- 172.21.15.66:0/337461438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800703c0 0x7ff780108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 --2- 172.21.15.66:0/337461438 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff78006fe80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 -- 172.21.15.66:0/337461438 >> 172.21.15.66:0/337461438 conn(0x7ff7800f80f0 msgr2=0x7ff7800fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 -- 172.21.15.66:0/337461438 shutdown_connections 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 -- 172.21.15.66:0/337461438 wait complete. 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 Processor -- start 2024-09-12T01:47:31.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.285+0000 7ff78822e640 1 -- start start 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff78822e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff7801153e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff78822e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800703c0 0x7ff780115920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff78822e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780115f20 con 0x7ff78006fab0 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff78822e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff780116090 con 0x7ff7800703c0 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff7801153e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff7801153e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49608/0 (socket says 172.21.15.66:49608) 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 -- 172.21.15.66:0/3271972212 learned_addr learned my addr 172.21.15.66:0/3271972212 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff7857c9640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800703c0 0x7ff780115920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 -- 172.21.15.66:0/3271972212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800703c0 msgr2=0x7ff780115920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800703c0 0x7ff780115920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 -- 172.21.15.66:0/3271972212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c005040 con 0x7ff78006fab0 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.286+0000 7ff785fca640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff7801153e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000c00 tx=0x7ff77c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.287+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff77c038070 con 0x7ff78006fab0 2024-09-12T01:47:31.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.287+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78010f4b0 con 0x7ff78006fab0 2024-09-12T01:47:31.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.287+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff77c02ade0 con 0x7ff78006fab0 2024-09-12T01:47:31.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.287+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff77c02c7d0 con 0x7ff78006fab0 2024-09-12T01:47:31.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.287+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78010f970 con 0x7ff78006fab0 2024-09-12T01:47:31.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.288+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7800711f0 con 0x7ff78006fab0 2024-09-12T01:47:31.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.288+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7ff77c030020 con 0x7ff78006fab0 2024-09-12T01:47:31.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.289+0000 7ff7767fc640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff76c06d950 0x7ff76c06fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.289+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ff77c0ad720 con 0x7ff78006fab0 2024-09-12T01:47:31.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.289+0000 7ff7857c9640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff76c06d950 0x7ff76c06fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.289+0000 7ff7857c9640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff76c06d950 0x7ff76c06fe00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff780110ce0 tx=0x7ff77000b040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.293+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ff77c0772a0 con 0x7ff78006fab0 2024-09-12T01:47:31.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:31 smithi153 ceph-mon[34713]: Upgrade: Target is version 19.1.1-298-gb53b6d3e (squid) 2024-09-12T01:47:31.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:31 smithi153 ceph-mon[34713]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66'] 2024-09-12T01:47:31.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:31 smithi153 ceph-mon[34713]: Upgrade: Setting container_image for all mgr 2024-09-12T01:47:31.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.507+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7800fbd30 con 0x7ff78006fab0 2024-09-12T01:47:31.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.508+0000 7ff7767fc640 1 -- 172.21.15.66:0/3271972212 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1806 (secure 0 0 0) 0x7ff77c07a960 con 0x7ff78006fab0 2024-09-12T01:47:31.508 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:47:31.508 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:47:31.508 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:47:31.509 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:47:31.512 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:47:31.512 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:47:31.512 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:47:31.512 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:47:31.513 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:31.514 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:31.515 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff76c06d950 msgr2=0x7ff76c06fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff76c06d950 0x7ff76c06fe00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff780110ce0 tx=0x7ff77000b040 comp rx=0 tx=0).stop 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 msgr2=0x7ff7801153e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff7801153e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000c00 tx=0x7ff77c009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 shutdown_connections 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7ff76c06d950 0x7ff76c06fe00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7800703c0 0x7ff780115920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 --2- 172.21.15.66:0/3271972212 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff78006fab0 0x7ff7801153e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 >> 172.21.15.66:0/3271972212 conn(0x7ff7800f80f0 msgr2=0x7ff7800f9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.516 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 shutdown_connections 2024-09-12T01:47:31.517 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.510+0000 7ff78822e640 1 -- 172.21.15.66:0/3271972212 wait complete. 2024-09-12T01:47:31.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 -- 172.21.15.66:0/3739621676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fcf80 msgr2=0x7f31780fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 --2- 172.21.15.66:0/3739621676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fcf80 0x7f31780fd3d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f316c0048d0 tx=0x7f316c009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 -- 172.21.15.66:0/3739621676 shutdown_connections 2024-09-12T01:47:31.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 --2- 172.21.15.66:0/3739621676 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fcf80 0x7f31780fd3d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 --2- 172.21.15.66:0/3739621676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31780fb810 0x7f31780fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 -- 172.21.15.66:0/3739621676 >> 172.21.15.66:0/3739621676 conn(0x7f31780723b0 msgr2=0x7f31780727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.594+0000 7f317cb7b640 1 -- 172.21.15.66:0/3739621676 shutdown_connections 2024-09-12T01:47:31.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 -- 172.21.15.66:0/3739621676 wait complete. 2024-09-12T01:47:31.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 Processor -- start 2024-09-12T01:47:31.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 -- start start 2024-09-12T01:47:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 0x7f3178113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31780fcf80 0x7f31781136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3178113cd0 con 0x7f31780fb810 2024-09-12T01:47:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317cb7b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317810d110 con 0x7f31780fcf80 2024-09-12T01:47:31.597 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 0x7f3178113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 0x7f3178113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49630/0 (socket says 172.21.15.66:49630) 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.595+0000 7f317659c640 1 -- 172.21.15.66:0/2345638195 learned_addr learned my addr 172.21.15.66:0/2345638195 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f3175d9b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31780fcf80 0x7f31781136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f317659c640 1 -- 172.21.15.66:0/2345638195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31780fcf80 msgr2=0x7f31781136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f317659c640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31780fcf80 0x7f31781136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f317659c640 1 -- 172.21.15.66:0/2345638195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c005040 con 0x7f31780fb810 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f317659c640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 0x7f3178113190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f316800c830 tx=0x7f3168004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f316800a7d0 con 0x7f31780fb810 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f316800add0 con 0x7f31780fb810 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317810d3f0 con 0x7f31780fb810 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31680113a0 con 0x7f31780fb810 2024-09-12T01:47:31.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.596+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f317810d960 con 0x7f31780fb810 2024-09-12T01:47:31.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.597+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31780fcbc0 con 0x7f31780fb810 2024-09-12T01:47:31.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.598+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f3168012400 con 0x7f31780fb810 2024-09-12T01:47:31.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.598+0000 7f3166ffd640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f316006d9b0 0x7f316006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.599+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f316808d320 con 0x7f31780fb810 2024-09-12T01:47:31.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.599+0000 7f3175d9b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f316006d9b0 0x7f316006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.599+0000 7f3175d9b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f316006d9b0 0x7f316006fe60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f316c009ac0 tx=0x7f316c035040 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.604 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.604+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3168056f20 con 0x7f31780fb810 2024-09-12T01:47:31.795 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.795+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 --> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f317804b720 con 0x7f316006d9b0 2024-09-12T01:47:31.796 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.796+0000 7f3166ffd640 1 -- 172.21.15.66:0/2345638195 <== mgr.14622 v2:172.21.15.66:6800/2996582467 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f317804b720 con 0x7f316006d9b0 2024-09-12T01:47:31.796 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:47:31.796 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr" 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "2/21 daemons upgraded", 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading mon daemons", 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:47:31.797 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:47:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f316006d9b0 msgr2=0x7f316006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f316006d9b0 0x7f316006fe60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f316c009ac0 tx=0x7f316c035040 comp rx=0 tx=0).stop 2024-09-12T01:47:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 msgr2=0x7f3178113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 0x7f3178113190 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f316800c830 tx=0x7f3168004430 comp rx=0 tx=0).stop 2024-09-12T01:47:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 shutdown_connections 2024-09-12T01:47:31.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f316006d9b0 0x7f316006fe60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31780fcf80 0x7f31781136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 --2- 172.21.15.66:0/2345638195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31780fb810 0x7f3178113190 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.798+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 >> 172.21.15.66:0/2345638195 conn(0x7f31780723b0 msgr2=0x7f3178065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.799+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 shutdown_connections 2024-09-12T01:47:31.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.799+0000 7f317cb7b640 1 -- 172.21.15.66:0/2345638195 wait complete. 2024-09-12T01:47:31.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.882+0000 7f70ef640640 1 -- 172.21.15.66:0/3494276944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 msgr2=0x7f70e8102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.882+0000 7f70ef640640 1 --2- 172.21.15.66:0/3494276944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e8102900 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f70e40048d0 tx=0x7f70e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- 172.21.15.66:0/3494276944 shutdown_connections 2024-09-12T01:47:31.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 --2- 172.21.15.66:0/3494276944 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70e8102ed0 0x7f70e80fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 --2- 172.21.15.66:0/3494276944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e8102900 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- 172.21.15.66:0/3494276944 >> 172.21.15.66:0/3494276944 conn(0x7f70e80f80f0 msgr2=0x7f70e80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- 172.21.15.66:0/3494276944 shutdown_connections 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- 172.21.15.66:0/3494276944 wait complete. 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 Processor -- start 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- start start 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70e8102ed0 0x7f70e806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8070490 con 0x7f70e8102530 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.883+0000 7f70ef640640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8070600 con 0x7f70e8102ed0 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:49642/0 (socket says 172.21.15.66:49642) 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 -- 172.21.15.66:0/1027670726 learned_addr learned my addr 172.21.15.66:0/1027670726 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ecbdb640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70e8102ed0 0x7f70e806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 -- 172.21.15.66:0/1027670726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70e8102ed0 msgr2=0x7f70e806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70e8102ed0 0x7f70e806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 -- 172.21.15.66:0/1027670726 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4005040 con 0x7f70e8102530 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ed3dc640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e806fa10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f70e4000c00 tx=0x7f70e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e4038070 con 0x7f70e8102530 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e8070830 con 0x7f70e8102530 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f70e402ade0 con 0x7f70e8102530 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e402c7e0 con 0x7f70e8102530 2024-09-12T01:47:31.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.884+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e8119890 con 0x7f70e8102530 2024-09-12T01:47:31.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.886+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e80fdcb0 con 0x7f70e8102530 2024-09-12T01:47:31.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.886+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 33) v1 ==== 91925+0+0 (secure 0 0 0) 0x7f70e4030020 con 0x7f70e8102530 2024-09-12T01:47:31.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.887+0000 7f70d9ffb640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f70d406d9b0 0x7f70d406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:47:31.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.887+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f70e40aceb0 con 0x7f70e8102530 2024-09-12T01:47:31.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.887+0000 7f70ecbdb640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f70d406d9b0 0x7f70d406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:47:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.887+0000 7f70ecbdb640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f70d406d9b0 0x7f70d406fe60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009fd0 tx=0x7f70dc009e50 comp rx=0 tx=0).ready entity=mgr.14622 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:47:31.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:31.891+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f70e4076ae0 con 0x7f70e8102530 2024-09-12T01:47:32.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.136+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f70e80fbd30 con 0x7f70e8102530 2024-09-12T01:47:32.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.136+0000 7f70d9ffb640 1 -- 172.21.15.66:0/1027670726 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f70e407a1a0 con 0x7f70e8102530 2024-09-12T01:47:32.137 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_OK 2024-09-12T01:47:32.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f70d406d9b0 msgr2=0x7f70d406fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f70d406d9b0 0x7f70d406fe60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009fd0 tx=0x7f70dc009e50 comp rx=0 tx=0).stop 2024-09-12T01:47:32.138 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 msgr2=0x7f70e806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e806fa10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f70e4000c00 tx=0x7f70e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 shutdown_connections 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:6800/2996582467,v1:172.21.15.66:6801/2996582467] conn(0x7f70d406d9b0 0x7f70d406fe60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70e8102ed0 0x7f70e806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 --2- 172.21.15.66:0/1027670726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e8102530 0x7f70e806fa10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 >> 172.21.15.66:0/1027670726 conn(0x7f70e80f80f0 msgr2=0x7f70e80f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 shutdown_connections 2024-09-12T01:47:32.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:47:32.138+0000 7f70ef640640 1 -- 172.21.15.66:0/1027670726 wait complete. 2024-09-12T01:47:32.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:32.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:32.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:32.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: pgmap v92: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:32.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3595270898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:32.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:32.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:47:32.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:47:32.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:32.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:32 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/3271972212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: pgmap v92: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3595270898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:32.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:32 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/3271972212' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:47:33.013 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 systemd[1]: Stopping Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:47:33.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 ceph-mon[27875]: Upgrade: Updating mon.smithi066 2024-09-12T01:47:33.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 ceph-mon[27875]: Deploying daemon mon.smithi066 on smithi066 2024-09-12T01:47:33.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 ceph-mon[27875]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:33.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 ceph-mon[27875]: from='client.? 172.21.15.66:0/1027670726' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:47:33.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[27871]: 2024-09-12T01:47:33.261+0000 7f17c0301640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi066 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:47:33.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[27871]: 2024-09-12T01:47:33.261+0000 7f17c0301640 -1 mon.smithi066@0(leader) e2 *** Got Signal Terminated *** 2024-09-12T01:47:33.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:33 smithi153 ceph-mon[34713]: Upgrade: Updating mon.smithi066 2024-09-12T01:47:33.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:33 smithi153 ceph-mon[34713]: Deploying daemon mon.smithi066 on smithi066 2024-09-12T01:47:33.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:33 smithi153 ceph-mon[34713]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:47:33.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:33 smithi153 ceph-mon[34713]: from='client.? 172.21.15.66:0/1027670726' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:47:33.603 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 podman[110841]: 2024-09-12 01:47:33.312658956 +0000 UTC m=+0.146238398 container died 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-554ba93, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:47:33.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 podman[110841]: 2024-09-12 01:47:33.669407097 +0000 UTC m=+0.502986538 container cleanup 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-554ba93, ceph=True) 2024-09-12T01:47:33.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 bash[110841]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066 2024-09-12T01:47:34.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:33 smithi066 podman[110854]: 2024-09-12 01:47:33.954252564 +0000 UTC m=+0.642564148 container remove 2554e537271ea7a88918cb709b96fcb19df369646f0ec915c7a86e5c0c1f0b3a (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=quincy-554ba93, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-12T01:47:34.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service: Deactivated successfully. 2024-09-12T01:47:34.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 systemd[1]: Stopped Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:47:34.330 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service: Consumed 13.298s CPU time. 2024-09-12T01:47:34.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 systemd[1]: Starting Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:47:34.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 podman[110978]: 2024-09-12 01:47:34.445636994 +0000 UTC m=+0.016542663 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:47:34.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 podman[110978]: 2024-09-12 01:47:34.571939813 +0000 UTC m=+0.142845475 container create f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 podman[110978]: 2024-09-12 01:47:34.824719824 +0000 UTC m=+0.395625481 container init f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 podman[110978]: 2024-09-12 01:47:34.828115056 +0000 UTC m=+0.399020710 container start f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: pidfile_write: ignore empty --pid-file 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: load: jerasure load: lrc 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Git sha 0 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:47:35.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: DB SUMMARY 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: DB Session ID: 6OARLVEXXKU52421018P 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1169 Bytes 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi066/store.db dir, Total Num: 1, files: 000033.sst 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi066/store.db: 000031.log size: 1267236 ; 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:47:35.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.env: 0x560dcb560940 2024-09-12T01:47:35.142 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:47:35.142 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.info_log: 0x560dcc4338c0 2024-09-12T01:47:35.142 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.statistics: (nil) 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.use_fsync: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:47:35.143 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.db_log_dir: 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.wal_dir: 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.write_buffer_manager: 0x560dcc442dc0 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:47:35.144 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.unordered_write: 0 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.row_cache: None 2024-09-12T01:47:35.145 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.wal_filter: None 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.wal_compression: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:47:35.146 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:47:35.147 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_open_files: -1 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Compression algorithms supported: 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kZSTD supported: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:47:35.148 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi066/store.db/MANIFEST-000015 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.merge_operator: 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_filter: None 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:47:35.149 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560dcc433520) 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: index_type: 0 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: data_block_index_type: 0 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: index_shortening: 1 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: checksum: 4 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: no_block_cache: 0 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache: 0x560dcc4271f0 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:47:35.150 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache_options: 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: capacity : 536870912 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: num_shard_bits : 4 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: strict_capacity_limit : 0 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_cache_compressed: (nil) 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: persistent_cache: (nil) 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_size: 4096 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_size_deviation: 10 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_restart_interval: 16 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: index_block_restart_interval: 1 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: metadata_block_size: 4096 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: partition_filters: 0 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: use_delta_encoding: 1 2024-09-12T01:47:35.151 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: filter_policy: bloomfilter 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: whole_key_filtering: 1 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: verify_compression: 0 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: format_version: 5 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: enable_index_compression: 1 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: block_align: 0 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: max_auto_readahead_size: 262144 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: prepopulate_block_cache: 0 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression: NoCompression 2024-09-12T01:47:35.152 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.num_levels: 7 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:47:35.153 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:47:35.154 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:47:35.155 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:47:35.155 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:47:35.155 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:47:35.155 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:47:35.156 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:47:35.157 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.ttl: 2592000 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:47:35.158 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-09-12T01:47:35.159 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi066/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 12019, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3f5d120e-4af7-4f9d-9064-afb71cd2223e 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105654855536, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105654860690, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 1190379, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12020, "largest_seqno": 13235, "table_properties": {"data_size": 1184549, "index_size": 3317, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13721, "raw_average_key_size": 24, "raw_value_size": 1172654, "raw_average_value_size": 2079, "num_data_blocks": 149, "num_entries": 564, "num_filter_entries": 564, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105654, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3f5d120e-4af7-4f9d-9064-afb71cd2223e", "db_session_id": "6OARLVEXXKU52421018P", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105654860811, "job": 1, "event": "recovery_finished"} 2024-09-12T01:47:35.160 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-09-12T01:47:35.161 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-12T01:47:35.161 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi066/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:47:35.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560dcc454e00 2024-09-12T01:47:35.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: DB pointer 0x560dcc550000 2024-09-12T01:47:35.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:47:35.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:47:35.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** DB Stats ** 2024-09-12T01:47:35.162 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:47:35.163 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: L0 1/0 1.14 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: L6 1/0 7.19 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Sum 2/0 8.32 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 419.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** Compaction Stats [default] ** 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 419.5 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.164 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Cumulative compaction: 0.00 GB write, 116.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Interval compaction: 0.00 GB write, 116.83 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Block cache BinnedLRUCache@0x560dcc4271f0#2 capacity: 512.00 MB usage: 4.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,3.33 KB,0.000634789%) Misc(1,0.00 KB,0%) 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.165 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: starting mon.smithi066 rank 0 at public addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] at bind addrs [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi066 fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???) e2 preinit fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).mds e16 new map 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).mds e16 print_map 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: e16 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: legacy client fscid: 1 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Filesystem 'cephfs' (1) 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: fs_name cephfs 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: epoch 16 2024-09-12T01:47:35.166 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: tableserver 0 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: root 0 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: session_timeout 60 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: session_autoclose 300 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: max_file_size 1099511627776 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: max_xattr_size 65536 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: required_client_features {} 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: last_failure 0 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: last_failure_osd_epoch 44 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: max_mds 1 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: in 0 2024-09-12T01:47:35.167 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: up {0=14462} 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: failed 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: damaged 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: stopped 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: data_pools [3] 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: metadata_pool 2 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: inline_data disabled 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: balancer 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: bal_rank_mask -1 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: standby_count_wanted 1 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: qdb_cluster leader: 0 members: 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: [mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.168 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Standby daemons: 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: [mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: [mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: [mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-12T01:47:35.169 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 ceph-mon[110996]: mon.smithi066@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-12T01:47:35.170 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 bash[110978]: f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 2024-09-12T01:47:35.170 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:34 smithi066 systemd[1]: Started Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: pgmap v94: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: mon.smithi066 calling monitor election 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: mon.smithi066 is new leader, mons smithi066,smithi153 in quorum (ranks 0,1) 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: monmap epoch 2 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: last_changed 2024-09-12T01:36:24.402578+0000 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: created 2024-09-12T01:33:57.049610+0000 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: min_mon_release 17 (quincy) 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: election_strategy: 1 2024-09-12T01:47:36.449 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.smithi066 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.smithi153 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: osdmap e46: 6 total, 6 up, 6 in 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: mgrmap e33: smithi066.qdwcrh(active, since 3m), standbys: smithi153.jpnqza 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: overall HEALTH_OK 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: from='mgr.14622 ' entity='' 2024-09-12T01:47:36.450 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:36 smithi066 ceph-mon[110996]: mgrmap e34: smithi066.qdwcrh(active, since 3m), standbys: smithi153.jpnqza 2024-09-12T01:47:36.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: from='mgr.14622 172.21.15.66:0/1237264173' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:36.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: pgmap v94: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:36.652 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: mon.smithi066 calling monitor election 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: mon.smithi066 is new leader, mons smithi066,smithi153 in quorum (ranks 0,1) 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: monmap epoch 2 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: last_changed 2024-09-12T01:36:24.402578+0000 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: created 2024-09-12T01:33:57.049610+0000 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: min_mon_release 17 (quincy) 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: election_strategy: 1 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.smithi066 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.smithi153 2024-09-12T01:47:36.653 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:47:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: osdmap e46: 6 total, 6 up, 6 in 2024-09-12T01:47:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: mgrmap e33: smithi066.qdwcrh(active, since 3m), standbys: smithi153.jpnqza 2024-09-12T01:47:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: overall HEALTH_OK 2024-09-12T01:47:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: from='mgr.14622 ' entity='' 2024-09-12T01:47:36.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:36 smithi153 ceph-mon[34713]: mgrmap e34: smithi066.qdwcrh(active, since 3m), standbys: smithi153.jpnqza 2024-09-12T01:47:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:41 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza restarted 2024-09-12T01:47:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:41 smithi153 ceph-mon[34713]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:47:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:41 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:47:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:41 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:47:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:41 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:47:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:41 smithi153 ceph-mon[34713]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:47:41.451 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:41 smithi066 ceph-mon[110996]: Standby manager daemon smithi153.jpnqza restarted 2024-09-12T01:47:41.451 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:41 smithi066 ceph-mon[110996]: Standby manager daemon smithi153.jpnqza started 2024-09-12T01:47:41.451 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:41 smithi066 ceph-mon[110996]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/crt"}]: dispatch 2024-09-12T01:47:41.451 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:41 smithi066 ceph-mon[110996]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-12T01:47:41.451 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:41 smithi066 ceph-mon[110996]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi153.jpnqza/key"}]: dispatch 2024-09-12T01:47:41.451 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:41 smithi066 ceph-mon[110996]: from='mgr.? 172.21.15.153:0/514321184' entity='mgr.smithi153.jpnqza' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-12T01:47:42.489 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: mgrmap e35: smithi066.qdwcrh(active, since 3m), standbys: smithi153.jpnqza 2024-09-12T01:47:42.489 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: Active manager daemon smithi066.qdwcrh restarted 2024-09-12T01:47:42.489 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: osdmap e47: 6 total, 6 up, 6 in 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: mgrmap e36: smithi066.qdwcrh(active, starting, since 0.00769712s), standbys: smithi153.jpnqza 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:47:42.490 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:47:42.491 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:42 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:47:42.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: mgrmap e35: smithi066.qdwcrh(active, since 3m), standbys: smithi153.jpnqza 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: Active manager daemon smithi066.qdwcrh restarted 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: Activating manager daemon smithi066.qdwcrh 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: osdmap e47: 6 total, 6 up, 6 in 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: mgrmap e36: smithi066.qdwcrh(active, starting, since 0.00769712s), standbys: smithi153.jpnqza 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:47:42.548 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi066.qdwcrh", "id": "smithi066.qdwcrh"}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr metadata", "who": "smithi153.jpnqza", "id": "smithi153.jpnqza"}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: Manager daemon smithi066.qdwcrh is now available 2024-09-12T01:47:42.549 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:42.550 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:47:42.550 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/mirror_snapshot_schedule"}]: dispatch 2024-09-12T01:47:42.550 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi066.qdwcrh/trash_purge_schedule"}]: dispatch 2024-09-12T01:47:43.495 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:43 smithi066 ceph-mon[110996]: mgrmap e37: smithi066.qdwcrh(active, since 1.00954s), standbys: smithi153.jpnqza 2024-09-12T01:47:43.495 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:43 smithi066 ceph-mon[110996]: pgmap v3: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:43.516 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:43 smithi153 ceph-mon[34713]: mgrmap e37: smithi066.qdwcrh(active, since 1.00954s), standbys: smithi153.jpnqza 2024-09-12T01:47:43.516 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:43 smithi153 ceph-mon[34713]: pgmap v3: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: [12/Sep/2024:01:47:43] ENGINE Bus STARTING 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: mgrmap e38: smithi066.qdwcrh(active, since 2s), standbys: smithi153.jpnqza 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: pgmap v4: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: [12/Sep/2024:01:47:43] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: [12/Sep/2024:01:47:43] ENGINE Error in HTTPServer.serve 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Traceback (most recent call last): 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:47:44.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._run(expiration_interval) 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: s = self.context.wrap_socket( 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: return self.sslsocket_class._create( 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self.do_handshake() 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: self._sslobj.do_handshake() 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:47:44.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: [12/Sep/2024:01:47:43] ENGINE Serving on http://172.21.15.66:8765 2024-09-12T01:47:44.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:44 smithi153 ceph-mon[34713]: [12/Sep/2024:01:47:43] ENGINE Bus STARTED 2024-09-12T01:47:44.733 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: [12/Sep/2024:01:47:43] ENGINE Bus STARTING 2024-09-12T01:47:44.733 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: mgrmap e38: smithi066.qdwcrh(active, since 2s), standbys: smithi153.jpnqza 2024-09-12T01:47:44.733 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: pgmap v4: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:44.733 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: [12/Sep/2024:01:47:43] ENGINE Serving on https://172.21.15.66:7150 2024-09-12T01:47:44.733 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: [12/Sep/2024:01:47:43] ENGINE Error in HTTPServer.serve 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: Traceback (most recent call last): 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._connections.run(self.expiration_interval) 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._run(expiration_interval) 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: s = self.context.wrap_socket( 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: return self.sslsocket_class._create( 2024-09-12T01:47:44.734 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-12T01:47:44.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self.do_handshake() 2024-09-12T01:47:44.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-12T01:47:44.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: self._sslobj.do_handshake() 2024-09-12T01:47:44.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-12T01:47:44.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: [12/Sep/2024:01:47:43] ENGINE Serving on http://172.21.15.66:8765 2024-09-12T01:47:44.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:44 smithi066 ceph-mon[110996]: [12/Sep/2024:01:47:43] ENGINE Bus STARTED 2024-09-12T01:47:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:45 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:45 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:45 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:45.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:45 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:47 smithi066 ceph-mon[110996]: pgmap v5: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:47 smithi066 ceph-mon[110996]: mgrmap e39: smithi066.qdwcrh(active, since 4s), standbys: smithi153.jpnqza 2024-09-12T01:47:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:47 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:47 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:47 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:47 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:47 smithi153 ceph-mon[34713]: pgmap v5: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:47:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:47 smithi153 ceph-mon[34713]: mgrmap e39: smithi066.qdwcrh(active, since 4s), standbys: smithi153.jpnqza 2024-09-12T01:47:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:47 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:47 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:47 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:47 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:49.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:49 smithi066 ceph-mon[110996]: pgmap v6: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-12T01:47:49.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:49 smithi153 ceph-mon[34713]: pgmap v6: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 41 KiB/s rd, 0 B/s wr, 23 op/s 2024-09-12T01:47:51.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:51 smithi066 ceph-mon[110996]: pgmap v7: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-12T01:47:51.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:51.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:51.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:51.392 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:51.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:51 smithi153 ceph-mon[34713]: pgmap v7: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-09-12T01:47:51.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:51 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:51.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:51 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:51.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:51 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:51.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:51 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Detected new or changed devices on smithi066 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:47:52.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:52.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:52 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-12T01:47:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Detected new or changed devices on smithi066 2024-09-12T01:47:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi066:/etc/ceph/ceph.conf 2024-09-12T01:47:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi153:/etc/ceph/ceph.conf 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi066:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi153:/etc/ceph/ceph.client.admin.keyring 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: Updating smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:52.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:47:52.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-12T01:47:53.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:53 smithi153 ceph-mon[34713]: pgmap v8: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:47:53.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:53 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:53.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:53 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:47:53.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:53 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:47:53.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:53 smithi153 ceph-mon[34713]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:53 smithi066 ceph-mon[110996]: pgmap v8: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-12T01:47:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:47:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:47:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:47:54.512 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:54 smithi153 ceph-mon[34713]: Upgrade: Updating mon.smithi153 2024-09-12T01:47:54.512 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:54 smithi153 ceph-mon[34713]: Deploying daemon mon.smithi153 on smithi153 2024-09-12T01:47:54.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:54 smithi066 ceph-mon[110996]: Upgrade: Updating mon.smithi153 2024-09-12T01:47:54.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:54 smithi066 ceph-mon[110996]: Deploying daemon mon.smithi153 on smithi153 2024-09-12T01:47:54.789 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:54 smithi153 systemd[1]: Stopping Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:47:55.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:54 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153[34688]: 2024-09-12T01:47:54.789+0000 7fae386c7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi153 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:47:55.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:54 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153[34688]: 2024-09-12T01:47:54.789+0000 7fae386c7640 -1 mon.smithi153@1(peon) e2 *** Got Signal Terminated *** 2024-09-12T01:47:55.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:54 smithi153 podman[80742]: 2024-09-12 01:47:54.952486809 +0000 UTC m=+0.294914341 container died ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, RELEASE=quincy-554ba93, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-12T01:47:55.427 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 podman[80742]: 2024-09-12 01:47:55.267506674 +0000 UTC m=+0.609934188 container cleanup ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=quincy-554ba93, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-12T01:47:55.427 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 bash[80742]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153 2024-09-12T01:47:55.839 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 podman[80753]: 2024-09-12 01:47:55.427685837 +0000 UTC m=+0.476722002 container remove ee5ee331f3c0729764dd5bee752b0443d7f3f3ad1cbe1bdd04c1eea78cfb98c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, io.buildah.version=1.37.2, RELEASE=quincy-554ba93, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:47:55.839 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi153.service: Deactivated successfully. 2024-09-12T01:47:55.839 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 systemd[1]: Stopped Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:47:55.839 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi153.service: Consumed 7.089s CPU time. 2024-09-12T01:47:56.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:55 smithi153 systemd[1]: Starting Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:47:56.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 podman[80880]: 2024-09-12 01:47:55.952208492 +0000 UTC m=+0.015932702 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:47:56.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 podman[80880]: 2024-09-12 01:47:56.056325291 +0000 UTC m=+0.120049541 container create d8441d45e1435eb97c751da87f19dc9e1e514ae27a90bc0d79310ab0c1fab1ff (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3) 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 podman[80880]: 2024-09-12 01:47:56.250522351 +0000 UTC m=+0.314246551 container init d8441d45e1435eb97c751da87f19dc9e1e514ae27a90bc0d79310ab0c1fab1ff (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 podman[80880]: 2024-09-12 01:47:56.253741605 +0000 UTC m=+0.317465803 container start d8441d45e1435eb97c751da87f19dc9e1e514ae27a90bc0d79310ab0c1fab1ff (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: set uid:gid to 167:167 (ceph:ceph) 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable), process ceph-mon, pid 2 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: pidfile_write: ignore empty --pid-file 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: load: jerasure load: lrc 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: RocksDB version: 7.9.2 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Git sha 0 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Compile date 2024-09-09 16:23:28 2024-09-12T01:47:56.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: DB SUMMARY 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: DB Session ID: D6JGTEDNUDYIK417KVNI 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: CURRENT file: CURRENT 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: IDENTITY file: IDENTITY 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1093 Bytes 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi153/store.db dir, Total Num: 1, files: 000027.sst 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi153/store.db: 000025.log size: 4749450 ; 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.error_if_exists: 0 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.create_if_missing: 0 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.paranoid_checks: 1 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-12T01:47:56.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.env: 0x5611ea9ef940 2024-09-12T01:47:56.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.fs: PosixFileSystem 2024-09-12T01:47:56.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.info_log: 0x5611ec9af8c0 2024-09-12T01:47:56.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_file_opening_threads: 16 2024-09-12T01:47:56.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.statistics: (nil) 2024-09-12T01:47:56.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.use_fsync: 0 2024-09-12T01:47:56.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_log_file_size: 0 2024-09-12T01:47:56.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-12T01:47:56.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.keep_log_file_num: 1000 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.recycle_log_file_num: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.allow_fallocate: 1 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.allow_mmap_reads: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.allow_mmap_writes: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.use_direct_reads: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.create_missing_column_families: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.db_log_dir: 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.wal_dir: 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-12T01:47:56.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.advise_random_on_open: 1 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.db_write_buffer_size: 0 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.write_buffer_manager: 0x5611ec9bedc0 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.rate_limiter: (nil) 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.wal_recovery_mode: 2 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.enable_thread_tracking: 0 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.enable_pipelined_write: 0 2024-09-12T01:47:56.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.unordered_write: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.row_cache: None 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.wal_filter: None 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.allow_ingest_behind: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.two_write_queues: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.manual_wal_flush: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.wal_compression: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.atomic_flush: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-12T01:47:56.661 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.log_readahead_size: 0 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.best_efforts_recovery: 0 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.allow_data_in_errors: 0 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.db_host_id: __hostname__ 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_background_jobs: 2 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_background_compactions: -1 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_subcompactions: 1 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-12T01:47:56.662 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_total_wal_size: 0 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_open_files: -1 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bytes_per_sync: 0 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_readahead_size: 0 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_background_flushes: -1 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Compression algorithms supported: 2024-09-12T01:47:56.663 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kZSTD supported: 0 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kXpressCompression supported: 0 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kBZip2Compression supported: 0 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kLZ4Compression supported: 1 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kZlibCompression supported: 1 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kLZ4HCCompression supported: 1 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: kSnappyCompression supported: 1 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000009 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-12T01:47:56.664 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.merge_operator: 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_filter: None 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_filter_factory: None 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.sst_partitioner_factory: None 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5611ec9af520) 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks: 1 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: pin_top_level_index_and_filter: 1 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_type: 0 2024-09-12T01:47:56.665 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_index_type: 0 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_shortening: 1 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: checksum: 4 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: no_block_cache: 0 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache: 0x5611ec9a31f0 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_name: BinnedLRUCache 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_options: 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: capacity : 536870912 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_shard_bits : 4 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: strict_capacity_limit : 0 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: high_pri_pool_ratio: 0.000 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_cache_compressed: (nil) 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: persistent_cache: (nil) 2024-09-12T01:47:56.666 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size: 4096 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_size_deviation: 10 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_restart_interval: 16 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: index_block_restart_interval: 1 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: metadata_block_size: 4096 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: partition_filters: 0 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: use_delta_encoding: 1 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: filter_policy: bloomfilter 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: whole_key_filtering: 1 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: verify_compression: 0 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: read_amp_bytes_per_bit: 0 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: format_version: 5 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_index_compression: 1 2024-09-12T01:47:56.667 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: block_align: 0 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_auto_readahead_size: 262144 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: prepopulate_block_cache: 0 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: initial_auto_readahead_size: 8192 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: num_file_reads_for_auto_readahead: 2 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.write_buffer_size: 33554432 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_write_buffer_number: 2 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression: NoCompression 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression: Disabled 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.prefix_extractor: nullptr 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.num_levels: 7 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-12T01:47:56.668 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.level: 32767 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.strategy: 0 2024-09-12T01:47:56.669 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.enabled: false 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.target_file_size_base: 67108864 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-12T01:47:56.670 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.arena_block_size: 1048576 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-12T01:47:56.671 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.disable_auto_compactions: 0 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-12T01:47:56.672 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.inplace_update_support: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.bloom_locality: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.max_successive_merges: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.paranoid_file_checks: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.force_consistency_checks: 1 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.report_bg_io_stats: 0 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.ttl: 2592000 2024-09-12T01:47:56.673 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.enable_blob_files: false 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.min_blob_size: 0 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.blob_file_size: 268435456 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.blob_file_starting_level: 0 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-12T01:47:56.674 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi153/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12297, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5a121ed2-6b20-4994-b832-212aabf72530 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105676280366, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105676291406, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2990450, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12302, "largest_seqno": 14115, "table_properties": {"data_size": 2982746, "index_size": 4738, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1925, "raw_key_size": 18508, "raw_average_key_size": 24, "raw_value_size": 2966467, "raw_average_value_size": 3867, "num_data_blocks": 214, "num_entries": 767, "num_filter_entries": 767, "num_deletions": 7, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726105676, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5a121ed2-6b20-4994-b832-212aabf72530", "db_session_id": "D6JGTEDNUDYIK417KVNI", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726105676291529, "job": 1, "event": "recovery_finished"} 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi153/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5611ec9d0e00 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: DB pointer 0x5611ecacc000 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-12T01:47:56.675 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** DB Stats ** 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L0 1/0 2.85 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 677.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: L6 1/0 7.19 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-12T01:47:56.676 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Sum 2/0 10.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 677.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 677.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** Compaction Stats [default] ** 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 677.3 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-12T01:47:56.677 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Cumulative compaction: 0.00 GB write, 159.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Interval compaction: 0.00 GB write, 159.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Block cache BinnedLRUCache@0x5611ec9a31f0#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: starting mon.smithi153 rank 1 at public addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] at bind addrs [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi153 fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???) e2 preinit fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).mds e16 new map 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).mds e16 print_map 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: e16 2024-09-12T01:47:56.678 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: legacy client fscid: 1 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Filesystem 'cephfs' (1) 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: fs_name cephfs 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: epoch 16 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: tableserver 0 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: root 0 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: session_timeout 60 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: session_autoclose 300 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_file_size 1099511627776 2024-09-12T01:47:56.679 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_xattr_size 65536 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: required_client_features {} 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: last_failure 0 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: last_failure_osd_epoch 44 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: max_mds 1 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: in 0 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: up {0=14462} 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: failed 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: damaged 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: stopped 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: data_pools [3] 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: metadata_pool 2 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: inline_data disabled 2024-09-12T01:47:56.680 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: balancer 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: bal_rank_mask -1 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: standby_count_wanted 1 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: qdb_cluster leader: 0 members: 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: Standby daemons: 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout: [mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-12T01:47:56.681 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-12T01:47:56.682 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: mon.smithi153@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-09-12T01:47:56.682 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 bash[80880]: d8441d45e1435eb97c751da87f19dc9e1e514ae27a90bc0d79310ab0c1fab1ff 2024-09-12T01:47:56.682 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 systemd[1]: Started Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:47:57.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:56 smithi066 ceph-mon[110996]: pgmap v9: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T01:47:57.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:56 smithi153 ceph-mon[80899]: pgmap v9: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-12T01:47:57.965 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: overall HEALTH_OK 2024-09-12T01:47:57.965 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: mon.smithi066 calling monitor election 2024-09-12T01:47:57.965 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: mon.smithi153 calling monitor election 2024-09-12T01:47:57.965 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:47:57.965 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: mon.smithi066 is new leader, mons smithi066,smithi153 in quorum (ranks 0,1) 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: monmap epoch 3 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: last_changed 2024-09-12T01:47:56.709961+0000 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: created 2024-09-12T01:33:57.049610+0000 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: min_mon_release 19 (squid) 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: election_strategy: 1 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.smithi066 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.smithi153 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: osdmap e47: 6 total, 6 up, 6 in 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: mgrmap e39: smithi066.qdwcrh(active, since 15s), standbys: smithi153.jpnqza 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: overall HEALTH_OK 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:47:57.966 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:57.967 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:57.967 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:58.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: overall HEALTH_OK 2024-09-12T01:47:58.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: mon.smithi066 calling monitor election 2024-09-12T01:47:58.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: mon.smithi153 calling monitor election 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi066"}]: dispatch 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: mon.smithi066 is new leader, mons smithi066,smithi153 in quorum (ranks 0,1) 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: monmap epoch 3 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: fsid f9344df4-70a6-11ef-bcea-c7b262605968 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: last_changed 2024-09-12T01:47:56.709961+0000 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: created 2024-09-12T01:33:57.049610+0000 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: min_mon_release 19 (squid) 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: election_strategy: 1 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: 0: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.smithi066 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: 1: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.smithi153 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: osdmap e47: 6 total, 6 up, 6 in 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: mgrmap e39: smithi066.qdwcrh(active, since 15s), standbys: smithi153.jpnqza 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: overall HEALTH_OK 2024-09-12T01:47:58.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mon metadata", "id": "smithi153"}]: dispatch 2024-09-12T01:47:58.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:58.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:47:58.141 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:47:59.021 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:47:58 smithi153 ceph-mon[80899]: pgmap v11: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-12T01:47:59.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:47:58 smithi066 ceph-mon[110996]: pgmap v11: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-12T01:48:00.724 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:00 smithi153 ceph-mon[80899]: pgmap v12: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:00.724 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:00 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.724 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:00 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.724 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:00 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.724 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:00 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:00 smithi066 ceph-mon[110996]: pgmap v12: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:00 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:00 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:00 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:00 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 -- 172.21.15.66:0/1416650091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fe100 msgr2=0x7f50881065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 --2- 172.21.15.66:0/1416650091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fe100 0x7f50881065a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f50780048d0 tx=0x7f5078009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 -- 172.21.15.66:0/1416650091 shutdown_connections 2024-09-12T01:48:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 --2- 172.21.15.66:0/1416650091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fe100 0x7f50881065a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 --2- 172.21.15.66:0/1416650091 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50880fd760 0x7f50880fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 -- 172.21.15.66:0/1416650091 >> 172.21.15.66:0/1416650091 conn(0x7f50880f7030 msgr2=0x7f50880f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 -- 172.21.15.66:0/1416650091 shutdown_connections 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.234+0000 7f508f7aa640 1 -- 172.21.15.66:0/1416650091 wait complete. 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508f7aa640 1 Processor -- start 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508f7aa640 1 -- start start 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508f7aa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 0x7f5088115540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508f7aa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50880fe100 0x7f5088115a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508f7aa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50881160d0 con 0x7f50880fd760 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508f7aa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508810f4e0 con 0x7f50880fe100 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508d546640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 0x7f5088115540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508d546640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 0x7f5088115540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38790/0 (socket says 172.21.15.66:38790) 2024-09-12T01:48:02.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508d546640 1 -- 172.21.15.66:0/3585549360 learned_addr learned my addr 172.21.15.66:0/3585549360 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.235+0000 7f508cd45640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50880fe100 0x7f5088115a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f508d546640 1 -- 172.21.15.66:0/3585549360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50880fe100 msgr2=0x7f5088115a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f508d546640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50880fe100 0x7f5088115a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f508d546640 1 -- 172.21.15.66:0/3585549360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078005040 con 0x7f50880fd760 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f508d546640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 0x7f5088115540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5084002a80 tx=0x7f5084004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5084007c30 con 0x7f50880fd760 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f508400f040 con 0x7f50880fd760 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f508400dab0 con 0x7f50880fd760 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.236+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508810f7c0 con 0x7f50880fd760 2024-09-12T01:48:02.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.237+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508810fcb0 con 0x7f50880fd760 2024-09-12T01:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.238+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50880fac90 con 0x7f50880fd760 2024-09-12T01:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.238+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f508400dc10 con 0x7f50880fd760 2024-09-12T01:48:02.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.239+0000 7f507dffb640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f507406e1e0 0x7f5074070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.239+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f508408d590 con 0x7f50880fd760 2024-09-12T01:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.239+0000 7f508cd45640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f507406e1e0 0x7f5074070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.239+0000 7f508cd45640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f507406e1e0 0x7f5074070690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50780048a0 tx=0x7f5078035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:02.244 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.244+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5084056820 con 0x7f50880fd760 2024-09-12T01:48:02.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.442+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5088110be0 con 0x7f507406e1e0 2024-09-12T01:48:02.443 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.444+0000 7f507dffb640 1 -- 172.21.15.66:0/3585549360 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f5088110be0 con 0x7f507406e1e0 2024-09-12T01:48:02.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f507406e1e0 msgr2=0x7f5074070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f507406e1e0 0x7f5074070690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50780048a0 tx=0x7f5078035040 comp rx=0 tx=0).stop 2024-09-12T01:48:02.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 msgr2=0x7f5088115540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 0x7f5088115540 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5084002a80 tx=0x7f5084004600 comp rx=0 tx=0).stop 2024-09-12T01:48:02.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 shutdown_connections 2024-09-12T01:48:02.446 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f507406e1e0 0x7f5074070690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50880fe100 0x7f5088115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 --2- 172.21.15.66:0/3585549360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50880fd760 0x7f5088115540 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 >> 172.21.15.66:0/3585549360 conn(0x7f50880f7030 msgr2=0x7f50880fb920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:02.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 shutdown_connections 2024-09-12T01:48:02.447 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.446+0000 7f508f7aa640 1 -- 172.21.15.66:0/3585549360 wait complete. 2024-09-12T01:48:02.454 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:48:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.528+0000 7f43cc82a640 1 -- 172.21.15.66:0/3088586264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c80fac80 msgr2=0x7f43c80fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.529 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.528+0000 7f43cc82a640 1 --2- 172.21.15.66:0/3088586264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c80fac80 0x7f43c80fb0f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0048d0 tx=0x7f43bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 -- 172.21.15.66:0/3088586264 shutdown_connections 2024-09-12T01:48:02.530 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 --2- 172.21.15.66:0/3088586264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c80fac80 0x7f43c80fb0f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 --2- 172.21.15.66:0/3088586264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c8102620 0x7f43c81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 -- 172.21.15.66:0/3088586264 >> 172.21.15.66:0/3088586264 conn(0x7f43c8070ce0 msgr2=0x7f43c80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:02.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 -- 172.21.15.66:0/3088586264 shutdown_connections 2024-09-12T01:48:02.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 -- 172.21.15.66:0/3088586264 wait complete. 2024-09-12T01:48:02.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 Processor -- start 2024-09-12T01:48:02.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.529+0000 7f43cc82a640 1 -- start start 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43cc82a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c80fac80 0x7f43c81131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43cc82a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 0x7f43c8113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43cc82a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8113d00 con 0x7f43c8102620 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43cc82a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c810d140 con 0x7f43c80fac80 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 0x7f43c8113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 0x7f43c8113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36368/0 (socket says 172.21.15.66:36368) 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 -- 172.21.15.66:0/2779014950 learned_addr learned my addr 172.21.15.66:0/2779014950 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:02.533 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c659c640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c80fac80 0x7f43c81131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 -- 172.21.15.66:0/2779014950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c80fac80 msgr2=0x7f43c81131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c80fac80 0x7f43c81131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 -- 172.21.15.66:0/2779014950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc005040 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43c5d9b640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 0x7f43c8113700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43bc000c00 tx=0x7f43bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43bc038070 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.530+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c810d3c0 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.531+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c810d900 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.531+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43bc02ade0 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.531+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43bc02c7b0 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.532+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c8065790 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.532+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f43bc030020 con 0x7f43c8102620 2024-09-12T01:48:02.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.533+0000 7f43b6ffd640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b006e1e0 0x7f43b0070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.533+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f43bc0ae040 con 0x7f43c8102620 2024-09-12T01:48:02.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.533+0000 7f43c659c640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b006e1e0 0x7f43b0070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.533+0000 7f43c659c640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b006e1e0 0x7f43b0070690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009af0 tx=0x7f43b800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:02.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.538+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f43bc077330 con 0x7f43c8102620 2024-09-12T01:48:02.730 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.730+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c81095a0 con 0x7f43b006e1e0 2024-09-12T01:48:02.731 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.731+0000 7f43b6ffd640 1 -- 172.21.15.66:0/2779014950 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f43c81095a0 con 0x7f43b006e1e0 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.733+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b006e1e0 msgr2=0x7f43b0070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.733+0000 7f43cc82a640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b006e1e0 0x7f43b0070690 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009af0 tx=0x7f43b800b040 comp rx=0 tx=0).stop 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.733+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 msgr2=0x7f43c8113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.733+0000 7f43cc82a640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 0x7f43c8113700 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f43bc000c00 tx=0x7f43bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.733+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 shutdown_connections 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.733+0000 7f43cc82a640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b006e1e0 0x7f43b0070690 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.734+0000 7f43cc82a640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43c8102620 0x7f43c8113700 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.734+0000 7f43cc82a640 1 --2- 172.21.15.66:0/2779014950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43c80fac80 0x7f43c81131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.734+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 >> 172.21.15.66:0/2779014950 conn(0x7f43c8070ce0 msgr2=0x7f43c80f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.734+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 shutdown_connections 2024-09-12T01:48:02.734 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.734+0000 7f43cc82a640 1 -- 172.21.15.66:0/2779014950 wait complete. 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 -- 172.21.15.66:0/920464619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 msgr2=0x7f18641029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 --2- 172.21.15.66:0/920464619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f18641029f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18540048d0 tx=0x7f1854009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 -- 172.21.15.66:0/920464619 shutdown_connections 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 --2- 172.21.15.66:0/920464619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18640fac80 0x7f18640fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 --2- 172.21.15.66:0/920464619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f18641029f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 -- 172.21.15.66:0/920464619 >> 172.21.15.66:0/920464619 conn(0x7f1864070ce0 msgr2=0x7f18640710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 -- 172.21.15.66:0/920464619 shutdown_connections 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.814+0000 7f1869511640 1 -- 172.21.15.66:0/920464619 wait complete. 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1869511640 1 Processor -- start 2024-09-12T01:48:02.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1869511640 1 -- start start 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1869511640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18640fac80 0x7f18641131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1869511640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f1864113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1869511640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864113d00 con 0x7f1864102620 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1869511640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186410d140 con 0x7f18640fac80 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f18627fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f1864113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f18627fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f1864113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36386/0 (socket says 172.21.15.66:36386) 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f18627fc640 1 -- 172.21.15.66:0/3215669631 learned_addr learned my addr 172.21.15.66:0/3215669631 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:02.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f1862ffd640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18640fac80 0x7f18641131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f18627fc640 1 -- 172.21.15.66:0/3215669631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18640fac80 msgr2=0x7f18641131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f18627fc640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18640fac80 0x7f18641131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.815+0000 7f18627fc640 1 -- 172.21.15.66:0/3215669631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854005040 con 0x7f1864102620 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.816+0000 7f18627fc640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f1864113700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f185800eb70 tx=0x7f185800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.816+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1858007c30 con 0x7f1864102620 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.816+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f185800f040 con 0x7f1864102620 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.816+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186410d3c0 con 0x7f1864102620 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.816+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185800ca60 con 0x7f1864102620 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.816+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186410d960 con 0x7f1864102620 2024-09-12T01:48:02.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.817+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18640657b0 con 0x7f1864102620 2024-09-12T01:48:02.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.818+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f185800cbc0 con 0x7f1864102620 2024-09-12T01:48:02.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.818+0000 7f184b7fe640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f184c06e1e0 0x7f184c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:02.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.818+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f185808d950 con 0x7f1864102620 2024-09-12T01:48:02.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.818+0000 7f1862ffd640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f184c06e1e0 0x7f184c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:02.819 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.819+0000 7f1862ffd640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f184c06e1e0 0x7f184c070690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1854004540 tx=0x7f1854035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:02.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:02.823+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1858056be0 con 0x7f1864102620 2024-09-12T01:48:03.006 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.006+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1864109590 con 0x7f184c06e1e0 2024-09-12T01:48:03.015 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.015+0000 7f184b7fe640 1 -- 172.21.15.66:0/3215669631 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1864109590 con 0x7f184c06e1e0 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (2m) 16s ago 12m 16.4M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (12m) 16s ago 12m 6903k - 17.2.7-1609-g554ba93e d4c538e492e4 96d3f9f2bffb 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (11m) 3s ago 11m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (111s) 16s ago 12m 76.6M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (7m) 16s ago 7m 14.0M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (7m) 16s ago 7m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (7m) 3s ago 7m 17.0M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (7m) 3s ago 7m 16.0M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:48:03.016 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (3m) 16s ago 13m 472M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (3m) 3s ago 11m 437M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (28s) 16s ago 14m 29.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (7s) 3s ago 11m 22.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (2m) 16s ago 12m 16.6M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (2m) 3s ago 11m 16.7M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (10m) 16s ago 10m 248M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (10m) 16s ago 10m 261M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (10m) 16s ago 10m 215M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (9m) 3s ago 9m 276M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (9m) 3s ago 9m 253M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (8m) 3s ago 8m 232M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:48:03.017 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (2m) 16s ago 12m 62.4M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:48:03.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f184c06e1e0 msgr2=0x7f184c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f184c06e1e0 0x7f184c070690 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1854004540 tx=0x7f1854035040 comp rx=0 tx=0).stop 2024-09-12T01:48:03.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 msgr2=0x7f1864113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.018 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f1864113700 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f185800eb70 tx=0x7f185800b040 comp rx=0 tx=0).stop 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 shutdown_connections 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f184c06e1e0 0x7f184c070690 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1864102620 0x7f1864113700 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 --2- 172.21.15.66:0/3215669631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18640fac80 0x7f18641131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 >> 172.21.15.66:0/3215669631 conn(0x7f1864070ce0 msgr2=0x7f1864105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 shutdown_connections 2024-09-12T01:48:03.019 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.018+0000 7f1869511640 1 -- 172.21.15.66:0/3215669631 wait complete. 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 -- 172.21.15.66:0/2803039166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102ef0 msgr2=0x7f00a40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/2803039166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102ef0 0x7f00a40fc5b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00980048d0 tx=0x7f0098009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 -- 172.21.15.66:0/2803039166 shutdown_connections 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/2803039166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102ef0 0x7f00a40fc5b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/2803039166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102550 0x7f00a4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 -- 172.21.15.66:0/2803039166 >> 172.21.15.66:0/2803039166 conn(0x7f00a40f80f0 msgr2=0x7f00a40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 -- 172.21.15.66:0/2803039166 shutdown_connections 2024-09-12T01:48:03.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.098+0000 7f00ab7c9640 1 -- 172.21.15.66:0/2803039166 wait complete. 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.099+0000 7f00ab7c9640 1 Processor -- start 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.099+0000 7f00ab7c9640 1 -- start start 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.099+0000 7f00ab7c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 0x7f00a4113500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.099+0000 7f00ab7c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102ef0 0x7f00a4113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00ab7c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a4114090 con 0x7f00a4102550 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00ab7c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a410d4a0 con 0x7f00a4102ef0 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 0x7f00a4113500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 0x7f00a4113500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36402/0 (socket says 172.21.15.66:36402) 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 -- 172.21.15.66:0/1373351408 learned_addr learned my addr 172.21.15.66:0/1373351408 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a8d64640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102ef0 0x7f00a4113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 -- 172.21.15.66:0/1373351408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102ef0 msgr2=0x7f00a4113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102ef0 0x7f00a4113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 -- 172.21.15.66:0/1373351408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0098005040 con 0x7f00a4102550 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a8d64640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102ef0 0x7f00a4113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.100+0000 7f00a9565640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 0x7f00a4113500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f009c00eb70 tx=0x7f009c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.101+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009c007c30 con 0x7f00a4102550 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.101+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a410d720 con 0x7f00a4102550 2024-09-12T01:48:03.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.101+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f009c00f040 con 0x7f00a4102550 2024-09-12T01:48:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.101+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f009c0094e0 con 0x7f00a4102550 2024-09-12T01:48:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.101+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a410dc90 con 0x7f00a4102550 2024-09-12T01:48:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.102+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a40fdcd0 con 0x7f00a4102550 2024-09-12T01:48:03.103 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.103+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f009c0097b0 con 0x7f00a4102550 2024-09-12T01:48:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.103+0000 7f00a1ffb640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f008c06e1e0 0x7f008c070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.103+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f009c08d9f0 con 0x7f00a4102550 2024-09-12T01:48:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.104+0000 7f00a8d64640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f008c06e1e0 0x7f008c070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.104+0000 7f00a8d64640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f008c06e1e0 0x7f008c070690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0098000c00 tx=0x7f0098035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:03.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.109+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f009c08fe60 con 0x7f00a4102550 2024-09-12T01:48:03.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.367+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f00a404b750 con 0x7f00a4102550 2024-09-12T01:48:03.367 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: pgmap v13: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:03.368 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:03.368 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.367+0000 7f00a1ffb640 1 -- 172.21.15.66:0/1373351408 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f009c056c00 con 0x7f00a4102550 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:48:03.369 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:03.370 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:48:03.370 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 10, 2024-09-12T01:48:03.370 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 4 2024-09-12T01:48:03.370 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:48:03.370 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f008c06e1e0 msgr2=0x7f008c070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f008c06e1e0 0x7f008c070690 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0098000c00 tx=0x7f0098035040 comp rx=0 tx=0).stop 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 msgr2=0x7f00a4113500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 0x7f00a4113500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f009c00eb70 tx=0x7f009c00b040 comp rx=0 tx=0).stop 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 shutdown_connections 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f008c06e1e0 0x7f008c070690 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00a4102ef0 0x7f00a4113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 --2- 172.21.15.66:0/1373351408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a4102550 0x7f00a4113500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 >> 172.21.15.66:0/1373351408 conn(0x7f00a40f80f0 msgr2=0x7f00a40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 shutdown_connections 2024-09-12T01:48:03.372 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.371+0000 7f00ab7c9640 1 -- 172.21.15.66:0/1373351408 wait complete. 2024-09-12T01:48:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: pgmap v13: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 -- 172.21.15.66:0/3920744825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fcf80 msgr2=0x7f8ed80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 --2- 172.21.15.66:0/3920744825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fcf80 0x7f8ed80fd3d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80048d0 tx=0x7f8ec8009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 -- 172.21.15.66:0/3920744825 shutdown_connections 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 --2- 172.21.15.66:0/3920744825 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fcf80 0x7f8ed80fd3d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 --2- 172.21.15.66:0/3920744825 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed80fb810 0x7f8ed80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 -- 172.21.15.66:0/3920744825 >> 172.21.15.66:0/3920744825 conn(0x7f8ed80723b0 msgr2=0x7f8ed80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 -- 172.21.15.66:0/3920744825 shutdown_connections 2024-09-12T01:48:03.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.457+0000 7f8edf735640 1 -- 172.21.15.66:0/3920744825 wait complete. 2024-09-12T01:48:03.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edf735640 1 Processor -- start 2024-09-12T01:48:03.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edf735640 1 -- start start 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edf735640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 0x7f8ed8113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edf735640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed80fcf80 0x7f8ed81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edf735640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8113cb0 con 0x7f8ed80fb810 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edf735640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed810d0f0 con 0x7f8ed80fcf80 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edd4d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 0x7f8ed8113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edd4d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 0x7f8ed8113170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36408/0 (socket says 172.21.15.66:36408) 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.458+0000 7f8edd4d1640 1 -- 172.21.15.66:0/1441756746 learned_addr learned my addr 172.21.15.66:0/1441756746 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8edd4d1640 1 -- 172.21.15.66:0/1441756746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed80fcf80 msgr2=0x7f8ed81136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8edd4d1640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed80fcf80 0x7f8ed81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8edd4d1640 1 -- 172.21.15.66:0/1441756746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8005040 con 0x7f8ed80fb810 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8edd4d1640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 0x7f8ed8113170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4002a50 tx=0x7f8ed4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed4007c30 con 0x7f8ed80fb810 2024-09-12T01:48:03.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8ed400f040 con 0x7f8ed80fb810 2024-09-12T01:48:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ed400da90 con 0x7f8ed80fb810 2024-09-12T01:48:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.459+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed810d3d0 con 0x7f8ed80fb810 2024-09-12T01:48:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.460+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed810d970 con 0x7f8ed80fb810 2024-09-12T01:48:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.460+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed80fcbc0 con 0x7f8ed80fb810 2024-09-12T01:48:03.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.461+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f8ed400dc30 con 0x7f8ed80fb810 2024-09-12T01:48:03.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.462+0000 7f8ecdffb640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8ec406e1e0 0x7f8ec4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.462+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8ed408d5f0 con 0x7f8ed80fb810 2024-09-12T01:48:03.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.462+0000 7f8edccd0640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8ec406e1e0 0x7f8ec4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.462+0000 7f8edccd0640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8ec406e1e0 0x7f8ec4070690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8ec802a530 tx=0x7f8ec8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:03.466 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.466+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8ed40567d0 con 0x7f8ed80fb810 2024-09-12T01:48:03.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.687+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8ed810e840 con 0x7f8ed80fb810 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.687+0000 7f8ecdffb640 1 -- 172.21.15.66:0/1441756746 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7f8ed4059e90 con 0x7f8ed80fb810 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:03.688 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:48:03.689 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:48:03.690 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:03.691 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.690+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8ec406e1e0 msgr2=0x7f8ec4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.690+0000 7f8edf735640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8ec406e1e0 0x7f8ec4070690 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8ec802a530 tx=0x7f8ec8009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.690+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 msgr2=0x7f8ed8113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.690+0000 7f8edf735640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 0x7f8ed8113170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4002a50 tx=0x7f8ed4004600 comp rx=0 tx=0).stop 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 shutdown_connections 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8ec406e1e0 0x7f8ec4070690 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ed80fcf80 0x7f8ed81136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 --2- 172.21.15.66:0/1441756746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ed80fb810 0x7f8ed8113170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 >> 172.21.15.66:0/1441756746 conn(0x7f8ed80723b0 msgr2=0x7f8ed8065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 shutdown_connections 2024-09-12T01:48:03.692 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.691+0000 7f8edf735640 1 -- 172.21.15.66:0/1441756746 wait complete. 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 -- 172.21.15.66:0/37216218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 msgr2=0x7f6778102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 --2- 172.21.15.66:0/37216218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f6778102950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f67680048d0 tx=0x7f6768009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 -- 172.21.15.66:0/37216218 shutdown_connections 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 --2- 172.21.15.66:0/37216218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6778102f20 0x7f67780fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 --2- 172.21.15.66:0/37216218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f6778102950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 -- 172.21.15.66:0/37216218 >> 172.21.15.66:0/37216218 conn(0x7f67780f81a0 msgr2=0x7f67780fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 -- 172.21.15.66:0/37216218 shutdown_connections 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.774+0000 7f677d4e5640 1 -- 172.21.15.66:0/37216218 wait complete. 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f677d4e5640 1 Processor -- start 2024-09-12T01:48:03.775 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f677d4e5640 1 -- start start 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f677d4e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f67781131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f677d4e5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6778102f20 0x7f6778113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f677d4e5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778113d10 con 0x7f6778102580 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f677d4e5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677810d150 con 0x7f6778102f20 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f6776ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f67781131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f6776ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f67781131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36426/0 (socket says 172.21.15.66:36426) 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f6776ffd640 1 -- 172.21.15.66:0/3985480348 learned_addr learned my addr 172.21.15.66:0/3985480348 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:03.777 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.775+0000 7f67767fc640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6778102f20 0x7f6778113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f6776ffd640 1 -- 172.21.15.66:0/3985480348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6778102f20 msgr2=0x7f6778113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f6776ffd640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6778102f20 0x7f6778113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f6776ffd640 1 -- 172.21.15.66:0/3985480348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6768005040 con 0x7f6778102580 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f6776ffd640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f67781131d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6768000c00 tx=0x7f6768009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6768038070 con 0x7f6778102580 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677810d3d0 con 0x7f6778102580 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f676802ade0 con 0x7f6778102580 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f676802c7e0 con 0x7f6778102580 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.776+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f677810d910 con 0x7f6778102580 2024-09-12T01:48:03.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.777+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67780fdd00 con 0x7f6778102580 2024-09-12T01:48:03.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.778+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6768030020 con 0x7f6778102580 2024-09-12T01:48:03.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.778+0000 7f675f7fe640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f676006e230 0x7f67600706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:03.779 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.778+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f67680ad9e0 con 0x7f6778102580 2024-09-12T01:48:03.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.778+0000 7f67767fc640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f676006e230 0x7f67600706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:03.780 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.779+0000 7f67767fc640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f676006e230 0x7f67600706e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f676c009fd0 tx=0x7f676c009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:03.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.782+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6768076c60 con 0x7f6778102580 2024-09-12T01:48:03.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.981+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f677804b720 con 0x7f676006e230 2024-09-12T01:48:03.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.983+0000 7f675f7fe640 1 -- 172.21.15.66:0/3985480348 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f677804b720 con 0x7f676006e230 2024-09-12T01:48:03.983 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:48:03.983 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:48:03.983 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:48:03.983 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:48:03.983 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:48:03.984 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:48:03.984 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:48:03.984 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:48:03.984 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "4/21 daemons upgraded", 2024-09-12T01:48:03.984 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading mon daemons", 2024-09-12T01:48:03.984 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:48:03.985 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:48:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.984+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f676006e230 msgr2=0x7f67600706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.984+0000 7f677d4e5640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f676006e230 0x7f67600706e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f676c009fd0 tx=0x7f676c009e50 comp rx=0 tx=0).stop 2024-09-12T01:48:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.984+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 msgr2=0x7f67781131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f67781131d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6768000c00 tx=0x7f6768009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 shutdown_connections 2024-09-12T01:48:03.986 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f676006e230 0x7f67600706e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6778102f20 0x7f6778113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 --2- 172.21.15.66:0/3985480348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778102580 0x7f67781131d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 >> 172.21.15.66:0/3985480348 conn(0x7f67780f81a0 msgr2=0x7f67780f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 shutdown_connections 2024-09-12T01:48:03.987 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:03.985+0000 7f677d4e5640 1 -- 172.21.15.66:0/3985480348 wait complete. 2024-09-12T01:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 -- 172.21.15.66:0/3912625117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 msgr2=0x7fb18c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 --2- 172.21.15.66:0/3912625117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c0fd3d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009c50 tx=0x7fb17c004d10 comp rx=0 tx=0).stop 2024-09-12T01:48:04.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 -- 172.21.15.66:0/3912625117 shutdown_connections 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 --2- 172.21.15.66:0/3912625117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c0fd3d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 --2- 172.21.15.66:0/3912625117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb18c0fb810 0x7fb18c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 -- 172.21.15.66:0/3912625117 >> 172.21.15.66:0/3912625117 conn(0x7fb18c0723b0 msgr2=0x7fb18c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 -- 172.21.15.66:0/3912625117 shutdown_connections 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 -- 172.21.15.66:0/3912625117 wait complete. 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 Processor -- start 2024-09-12T01:48:04.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.066+0000 7fb1931d8640 1 -- start start 2024-09-12T01:48:04.068 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb1931d8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb18c0fb810 0x7fb18c10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb1931d8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c10e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb1931d8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c10ed00 con 0x7fb18c0fcf80 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb1931d8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c10ee70 con 0x7fb18c0fb810 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c10e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c10e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36438/0 (socket says 172.21.15.66:36438) 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 -- 172.21.15.66:0/1868154709 learned_addr learned my addr 172.21.15.66:0/1868154709 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb190f74640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb18c0fb810 0x7fb18c10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 -- 172.21.15.66:0/1868154709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb18c0fb810 msgr2=0x7fb18c10e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb18c0fb810 0x7fb18c10e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 -- 172.21.15.66:0/1868154709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0098b0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb18bfff640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c10e6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb17c004750 tx=0x7fb17c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.067+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17c009540 con 0x7fb18c0fcf80 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.068+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb17c0096a0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.069 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.068+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c1171e0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.068+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb17c03d960 con 0x7fb18c0fcf80 2024-09-12T01:48:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.068+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c1176a0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.069+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c0fcbc0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.069+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fb17c02f030 con 0x7fb18c0fcf80 2024-09-12T01:48:04.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.070+0000 7fb1897fa640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb17806e1e0 0x7fb178070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:04.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.070+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb17c0aebc0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.070+0000 7fb190f74640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb17806e1e0 0x7fb178070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:04.071 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.070+0000 7fb190f74640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb17806e1e0 0x7fb178070690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb184004eb0 tx=0x7fb18400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:04.074 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.074+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb17c077da0 con 0x7fb18c0fcf80 2024-09-12T01:48:04.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.328+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb18c065760 con 0x7fb18c0fcf80 2024-09-12T01:48:04.329 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.329+0000 7fb1897fa640 1 -- 172.21.15.66:0/1868154709 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb17c07b460 con 0x7fb18c0fcf80 2024-09-12T01:48:04.329 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_OK 2024-09-12T01:48:04.331 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb17806e1e0 msgr2=0x7fb178070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb17806e1e0 0x7fb178070690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb184004eb0 tx=0x7fb18400b040 comp rx=0 tx=0).stop 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 msgr2=0x7fb18c10e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c10e6b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb17c004750 tx=0x7fb17c004d10 comp rx=0 tx=0).stop 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 shutdown_connections 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb17806e1e0 0x7fb178070690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb18c0fcf80 0x7fb18c10e6b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 --2- 172.21.15.66:0/1868154709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb18c0fb810 0x7fb18c10e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 >> 172.21.15.66:0/1868154709 conn(0x7fb18c0723b0 msgr2=0x7fb18c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 shutdown_connections 2024-09-12T01:48:04.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:04.331+0000 7fb1931d8640 1 -- 172.21.15.66:0/1868154709 wait complete. 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: Detected new or changed devices on smithi153 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: Reconfiguring mon.smithi066 (monmap changed)... 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: Reconfiguring daemon mon.smithi066 on smithi066 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1373351408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:04.501 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:04 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1441756746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: Detected new or changed devices on smithi153 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: Reconfiguring mon.smithi066 (monmap changed)... 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: Reconfiguring daemon mon.smithi066 on smithi066 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1373351408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:04.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:04 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1441756746' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:48:05.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1868154709' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:05.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: pgmap v14: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1868154709' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi066.qdwcrh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:05.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:06.568 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:06 smithi066 ceph-mon[110996]: Reconfiguring mgr.smithi066.qdwcrh (monmap changed)... 2024-09-12T01:48:06.568 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:06 smithi066 ceph-mon[110996]: Reconfiguring daemon mgr.smithi066.qdwcrh on smithi066 2024-09-12T01:48:06.568 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:06 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:06.568 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:06 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:06.568 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:06 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:06.569 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:06 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:06.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:06 smithi153 ceph-mon[80899]: Reconfiguring mgr.smithi066.qdwcrh (monmap changed)... 2024-09-12T01:48:06.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:06 smithi153 ceph-mon[80899]: Reconfiguring daemon mgr.smithi066.qdwcrh on smithi066 2024-09-12T01:48:06.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:06 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:06.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:06 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:06.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:06 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:06.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:06 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:07 smithi066 ceph-mon[110996]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:07 smithi066 ceph-mon[110996]: Reconfiguring crash.smithi066 (monmap changed)... 2024-09-12T01:48:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:07 smithi066 ceph-mon[110996]: Reconfiguring daemon crash.smithi066 on smithi066 2024-09-12T01:48:07.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:07 smithi153 ceph-mon[80899]: pgmap v15: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:07.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:07 smithi153 ceph-mon[80899]: Reconfiguring crash.smithi066 (monmap changed)... 2024-09-12T01:48:07.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:07 smithi153 ceph-mon[80899]: Reconfiguring daemon crash.smithi066 on smithi066 2024-09-12T01:48:08.770 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: pgmap v16: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:08.771 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:08.771 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:08.771 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: Reconfiguring osd.0 (monmap changed)... 2024-09-12T01:48:08.771 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:48:08.771 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:08.771 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:08 smithi066 ceph-mon[110996]: Reconfiguring daemon osd.0 on smithi066 2024-09-12T01:48:08.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: pgmap v16: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: Reconfiguring osd.0 (monmap changed)... 2024-09-12T01:48:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:48:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:08 smithi153 ceph-mon[80899]: Reconfiguring daemon osd.0 on smithi066 2024-09-12T01:48:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:09 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:09 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:09 smithi066 ceph-mon[110996]: Reconfiguring osd.1 (monmap changed)... 2024-09-12T01:48:10.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:09 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:48:10.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:09 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:10.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:09 smithi066 ceph-mon[110996]: Reconfiguring daemon osd.1 on smithi066 2024-09-12T01:48:10.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:09 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:09 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:09 smithi153 ceph-mon[80899]: Reconfiguring osd.1 (monmap changed)... 2024-09-12T01:48:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:09 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:48:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:09 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:09 smithi153 ceph-mon[80899]: Reconfiguring daemon osd.1 on smithi066 2024-09-12T01:48:11.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:11.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:11.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: Reconfiguring osd.2 (monmap changed)... 2024-09-12T01:48:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:48:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:11.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:11 smithi066 ceph-mon[110996]: Reconfiguring daemon osd.2 on smithi066 2024-09-12T01:48:11.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: pgmap v17: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:11.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:11.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: Reconfiguring osd.2 (monmap changed)... 2024-09-12T01:48:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:48:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:11 smithi153 ceph-mon[80899]: Reconfiguring daemon osd.2 on smithi066 2024-09-12T01:48:12.514 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:12.515 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:12.515 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:12.515 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:12.515 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:12.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:12.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: Reconfiguring mds.cephfs.smithi066.ipygev (monmap changed)... 2024-09-12T01:48:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: Reconfiguring daemon mds.cephfs.smithi066.ipygev on smithi066 2024-09-12T01:48:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:13.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:13 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: pgmap v18: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: Reconfiguring mds.cephfs.smithi066.ipygev (monmap changed)... 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: Reconfiguring daemon mds.cephfs.smithi066.ipygev on smithi066 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:13.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:13 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:14.453 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:14 smithi066 ceph-mon[110996]: Reconfiguring mds.cephfs.smithi066.jacfsu (monmap changed)... 2024-09-12T01:48:14.453 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:14 smithi066 ceph-mon[110996]: Reconfiguring daemon mds.cephfs.smithi066.jacfsu on smithi066 2024-09-12T01:48:14.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:14 smithi153 ceph-mon[80899]: Reconfiguring mds.cephfs.smithi066.jacfsu (monmap changed)... 2024-09-12T01:48:14.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:14 smithi153 ceph-mon[80899]: Reconfiguring daemon mds.cephfs.smithi066.jacfsu on smithi066 2024-09-12T01:48:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:15 smithi066 ceph-mon[110996]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:15.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:15.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:15 smithi153 ceph-mon[80899]: pgmap v19: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:15.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:15.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:15.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:15.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: Reconfiguring crash.smithi153 (monmap changed)... 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: Reconfiguring daemon crash.smithi153 on smithi153 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:16.609 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: Reconfiguring crash.smithi153 (monmap changed)... 2024-09-12T01:48:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: Reconfiguring daemon crash.smithi153 on smithi153 2024-09-12T01:48:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi153.jpnqza", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-12T01:48:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-12T01:48:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:17.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:17 smithi153 ceph-mon[80899]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:17.566 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:17 smithi153 ceph-mon[80899]: Reconfiguring mgr.smithi153.jpnqza (monmap changed)... 2024-09-12T01:48:17.567 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:17 smithi153 ceph-mon[80899]: Reconfiguring daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:48:17.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:17 smithi066 ceph-mon[110996]: pgmap v20: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:17.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:17 smithi066 ceph-mon[110996]: Reconfiguring mgr.smithi153.jpnqza (monmap changed)... 2024-09-12T01:48:17.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:17 smithi066 ceph-mon[110996]: Reconfiguring daemon mgr.smithi153.jpnqza on smithi153 2024-09-12T01:48:18.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: Reconfiguring mon.smithi153 (monmap changed)... 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:18.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:18 smithi066 ceph-mon[110996]: Reconfiguring daemon mon.smithi153 on smithi153 2024-09-12T01:48:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: pgmap v21: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: Reconfiguring mon.smithi153 (monmap changed)... 2024-09-12T01:48:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-12T01:48:18.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-12T01:48:18.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:18.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:18 smithi153 ceph-mon[80899]: Reconfiguring daemon mon.smithi153 on smithi153 2024-09-12T01:48:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:20 smithi066 ceph-mon[110996]: Reconfiguring osd.3 (monmap changed)... 2024-09-12T01:48:20.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:48:20.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:20.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:20 smithi066 ceph-mon[110996]: Reconfiguring daemon osd.3 on smithi153 2024-09-12T01:48:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:20.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:20 smithi153 ceph-mon[80899]: Reconfiguring osd.3 (monmap changed)... 2024-09-12T01:48:20.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:48:20.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:20.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:20 smithi153 ceph-mon[80899]: Reconfiguring daemon osd.3 on smithi153 2024-09-12T01:48:21.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:21 smithi153 ceph-mon[80899]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:21.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:21 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:21.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:21 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:21.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:21 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:48:21.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:21 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:21 smithi066 ceph-mon[110996]: pgmap v22: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:21 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:21.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:21 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:21.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:21 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:48:21.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:21 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:22.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:22 smithi066 ceph-mon[110996]: Reconfiguring osd.4 (monmap changed)... 2024-09-12T01:48:22.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:22 smithi066 ceph-mon[110996]: Reconfiguring daemon osd.4 on smithi153 2024-09-12T01:48:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:22 smithi153 ceph-mon[80899]: Reconfiguring osd.4 (monmap changed)... 2024-09-12T01:48:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:22 smithi153 ceph-mon[80899]: Reconfiguring daemon osd.4 on smithi153 2024-09-12T01:48:23.369 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:23.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:23.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:23.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: Reconfiguring osd.5 (monmap changed)... 2024-09-12T01:48:23.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:48:23.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:23.370 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:23 smithi153 ceph-mon[80899]: Reconfiguring daemon osd.5 on smithi153 2024-09-12T01:48:23.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: pgmap v23: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:23.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:23.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:23.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: Reconfiguring osd.5 (monmap changed)... 2024-09-12T01:48:23.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:48:23.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:23 smithi066 ceph-mon[110996]: Reconfiguring daemon osd.5 on smithi153 2024-09-12T01:48:24.776 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:24.776 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:24.777 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:24.777 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: Reconfiguring mds.cephfs.smithi153.cbdplo (monmap changed)... 2024-09-12T01:48:24.777 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:24.777 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:24.777 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:24 smithi153 ceph-mon[80899]: Reconfiguring daemon mds.cephfs.smithi153.cbdplo on smithi153 2024-09-12T01:48:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: pgmap v24: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: Reconfiguring mds.cephfs.smithi153.cbdplo (monmap changed)... 2024-09-12T01:48:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:24.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:24 smithi066 ceph-mon[110996]: Reconfiguring daemon mds.cephfs.smithi153.cbdplo on smithi153 2024-09-12T01:48:26.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:25 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:26.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:25 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:26.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:25 smithi066 ceph-mon[110996]: Reconfiguring mds.cephfs.smithi153.aiydtj (monmap changed)... 2024-09-12T01:48:26.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:25 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:26.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:25 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:26.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:25 smithi066 ceph-mon[110996]: Reconfiguring daemon mds.cephfs.smithi153.aiydtj on smithi153 2024-09-12T01:48:26.141 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:25 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:26.141 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:25 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:26.141 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:25 smithi153 ceph-mon[80899]: Reconfiguring mds.cephfs.smithi153.aiydtj (monmap changed)... 2024-09-12T01:48:26.141 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:25 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:48:26.141 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:25 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:26.141 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:25 smithi153 ceph-mon[80899]: Reconfiguring daemon mds.cephfs.smithi153.aiydtj on smithi153 2024-09-12T01:48:27.591 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:27.591 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:27.591 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:27.591 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all mon 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi066"}]: dispatch 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi066"}]': finished 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]: dispatch 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]': finished 2024-09-12T01:48:27.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: pgmap v25: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all mon 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi066"}]: dispatch 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi066"}]': finished 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]: dispatch 2024-09-12T01:48:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi153"}]': finished 2024-09-12T01:48:27.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:28.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:28 smithi066 ceph-mon[110996]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:28.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:28 smithi066 ceph-mon[110996]: Upgrade: Updating crash.smithi066 (1/2) 2024-09-12T01:48:28.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:28 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:28.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:28 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:28.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:28 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:28.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:28 smithi066 ceph-mon[110996]: Deploying daemon crash.smithi066 on smithi066 2024-09-12T01:48:28.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:28 smithi153 ceph-mon[80899]: pgmap v26: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:28 smithi153 ceph-mon[80899]: Upgrade: Updating crash.smithi066 (1/2) 2024-09-12T01:48:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:28 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:28 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi066", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:28 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:28 smithi153 ceph-mon[80899]: Deploying daemon crash.smithi066 on smithi066 2024-09-12T01:48:30.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:30 smithi066 ceph-mon[110996]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:30.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:30 smithi153 ceph-mon[80899]: pgmap v27: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:32.365 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:32.365 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:32.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:32.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:33.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:33 smithi066 ceph-mon[110996]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:33.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:33 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:33.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:33 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:33.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:33 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:33 smithi153 ceph-mon[80899]: pgmap v28: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:33 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:33.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:33 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-12T01:48:33.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:33 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:34.284 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:34 smithi153 ceph-mon[80899]: Upgrade: Updating crash.smithi153 (2/2) 2024-09-12T01:48:34.284 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:34 smithi153 ceph-mon[80899]: Deploying daemon crash.smithi153 on smithi153 2024-09-12T01:48:34.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:34 smithi066 ceph-mon[110996]: Upgrade: Updating crash.smithi153 (2/2) 2024-09-12T01:48:34.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:34 smithi066 ceph-mon[110996]: Deploying daemon crash.smithi153 on smithi153 2024-09-12T01:48:34.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 -- 172.21.15.66:0/3902929939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 msgr2=0x7f95780fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.422 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 --2- 172.21.15.66:0/3902929939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f95780fc590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f956c0048d0 tx=0x7f956c009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 -- 172.21.15.66:0/3902929939 shutdown_connections 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 --2- 172.21.15.66:0/3902929939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f95780fc590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 --2- 172.21.15.66:0/3902929939 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 0x7f9578102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 -- 172.21.15.66:0/3902929939 >> 172.21.15.66:0/3902929939 conn(0x7f95780f80f0 msgr2=0x7f95780fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 -- 172.21.15.66:0/3902929939 shutdown_connections 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 -- 172.21.15.66:0/3902929939 wait complete. 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 Processor -- start 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.420+0000 7f957f29f640 1 -- start start 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957f29f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 0x7f95781131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:34.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957f29f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f9578113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957f29f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9578113d10 con 0x7f9578102ed0 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957f29f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957810d150 con 0x7f9578102530 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f9578113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f9578113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37926/0 (socket says 172.21.15.66:37926) 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 -- 172.21.15.66:0/1564778024 learned_addr learned my addr 172.21.15.66:0/1564778024 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957d03b640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 0x7f95781131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 -- 172.21.15.66:0/1564778024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 msgr2=0x7f95781131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 0x7f95781131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 -- 172.21.15.66:0/1564778024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c005040 con 0x7f9578102ed0 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957d03b640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 0x7f95781131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.421+0000 7f957c83a640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f9578113710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f956c003080 tx=0x7f956c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.422+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f956c038070 con 0x7f9578102ed0 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.422+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957810d3d0 con 0x7f9578102ed0 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.422+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f956c009760 con 0x7f9578102ed0 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.422+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f956c033420 con 0x7f9578102ed0 2024-09-12T01:48:34.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.422+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957810d8b0 con 0x7f9578102ed0 2024-09-12T01:48:34.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.423+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95780fdcb0 con 0x7f9578102ed0 2024-09-12T01:48:34.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.423+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f956c030020 con 0x7f9578102ed0 2024-09-12T01:48:34.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.424+0000 7f9575ffb640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f956006e1e0 0x7f9560070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:34.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.424+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f956c0ada80 con 0x7f9578102ed0 2024-09-12T01:48:34.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.424+0000 7f957d03b640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f956006e1e0 0x7f9560070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:34.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.425+0000 7f957d03b640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f956006e1e0 0x7f9560070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9568004c80 tx=0x7f9568009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:34.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.429+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f956c076cf0 con 0x7f9578102ed0 2024-09-12T01:48:34.623 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.623+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95781095f0 con 0x7f956006e1e0 2024-09-12T01:48:34.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.624+0000 7f9575ffb640 1 -- 172.21.15.66:0/1564778024 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f95781095f0 con 0x7f956006e1e0 2024-09-12T01:48:34.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f956006e1e0 msgr2=0x7f9560070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f956006e1e0 0x7f9560070690 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9568004c80 tx=0x7f9568009040 comp rx=0 tx=0).stop 2024-09-12T01:48:34.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 msgr2=0x7f9578113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f9578113710 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f956c003080 tx=0x7f956c009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 shutdown_connections 2024-09-12T01:48:34.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f956006e1e0 0x7f9560070690 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9578102ed0 0x7f9578113710 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 --2- 172.21.15.66:0/1564778024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9578102530 0x7f95781131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.626+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 >> 172.21.15.66:0/1564778024 conn(0x7f95780f80f0 msgr2=0x7f95780f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:34.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.627+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 shutdown_connections 2024-09-12T01:48:34.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.627+0000 7f957f29f640 1 -- 172.21.15.66:0/1564778024 wait complete. 2024-09-12T01:48:34.635 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:48:34.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 -- 172.21.15.66:0/3560445942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 msgr2=0x7f5a94102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 --2- 172.21.15.66:0/3560445942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a94102900 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5a84009c50 tx=0x7f5a84004d10 comp rx=0 tx=0).stop 2024-09-12T01:48:34.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 -- 172.21.15.66:0/3560445942 shutdown_connections 2024-09-12T01:48:34.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 --2- 172.21.15.66:0/3560445942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a94102ed0 0x7f5a940fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 --2- 172.21.15.66:0/3560445942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a94102900 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 -- 172.21.15.66:0/3560445942 >> 172.21.15.66:0/3560445942 conn(0x7f5a940f80f0 msgr2=0x7f5a940fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 -- 172.21.15.66:0/3560445942 shutdown_connections 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.708+0000 7f5a98931640 1 -- 172.21.15.66:0/3560445942 wait complete. 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a98931640 1 Processor -- start 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a98931640 1 -- start start 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a98931640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a9406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a98931640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a94102ed0 0x7f5a9406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a98931640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94070490 con 0x7f5a94102530 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a98931640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a94070600 con 0x7f5a94102ed0 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a9406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:34.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a9259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a9406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37948/0 (socket says 172.21.15.66:37948) 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a9259c640 1 -- 172.21.15.66:0/4023678558 learned_addr learned my addr 172.21.15.66:0/4023678558 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.709+0000 7f5a91d9b640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a94102ed0 0x7f5a9406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a9259c640 1 -- 172.21.15.66:0/4023678558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a94102ed0 msgr2=0x7f5a9406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a9259c640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a94102ed0 0x7f5a9406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a9259c640 1 -- 172.21.15.66:0/4023678558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a840098b0 con 0x7f5a94102530 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a9259c640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a9406fa10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a84004750 tx=0x7f5a84004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a84009610 con 0x7f5a94102530 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a84032b10 con 0x7f5a94102530 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a94070830 con 0x7f5a94102530 2024-09-12T01:48:34.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a8403d990 con 0x7f5a94102530 2024-09-12T01:48:34.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.710+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a94119860 con 0x7f5a94102530 2024-09-12T01:48:34.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.711+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a940fdcb0 con 0x7f5a94102530 2024-09-12T01:48:34.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.711+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f5a8402f030 con 0x7f5a94102530 2024-09-12T01:48:34.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.712+0000 7f5a8affd640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f5a8006e1e0 0x7f5a80070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:34.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.712+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f5a840aee70 con 0x7f5a94102530 2024-09-12T01:48:34.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.712+0000 7f5a91d9b640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f5a8006e1e0 0x7f5a80070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:34.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.713+0000 7f5a91d9b640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f5a8006e1e0 0x7f5a80070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a94071350 tx=0x7f5a7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:34.717 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.717+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5a84078100 con 0x7f5a94102530 2024-09-12T01:48:34.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.911+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a94071100 con 0x7f5a8006e1e0 2024-09-12T01:48:34.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.913+0000 7f5a8affd640 1 -- 172.21.15.66:0/4023678558 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f5a94071100 con 0x7f5a8006e1e0 2024-09-12T01:48:34.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f5a8006e1e0 msgr2=0x7f5a80070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f5a8006e1e0 0x7f5a80070690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5a94071350 tx=0x7f5a7c00b040 comp rx=0 tx=0).stop 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 msgr2=0x7f5a9406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a9406fa10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5a84004750 tx=0x7f5a84004d10 comp rx=0 tx=0).stop 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 shutdown_connections 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f5a8006e1e0 0x7f5a80070690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a94102ed0 0x7f5a9406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 --2- 172.21.15.66:0/4023678558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a94102530 0x7f5a9406fa10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 >> 172.21.15.66:0/4023678558 conn(0x7f5a940f80f0 msgr2=0x7f5a940f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 shutdown_connections 2024-09-12T01:48:34.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.915+0000 7f5a98931640 1 -- 172.21.15.66:0/4023678558 wait complete. 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.995+0000 7fa8d2506640 1 -- 172.21.15.66:0/3384494883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 msgr2=0x7fa8cc106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.995+0000 7fa8d2506640 1 --2- 172.21.15.66:0/3384494883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc106640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00048d0 tx=0x7fa8c0009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.995+0000 7fa8d2506640 1 -- 172.21.15.66:0/3384494883 shutdown_connections 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.995+0000 7fa8d2506640 1 --2- 172.21.15.66:0/3384494883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc106640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.995+0000 7fa8d2506640 1 --2- 172.21.15.66:0/3384494883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 0x7fa8cc0fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.995+0000 7fa8d2506640 1 -- 172.21.15.66:0/3384494883 >> 172.21.15.66:0/3384494883 conn(0x7fa8cc0f7090 msgr2=0x7fa8cc0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.996+0000 7fa8d2506640 1 -- 172.21.15.66:0/3384494883 shutdown_connections 2024-09-12T01:48:34.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.996+0000 7fa8d2506640 1 -- 172.21.15.66:0/3384494883 wait complete. 2024-09-12T01:48:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.996+0000 7fa8d2506640 1 Processor -- start 2024-09-12T01:48:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.996+0000 7fa8d2506640 1 -- start start 2024-09-12T01:48:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8d2506640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 0x7fa8cc113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8d2506640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8d2506640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc113d60 con 0x7fa8cc0fdf70 2024-09-12T01:48:35.002 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8d2506640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc10d1a0 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cbfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 0x7fa8cc113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc113760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37964/0 (socket says 172.21.15.66:37964) 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cb7fe640 1 -- 172.21.15.66:0/2409825042 learned_addr learned my addr 172.21.15.66:0/2409825042 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cbfff640 1 -- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 msgr2=0x7fa8cc113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cbfff640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cbfff640 1 -- 172.21.15.66:0/2409825042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0005040 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.997+0000 7fa8cb7fe640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.998+0000 7fa8cbfff640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 0x7fa8cc113220 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0027a0 tx=0x7fa8bc009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.998+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8bc002d30 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.998+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc10d480 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.998+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa8bc00f040 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.998+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8bc009430 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.998+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc10d9a0 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.999+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc066290 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:34.999+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fa8bc007c30 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.000+0000 7fa8c8ff9640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa8b406e1e0 0x7fa8b4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.000+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa8bc08dbf0 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.000+0000 7fa8cb7fe640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa8b406e1e0 0x7fa8b4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.004 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.000+0000 7fa8cb7fe640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa8b406e1e0 0x7fa8b4070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc10eae0 tx=0x7fa8c0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.005 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.005+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa8bc056cf0 con 0x7fa8cc0fd5d0 2024-09-12T01:48:35.193 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.193+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8cc04b770 con 0x7fa8b406e1e0 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.202+0000 7fa8c8ff9640 1 -- 172.21.15.66:0/2409825042 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa8cc04b770 con 0x7fa8b406e1e0 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (2m) 48s ago 13m 16.4M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 starting - - - - 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (12m) 35s ago 12m 6899k - 17.2.7-1609-g554ba93e d4c538e492e4 ee821b529cee 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (2m) 48s ago 12m 76.6M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:48:35.202 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (7m) 48s ago 7m 14.0M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (7m) 48s ago 7m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (7m) 35s ago 7m 17.0M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (7m) 35s ago 7m 16.0M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (4m) 48s ago 14m 472M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (3m) 35s ago 12m 437M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (60s) 48s ago 14m 29.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (39s) 35s ago 12m 22.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (3m) 48s ago 13m 16.6M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (3m) 35s ago 12m 16.7M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (11m) 48s ago 11m 248M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 abd16a4ca469 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (11m) 48s ago 11m 261M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (10m) 48s ago 10m 215M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (10m) 35s ago 10m 276M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:48:35.203 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (9m) 35s ago 9m 253M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:48:35.204 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (9m) 35s ago 9m 232M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:48:35.204 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (3m) 48s ago 12m 62.4M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:48:35.204 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa8b406e1e0 msgr2=0x7fa8b4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa8b406e1e0 0x7fa8b4070690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc10eae0 tx=0x7fa8c0035040 comp rx=0 tx=0).stop 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 msgr2=0x7fa8cc113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 0x7fa8cc113220 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0027a0 tx=0x7fa8bc009f30 comp rx=0 tx=0).stop 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 shutdown_connections 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa8b406e1e0 0x7fa8b4070690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8cc0fdf70 0x7fa8cc113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 --2- 172.21.15.66:0/2409825042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8cc0fd5d0 0x7fa8cc113220 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 >> 172.21.15.66:0/2409825042 conn(0x7fa8cc0f7090 msgr2=0x7fa8cc0f8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 shutdown_connections 2024-09-12T01:48:35.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.204+0000 7fa8d2506640 1 -- 172.21.15.66:0/2409825042 wait complete. 2024-09-12T01:48:35.267 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:35 smithi153 ceph-mon[80899]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:35.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.283+0000 7f42295c3640 1 -- 172.21.15.66:0/3484581128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 msgr2=0x7f42241029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.283+0000 7f42295c3640 1 --2- 172.21.15.66:0/3484581128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f42241029f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f42140048d0 tx=0x7f4214009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 -- 172.21.15.66:0/3484581128 shutdown_connections 2024-09-12T01:48:35.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 --2- 172.21.15.66:0/3484581128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42240fac80 0x7f42240fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 --2- 172.21.15.66:0/3484581128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f42241029f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.284 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 -- 172.21.15.66:0/3484581128 >> 172.21.15.66:0/3484581128 conn(0x7f4224070ce0 msgr2=0x7f42240710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.284 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:35 smithi066 ceph-mon[110996]: pgmap v29: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 -- 172.21.15.66:0/3484581128 shutdown_connections 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 -- 172.21.15.66:0/3484581128 wait complete. 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 Processor -- start 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.284+0000 7f42295c3640 1 -- start start 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f42295c3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42240fac80 0x7f42241131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f42295c3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f4224113700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f42295c3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224113d00 con 0x7f4224102620 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f42295c3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422410d140 con 0x7f42240fac80 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f4224113700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.286 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f4224113700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:37980/0 (socket says 172.21.15.66:37980) 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 -- 172.21.15.66:0/3490764251 learned_addr learned my addr 172.21.15.66:0/3490764251 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f4222ffd640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42240fac80 0x7f42241131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 -- 172.21.15.66:0/3490764251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42240fac80 msgr2=0x7f42241131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42240fac80 0x7f42241131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 -- 172.21.15.66:0/3490764251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4214005040 con 0x7f4224102620 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421bfff640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f4224113700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f420c00eb70 tx=0x7f420c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420c007c30 con 0x7f4224102620 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f420c00f040 con 0x7f4224102620 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.285+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422410d3c0 con 0x7f4224102620 2024-09-12T01:48:35.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.286+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420c00ca60 con 0x7f4224102620 2024-09-12T01:48:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.286+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422410d960 con 0x7f4224102620 2024-09-12T01:48:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.287+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42240657b0 con 0x7f4224102620 2024-09-12T01:48:35.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.287+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f420c00cbc0 con 0x7f4224102620 2024-09-12T01:48:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.288+0000 7f421b7fe640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f421006e1e0 0x7f4210070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.288+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f420c08d950 con 0x7f4224102620 2024-09-12T01:48:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.288+0000 7f4222ffd640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f421006e1e0 0x7f4210070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.288+0000 7f4222ffd640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f421006e1e0 0x7f4210070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4214004540 tx=0x7f4214035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.292+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f420c056be0 con 0x7f4224102620 2024-09-12T01:48:35.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.539+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4224074c00 con 0x7f4224102620 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.539+0000 7f421b7fe640 1 -- 172.21.15.66:0/3490764251 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f420c05a2a0 con 0x7f4224102620 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6 2024-09-12T01:48:35.540 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 10, 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 4 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:48:35.541 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:48:35.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f421006e1e0 msgr2=0x7f4210070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f421006e1e0 0x7f4210070690 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4214004540 tx=0x7f4214035040 comp rx=0 tx=0).stop 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 msgr2=0x7f4224113700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f4224113700 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f420c00eb70 tx=0x7f420c00b040 comp rx=0 tx=0).stop 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 shutdown_connections 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f421006e1e0 0x7f4210070690 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4224102620 0x7f4224113700 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 --2- 172.21.15.66:0/3490764251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42240fac80 0x7f42241131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 >> 172.21.15.66:0/3490764251 conn(0x7f4224070ce0 msgr2=0x7f4224105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 shutdown_connections 2024-09-12T01:48:35.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.542+0000 7f42295c3640 1 -- 172.21.15.66:0/3490764251 wait complete. 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.622+0000 7f1a6fac3640 1 -- 172.21.15.66:0/2892255413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065300 msgr2=0x7f1a680656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.622+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/2892255413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065300 0x7f1a680656d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a600048d0 tx=0x7f1a60009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- 172.21.15.66:0/2892255413 shutdown_connections 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/2892255413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a68065c10 0x7f1a680fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/2892255413 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065300 0x7f1a680656d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- 172.21.15.66:0/2892255413 >> 172.21.15.66:0/2892255413 conn(0x7f1a680723b0 msgr2=0x7f1a680727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.624 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- 172.21.15.66:0/2892255413 shutdown_connections 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- 172.21.15.66:0/2892255413 wait complete. 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 Processor -- start 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- start start 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a68065300 0x7f1a681131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 0x7f1a68113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68113d10 con 0x7f1a68065c10 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.623+0000 7f1a6fac3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6810d150 con 0x7f1a68065300 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 0x7f1a68113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 0x7f1a68113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38002/0 (socket says 172.21.15.66:38002) 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 -- 172.21.15.66:0/4028924266 learned_addr learned my addr 172.21.15.66:0/4028924266 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 -- 172.21.15.66:0/4028924266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a68065300 msgr2=0x7f1a681131d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a68065300 0x7f1a681131d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 -- 172.21.15.66:0/4028924266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60005040 con 0x7f1a68065c10 2024-09-12T01:48:35.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6d05e640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 0x7f1a68113710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00eb70 tx=0x7f1a5c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c007c30 con 0x7f1a68065c10 2024-09-12T01:48:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a5c00f040 con 0x7f1a68065c10 2024-09-12T01:48:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c0094e0 con 0x7f1a68065c10 2024-09-12T01:48:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6810d3d0 con 0x7f1a68065c10 2024-09-12T01:48:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.624+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6810d970 con 0x7f1a68065c10 2024-09-12T01:48:35.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.625+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a680fdce0 con 0x7f1a68065c10 2024-09-12T01:48:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.626+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f1a5c009660 con 0x7f1a68065c10 2024-09-12T01:48:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.627+0000 7f1a667fc640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1a5006e1e0 0x7f1a50070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.627+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1a5c08db60 con 0x7f1a68065c10 2024-09-12T01:48:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.627+0000 7f1a6d85f640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1a5006e1e0 0x7f1a50070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.627+0000 7f1a6d85f640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1a5006e1e0 0x7f1a50070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a600043d0 tx=0x7f1a60009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.631+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1a5c056cc0 con 0x7f1a68065c10 2024-09-12T01:48:35.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.845+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1a6804b720 con 0x7f1a68065c10 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.845+0000 7f1a667fc640 1 -- 172.21.15.66:0/4028924266 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7f1a5c05a380 con 0x7f1a68065c10 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:35.846 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:48:35.847 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:48:35.848 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:35.849 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1a5006e1e0 msgr2=0x7f1a50070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1a5006e1e0 0x7f1a50070690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1a600043d0 tx=0x7f1a60009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 msgr2=0x7f1a68113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 0x7f1a68113710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00eb70 tx=0x7f1a5c00b040 comp rx=0 tx=0).stop 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 shutdown_connections 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1a5006e1e0 0x7f1a50070690 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a68065c10 0x7f1a68113710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 --2- 172.21.15.66:0/4028924266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a68065300 0x7f1a681131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 >> 172.21.15.66:0/4028924266 conn(0x7f1a680723b0 msgr2=0x7f1a68105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.850 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 shutdown_connections 2024-09-12T01:48:35.851 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.848+0000 7f1a6fac3640 1 -- 172.21.15.66:0/4028924266 wait complete. 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3353443190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e40fe460 msgr2=0x7fa5e40fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3353443190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e40fe460 0x7fa5e40fe830 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa5d40048d0 tx=0x7fa5d4009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3353443190 shutdown_connections 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3353443190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e4064fc0 0x7fa5e4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3353443190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e40fe460 0x7fa5e40fe830 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3353443190 >> 172.21.15.66:0/3353443190 conn(0x7fa5e40723b0 msgr2=0x7fa5e40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3353443190 shutdown_connections 2024-09-12T01:48:35.934 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.933+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3353443190 wait complete. 2024-09-12T01:48:35.935 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5ea52b640 1 Processor -- start 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5ea52b640 1 -- start start 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5ea52b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 0x7fa5e41131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5ea52b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e40fe460 0x7fa5e41136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5ea52b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e4113cf0 con 0x7fa5e4064fc0 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5ea52b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e410d130 con 0x7fa5e40fe460 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5e3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 0x7fa5e41131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5e3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 0x7fa5e41131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38032/0 (socket says 172.21.15.66:38032) 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5e3fff640 1 -- 172.21.15.66:0/3669212459 learned_addr learned my addr 172.21.15.66:0/3669212459 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.934+0000 7fa5e37fe640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e40fe460 0x7fa5e41136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e3fff640 1 -- 172.21.15.66:0/3669212459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e40fe460 msgr2=0x7fa5e41136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:35.936 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e3fff640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e40fe460 0x7fa5e41136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:35.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e3fff640 1 -- 172.21.15.66:0/3669212459 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4005040 con 0x7fa5e4064fc0 2024-09-12T01:48:35.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e37fe640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e40fe460 0x7fa5e41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:48:35.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e3fff640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 0x7fa5e41131b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4000c00 tx=0x7fa5d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d4038070 con 0x7fa5e4064fc0 2024-09-12T01:48:35.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5d402ade0 con 0x7fa5e4064fc0 2024-09-12T01:48:35.937 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.935+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e410d3b0 con 0x7fa5e4064fc0 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.936+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5d402c7b0 con 0x7fa5e4064fc0 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.936+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e410d8f0 con 0x7fa5e4064fc0 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.937+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fa5d4030020 con 0x7fa5e4064fc0 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.937+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e40fdcf0 con 0x7fa5e4064fc0 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.937+0000 7fa5e0ff9640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa5cc06e1e0 0x7fa5cc070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.937+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fa5d40ad770 con 0x7fa5e4064fc0 2024-09-12T01:48:35.938 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.937+0000 7fa5e37fe640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa5cc06e1e0 0x7fa5cc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:35.939 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.938+0000 7fa5e37fe640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa5cc06e1e0 0x7fa5cc070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8004fd0 tx=0x7fa5d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:35.942 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:35.942+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa5d40769d0 con 0x7fa5e4064fc0 2024-09-12T01:48:36.110 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:36.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:36.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='client.44131 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:36.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3490764251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:36.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:36.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:36.111 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:36.144 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.144+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5e404b7b0 con 0x7fa5cc06e1e0 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.145+0000 7fa5e0ff9640 1 -- 172.21.15.66:0/3669212459 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fa5e404b7b0 con 0x7fa5cc06e1e0 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "4/21 daemons upgraded", 2024-09-12T01:48:36.146 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading crash daemons", 2024-09-12T01:48:36.147 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:48:36.147 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:48:36.148 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa5cc06e1e0 msgr2=0x7fa5cc070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa5cc06e1e0 0x7fa5cc070690 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8004fd0 tx=0x7fa5d800b040 comp rx=0 tx=0).stop 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 msgr2=0x7fa5e41131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 0x7fa5e41131b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4000c00 tx=0x7fa5d4009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 shutdown_connections 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fa5cc06e1e0 0x7fa5cc070690 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5e40fe460 0x7fa5e41136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 --2- 172.21.15.66:0/3669212459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5e4064fc0 0x7fa5e41131b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 >> 172.21.15.66:0/3669212459 conn(0x7fa5e40723b0 msgr2=0x7fa5e4105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 shutdown_connections 2024-09-12T01:48:36.149 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.148+0000 7fa5ea52b640 1 -- 172.21.15.66:0/3669212459 wait complete. 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 -- 172.21.15.66:0/1447763645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 msgr2=0x7f289c101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 --2- 172.21.15.66:0/1447763645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c101850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f288c0048d0 tx=0x7f288c009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 -- 172.21.15.66:0/1447763645 shutdown_connections 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 --2- 172.21.15.66:0/1447763645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f289c101e20 0x7f289c0fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 --2- 172.21.15.66:0/1447763645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c101850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 -- 172.21.15.66:0/1447763645 >> 172.21.15.66:0/1447763645 conn(0x7f289c070c80 msgr2=0x7f289c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 -- 172.21.15.66:0/1447763645 shutdown_connections 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.245+0000 7f28a0d64640 1 -- 172.21.15.66:0/1447763645 wait complete. 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f28a0d64640 1 Processor -- start 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f28a0d64640 1 -- start start 2024-09-12T01:48:36.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f28a0d64640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f28a0d64640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f289c101e20 0x7f289c10e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f28a0d64640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c10ecc0 con 0x7f289c101480 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f28a0d64640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c10ee30 con 0x7f289c101e20 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f289a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f289a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c10e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38044/0 (socket says 172.21.15.66:38044) 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f289a59c640 1 -- 172.21.15.66:0/2091908418 learned_addr learned my addr 172.21.15.66:0/2091908418 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.246+0000 7f2899d9b640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f289c101e20 0x7f289c10e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f289a59c640 1 -- 172.21.15.66:0/2091908418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f289c101e20 msgr2=0x7f289c10e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f289a59c640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f289c101e20 0x7f289c10e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f289a59c640 1 -- 172.21.15.66:0/2091908418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c005040 con 0x7f289c101480 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f289a59c640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c10e180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f288c0043d0 tx=0x7f288c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f288c038070 con 0x7f289c101480 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f288c0096e0 con 0x7f289c101480 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c1171f0 con 0x7f289c101480 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c1176b0 con 0x7f289c101480 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.247+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f288c03d420 con 0x7f289c101480 2024-09-12T01:48:36.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.248+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c005210 con 0x7f289c101480 2024-09-12T01:48:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.249+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f288c030020 con 0x7f289c101480 2024-09-12T01:48:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.249+0000 7f288affd640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f288406e1e0 0x7f2884070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:48:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.250+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f288c0ae080 con 0x7f289c101480 2024-09-12T01:48:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.250+0000 7f2899d9b640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f288406e1e0 0x7f2884070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:48:36.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.250+0000 7f2899d9b640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f288406e1e0 0x7f2884070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f289c0fb680 tx=0x7f289000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:48:36.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.254+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f288c0772f0 con 0x7f289c101480 2024-09-12T01:48:36.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:36 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4028924266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:48:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:36.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='client.44131 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:36.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3490764251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:36.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:36.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:36.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:36.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:36 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4028924266' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:48:36.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.503+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f287c005790 con 0x7f289c101480 2024-09-12T01:48:36.504 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.504+0000 7f288affd640 1 -- 172.21.15.66:0/2091908418 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f288c07a9b0 con 0x7f289c101480 2024-09-12T01:48:36.504 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_OK 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f288406e1e0 msgr2=0x7f2884070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f288406e1e0 0x7f2884070690 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f289c0fb680 tx=0x7f289000b040 comp rx=0 tx=0).stop 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 msgr2=0x7f289c10e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c10e180 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f288c0043d0 tx=0x7f288c009da0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 shutdown_connections 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f288406e1e0 0x7f2884070690 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f289c101e20 0x7f289c10e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 --2- 172.21.15.66:0/2091908418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f289c101480 0x7f289c10e180 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:48:36.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 >> 172.21.15.66:0/2091908418 conn(0x7f289c070c80 msgr2=0x7f289c104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:48:36.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 shutdown_connections 2024-09-12T01:48:36.508 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:48:36.506+0000 7f28a0d64640 1 -- 172.21.15.66:0/2091908418 wait complete. 2024-09-12T01:48:37.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:37 smithi066 ceph-mon[110996]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:37.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:37 smithi066 ceph-mon[110996]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:37.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:37 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2091908418' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:48:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:37 smithi153 ceph-mon[80899]: pgmap v30: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:37 smithi153 ceph-mon[80899]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:48:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:37 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2091908418' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:48:39.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:39 smithi066 ceph-mon[110996]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:39.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:39 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:39.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:39 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:39.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:39 smithi153 ceph-mon[80899]: pgmap v31: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:39.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:39 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:39.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:39 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:40.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:40.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:40.550 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:41.465 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:41 smithi153 ceph-mon[80899]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:41.466 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:41.466 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:41.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:41 smithi066 ceph-mon[110996]: pgmap v32: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:41.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:41.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:42.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:42.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:43.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:43 smithi066 ceph-mon[110996]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:43.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:43 smithi153 ceph-mon[80899]: pgmap v33: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:45.441 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:45.441 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.441 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.441 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi066"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi066"}]': finished 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]: dispatch 2024-09-12T01:48:45.442 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]': finished 2024-09-12T01:48:45.443 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:45 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: pgmap v34: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi066"}]: dispatch 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi066"}]': finished 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]: dispatch 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi153"}]': finished 2024-09-12T01:48:45.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:45 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-12T01:48:46.605 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:46 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all crash 2024-09-12T01:48:46.606 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:46 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-12T01:48:46.606 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:46 smithi066 ceph-mon[110996]: Upgrade: osd.0 is safe to restart 2024-09-12T01:48:46.606 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:46 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:46.606 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:46 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:48:46.606 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:46 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:46.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:46 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all crash 2024-09-12T01:48:46.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:46 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-12T01:48:46.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:46 smithi153 ceph-mon[80899]: Upgrade: osd.0 is safe to restart 2024-09-12T01:48:46.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:46 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:46.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:46 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-12T01:48:46.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:46 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:48:47.624 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:47 smithi066 ceph-mon[110996]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:47.624 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:47 smithi066 ceph-mon[110996]: Upgrade: Updating osd.0 2024-09-12T01:48:47.624 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:47 smithi066 ceph-mon[110996]: Deploying daemon osd.0 on smithi066 2024-09-12T01:48:47.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:47 smithi153 ceph-mon[80899]: pgmap v35: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:47 smithi153 ceph-mon[80899]: Upgrade: Updating osd.0 2024-09-12T01:48:47.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:47 smithi153 ceph-mon[80899]: Deploying daemon osd.0 on smithi066 2024-09-12T01:48:49.587 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:49 smithi066 ceph-mon[110996]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:49.587 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:49 smithi066 systemd[1]: Stopping Ceph osd.0 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:48:49.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:49 smithi153 ceph-mon[80899]: pgmap v36: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:49.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:49 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[46067]: 2024-09-12T01:48:49.693+0000 7f3d87c92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:48:49.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:49 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[46067]: 2024-09-12T01:48:49.693+0000 7f3d87c92640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-12T01:48:49.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:49 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[46067]: 2024-09-12T01:48:49.693+0000 7f3d87c92640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:48:50.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:50 smithi066 ceph-mon[110996]: osd.0 marked itself down and dead 2024-09-12T01:48:50.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:50 smithi153 ceph-mon[80899]: osd.0 marked itself down and dead 2024-09-12T01:48:50.993 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:50 smithi066 podman[122101]: 2024-09-12 01:48:50.736100657 +0000 UTC m=+1.178466296 container died abd16a4ca469765fd2214aaeab323c7bb4e277d622df7a89d89f72ca8d70aff2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, RELEASE=quincy-554ba93, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2) 2024-09-12T01:48:51.259 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 podman[122101]: 2024-09-12 01:48:51.067081094 +0000 UTC m=+1.509446731 container cleanup abd16a4ca469765fd2214aaeab323c7bb4e277d622df7a89d89f72ca8d70aff2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-554ba93, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T01:48:51.259 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 bash[122101]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0 2024-09-12T01:48:51.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:51 smithi066 ceph-mon[110996]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:51.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:51 smithi066 ceph-mon[110996]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:48:51.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:51 smithi066 ceph-mon[110996]: osdmap e48: 6 total, 5 up, 6 in 2024-09-12T01:48:51.640 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 podman[122117]: 2024-09-12 01:48:51.260131781 +0000 UTC m=+0.519382611 container remove abd16a4ca469765fd2214aaeab323c7bb4e277d622df7a89d89f72ca8d70aff2 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-554ba93) 2024-09-12T01:48:51.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:51 smithi153 ceph-mon[80899]: pgmap v37: 65 pgs: 65 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:51.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:51 smithi153 ceph-mon[80899]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:48:51.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:51 smithi153 ceph-mon[80899]: osdmap e48: 6 total, 5 up, 6 in 2024-09-12T01:48:51.963 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 podman[122205]: 2024-09-12 01:48:51.607608377 +0000 UTC m=+0.016627928 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:48:51.963 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 podman[122205]: 2024-09-12 01:48:51.736226571 +0000 UTC m=+0.145246119 container create e7e991da40d43fde05fa880f38bf5d988853ea84d491f2982dccc450317a47d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-12T01:48:51.963 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 podman[122205]: 2024-09-12 01:48:51.963719745 +0000 UTC m=+0.372739293 container init e7e991da40d43fde05fa880f38bf5d988853ea84d491f2982dccc450317a47d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-12T01:48:52.314 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:51 smithi066 podman[122205]: 2024-09-12 01:48:51.967229031 +0000 UTC m=+0.376248580 container start e7e991da40d43fde05fa880f38bf5d988853ea84d491f2982dccc450317a47d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:48:52.314 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 podman[122205]: 2024-09-12 01:48:52.072049077 +0000 UTC m=+0.481068635 container attach e7e991da40d43fde05fa880f38bf5d988853ea84d491f2982dccc450317a47d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:48:52.314 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 podman[122205]: 2024-09-12 01:48:52.166473446 +0000 UTC m=+0.575492997 container died e7e991da40d43fde05fa880f38bf5d988853ea84d491f2982dccc450317a47d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:48:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:52 smithi066 ceph-mon[110996]: osdmap e49: 6 total, 5 up, 6 in 2024-09-12T01:48:52.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:52 smithi153 ceph-mon[80899]: osdmap e49: 6 total, 5 up, 6 in 2024-09-12T01:48:53.139 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 podman[122227]: 2024-09-12 01:48:52.734334554 +0000 UTC m=+0.561805676 container remove e7e991da40d43fde05fa880f38bf5d988853ea84d491f2982dccc450317a47d5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T01:48:53.140 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-12T01:48:53.140 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 systemd[1]: Stopped Ceph osd.0 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:48:53.140 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.0.service: Consumed 1min 29ms CPU time. 2024-09-12T01:48:53.140 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:52 smithi066 systemd[1]: Starting Ceph osd.0 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:48:53.437 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:53 smithi066 ceph-mon[110996]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:53.438 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 podman[122328]: 2024-09-12 01:48:53.090233985 +0000 UTC m=+0.017079659 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:48:53.438 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 podman[122328]: 2024-09-12 01:48:53.202353043 +0000 UTC m=+0.129198768 container create a89d23cb75bbd0b137be46b54c5ea4abe3b0a36706ce862eb106fa18b33adbaf (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS) 2024-09-12T01:48:53.438 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 podman[122328]: 2024-09-12 01:48:53.43819907 +0000 UTC m=+0.365044741 container init a89d23cb75bbd0b137be46b54c5ea4abe3b0a36706ce862eb106fa18b33adbaf (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:48:53.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:53 smithi153 ceph-mon[80899]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:48:53.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 podman[122328]: 2024-09-12 01:48:53.441903833 +0000 UTC m=+0.368749505 container start a89d23cb75bbd0b137be46b54c5ea4abe3b0a36706ce862eb106fa18b33adbaf (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:48:53.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 podman[122328]: 2024-09-12 01:48:53.529784964 +0000 UTC m=+0.456630648 container attach a89d23cb75bbd0b137be46b54c5ea4abe3b0a36706ce862eb106fa18b33adbaf (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-12T01:48:53.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:48:53.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 bash[122328]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:48:53.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:48:53.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:53 smithi066 bash[122328]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:48:54.604 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-mon[110996]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:48:54.604 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-mon[110996]: Health check failed: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded (PG_DEGRADED) 2024-09-12T01:48:54.604 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T01:48:54.604 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T01:48:54.605 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-12T01:48:54.605 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-12T01:48:54.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:54 smithi153 ceph-mon[80899]: pgmap v41: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:48:54.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:54 smithi153 ceph-mon[80899]: Health check failed: Degraded data redundancy: 44/219 objects degraded (20.091%), 17 pgs degraded (PG_DEGRADED) 2024-09-12T01:48:54.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate[122343]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 bash[122328]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-12T01:48:54.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:54 smithi066 podman[122328]: 2024-09-12 01:48:54.635296662 +0000 UTC m=+1.562142329 container died a89d23cb75bbd0b137be46b54c5ea4abe3b0a36706ce862eb106fa18b33adbaf (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:48:55.528 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 podman[122483]: 2024-09-12 01:48:55.217106792 +0000 UTC m=+0.575524923 container remove a89d23cb75bbd0b137be46b54c5ea4abe3b0a36706ce862eb106fa18b33adbaf (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-12T01:48:55.528 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 podman[122541]: 2024-09-12 01:48:55.332697579 +0000 UTC m=+0.017116832 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:48:55.528 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 podman[122541]: 2024-09-12 01:48:55.434711997 +0000 UTC m=+0.119131285 container create 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:48:55.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 podman[122541]: 2024-09-12 01:48:55.662252188 +0000 UTC m=+0.346671454 container init 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-12T01:48:55.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 podman[122541]: 2024-09-12 01:48:55.665870509 +0000 UTC m=+0.350289751 container start 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD) 2024-09-12T01:48:55.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 ceph-osd[122560]: -- 172.21.15.66:0/2889172905 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635f98e81e0 con 0x5635f8a95c00 2024-09-12T01:48:55.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 bash[122541]: 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 2024-09-12T01:48:55.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:55 smithi066 systemd[1]: Started Ceph osd.0 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:48:57.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:56 smithi066 ceph-mon[110996]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:48:57.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:57.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:57.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:57.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:57.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:57.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:56 smithi153 ceph-mon[80899]: pgmap v42: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:48:57.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:57.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:57.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:48:57.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:48:57.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:48:57.639 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:48:57 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[122556]: 2024-09-12T01:48:57.550+0000 7f54a0d74640 -1 Falling back to public interface 2024-09-12T01:48:59.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:48:58 smithi066 ceph-mon[110996]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:48:59.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:48:58 smithi153 ceph-mon[80899]: pgmap v43: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:00 smithi066 ceph-mon[110996]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:00 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:01.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:00 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:01.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:00 smithi153 ceph-mon[80899]: pgmap v44: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:01.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:00 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:01.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:00 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:02.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:02 smithi066 ceph-mon[110996]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:02.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:02.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:02.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:02 smithi153 ceph-mon[80899]: pgmap v45: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:02.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:02.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:03.890 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:49:03 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[122556]: 2024-09-12T01:49:03.623+0000 7f54a0d74640 -1 osd.0 47 log_to_monitors true 2024-09-12T01:49:04.597 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:04 smithi066 ceph-mon[110996]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:04.597 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:04 smithi066 ceph-mon[110996]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:49:04.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:04 smithi153 ceph-mon[80899]: pgmap v46: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:04.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:04 smithi153 ceph-mon[80899]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-12T01:49:05.639 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[122556]: 2024-09-12T01:49:05.376+0000 7f5494b06640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:49:05.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: osdmap e50: 6 total, 5 up, 6 in 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:05.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:05.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:05.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:05.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-12T01:49:05.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:05 smithi066 ceph-mon[110996]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: osdmap e50: 6 total, 5 up, 6 in 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:05.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:05.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:05.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:05.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:05.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-12T01:49:05.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:05 smithi153 ceph-mon[80899]: from='osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833]' entity='osd.0' 2024-09-12T01:49:06.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 -- 172.21.15.66:0/2946053025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 msgr2=0x7fc8a80fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.598 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/2946053025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a80fad10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc8980048d0 tx=0x7fc898009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 -- 172.21.15.66:0/2946053025 shutdown_connections 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/2946053025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a80fad10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/2946053025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a80642a0 0x7fc8a80fa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 -- 172.21.15.66:0/2946053025 >> 172.21.15.66:0/2946053025 conn(0x7fc8a8072740 msgr2=0x7fc8a8072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 -- 172.21.15.66:0/2946053025 shutdown_connections 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 -- 172.21.15.66:0/2946053025 wait complete. 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.597+0000 7fc8afe2a640 1 Processor -- start 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8afe2a640 1 -- start start 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8afe2a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a80642a0 0x7fc8a810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8afe2a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8afe2a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a810ed90 con 0x7fc8a8101100 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8afe2a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a810ef00 con 0x7fc8a80642a0 2024-09-12T01:49:06.599 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8ad3c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8ad3c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a810e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38832/0 (socket says 172.21.15.66:38832) 2024-09-12T01:49:06.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8ad3c5640 1 -- 172.21.15.66:0/3441823718 learned_addr learned my addr 172.21.15.66:0/3441823718 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:06.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8adbc6640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a80642a0 0x7fc8a810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8ad3c5640 1 -- 172.21.15.66:0/3441823718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a80642a0 msgr2=0x7fc8a810e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8ad3c5640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a80642a0 0x7fc8a810e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.600 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.598+0000 7fc8ad3c5640 1 -- 172.21.15.66:0/3441823718 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898005040 con 0x7fc8a8101100 2024-09-12T01:49:06.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.599+0000 7fc8ad3c5640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a810e6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8980048a0 tx=0x7fc898009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.599+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc898038070 con 0x7fc8a8101100 2024-09-12T01:49:06.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.599+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc898032d00 con 0x7fc8a8101100 2024-09-12T01:49:06.601 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.599+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a81171e0 con 0x7fc8a8101100 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.599+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8980097b0 con 0x7fc8a8101100 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.599+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a8117720 con 0x7fc8a8101100 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.600+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a80fbf00 con 0x7fc8a8101100 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.601+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fc898030020 con 0x7fc8a8101100 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.601+0000 7fc89e7fc640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc89406e1e0 0x7fc894070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.601+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc8980ae0f0 con 0x7fc8a8101100 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.601+0000 7fc8adbc6640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc89406e1e0 0x7fc894070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.602+0000 7fc8adbc6640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc89406e1e0 0x7fc894070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009b50 tx=0x7fc8a4009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.606+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc898077360 con 0x7fc8a8101100 2024-09-12T01:49:06.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.798+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8a804b720 con 0x7fc89406e1e0 2024-09-12T01:49:06.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:06 smithi066 ceph-mon[110996]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:06.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:06 smithi066 ceph-mon[110996]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:49:06.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:06 smithi066 ceph-mon[110996]: osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833] boot 2024-09-12T01:49:06.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:06 smithi066 ceph-mon[110996]: osdmap e51: 6 total, 6 up, 6 in 2024-09-12T01:49:06.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:06 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:06.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.799+0000 7fc89e7fc640 1 -- 172.21.15.66:0/3441823718 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc8a804b720 con 0x7fc89406e1e0 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc89406e1e0 msgr2=0x7fc894070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc89406e1e0 0x7fc894070690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009b50 tx=0x7fc8a4009120 comp rx=0 tx=0).stop 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 msgr2=0x7fc8a810e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a810e6b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8980048a0 tx=0x7fc898009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 shutdown_connections 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc89406e1e0 0x7fc894070690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a8101100 0x7fc8a810e6b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 --2- 172.21.15.66:0/3441823718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8a80642a0 0x7fc8a810e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 >> 172.21.15.66:0/3441823718 conn(0x7fc8a8072740 msgr2=0x7fc8a8103950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:06.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 shutdown_connections 2024-09-12T01:49:06.803 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.802+0000 7fc8afe2a640 1 -- 172.21.15.66:0/3441823718 wait complete. 2024-09-12T01:49:06.811 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:49:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 -- 172.21.15.66:0/2282870837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fe100 msgr2=0x7fb7481065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 --2- 172.21.15.66:0/2282870837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fe100 0x7fb7481065a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb7380048d0 tx=0x7fb738009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 -- 172.21.15.66:0/2282870837 shutdown_connections 2024-09-12T01:49:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 --2- 172.21.15.66:0/2282870837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fe100 0x7fb7481065a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 --2- 172.21.15.66:0/2282870837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fd760 0x7fb7480fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 -- 172.21.15.66:0/2282870837 >> 172.21.15.66:0/2282870837 conn(0x7fb7480f7030 msgr2=0x7fb7480f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 -- 172.21.15.66:0/2282870837 shutdown_connections 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.884+0000 7fb7504c1640 1 -- 172.21.15.66:0/2282870837 wait complete. 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb7504c1640 1 Processor -- start 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb7504c1640 1 -- start start 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb7504c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 0x7fb7481155f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb7504c1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fe100 0x7fb748115b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb7504c1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb748116230 con 0x7fb7480fd760 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb7504c1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74810f590 con 0x7fb7480fe100 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74e25d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 0x7fb7481155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74e25d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 0x7fb7481155f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38850/0 (socket says 172.21.15.66:38850) 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74e25d640 1 -- 172.21.15.66:0/3433815081 learned_addr learned my addr 172.21.15.66:0/3433815081 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74da5c640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fe100 0x7fb748115b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74e25d640 1 -- 172.21.15.66:0/3433815081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fe100 msgr2=0x7fb748115b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74e25d640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fe100 0x7fb748115b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74e25d640 1 -- 172.21.15.66:0/3433815081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738005040 con 0x7fb7480fd760 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.885+0000 7fb74da5c640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fe100 0x7fb748115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.886+0000 7fb74e25d640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 0x7fb7481155f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb74400b790 tx=0x7fb7440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.886+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb74400c700 con 0x7fb7480fd760 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.886+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb74400cd00 con 0x7fb7480fd760 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.886+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb74810f870 con 0x7fb7480fd760 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.886+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb744015e70 con 0x7fb7480fd760 2024-09-12T01:49:06.888 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.886+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74810fd60 con 0x7fb7480fd760 2024-09-12T01:49:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.887+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7480fac90 con 0x7fb7480fd760 2024-09-12T01:49:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.887+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fb744012070 con 0x7fb7480fd760 2024-09-12T01:49:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.888+0000 7fb73effd640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb73406e1e0 0x7fb734070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.888+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb74408d7d0 con 0x7fb7480fd760 2024-09-12T01:49:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.888+0000 7fb74da5c640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb73406e1e0 0x7fb734070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:06.889 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.888+0000 7fb74da5c640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb73406e1e0 0x7fb734070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb738000c00 tx=0x7fb738035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:06.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:06.892+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb744056ac0 con 0x7fb7480fd760 2024-09-12T01:49:06.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:06 smithi153 ceph-mon[80899]: pgmap v48: 65 pgs: 17 active+undersized, 17 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 44/219 objects degraded (20.091%) 2024-09-12T01:49:06.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:06 smithi153 ceph-mon[80899]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:49:06.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:06 smithi153 ceph-mon[80899]: osd.0 [v2:172.21.15.66:6802/389146833,v1:172.21.15.66:6803/389146833] boot 2024-09-12T01:49:06.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:06 smithi153 ceph-mon[80899]: osdmap e51: 6 total, 6 up, 6 in 2024-09-12T01:49:06.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:06 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-12T01:49:07.085 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.085+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb748066330 con 0x7fb73406e1e0 2024-09-12T01:49:07.086 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.086+0000 7fb73effd640 1 -- 172.21.15.66:0/3433815081 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb748066330 con 0x7fb73406e1e0 2024-09-12T01:49:07.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb73406e1e0 msgr2=0x7fb734070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb73406e1e0 0x7fb734070690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb738000c00 tx=0x7fb738035040 comp rx=0 tx=0).stop 2024-09-12T01:49:07.088 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 msgr2=0x7fb7481155f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 0x7fb7481155f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb74400b790 tx=0x7fb7440091d0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 shutdown_connections 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb73406e1e0 0x7fb734070690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7480fe100 0x7fb748115b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 --2- 172.21.15.66:0/3433815081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7480fd760 0x7fb7481155f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 >> 172.21.15.66:0/3433815081 conn(0x7fb7480f7030 msgr2=0x7fb7480fb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 shutdown_connections 2024-09-12T01:49:07.089 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.088+0000 7fb7504c1640 1 -- 172.21.15.66:0/3433815081 wait complete. 2024-09-12T01:49:07.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 -- 172.21.15.66:0/2923688182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102530 msgr2=0x7f43cc102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 --2- 172.21.15.66:0/2923688182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102530 0x7f43cc102900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0048d0 tx=0x7f43bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 -- 172.21.15.66:0/2923688182 shutdown_connections 2024-09-12T01:49:07.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 --2- 172.21.15.66:0/2923688182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc102ed0 0x7f43cc0fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 --2- 172.21.15.66:0/2923688182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102530 0x7f43cc102900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 -- 172.21.15.66:0/2923688182 >> 172.21.15.66:0/2923688182 conn(0x7f43cc0f80f0 msgr2=0x7f43cc0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 -- 172.21.15.66:0/2923688182 shutdown_connections 2024-09-12T01:49:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.169+0000 7f43d2733640 1 -- 172.21.15.66:0/2923688182 wait complete. 2024-09-12T01:49:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43d2733640 1 Processor -- start 2024-09-12T01:49:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43d2733640 1 -- start start 2024-09-12T01:49:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43d2733640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc102530 0x7f43cc06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43d2733640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 0x7f43cc06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43d2733640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc070490 con 0x7f43cc102ed0 2024-09-12T01:49:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43d2733640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc070600 con 0x7f43cc102530 2024-09-12T01:49:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 0x7f43cc06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 0x7f43cc06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38864/0 (socket says 172.21.15.66:38864) 2024-09-12T01:49:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cb7fe640 1 -- 172.21.15.66:0/910191864 learned_addr learned my addr 172.21.15.66:0/910191864 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:07.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cbfff640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc102530 0x7f43cc06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cb7fe640 1 -- 172.21.15.66:0/910191864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc102530 msgr2=0x7f43cc06fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cb7fe640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc102530 0x7f43cc06fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.170+0000 7f43cb7fe640 1 -- 172.21.15.66:0/910191864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc005040 con 0x7f43cc102ed0 2024-09-12T01:49:07.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.171+0000 7f43cb7fe640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 0x7f43cc06ff50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c790 tx=0x7f43c00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.171+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43c000a7a0 con 0x7f43cc102ed0 2024-09-12T01:49:07.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.171+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f43c000ada0 con 0x7f43cc102ed0 2024-09-12T01:49:07.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.171+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc070890 con 0x7f43cc102ed0 2024-09-12T01:49:07.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.171+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc119970 con 0x7f43cc102ed0 2024-09-12T01:49:07.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.171+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43c0011380 con 0x7f43cc102ed0 2024-09-12T01:49:07.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.172+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc0fdcb0 con 0x7f43cc102ed0 2024-09-12T01:49:07.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.172+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f43c0012420 con 0x7f43cc102ed0 2024-09-12T01:49:07.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.173+0000 7f43c8ff9640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b406e1e0 0x7f43b4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.173+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f43c008e140 con 0x7f43cc102ed0 2024-09-12T01:49:07.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.173+0000 7f43cbfff640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b406e1e0 0x7f43b4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.174+0000 7f43cbfff640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b406e1e0 0x7f43b4070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f43bc007ac0 tx=0x7f43bc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.177+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f43c0057430 con 0x7f43cc102ed0 2024-09-12T01:49:07.364 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.362+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43cc04b720 con 0x7f43b406e1e0 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.373+0000 7f43c8ff9640 1 -- 172.21.15.66:0/910191864 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f43cc04b720 con 0x7f43b406e1e0 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (3m) 6s ago 13m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (36s) 6s ago 13m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (31s) 28s ago 12m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (2m) 6s ago 13m 80.5M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (8m) 6s ago 8m 14.4M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (8m) 6s ago 8m 150M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:49:07.373 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (8m) 28s ago 8m 17.2M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (8m) 28s ago 8m 16.2M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (4m) 6s ago 15m 493M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (4m) 28s ago 12m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (92s) 6s ago 15m 44.3M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (71s) 28s ago 12m 33.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (3m) 6s ago 13m 16.7M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (3m) 28s ago 12m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (12s) 6s ago 12m 11.4M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (11m) 6s ago 11m 260M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 5a5cec46ff04 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (11m) 6s ago 11m 214M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (10m) 28s ago 10m 277M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (10m) 28s ago 10m 253M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:49:07.374 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (9m) 28s ago 9m 233M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:49:07.375 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (3m) 6s ago 13m 62.4M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:49:07.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b406e1e0 msgr2=0x7f43b4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b406e1e0 0x7f43b4070690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f43bc007ac0 tx=0x7f43bc035040 comp rx=0 tx=0).stop 2024-09-12T01:49:07.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 msgr2=0x7f43cc06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 0x7f43cc06ff50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c790 tx=0x7f43c00043c0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 shutdown_connections 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f43b406e1e0 0x7f43b4070690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43cc102ed0 0x7f43cc06ff50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 --2- 172.21.15.66:0/910191864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43cc102530 0x7f43cc06fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 >> 172.21.15.66:0/910191864 conn(0x7f43cc0f80f0 msgr2=0x7f43cc0f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 shutdown_connections 2024-09-12T01:49:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.375+0000 7f43d2733640 1 -- 172.21.15.66:0/910191864 wait complete. 2024-09-12T01:49:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 -- 172.21.15.66:0/2520062967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de40fbd90 msgr2=0x7f0de40fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/2520062967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de40fbd90 0x7f0de40fc200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80048d0 tx=0x7f0dd8009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 -- 172.21.15.66:0/2520062967 shutdown_connections 2024-09-12T01:49:07.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/2520062967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de40fbd90 0x7f0de40fc200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/2520062967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de41014f0 0x7f0de41018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 -- 172.21.15.66:0/2520062967 >> 172.21.15.66:0/2520062967 conn(0x7f0de4070ce0 msgr2=0x7f0de40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 -- 172.21.15.66:0/2520062967 shutdown_connections 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.475+0000 7f0de8c3b640 1 -- 172.21.15.66:0/2520062967 wait complete. 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de8c3b640 1 Processor -- start 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de8c3b640 1 -- start start 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de8c3b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de40fbd90 0x7f0de41153b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de8c3b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 0x7f0de41158f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de8c3b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de4115ef0 con 0x7f0de41014f0 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de8c3b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de4116060 con 0x7f0de40fbd90 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 0x7f0de41158f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 0x7f0de41158f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38882/0 (socket says 172.21.15.66:38882) 2024-09-12T01:49:07.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de1d9b640 1 -- 172.21.15.66:0/4005036441 learned_addr learned my addr 172.21.15.66:0/4005036441 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.476+0000 7f0de259c640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de40fbd90 0x7f0de41153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0de1d9b640 1 -- 172.21.15.66:0/4005036441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de40fbd90 msgr2=0x7f0de41153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0de1d9b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de40fbd90 0x7f0de41153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0de1d9b640 1 -- 172.21.15.66:0/4005036441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8005040 con 0x7f0de41014f0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0de1d9b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 0x7f0de41158f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8000c00 tx=0x7f0dd8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd8038070 con 0x7f0de41014f0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0dd802ade0 con 0x7f0de41014f0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de410f480 con 0x7f0de41014f0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd802c7e0 con 0x7f0de41014f0 2024-09-12T01:49:07.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.477+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de410f9c0 con 0x7f0de41014f0 2024-09-12T01:49:07.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.478+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de40fcda0 con 0x7f0de41014f0 2024-09-12T01:49:07.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.479+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f0dd8030020 con 0x7f0de41014f0 2024-09-12T01:49:07.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.479+0000 7f0dd2ffd640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0dcc06e1e0 0x7f0dcc070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.479+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f0dd80ad8a0 con 0x7f0de41014f0 2024-09-12T01:49:07.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.479+0000 7f0de259c640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0dcc06e1e0 0x7f0dcc070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.480+0000 7f0de259c640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0dcc06e1e0 0x7f0dcc070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0de40653f0 tx=0x7f0dd400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.484+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0dd8076c40 con 0x7f0de41014f0 2024-09-12T01:49:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:07 smithi066 ceph-mon[110996]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:07 smithi066 ceph-mon[110996]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:07 smithi066 ceph-mon[110996]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:07 smithi066 ceph-mon[110996]: osdmap e52: 6 total, 6 up, 6 in 2024-09-12T01:49:07.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.733+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0de4074c00 con 0x7f0de41014f0 2024-09-12T01:49:07.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.733+0000 7f0dd2ffd640 1 -- 172.21.15.66:0/4005036441 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f0dd807a300 con 0x7f0de41014f0 2024-09-12T01:49:07.733 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 5, 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:49:07.734 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 9, 2024-09-12T01:49:07.735 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 5 2024-09-12T01:49:07.735 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:49:07.735 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0dcc06e1e0 msgr2=0x7f0dcc070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0dcc06e1e0 0x7f0dcc070690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0de40653f0 tx=0x7f0dd400b040 comp rx=0 tx=0).stop 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 msgr2=0x7f0de41158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 0x7f0de41158f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dd8000c00 tx=0x7f0dd8009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 shutdown_connections 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0dcc06e1e0 0x7f0dcc070690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0de41014f0 0x7f0de41158f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 --2- 172.21.15.66:0/4005036441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0de40fbd90 0x7f0de41153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.735+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 >> 172.21.15.66:0/4005036441 conn(0x7f0de4070ce0 msgr2=0x7f0de40fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.736+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 shutdown_connections 2024-09-12T01:49:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.736+0000 7f0de8c3b640 1 -- 172.21.15.66:0/4005036441 wait complete. 2024-09-12T01:49:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 -- 172.21.15.66:0/1406109525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 msgr2=0x7fdd4c0fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 --2- 172.21.15.66:0/1406109525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c0fe0d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd340048d0 tx=0x7fdd34009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 -- 172.21.15.66:0/1406109525 shutdown_connections 2024-09-12T01:49:07.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 --2- 172.21.15.66:0/1406109525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c0fe0d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 --2- 172.21.15.66:0/1406109525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4c065300 0x7fdd4c0656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 -- 172.21.15.66:0/1406109525 >> 172.21.15.66:0/1406109525 conn(0x7fdd4c0723b0 msgr2=0x7fdd4c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 -- 172.21.15.66:0/1406109525 shutdown_connections 2024-09-12T01:49:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 -- 172.21.15.66:0/1406109525 wait complete. 2024-09-12T01:49:07.818 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 Processor -- start 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.817+0000 7fdd5236f640 1 -- start start 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd5236f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4c065300 0x7fdd4c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd5236f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd5236f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c113cf0 con 0x7fdd4c065c10 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd5236f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c10d130 con 0x7fdd4c065300 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38894/0 (socket says 172.21.15.66:38894) 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 -- 172.21.15.66:0/2733205262 learned_addr learned my addr 172.21.15.66:0/2733205262 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4bfff640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4c065300 0x7fdd4c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 -- 172.21.15.66:0/2733205262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4c065300 msgr2=0x7fdd4c1131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4c065300 0x7fdd4c1131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 -- 172.21.15.66:0/2733205262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34005040 con 0x7fdd4c065c10 2024-09-12T01:49:07.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.818+0000 7fdd4b7fe640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c1136f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.819+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd34038070 con 0x7fdd4c065c10 2024-09-12T01:49:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.819+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd3402ade0 con 0x7fdd4c065c10 2024-09-12T01:49:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.819+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3402c7e0 con 0x7fdd4c065c10 2024-09-12T01:49:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.819+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c10d3b0 con 0x7fdd4c065c10 2024-09-12T01:49:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.819+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c10d8f0 con 0x7fdd4c065c10 2024-09-12T01:49:07.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.820+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c0fdce0 con 0x7fdd4c065c10 2024-09-12T01:49:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.820+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7fdd34030020 con 0x7fdd4c065c10 2024-09-12T01:49:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.821+0000 7fdd48ff9640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fdd3806e1e0 0x7fdd38070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.821+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fdd340ad940 con 0x7fdd4c065c10 2024-09-12T01:49:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.821+0000 7fdd4bfff640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fdd3806e1e0 0x7fdd38070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:07.822 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.821+0000 7fdd4bfff640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fdd3806e1e0 0x7fdd38070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007fd0 tx=0x7fdd3c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:07.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:07.825+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd34076c60 con 0x7fdd4c065c10 2024-09-12T01:49:07.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:07 smithi153 ceph-mon[80899]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:07 smithi153 ceph-mon[80899]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:07 smithi153 ceph-mon[80899]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:07 smithi153 ceph-mon[80899]: osdmap e52: 6 total, 6 up, 6 in 2024-09-12T01:49:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.039+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd4c10e820 con 0x7fdd4c065c10 2024-09-12T01:49:08.039 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.039+0000 7fdd48ff9640 1 -- 172.21.15.66:0/2733205262 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7fdd3407a320 con 0x7fdd4c065c10 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:49:08.040 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:49:08.041 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:08.042 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:08.043 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fdd3806e1e0 msgr2=0x7fdd38070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fdd3806e1e0 0x7fdd38070690 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007fd0 tx=0x7fdd3c009e90 comp rx=0 tx=0).stop 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 msgr2=0x7fdd4c1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c1136f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd34000c00 tx=0x7fdd34009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 shutdown_connections 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fdd3806e1e0 0x7fdd38070690 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd4c065c10 0x7fdd4c1136f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 --2- 172.21.15.66:0/2733205262 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd4c065300 0x7fdd4c1131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 >> 172.21.15.66:0/2733205262 conn(0x7fdd4c0723b0 msgr2=0x7fdd4c0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 shutdown_connections 2024-09-12T01:49:08.044 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.042+0000 7fdd5236f640 1 -- 172.21.15.66:0/2733205262 wait complete. 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 -- 172.21.15.66:0/2747179158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c80fac80 msgr2=0x7f76c80fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 --2- 172.21.15.66:0/2747179158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c80fac80 0x7f76c80fb0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76b00048d0 tx=0x7f76b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 -- 172.21.15.66:0/2747179158 shutdown_connections 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 --2- 172.21.15.66:0/2747179158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c80fac80 0x7f76c80fb0f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 --2- 172.21.15.66:0/2747179158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c8102620 0x7f76c81029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 -- 172.21.15.66:0/2747179158 >> 172.21.15.66:0/2747179158 conn(0x7f76c8070ce0 msgr2=0x7f76c80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 -- 172.21.15.66:0/2747179158 shutdown_connections 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.126+0000 7f76cd95e640 1 -- 172.21.15.66:0/2747179158 wait complete. 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76cd95e640 1 Processor -- start 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76cd95e640 1 -- start start 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76cd95e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80fac80 0x7f76c8113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76cd95e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 0x7f76c81136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76cd95e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8113cd0 con 0x7f76c8102620 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76cd95e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c810d110 con 0x7f76c80fac80 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 0x7f76c81136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76be7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 0x7f76c81136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38914/0 (socket says 172.21.15.66:38914) 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76be7fc640 1 -- 172.21.15.66:0/1017886333 learned_addr learned my addr 172.21.15.66:0/1017886333 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.127+0000 7f76c6ffd640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80fac80 0x7f76c8113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76be7fc640 1 -- 172.21.15.66:0/1017886333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80fac80 msgr2=0x7f76c8113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76be7fc640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80fac80 0x7f76c8113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76be7fc640 1 -- 172.21.15.66:0/1017886333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0005040 con 0x7f76c8102620 2024-09-12T01:49:08.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76be7fc640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 0x7f76c81136d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76b0003080 tx=0x7f76b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b0038070 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f76b00097e0 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c810d390 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b003d420 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.128+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c810d8d0 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.129+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c8065790 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.130+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f76b0030020 con 0x7f76c8102620 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.130+0000 7f76bffff640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f76b406e1e0 0x7f76b4070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.131 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.130+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f76b00ae1c0 con 0x7f76c8102620 2024-09-12T01:49:08.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.130+0000 7f76c6ffd640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f76b406e1e0 0x7f76b4070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.131+0000 7f76c6ffd640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f76b406e1e0 0x7f76b4070690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76c80652b0 tx=0x7f76b8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.135+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f76b0077430 con 0x7f76c8102620 2024-09-12T01:49:08.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.334+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76c8109580 con 0x7f76b406e1e0 2024-09-12T01:49:08.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.336+0000 7f76bffff640 1 -- 172.21.15.66:0/1017886333 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f76c8109580 con 0x7f76b406e1e0 2024-09-12T01:49:08.336 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:49:08.336 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:49:08.336 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:49:08.336 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "7/21 daemons upgraded", 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading osd daemons", 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:49:08.337 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:49:08.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f76b406e1e0 msgr2=0x7f76b4070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f76b406e1e0 0x7f76b4070690 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76c80652b0 tx=0x7f76b8009040 comp rx=0 tx=0).stop 2024-09-12T01:49:08.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 msgr2=0x7f76c81136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 0x7f76c81136d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f76b0003080 tx=0x7f76b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.340 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 shutdown_connections 2024-09-12T01:49:08.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f76b406e1e0 0x7f76b4070690 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76c8102620 0x7f76c81136d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 --2- 172.21.15.66:0/1017886333 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76c80fac80 0x7f76c8113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 >> 172.21.15.66:0/1017886333 conn(0x7f76c8070ce0 msgr2=0x7f76c80f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 shutdown_connections 2024-09-12T01:49:08.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.339+0000 7f76cd95e640 1 -- 172.21.15.66:0/1017886333 wait complete. 2024-09-12T01:49:08.423 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 -- 172.21.15.66:0/3983936587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102ef0 msgr2=0x7f6b1c0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 --2- 172.21.15.66:0/3983936587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c0fc5b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6b100048d0 tx=0x7f6b10009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 -- 172.21.15.66:0/3983936587 shutdown_connections 2024-09-12T01:49:08.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 --2- 172.21.15.66:0/3983936587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c0fc5b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 --2- 172.21.15.66:0/3983936587 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102550 0x7f6b1c102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.424 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 -- 172.21.15.66:0/3983936587 >> 172.21.15.66:0/3983936587 conn(0x7f6b1c0f80f0 msgr2=0x7f6b1c0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 -- 172.21.15.66:0/3983936587 shutdown_connections 2024-09-12T01:49:08.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.420+0000 7f6b21382640 1 -- 172.21.15.66:0/3983936587 wait complete. 2024-09-12T01:49:08.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b21382640 1 Processor -- start 2024-09-12T01:49:08.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b21382640 1 -- start start 2024-09-12T01:49:08.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b21382640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 0x7f6b1c115740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.425 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b21382640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c115c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b21382640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1162d0 con 0x7f6b1c102550 2024-09-12T01:49:08.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b21382640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c10f6e0 con 0x7f6b1c102ef0 2024-09-12T01:49:08.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b1affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 0x7f6b1c115740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.426 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b1affd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 0x7f6b1c115740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38938/0 (socket says 172.21.15.66:38938) 2024-09-12T01:49:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b1affd640 1 -- 172.21.15.66:0/339087792 learned_addr learned my addr 172.21.15.66:0/339087792 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.421+0000 7f6b1a7fc640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c115c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b1affd640 1 -- 172.21.15.66:0/339087792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102ef0 msgr2=0x7f6b1c115c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b1affd640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c115c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b1affd640 1 -- 172.21.15.66:0/339087792 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10005040 con 0x7f6b1c102550 2024-09-12T01:49:08.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b1a7fc640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:08.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b1affd640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 0x7f6b1c115740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c790 tx=0x7f6b0c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0c00a820 con 0x7f6b1c102550 2024-09-12T01:49:08.429 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c10f9c0 con 0x7f6b1c102550 2024-09-12T01:49:08.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6b0c00ae20 con 0x7f6b1c102550 2024-09-12T01:49:08.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b0c0113a0 con 0x7f6b1c102550 2024-09-12T01:49:08.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.422+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c10ff60 con 0x7f6b1c102550 2024-09-12T01:49:08.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.423+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c0fdcd0 con 0x7f6b1c102550 2024-09-12T01:49:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.424+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 39) v1 ==== 92305+0+0 (secure 0 0 0) 0x7f6b0c012400 con 0x7f6b1c102550 2024-09-12T01:49:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.424+0000 7f6b037fe640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6b0406e1e0 0x7f6b04070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.424+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6b0c08de80 con 0x7f6b1c102550 2024-09-12T01:49:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.424+0000 7f6b1a7fc640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6b0406e1e0 0x7f6b04070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.425+0000 7f6b1a7fc640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6b0406e1e0 0x7f6b04070690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c1109c0 tx=0x7f6b10009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:08.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.428+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6b0c057170 con 0x7f6b1c102550 2024-09-12T01:49:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:08 smithi066 ceph-mon[110996]: pgmap v51: 65 pgs: 2 active, 3 activating, 7 active+undersized, 2 active+undersized+degraded, 51 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:49:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:08 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4005036441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:08 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2733205262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:49:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:08 smithi066 ceph-mon[110996]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:08.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:08 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:08.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.679+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6b1c1095b0 con 0x7f6b1c102550 2024-09-12T01:49:08.679 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.679+0000 7f6b037fe640 1 -- 172.21.15.66:0/339087792 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+291 (secure 0 0 0) 0x7f6b0c05a830 con 0x7f6b1c102550 2024-09-12T01:49:08.679 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded 2024-09-12T01:49:08.680 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded 2024-09-12T01:49:08.680 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-12T01:49:08.680 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6b0406e1e0 msgr2=0x7f6b04070690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6b0406e1e0 0x7f6b04070690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c1109c0 tx=0x7f6b10009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 msgr2=0x7f6b1c115740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 0x7f6b1c115740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00c790 tx=0x7f6b0c0043c0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 shutdown_connections 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6b0406e1e0 0x7f6b04070690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b1c102ef0 0x7f6b1c115c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 --2- 172.21.15.66:0/339087792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b1c102550 0x7f6b1c115740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.681+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 >> 172.21.15.66:0/339087792 conn(0x7f6b1c0f80f0 msgr2=0x7f6b1c0f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.682+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 shutdown_connections 2024-09-12T01:49:08.682 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:08.682+0000 7f6b21382640 1 -- 172.21.15.66:0/339087792 wait complete. 2024-09-12T01:49:08.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:08 smithi153 ceph-mon[80899]: pgmap v51: 65 pgs: 2 active, 3 activating, 7 active+undersized, 2 active+undersized+degraded, 51 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:49:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:08 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4005036441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:08 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2733205262' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:49:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:08 smithi153 ceph-mon[80899]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:08.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:08 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:09.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:09 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/339087792' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:49:09.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:09 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/339087792' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:49:10.806 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:10 smithi153 ceph-mon[80899]: pgmap v52: 65 pgs: 2 active, 3 activating, 7 active+undersized, 2 active+undersized+degraded, 51 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:49:10.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:10 smithi066 ceph-mon[110996]: pgmap v52: 65 pgs: 2 active, 3 activating, 7 active+undersized, 2 active+undersized+degraded, 51 active+clean; 199 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:49:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:12 smithi066 ceph-mon[110996]: pgmap v53: 65 pgs: 2 active, 3 activating, 60 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:49:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:12 smithi066 ceph-mon[110996]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded) 2024-09-12T01:49:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:12 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:49:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:12 smithi153 ceph-mon[80899]: pgmap v53: 65 pgs: 2 active, 3 activating, 60 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail 2024-09-12T01:49:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:12 smithi153 ceph-mon[80899]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 2 pgs degraded) 2024-09-12T01:49:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:12 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:49:14.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:14 smithi066 ceph-mon[110996]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 127 B/s wr, 0 op/s 2024-09-12T01:49:14.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:14 smithi066 ceph-mon[110996]: mgrmap e40: smithi066.qdwcrh(active, since 92s), standbys: smithi153.jpnqza 2024-09-12T01:49:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:14 smithi153 ceph-mon[80899]: pgmap v54: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 127 B/s wr, 0 op/s 2024-09-12T01:49:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:14 smithi153 ceph-mon[80899]: mgrmap e40: smithi066.qdwcrh(active, since 92s), standbys: smithi153.jpnqza 2024-09-12T01:49:16.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:16 smithi066 ceph-mon[110996]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 339 B/s wr, 0 op/s 2024-09-12T01:49:16.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:16 smithi153 ceph-mon[80899]: pgmap v55: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 339 B/s wr, 0 op/s 2024-09-12T01:49:18.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:18 smithi066 ceph-mon[110996]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 306 B/s wr, 0 op/s 2024-09-12T01:49:18.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:18 smithi153 ceph-mon[80899]: pgmap v56: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 306 B/s wr, 0 op/s 2024-09-12T01:49:20.746 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:20 smithi066 ceph-mon[110996]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:49:20.746 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:20.746 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:20 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:20.746 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:20 smithi066 ceph-mon[110996]: Upgrade: osd.1 is safe to restart 2024-09-12T01:49:20.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:20 smithi153 ceph-mon[80899]: pgmap v57: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:49:20.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:20.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:20 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-12T01:49:20.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:20 smithi153 ceph-mon[80899]: Upgrade: osd.1 is safe to restart 2024-09-12T01:49:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:49:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: Upgrade: Updating osd.1 2024-09-12T01:49:22.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:22.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:49:22.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:22.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:22 smithi066 ceph-mon[110996]: Deploying daemon osd.1 on smithi066 2024-09-12T01:49:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: pgmap v58: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:49:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: Upgrade: Updating osd.1 2024-09-12T01:49:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-12T01:49:22.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:22.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:22 smithi153 ceph-mon[80899]: Deploying daemon osd.1 on smithi066 2024-09-12T01:49:24.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:24 smithi066 ceph-mon[110996]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:49:24.640 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:24 smithi066 systemd[1]: Stopping Ceph osd.1 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:49:24.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:24 smithi153 ceph-mon[80899]: pgmap v59: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-12T01:49:25.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:24 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[53565]: 2024-09-12T01:49:24.859+0000 7fb58066e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:49:25.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:24 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[53565]: 2024-09-12T01:49:24.859+0000 7fb58066e640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-12T01:49:25.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:24 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[53565]: 2024-09-12T01:49:24.859+0000 7fb58066e640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:49:25.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:25 smithi066 ceph-mon[110996]: osd.1 marked itself down and dead 2024-09-12T01:49:25.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:25 smithi153 ceph-mon[80899]: osd.1 marked itself down and dead 2024-09-12T01:49:26.300 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:25 smithi066 podman[127731]: 2024-09-12 01:49:25.965273179 +0000 UTC m=+1.231754718 container died 5a5cec46ff0475342be435b811559f0fdc4c66bd9f5a05910def479c44add850 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , RELEASE=quincy-554ba93, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:49:26.300 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:26 smithi066 podman[127731]: 2024-09-12 01:49:26.301166102 +0000 UTC m=+1.567647649 container cleanup 5a5cec46ff0475342be435b811559f0fdc4c66bd9f5a05910def479c44add850 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=quincy-554ba93, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-09-12T01:49:26.639 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:26 smithi066 bash[127731]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1 2024-09-12T01:49:26.639 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:26 smithi066 podman[127746]: 2024-09-12 01:49:26.477645493 +0000 UTC m=+0.506191534 container remove 5a5cec46ff0475342be435b811559f0fdc4c66bd9f5a05910def479c44add850 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, RELEASE=quincy-554ba93, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:49:26.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:26 smithi066 ceph-mon[110996]: pgmap v60: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:49:26.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:26 smithi066 ceph-mon[110996]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:49:26.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:26 smithi066 ceph-mon[110996]: osdmap e53: 6 total, 5 up, 6 in 2024-09-12T01:49:26.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:26.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:26.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:26 smithi153 ceph-mon[80899]: pgmap v60: 65 pgs: 65 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-12T01:49:26.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:26 smithi153 ceph-mon[80899]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:49:26.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:26 smithi153 ceph-mon[80899]: osdmap e53: 6 total, 5 up, 6 in 2024-09-12T01:49:26.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:26.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:27.151 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:26 smithi066 podman[127836]: 2024-09-12 01:49:26.802161867 +0000 UTC m=+0.016406056 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:27.151 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:26 smithi066 podman[127836]: 2024-09-12 01:49:26.912080496 +0000 UTC m=+0.126324687 container create f3a02970b292d5ae0eeefeafb25681562b0180803cddfeb8dcd11af1d1d66a81 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T01:49:27.151 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 podman[127836]: 2024-09-12 01:49:27.147974027 +0000 UTC m=+0.362218216 container init f3a02970b292d5ae0eeefeafb25681562b0180803cddfeb8dcd11af1d1d66a81 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T01:49:27.151 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 podman[127836]: 2024-09-12 01:49:27.151464359 +0000 UTC m=+0.365708550 container start f3a02970b292d5ae0eeefeafb25681562b0180803cddfeb8dcd11af1d1d66a81 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2) 2024-09-12T01:49:27.480 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 podman[127836]: 2024-09-12 01:49:27.2481533 +0000 UTC m=+0.462397501 container attach f3a02970b292d5ae0eeefeafb25681562b0180803cddfeb8dcd11af1d1d66a81 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:49:27.481 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 podman[127836]: 2024-09-12 01:49:27.345256788 +0000 UTC m=+0.559500979 container died f3a02970b292d5ae0eeefeafb25681562b0180803cddfeb8dcd11af1d1d66a81 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T01:49:27.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:27 smithi066 ceph-mon[110996]: osdmap e54: 6 total, 5 up, 6 in 2024-09-12T01:49:27.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:27 smithi153 ceph-mon[80899]: osdmap e54: 6 total, 5 up, 6 in 2024-09-12T01:49:28.377 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 podman[127859]: 2024-09-12 01:49:27.918356455 +0000 UTC m=+0.564503993 container remove f3a02970b292d5ae0eeefeafb25681562b0180803cddfeb8dcd11af1d1d66a81 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-12T01:49:28.377 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-12T01:49:28.377 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 systemd[1]: Stopped Ceph osd.1 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:49:28.377 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:27 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.1.service: Consumed 1min 5.835s CPU time. 2024-09-12T01:49:28.377 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 systemd[1]: Starting Ceph osd.1 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:49:28.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:28 smithi066 ceph-mon[110996]: pgmap v63: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:49:28.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:28 smithi066 ceph-mon[110996]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:28.640 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 podman[127961]: 2024-09-12 01:49:28.279637427 +0000 UTC m=+0.016580990 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:28.640 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 podman[127961]: 2024-09-12 01:49:28.419368725 +0000 UTC m=+0.156312278 container create 766add73797e2efedd38d450d57e4092485e016a7d1d57ccf30727eb0be61623 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T01:49:28.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:28 smithi153 ceph-mon[80899]: pgmap v63: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:49:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:28 smithi153 ceph-mon[80899]: Health check failed: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:29.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 podman[127961]: 2024-09-12 01:49:28.647182961 +0000 UTC m=+0.384126524 container init 766add73797e2efedd38d450d57e4092485e016a7d1d57ccf30727eb0be61623 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-12T01:49:29.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 podman[127961]: 2024-09-12 01:49:28.65063712 +0000 UTC m=+0.387580674 container start 766add73797e2efedd38d450d57e4092485e016a7d1d57ccf30727eb0be61623 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-12T01:49:29.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 podman[127961]: 2024-09-12 01:49:28.755590126 +0000 UTC m=+0.492533701 container attach 766add73797e2efedd38d450d57e4092485e016a7d1d57ccf30727eb0be61623 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-12T01:49:29.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:49:29.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 bash[127961]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:49:29.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:49:29.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:28 smithi066 bash[127961]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:49:29.825 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T01:49:29.825 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T01:49:29.826 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-12T01:49:29.826 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-12T01:49:30.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-12T01:49:30.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-12T01:49:30.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-12T01:49:30.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-12T01:49:30.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-12T01:49:30.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-12T01:49:30.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T01:49:30.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T01:49:30.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate[127975]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-12T01:49:30.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 bash[127961]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-12T01:49:30.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:29 smithi066 podman[127961]: 2024-09-12 01:49:29.855447374 +0000 UTC m=+1.592390928 container died 766add73797e2efedd38d450d57e4092485e016a7d1d57ccf30727eb0be61623 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:49:30.844 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:30 smithi066 ceph-mon[110996]: pgmap v64: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:49:30.844 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:30 smithi066 podman[128110]: 2024-09-12 01:49:30.635487146 +0000 UTC m=+0.773985456 container remove 766add73797e2efedd38d450d57e4092485e016a7d1d57ccf30727eb0be61623 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-12T01:49:30.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:30 smithi153 ceph-mon[80899]: pgmap v64: 65 pgs: 18 active+undersized, 3 stale+active+clean, 11 active+undersized+degraded, 33 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:49:31.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:30 smithi066 podman[128171]: 2024-09-12 01:49:30.844599473 +0000 UTC m=+0.106739474 container create f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:49:31.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:30 smithi066 podman[128171]: 2024-09-12 01:49:30.754534925 +0000 UTC m=+0.016674931 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:49:31.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:31 smithi066 podman[128171]: 2024-09-12 01:49:31.05552065 +0000 UTC m=+0.317660657 container init f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-12T01:49:31.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:31 smithi066 podman[128171]: 2024-09-12 01:49:31.058829245 +0000 UTC m=+0.320969246 container start f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-12T01:49:31.140 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:31 smithi066 ceph-osd[128189]: -- 172.21.15.66:0/2509105106 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a0cb881e0 con 0x556a0bd35c00 2024-09-12T01:49:31.639 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:31 smithi066 bash[128171]: f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d 2024-09-12T01:49:31.639 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:31 smithi066 systemd[1]: Started Ceph osd.1 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:49:32.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:32.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:32.612 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:33.206 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:32 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[128185]: 2024-09-12T01:49:32.952+0000 7f0f1a3f3640 -1 Falling back to public interface 2024-09-12T01:49:33.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:33 smithi066 ceph-mon[110996]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:33.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:33 smithi153 ceph-mon[80899]: pgmap v65: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:35.509 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:35 smithi066 ceph-mon[110996]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:35.509 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:35 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:35 smithi153 ceph-mon[80899]: pgmap v66: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:35 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:37.255 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:36 smithi066 ceph-mon[110996]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:37.255 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.255 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.255 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.255 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:36 smithi153 ceph-mon[80899]: pgmap v67: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:37.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:38.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.767+0000 7fb96c1c9640 1 -- 172.21.15.66:0/2236600267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9640fe460 msgr2=0x7fb9640fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.767+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/2236600267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9640fe460 0x7fb9640fe830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb9600048d0 tx=0x7fb960009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 -- 172.21.15.66:0/2236600267 shutdown_connections 2024-09-12T01:49:38.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/2236600267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb964064fc0 0x7fb964065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.770 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/2236600267 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9640fe460 0x7fb9640fe830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 -- 172.21.15.66:0/2236600267 >> 172.21.15.66:0/2236600267 conn(0x7fb9640723b0 msgr2=0x7fb9640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 -- 172.21.15.66:0/2236600267 shutdown_connections 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 -- 172.21.15.66:0/2236600267 wait complete. 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 Processor -- start 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 -- start start 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.768+0000 7fb96c1c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 0x7fb9641131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb96c1c9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9640fe460 0x7fb9641136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb96c1c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964113cf0 con 0x7fb964064fc0 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb96c1c9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96410d130 con 0x7fb9640fe460 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 0x7fb9641131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 0x7fb9641131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45174/0 (socket says 172.21.15.66:45174) 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 -- 172.21.15.66:0/1791861235 learned_addr learned my addr 172.21.15.66:0/1791861235 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:38.771 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969764640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9640fe460 0x7fb9641136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 -- 172.21.15.66:0/1791861235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9640fe460 msgr2=0x7fb9641136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9640fe460 0x7fb9641136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 -- 172.21.15.66:0/1791861235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb960005040 con 0x7fb964064fc0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.769+0000 7fb969f65640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 0x7fb9641131b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb960000c00 tx=0x7fb960009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.770+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb960038070 con 0x7fb964064fc0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.770+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb96002ade0 con 0x7fb964064fc0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.770+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb96002c7e0 con 0x7fb964064fc0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.770+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96410d3b0 con 0x7fb964064fc0 2024-09-12T01:49:38.772 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.770+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96410d8f0 con 0x7fb964064fc0 2024-09-12T01:49:38.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.771+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9640fdcf0 con 0x7fb964064fc0 2024-09-12T01:49:38.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.772+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb960030020 con 0x7fb964064fc0 2024-09-12T01:49:38.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.773+0000 7fb95a7fc640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb95006e0b0 0x7fb950070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:38.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.773+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb9600ad910 con 0x7fb964064fc0 2024-09-12T01:49:38.773 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.773+0000 7fb969764640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb95006e0b0 0x7fb950070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:38.774 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.774+0000 7fb969764640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb95006e0b0 0x7fb950070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb96410ea70 tx=0x7fb95400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:38.778 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:38.778+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb960076e60 con 0x7fb964064fc0 2024-09-12T01:49:39.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.140+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb96404b720 con 0x7fb95006e0b0 2024-09-12T01:49:39.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.142+0000 7fb95a7fc640 1 -- 172.21.15.66:0/1791861235 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb96404b720 con 0x7fb95006e0b0 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb95006e0b0 msgr2=0x7fb950070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb95006e0b0 0x7fb950070560 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb96410ea70 tx=0x7fb95400b040 comp rx=0 tx=0).stop 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 msgr2=0x7fb9641131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 0x7fb9641131b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb960000c00 tx=0x7fb960009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 shutdown_connections 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb95006e0b0 0x7fb950070560 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9640fe460 0x7fb9641136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 --2- 172.21.15.66:0/1791861235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb964064fc0 0x7fb9641131b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.145+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 >> 172.21.15.66:0/1791861235 conn(0x7fb9640723b0 msgr2=0x7fb964105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:39.146 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.146+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 shutdown_connections 2024-09-12T01:49:39.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.146+0000 7fb96c1c9640 1 -- 172.21.15.66:0/1791861235 wait complete. 2024-09-12T01:49:39.158 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:49:39.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 -- 172.21.15.66:0/479542557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102f20 msgr2=0x7fe5e40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 --2- 172.21.15.66:0/479542557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102f20 0x7fe5e40fc5e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00048d0 tx=0x7fe5d0009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.234 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:39 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[128185]: 2024-09-12T01:49:39.139+0000 7f0f1a3f3640 -1 osd.1 52 log_to_monitors true 2024-09-12T01:49:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 -- 172.21.15.66:0/479542557 shutdown_connections 2024-09-12T01:49:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 --2- 172.21.15.66:0/479542557 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102f20 0x7fe5e40fc5e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 --2- 172.21.15.66:0/479542557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e4102580 0x7fe5e4102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 -- 172.21.15.66:0/479542557 >> 172.21.15.66:0/479542557 conn(0x7fe5e40f8100 msgr2=0x7fe5e40fa510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 -- 172.21.15.66:0/479542557 shutdown_connections 2024-09-12T01:49:39.235 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 -- 172.21.15.66:0/479542557 wait complete. 2024-09-12T01:49:39.236 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:38 smithi066 ceph-mon[110996]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:39.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.234+0000 7fe5ead51640 1 Processor -- start 2024-09-12T01:49:39.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5ead51640 1 -- start start 2024-09-12T01:49:39.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5ead51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 0x7fe5e41154a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5ead51640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e4102f20 0x7fe5e41159e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5ead51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e41160c0 con 0x7fe5e4102580 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5ead51640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e410f440 con 0x7fe5e4102f20 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5e8aed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 0x7fe5e41154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5e8aed640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 0x7fe5e41154a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45202/0 (socket says 172.21.15.66:45202) 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5e8aed640 1 -- 172.21.15.66:0/3719789288 learned_addr learned my addr 172.21.15.66:0/3719789288 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.235+0000 7fe5e3fff640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e4102f20 0x7fe5e41159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e8aed640 1 -- 172.21.15.66:0/3719789288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e4102f20 msgr2=0x7fe5e41159e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e8aed640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e4102f20 0x7fe5e41159e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e8aed640 1 -- 172.21.15.66:0/3719789288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d0005040 con 0x7fe5e4102580 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e8aed640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 0x7fe5e41154a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800b790 tx=0x7fe5d80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5d800c700 con 0x7fe5e4102580 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe5d800cd00 con 0x7fe5e4102580 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e410f6d0 con 0x7fe5e4102580 2024-09-12T01:49:39.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5d8015e80 con 0x7fe5e4102580 2024-09-12T01:49:39.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.236+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e410fbc0 con 0x7fe5e4102580 2024-09-12T01:49:39.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.238+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e40fdd00 con 0x7fe5e4102580 2024-09-12T01:49:39.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.238+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe5d8012070 con 0x7fe5e4102580 2024-09-12T01:49:39.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.239+0000 7fe5e17fa640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe5d406e0b0 0x7fe5d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.239+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe5d808d380 con 0x7fe5e4102580 2024-09-12T01:49:39.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.239+0000 7fe5e3fff640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe5d406e0b0 0x7fe5d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.239+0000 7fe5e3fff640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe5d406e0b0 0x7fe5d4070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00048a0 tx=0x7fe5d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:39.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.246+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe5d8056780 con 0x7fe5e4102580 2024-09-12T01:49:39.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:38 smithi153 ceph-mon[80899]: pgmap v68: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:39.444 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.444+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5e404b7b0 con 0x7fe5d406e0b0 2024-09-12T01:49:39.445 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.445+0000 7fe5e17fa640 1 -- 172.21.15.66:0/3719789288 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe5e404b7b0 con 0x7fe5d406e0b0 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.447+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe5d406e0b0 msgr2=0x7fe5d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.447+0000 7fe5ead51640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe5d406e0b0 0x7fe5d4070560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe5d00048a0 tx=0x7fe5d0035040 comp rx=0 tx=0).stop 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.447+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 msgr2=0x7fe5e41154a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.447+0000 7fe5ead51640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 0x7fe5e41154a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800b790 tx=0x7fe5d80091d0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 shutdown_connections 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe5d406e0b0 0x7fe5d4070560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5e4102f20 0x7fe5e41159e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.448 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 --2- 172.21.15.66:0/3719789288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5e4102580 0x7fe5e41154a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 >> 172.21.15.66:0/3719789288 conn(0x7fe5e40f8100 msgr2=0x7fe5e406fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:39.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 shutdown_connections 2024-09-12T01:49:39.449 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.448+0000 7fe5ead51640 1 -- 172.21.15.66:0/3719789288 wait complete. 2024-09-12T01:49:39.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 -- 172.21.15.66:0/2273129874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee40658f0 msgr2=0x7f7ee4108b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2273129874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee40658f0 0x7f7ee4108b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80048d0 tx=0x7f7ed8009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 -- 172.21.15.66:0/2273129874 shutdown_connections 2024-09-12T01:49:39.534 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2273129874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee40658f0 0x7f7ee4108b00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2273129874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee4064fe0 0x7f7ee40653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 -- 172.21.15.66:0/2273129874 >> 172.21.15.66:0/2273129874 conn(0x7f7ee40723b0 msgr2=0x7f7ee40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:39.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.533+0000 7f7eea4de640 1 -- 172.21.15.66:0/2273129874 shutdown_connections 2024-09-12T01:49:39.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.534+0000 7f7eea4de640 1 -- 172.21.15.66:0/2273129874 wait complete. 2024-09-12T01:49:39.535 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.534+0000 7f7eea4de640 1 Processor -- start 2024-09-12T01:49:39.536 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.534+0000 7f7eea4de640 1 -- start start 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7eea4de640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 0x7f7ee4115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7eea4de640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee40658f0 0x7f7ee41159c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7eea4de640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee4116010 con 0x7f7ee4064fe0 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7eea4de640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee410f420 con 0x7f7ee40658f0 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 0x7f7ee4115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 0x7f7ee4115480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45214/0 (socket says 172.21.15.66:45214) 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 -- 172.21.15.66:0/2698207502 learned_addr learned my addr 172.21.15.66:0/2698207502 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee37fe640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee40658f0 0x7f7ee41159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 -- 172.21.15.66:0/2698207502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee40658f0 msgr2=0x7f7ee41159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee40658f0 0x7f7ee41159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 -- 172.21.15.66:0/2698207502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed8005040 con 0x7f7ee4064fe0 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee37fe640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee40658f0 0x7f7ee41159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:49:39.537 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.535+0000 7f7ee3fff640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 0x7f7ee4115480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4002a50 tx=0x7f7ed4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:39.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.536+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ed4007c30 con 0x7f7ee4064fe0 2024-09-12T01:49:39.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.536+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ed400f040 con 0x7f7ee4064fe0 2024-09-12T01:49:39.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.536+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee410f700 con 0x7f7ee4064fe0 2024-09-12T01:49:39.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.536+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ed40094b0 con 0x7f7ee4064fe0 2024-09-12T01:49:39.538 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.536+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee410fc20 con 0x7f7ee4064fe0 2024-09-12T01:49:39.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.537+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee40fbad0 con 0x7f7ee4064fe0 2024-09-12T01:49:39.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.537+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7ed400dc50 con 0x7f7ee4064fe0 2024-09-12T01:49:39.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.538+0000 7f7ee0ff9640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7ecc06e0b0 0x7f7ecc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.538+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7ed408d9e0 con 0x7f7ee4064fe0 2024-09-12T01:49:39.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.538+0000 7f7ee37fe640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7ecc06e0b0 0x7f7ecc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.539 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.539+0000 7f7ee37fe640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7ecc06e0b0 0x7f7ecc070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ac0 tx=0x7f7ed8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:39.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.542+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ed4056d60 con 0x7f7ee4064fe0 2024-09-12T01:49:39.740 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.739+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ee404b720 con 0x7f7ecc06e0b0 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.748+0000 7f7ee0ff9640 1 -- 172.21.15.66:0/2698207502 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7ee404b720 con 0x7f7ecc06e0b0 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (3m) 3s ago 14m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (69s) 3s ago 14m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (64s) 61s ago 13m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (3m) 3s ago 13m 82.2M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (8m) 3s ago 8m 14.5M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (8m) 3s ago 8m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (8m) 61s ago 8m 17.2M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (8m) 61s ago 8m 16.2M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:49:39.749 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (5m) 3s ago 15m 497M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (4m) 61s ago 13m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (2m) 3s ago 15m 46.2M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (103s) 61s ago 13m 33.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (4m) 3s ago 14m 16.9M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (4m) 61s ago 13m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (44s) 3s ago 12m 100M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (8s) 3s ago 12m 12.1M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (11m) 3s ago 11m 213M 1557M 17.2.7-1609-g554ba93e d4c538e492e4 43e9cbb6955d 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (11m) 61s ago 11m 277M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (10m) 61s ago 10m 253M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (10m) 61s ago 10m 233M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:49:39.750 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (4m) 3s ago 13m 62.4M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.750+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7ecc06e0b0 msgr2=0x7f7ecc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7ecc06e0b0 0x7f7ecc070560 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ac0 tx=0x7f7ed8009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 msgr2=0x7f7ee4115480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 0x7f7ee4115480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4002a50 tx=0x7f7ed4004600 comp rx=0 tx=0).stop 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 shutdown_connections 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7ecc06e0b0 0x7f7ecc070560 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ee40658f0 0x7f7ee41159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 --2- 172.21.15.66:0/2698207502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ee4064fe0 0x7f7ee4115480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 >> 172.21.15.66:0/2698207502 conn(0x7f7ee40723b0 msgr2=0x7f7ee4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:39.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 shutdown_connections 2024-09-12T01:49:39.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.751+0000 7f7eea4de640 1 -- 172.21.15.66:0/2698207502 wait complete. 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 -- 172.21.15.66:0/3891129783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 msgr2=0x7f2ce80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/3891129783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce80fd3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0048d0 tx=0x7f2cdc009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 -- 172.21.15.66:0/3891129783 shutdown_connections 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/3891129783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce80fd3d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/3891129783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce80fb810 0x7f2ce80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 -- 172.21.15.66:0/3891129783 >> 172.21.15.66:0/3891129783 conn(0x7f2ce80723b0 msgr2=0x7f2ce80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 -- 172.21.15.66:0/3891129783 shutdown_connections 2024-09-12T01:49:39.835 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.834+0000 7f2ced1f0640 1 -- 172.21.15.66:0/3891129783 wait complete. 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ced1f0640 1 Processor -- start 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ced1f0640 1 -- start start 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ced1f0640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce80fb810 0x7f2ce8113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ced1f0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce81136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ced1f0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8113cb0 con 0x7f2ce80fcf80 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ced1f0640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce810d0f0 con 0x7f2ce80fb810 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ce659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce81136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ce659c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce81136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45232/0 (socket says 172.21.15.66:45232) 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.835+0000 7f2ce659c640 1 -- 172.21.15.66:0/1653679558 learned_addr learned my addr 172.21.15.66:0/1653679558 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:39.837 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ce6d9d640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce80fb810 0x7f2ce8113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ce659c640 1 -- 172.21.15.66:0/1653679558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce80fb810 msgr2=0x7f2ce8113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ce659c640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce80fb810 0x7f2ce8113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ce659c640 1 -- 172.21.15.66:0/1653679558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc005040 con 0x7f2ce80fcf80 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ce659c640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce81136b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc000c00 tx=0x7f2cdc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cdc038070 con 0x7f2ce80fcf80 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2cdc02ade0 con 0x7f2ce80fcf80 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce810d370 con 0x7f2ce80fcf80 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.836+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cdc02c7e0 con 0x7f2ce80fcf80 2024-09-12T01:49:39.838 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.837+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce810d8b0 con 0x7f2ce80fcf80 2024-09-12T01:49:39.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.837+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce80fcbc0 con 0x7f2ce80fcf80 2024-09-12T01:49:39.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.838+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2cdc030020 con 0x7f2ce80fcf80 2024-09-12T01:49:39.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.839+0000 7f2ccf7fe640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f2cd006e0b0 0x7f2cd0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:39.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.839+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2cdc0ad720 con 0x7f2ce80fcf80 2024-09-12T01:49:39.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.839+0000 7f2ce6d9d640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f2cd006e0b0 0x7f2cd0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:39.839 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.839+0000 7f2ce6d9d640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f2cd006e0b0 0x7f2cd0070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8004ed0 tx=0x7f2cd800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:39.843 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:39.843+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2cdc076bd0 con 0x7f2ce80fcf80 2024-09-12T01:49:40.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.119+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ce810e7e0 con 0x7f2ce80fcf80 2024-09-12T01:49:40.119 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:49:39 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[128185]: 2024-09-12T01:49:39.934+0000 7f0f1218d640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:49:40.120 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:39 smithi066 ceph-mon[110996]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:40.120 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:39 smithi066 ceph-mon[110996]: from='osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:40.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.119+0000 7f2ccf7fe640 1 -- 172.21.15.66:0/1653679558 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f2cdc07a290 con 0x7f2ce80fcf80 2024-09-12T01:49:40.120 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:49:40.120 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4, 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:49:40.121 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:49:40.122 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 8, 2024-09-12T01:49:40.122 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 5 2024-09-12T01:49:40.122 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:49:40.122 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.122+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f2cd006e0b0 msgr2=0x7f2cd0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.122+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f2cd006e0b0 0x7f2cd0070560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8004ed0 tx=0x7f2cd800b040 comp rx=0 tx=0).stop 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.122+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 msgr2=0x7f2ce81136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce81136b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc000c00 tx=0x7f2cdc009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 shutdown_connections 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f2cd006e0b0 0x7f2cd0070560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ce80fcf80 0x7f2ce81136b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 --2- 172.21.15.66:0/1653679558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ce80fb810 0x7f2ce8113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 >> 172.21.15.66:0/1653679558 conn(0x7f2ce80723b0 msgr2=0x7f2ce8065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 shutdown_connections 2024-09-12T01:49:40.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.123+0000 7f2ced1f0640 1 -- 172.21.15.66:0/1653679558 wait complete. 2024-09-12T01:49:40.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 -- 172.21.15.66:0/3643134012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 msgr2=0x7f07f40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.211 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/3643134012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f40fe820 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07e40048d0 tx=0x7f07e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 -- 172.21.15.66:0/3643134012 shutdown_connections 2024-09-12T01:49:40.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/3643134012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07f4064fe0 0x7f07f4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/3643134012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f40fe820 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 -- 172.21.15.66:0/3643134012 >> 172.21.15.66:0/3643134012 conn(0x7f07f40723b0 msgr2=0x7f07f40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 -- 172.21.15.66:0/3643134012 shutdown_connections 2024-09-12T01:49:40.212 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.211+0000 7f07f8fd9640 1 -- 172.21.15.66:0/3643134012 wait complete. 2024-09-12T01:49:40.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f8fd9640 1 Processor -- start 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f8fd9640 1 -- start start 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f8fd9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07f4064fe0 0x7f07f4113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f8fd9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f8fd9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4113d50 con 0x7f07f40fe450 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f8fd9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f410d190 con 0x7f07f4064fe0 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f1d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f4113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45256/0 (socket says 172.21.15.66:45256) 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f1d9b640 1 -- 172.21.15.66:0/4015107622 learned_addr learned my addr 172.21.15.66:0/4015107622 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f259c640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07f4064fe0 0x7f07f4113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f1d9b640 1 -- 172.21.15.66:0/4015107622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07f4064fe0 msgr2=0x7f07f4113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.214 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f1d9b640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07f4064fe0 0x7f07f4113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.212+0000 7f07f1d9b640 1 -- 172.21.15.66:0/4015107622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4005040 con 0x7f07f40fe450 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.213+0000 7f07f1d9b640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f4113750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07e8002a50 tx=0x7f07e8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.213+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e8007c30 con 0x7f07f40fe450 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.213+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f07e800f040 con 0x7f07f40fe450 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.213+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f410d470 con 0x7f07f40fe450 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.213+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07e800da10 con 0x7f07f40fe450 2024-09-12T01:49:40.215 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.213+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f410d990 con 0x7f07f40fe450 2024-09-12T01:49:40.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.214+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40fdce0 con 0x7f07f40fe450 2024-09-12T01:49:40.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.214+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f07e800dc80 con 0x7f07f40fe450 2024-09-12T01:49:40.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.215+0000 7f07e2ffd640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f07dc06e0b0 0x7f07dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.215+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f07e808d3b0 con 0x7f07f40fe450 2024-09-12T01:49:40.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.215+0000 7f07f259c640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f07dc06e0b0 0x7f07dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.216+0000 7f07f259c640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f07dc06e0b0 0x7f07dc070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07e4007ac0 tx=0x7f07e4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:40.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.220+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f07e8056730 con 0x7f07f40fe450 2024-09-12T01:49:40.306 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:39 smithi153 ceph-mon[80899]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:40.306 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:39 smithi153 ceph-mon[80899]: from='osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-12T01:49:40.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.433+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f07f410e8b0 con 0x7f07f40fe450 2024-09-12T01:49:40.433 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.433+0000 7f07e2ffd640 1 -- 172.21.15.66:0/4015107622 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7f07e8059df0 con 0x7f07f40fe450 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:49:40.434 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:49:40.435 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:40.436 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:40.437 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:40.437 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:49:40.437 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:49:40.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:40.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:40.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f07dc06e0b0 msgr2=0x7f07dc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f07dc06e0b0 0x7f07dc070560 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07e4007ac0 tx=0x7f07e4035040 comp rx=0 tx=0).stop 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 msgr2=0x7f07f4113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f4113750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07e8002a50 tx=0x7f07e8004600 comp rx=0 tx=0).stop 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 shutdown_connections 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f07dc06e0b0 0x7f07dc070560 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07f40fe450 0x7f07f4113750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 --2- 172.21.15.66:0/4015107622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f07f4064fe0 0x7f07f4113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.435+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 >> 172.21.15.66:0/4015107622 conn(0x7f07f40723b0 msgr2=0x7f07f40fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.436+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 shutdown_connections 2024-09-12T01:49:40.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.436+0000 7f07f8fd9640 1 -- 172.21.15.66:0/4015107622 wait complete. 2024-09-12T01:49:40.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.517+0000 7f6db0bcc640 1 -- 172.21.15.66:0/4232800465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fb810 msgr2=0x7f6dac0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/4232800465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fb810 0x7f6dac0fbbe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6d94009c50 tx=0x7f6d94004d10 comp rx=0 tx=0).stop 2024-09-12T01:49:40.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 -- 172.21.15.66:0/4232800465 shutdown_connections 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/4232800465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac0fcf80 0x7f6dac0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/4232800465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fb810 0x7f6dac0fbbe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 -- 172.21.15.66:0/4232800465 >> 172.21.15.66:0/4232800465 conn(0x7f6dac0723b0 msgr2=0x7f6dac0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 -- 172.21.15.66:0/4232800465 shutdown_connections 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 -- 172.21.15.66:0/4232800465 wait complete. 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 Processor -- start 2024-09-12T01:49:40.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.518+0000 7f6db0bcc640 1 -- start start 2024-09-12T01:49:40.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6db0bcc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac0fb810 0x7f6dac10e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6db0bcc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 0x7f6dac10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6db0bcc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac10ede0 con 0x7f6dac0fcf80 2024-09-12T01:49:40.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6db0bcc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac10ef50 con 0x7f6dac0fb810 2024-09-12T01:49:40.520 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 0x7f6dac10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 0x7f6dac10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45286/0 (socket says 172.21.15.66:45286) 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 -- 172.21.15.66:0/2359588228 learned_addr learned my addr 172.21.15.66:0/2359588228 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 -- 172.21.15.66:0/2359588228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac0fb810 msgr2=0x7f6dac10e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac0fb810 0x7f6dac10e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 -- 172.21.15.66:0/2359588228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940098b0 con 0x7f6dac0fcf80 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.519+0000 7f6da9d9b640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 0x7f6dac10e700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00b790 tx=0x7f6d9c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.520+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d9c00c700 con 0x7f6dac0fcf80 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.520+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6d9c00cd00 con 0x7f6dac0fcf80 2024-09-12T01:49:40.521 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.520+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac117230 con 0x7f6dac0fcf80 2024-09-12T01:49:40.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.520+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d9c015e70 con 0x7f6dac0fcf80 2024-09-12T01:49:40.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.520+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac117750 con 0x7f6dac0fcf80 2024-09-12T01:49:40.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.522+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6d9c012070 con 0x7f6dac0fcf80 2024-09-12T01:49:40.522 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.522+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac0fcbc0 con 0x7f6dac0fcf80 2024-09-12T01:49:40.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.523+0000 7f6da2ffd640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6d9806dea0 0x7f6d98070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.523+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6d9c095350 con 0x7f6dac0fcf80 2024-09-12T01:49:40.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.523+0000 7f6daa59c640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6d9806dea0 0x7f6d98070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.523+0000 7f6daa59c640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6d9806dea0 0x7f6d98070350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d9402a8b0 tx=0x7f6d94004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:40.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.527+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6d9c092060 con 0x7f6dac0fcf80 2024-09-12T01:49:40.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.721+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6dac065730 con 0x7f6d9806dea0 2024-09-12T01:49:40.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.723+0000 7f6da2ffd640 1 -- 172.21.15.66:0/2359588228 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6dac065730 con 0x7f6d9806dea0 2024-09-12T01:49:40.723 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:49:40.723 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:49:40.723 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:49:40.723 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "8/21 daemons upgraded", 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading osd daemons", 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:49:40.724 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6d9806dea0 msgr2=0x7f6d98070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6d9806dea0 0x7f6d98070350 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6d9402a8b0 tx=0x7f6d94004d10 comp rx=0 tx=0).stop 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 msgr2=0x7f6dac10e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 0x7f6dac10e700 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00b790 tx=0x7f6d9c0091d0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 shutdown_connections 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6d9806dea0 0x7f6d98070350 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dac0fcf80 0x7f6dac10e700 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 --2- 172.21.15.66:0/2359588228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dac0fb810 0x7f6dac10e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.725+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 >> 172.21.15.66:0/2359588228 conn(0x7f6dac0723b0 msgr2=0x7f6dac0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.726+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 shutdown_connections 2024-09-12T01:49:40.726 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.726+0000 7f6db0bcc640 1 -- 172.21.15.66:0/2359588228 wait complete. 2024-09-12T01:49:40.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 -- 172.21.15.66:0/1377611743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 msgr2=0x7facf40fb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 --2- 172.21.15.66:0/1377611743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf40fb140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7face8004da0 tx=0x7face800ad20 comp rx=0 tx=0).stop 2024-09-12T01:49:40.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 -- 172.21.15.66:0/1377611743 shutdown_connections 2024-09-12T01:49:40.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 --2- 172.21.15.66:0/1377611743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf40fb140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 --2- 172.21.15.66:0/1377611743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf4100d10 0x7facf41010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 -- 172.21.15.66:0/1377611743 >> 172.21.15.66:0/1377611743 conn(0x7facf4070d50 msgr2=0x7facf4071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:40.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 -- 172.21.15.66:0/1377611743 shutdown_connections 2024-09-12T01:49:40.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.808+0000 7facf9796640 1 -- 172.21.15.66:0/1377611743 wait complete. 2024-09-12T01:49:40.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.809+0000 7facf9796640 1 Processor -- start 2024-09-12T01:49:40.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.809+0000 7facf9796640 1 -- start start 2024-09-12T01:49:40.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.809+0000 7facf9796640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf41131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.811 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.809+0000 7facf9796640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf4100d10 0x7facf4113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.809+0000 7facf9796640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4113d20 con 0x7facf40facf0 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.809+0000 7facf9796640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf410d160 con 0x7facf4100d10 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf41131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf41131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45316/0 (socket says 172.21.15.66:45316) 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 -- 172.21.15.66:0/276442165 learned_addr learned my addr 172.21.15.66:0/276442165 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf27fc640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf4100d10 0x7facf4113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 -- 172.21.15.66:0/276442165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf4100d10 msgr2=0x7facf4113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:40.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf4100d10 0x7facf4113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 -- 172.21.15.66:0/276442165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80049b0 con 0x7facf40facf0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf2ffd640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf41131e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7face4002a80 tx=0x7face4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face4007c30 con 0x7facf40facf0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7face400f040 con 0x7facf40facf0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf410d440 con 0x7facf40facf0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face4009530 con 0x7facf40facf0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.810+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf410d960 con 0x7facf40facf0 2024-09-12T01:49:40.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.811+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf40fc3d0 con 0x7facf40facf0 2024-09-12T01:49:40.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.812+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7face4009690 con 0x7facf40facf0 2024-09-12T01:49:40.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.812+0000 7facdb7fe640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7facdc06e0b0 0x7facdc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:49:40.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.813+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6410+0+0 (secure 0 0 0) 0x7face408d480 con 0x7facf40facf0 2024-09-12T01:49:40.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.813+0000 7facf27fc640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7facdc06e0b0 0x7facdc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:49:40.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.813+0000 7facf27fc640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7facdc06e0b0 0x7facdc070560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7face8000f80 tx=0x7face8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:49:40.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:40.817+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7face4056880 con 0x7facf40facf0 2024-09-12T01:49:41.079 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.078+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7facf4074c70 con 0x7facf40facf0 2024-09-12T01:49:41.079 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:41.079 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: osdmap e55: 6 total, 5 up, 6 in 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1653679558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:41.080 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.081 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.081 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.081 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:41.081 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:41.081 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-12T01:49:41.081 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:40 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4015107622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:49:41.081 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.079+0000 7facdb7fe640 1 -- 172.21.15.66:0/276442165 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+903 (secure 0 0 0) 0x7facf4074c70 con 0x7facf40facf0 2024-09-12T01:49:41.081 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/219 objects degraded (14.155%), 13 pgs degraded 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-12T01:49:41.082 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-12T01:49:41.083 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-12T01:49:41.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7facdc06e0b0 msgr2=0x7facdc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:41.083 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7facdc06e0b0 0x7facdc070560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7face8000f80 tx=0x7face8009040 comp rx=0 tx=0).stop 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 msgr2=0x7facf41131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf41131e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7face4002a80 tx=0x7face4004600 comp rx=0 tx=0).stop 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 shutdown_connections 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7facdc06e0b0 0x7facdc070560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facf4100d10 0x7facf4113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 --2- 172.21.15.66:0/276442165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf40facf0 0x7facf41131e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 >> 172.21.15.66:0/276442165 conn(0x7facf4070d50 msgr2=0x7facf40f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 shutdown_connections 2024-09-12T01:49:41.084 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:49:41.081+0000 7facf9796640 1 -- 172.21.15.66:0/276442165 wait complete. 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: pgmap v69: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: osdmap e55: 6 total, 5 up, 6 in 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:49:41.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1653679558' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:41.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-12T01:49:41.407 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:40 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4015107622' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137] boot 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: osdmap e56: 6 total, 6 up, 6 in 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/276442165' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:41 smithi066 ceph-mon[110996]: osdmap e57: 6 total, 6 up, 6 in 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: osd.1 [v2:172.21.15.66:6810/3712300137,v1:172.21.15.66:6811/3712300137] boot 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: osdmap e56: 6 total, 6 up, 6 in 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/276442165' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:41 smithi153 ceph-mon[80899]: osdmap e57: 6 total, 6 up, 6 in 2024-09-12T01:49:43.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:42 smithi066 ceph-mon[110996]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:43.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:42 smithi153 ceph-mon[80899]: pgmap v72: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 31/219 objects degraded (14.155%) 2024-09-12T01:49:44.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:43 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:44.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:43 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded (PG_DEGRADED) 2024-09-12T01:49:45.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:44 smithi066 ceph-mon[110996]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-09-12T01:49:45.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:44 smithi153 ceph-mon[80899]: pgmap v74: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 16/219 objects degraded (7.306%) 2024-09-12T01:49:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:46 smithi066 ceph-mon[110996]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-09-12T01:49:46.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:46 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:49:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:46 smithi153 ceph-mon[80899]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/219 objects degraded (7.306%), 7 pgs degraded) 2024-09-12T01:49:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:46 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:49:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:47 smithi066 ceph-mon[110996]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:47 smithi153 ceph-mon[80899]: pgmap v75: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:49.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:49 smithi066 ceph-mon[110996]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:49.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:49 smithi153 ceph-mon[80899]: pgmap v76: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:51 smithi066 ceph-mon[110996]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:51.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:51 smithi153 ceph-mon[80899]: pgmap v77: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:52 smithi066 ceph-mon[110996]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:52.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:52 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:52.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:52 smithi153 ceph-mon[80899]: pgmap v78: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:52.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:52 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:54.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:54 smithi066 ceph-mon[110996]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:54.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:54 smithi153 ceph-mon[80899]: pgmap v79: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:55.838 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:55 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:55.838 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:55 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:55.838 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:55 smithi066 ceph-mon[110996]: Upgrade: osd.2 is safe to restart 2024-09-12T01:49:55.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:55 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:55.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:55 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-12T01:49:55.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:55 smithi153 ceph-mon[80899]: Upgrade: osd.2 is safe to restart 2024-09-12T01:49:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:56 smithi066 ceph-mon[110996]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:56.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:56 smithi153 ceph-mon[80899]: pgmap v80: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:56.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:49:57.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:57 smithi153 ceph-mon[80899]: Upgrade: Updating osd.2 2024-09-12T01:49:57.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:57.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:49:57.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:57.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:57 smithi153 ceph-mon[80899]: Deploying daemon osd.2 on smithi066 2024-09-12T01:49:58.029 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:57 smithi066 ceph-mon[110996]: Upgrade: Updating osd.2 2024-09-12T01:49:58.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:49:58.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-12T01:49:58.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:49:58.030 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:57 smithi066 ceph-mon[110996]: Deploying daemon osd.2 on smithi066 2024-09-12T01:49:58.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:49:58 smithi066 ceph-mon[110996]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:58.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:49:58 smithi153 ceph-mon[80899]: pgmap v81: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:49:59.887 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:49:59 smithi066 systemd[1]: Stopping Ceph osd.2 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:50:00.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:49:59 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[61261]: 2024-09-12T01:49:59.886+0000 7f1dc45d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:50:00.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:49:59 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[61261]: 2024-09-12T01:49:59.886+0000 7f1dc45d7640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-12T01:50:00.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:49:59 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[61261]: 2024-09-12T01:49:59.886+0000 7f1dc45d7640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:50:00.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:00 smithi153 ceph-mon[80899]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:00 smithi153 ceph-mon[80899]: osd.2 marked itself down and dead 2024-09-12T01:50:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:00 smithi153 ceph-mon[80899]: overall HEALTH_OK 2024-09-12T01:50:00.953 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:00 smithi066 ceph-mon[110996]: pgmap v82: 65 pgs: 65 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:00.954 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:00 smithi066 ceph-mon[110996]: osd.2 marked itself down and dead 2024-09-12T01:50:00.954 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:00 smithi066 ceph-mon[110996]: overall HEALTH_OK 2024-09-12T01:50:01.230 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:00 smithi066 podman[133342]: 2024-09-12 01:50:00.992064054 +0000 UTC m=+1.197731579 container died 43e9cbb6955d3eb1213fc9614a26776f58c7446228ab76b4df85944e9b1d106a (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=quincy-554ba93, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T01:50:01.505 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:01 smithi066 podman[133342]: 2024-09-12 01:50:01.32897512 +0000 UTC m=+1.534642632 container cleanup 43e9cbb6955d3eb1213fc9614a26776f58c7446228ab76b4df85944e9b1d106a (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=quincy-554ba93, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:50:01.505 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:01 smithi066 bash[133342]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2 2024-09-12T01:50:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:01 smithi066 ceph-mon[110996]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:50:01.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:01 smithi066 ceph-mon[110996]: osdmap e58: 6 total, 5 up, 6 in 2024-09-12T01:50:01.890 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:01 smithi066 podman[133359]: 2024-09-12 01:50:01.50525263 +0000 UTC m=+0.506061887 container remove 43e9cbb6955d3eb1213fc9614a26776f58c7446228ab76b4df85944e9b1d106a (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, ceph=True, RELEASE=quincy-554ba93, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:50:01.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:01 smithi153 ceph-mon[80899]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:50:01.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:01 smithi153 ceph-mon[80899]: osdmap e58: 6 total, 5 up, 6 in 2024-09-12T01:50:02.225 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:01 smithi066 podman[133449]: 2024-09-12 01:50:01.834294382 +0000 UTC m=+0.016639861 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:02.225 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:01 smithi066 podman[133449]: 2024-09-12 01:50:01.939593547 +0000 UTC m=+0.121939027 container create dfd8da692e31ada2d9552d2f7e444f9726450f827a48d193a12500da3e9b9eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T01:50:02.225 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:02 smithi066 podman[133449]: 2024-09-12 01:50:02.150901871 +0000 UTC m=+0.333247364 container init dfd8da692e31ada2d9552d2f7e444f9726450f827a48d193a12500da3e9b9eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:50:02.225 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:02 smithi066 podman[133449]: 2024-09-12 01:50:02.154897828 +0000 UTC m=+0.337243310 container start dfd8da692e31ada2d9552d2f7e444f9726450f827a48d193a12500da3e9b9eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-12T01:50:02.226 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:02 smithi066 podman[133449]: 2024-09-12 01:50:02.225303618 +0000 UTC m=+0.407649115 container attach dfd8da692e31ada2d9552d2f7e444f9726450f827a48d193a12500da3e9b9eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T01:50:02.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:02 smithi066 podman[133449]: 2024-09-12 01:50:02.353467206 +0000 UTC m=+0.535812685 container died dfd8da692e31ada2d9552d2f7e444f9726450f827a48d193a12500da3e9b9eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-12T01:50:03.029 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:02 smithi066 ceph-mon[110996]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:03.029 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:02 smithi066 ceph-mon[110996]: osdmap e59: 6 total, 5 up, 6 in 2024-09-12T01:50:03.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:02 smithi153 ceph-mon[80899]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:03.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:02 smithi153 ceph-mon[80899]: osdmap e59: 6 total, 5 up, 6 in 2024-09-12T01:50:03.282 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 podman[133473]: 2024-09-12 01:50:03.029559722 +0000 UTC m=+0.669780169 container remove dfd8da692e31ada2d9552d2f7e444f9726450f827a48d193a12500da3e9b9eb3 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:50:03.282 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-12T01:50:03.282 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 systemd[1]: Stopped Ceph osd.2 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:50:03.282 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.2.service: Consumed 54.573s CPU time. 2024-09-12T01:50:03.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 systemd[1]: Starting Ceph osd.2 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:50:03.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 podman[133571]: 2024-09-12 01:50:03.399635192 +0000 UTC m=+0.016606256 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:03.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 podman[133571]: 2024-09-12 01:50:03.530635566 +0000 UTC m=+0.147606612 container create b50445582e6afd3aa049a6cd87e6f74abf9afe19f4cc62eb48a7c306e53e55da (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True) 2024-09-12T01:50:03.912 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:03 smithi066 ceph-mon[110996]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 5 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:03.913 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 podman[133571]: 2024-09-12 01:50:03.774958121 +0000 UTC m=+0.391929173 container init b50445582e6afd3aa049a6cd87e6f74abf9afe19f4cc62eb48a7c306e53e55da (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T01:50:03.913 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 podman[133571]: 2024-09-12 01:50:03.778451744 +0000 UTC m=+0.395422793 container start b50445582e6afd3aa049a6cd87e6f74abf9afe19f4cc62eb48a7c306e53e55da (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:50:03.913 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 podman[133571]: 2024-09-12 01:50:03.849919146 +0000 UTC m=+0.466890199 container attach b50445582e6afd3aa049a6cd87e6f74abf9afe19f4cc62eb48a7c306e53e55da (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-12T01:50:04.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:03 smithi153 ceph-mon[80899]: Health check failed: Degraded data redundancy: 8/219 objects degraded (3.653%), 5 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:04.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:04.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 bash[133571]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:04.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:04.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:03 smithi066 bash[133571]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:04.947 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-mon[110996]: pgmap v86: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-09-12T01:50:04.947 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T01:50:04.947 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T01:50:04.947 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-12T01:50:04.947 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-12T01:50:05.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:04 smithi153 ceph-mon[80899]: pgmap v86: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 8/219 objects degraded (3.653%) 2024-09-12T01:50:05.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-12T01:50:05.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-12T01:50:05.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-12T01:50:05.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate[133586]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 bash[133571]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-12T01:50:05.390 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:04 smithi066 podman[133571]: 2024-09-12 01:50:04.976556024 +0000 UTC m=+1.593527077 container died b50445582e6afd3aa049a6cd87e6f74abf9afe19f4cc62eb48a7c306e53e55da (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-12T01:50:06.072 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:05 smithi066 podman[133730]: 2024-09-12 01:50:05.728814475 +0000 UTC m=+0.746201749 container remove b50445582e6afd3aa049a6cd87e6f74abf9afe19f4cc62eb48a7c306e53e55da (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:50:06.072 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:05 smithi066 podman[133786]: 2024-09-12 01:50:05.850993029 +0000 UTC m=+0.017466400 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:06.072 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:05 smithi066 podman[133786]: 2024-09-12 01:50:05.954696414 +0000 UTC m=+0.121169792 container create a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-12T01:50:06.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:06 smithi066 podman[133786]: 2024-09-12 01:50:06.182080869 +0000 UTC m=+0.348554239 container init a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:50:06.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:06 smithi066 podman[133786]: 2024-09-12 01:50:06.185434698 +0000 UTC m=+0.351908069 container start a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3) 2024-09-12T01:50:06.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:06 smithi066 ceph-osd[133804]: -- 172.21.15.66:0/2084519010 <== mon.0 v2:172.21.15.66:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f3270e1e0 con 0x559f326f6000 2024-09-12T01:50:06.640 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:06 smithi066 bash[133786]: a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 2024-09-12T01:50:06.640 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:06 smithi066 systemd[1]: Started Ceph osd.2 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:50:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:07 smithi066 ceph-mon[110996]: pgmap v87: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:07 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:07 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:07.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:07 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:07.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:07 smithi153 ceph-mon[80899]: pgmap v87: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:07.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:07 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:07.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:07 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:07.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:07 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:08.389 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:08 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[133800]: 2024-09-12T01:50:08.060+0000 7f6241e70640 -1 Falling back to public interface 2024-09-12T01:50:09.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:09 smithi066 ceph-mon[110996]: pgmap v88: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:09.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:09 smithi153 ceph-mon[80899]: pgmap v88: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:10.574 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:10 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:10.636 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:10 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:11.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/345833870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 msgr2=0x7f6ff00fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/345833870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff00fbbe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009c50 tx=0x7f6fe0004d10 comp rx=0 tx=0).stop 2024-09-12T01:50:11.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/345833870 shutdown_connections 2024-09-12T01:50:11.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/345833870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 0x7f6ff00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/345833870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff00fbbe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/345833870 >> 172.21.15.66:0/345833870 conn(0x7f6ff00723b0 msgr2=0x7f6ff00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/345833870 shutdown_connections 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.168+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/345833870 wait complete. 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6ff4c5d640 1 Processor -- start 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6ff4c5d640 1 -- start start 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6ff4c5d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff010c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6ff4c5d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 0x7f6ff010c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6ff4c5d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff010cb60 con 0x7f6ff00fb810 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6ff4c5d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff010ccd0 con 0x7f6ff00fcf80 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fee59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff010c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fee59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff010c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52958/0 (socket says 172.21.15.66:52958) 2024-09-12T01:50:11.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fee59c640 1 -- 172.21.15.66:0/405510896 learned_addr learned my addr 172.21.15.66:0/405510896 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fedd9b640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 0x7f6ff010c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fee59c640 1 -- 172.21.15.66:0/405510896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 msgr2=0x7f6ff010c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fee59c640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 0x7f6ff010c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fee59c640 1 -- 172.21.15.66:0/405510896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00098b0 con 0x7f6ff00fb810 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.169+0000 7f6fedd9b640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 0x7f6ff010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.170+0000 7f6fee59c640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff010c0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0003400 tx=0x7f6fe0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.170+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe00094c0 con 0x7f6ff00fb810 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.170+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6fe0009620 con 0x7f6ff00fb810 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.170+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff0110f90 con 0x7f6ff00fb810 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.170+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff0111530 con 0x7f6ff00fb810 2024-09-12T01:50:11.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.170+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6fe003d8f0 con 0x7f6ff00fb810 2024-09-12T01:50:11.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.171+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff00fcbc0 con 0x7f6ff00fb810 2024-09-12T01:50:11.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.172+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f6fe002f030 con 0x7f6ff00fb810 2024-09-12T01:50:11.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.172+0000 7f6fe6ffd640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6fdc06e0b0 0x7f6fdc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.172+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6fe00aeef0 con 0x7f6ff00fb810 2024-09-12T01:50:11.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.172+0000 7f6fedd9b640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6fdc06e0b0 0x7f6fdc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.173+0000 7f6fedd9b640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6fdc06e0b0 0x7f6fdc070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8004fd0 tx=0x7f6fd800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:11.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.177+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6fe0078330 con 0x7f6ff00fb810 2024-09-12T01:50:11.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.389+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ff004b720 con 0x7f6fdc06e0b0 2024-09-12T01:50:11.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.390+0000 7f6fe6ffd640 1 -- 172.21.15.66:0/405510896 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6ff004b720 con 0x7f6fdc06e0b0 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.392+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6fdc06e0b0 msgr2=0x7f6fdc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.392+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6fdc06e0b0 0x7f6fdc070560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8004fd0 tx=0x7f6fd800b040 comp rx=0 tx=0).stop 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 msgr2=0x7f6ff010c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff010c0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0003400 tx=0x7f6fe0004d10 comp rx=0 tx=0).stop 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 shutdown_connections 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f6fdc06e0b0 0x7f6fdc070560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ff00fcf80 0x7f6ff010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 --2- 172.21.15.66:0/405510896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6ff00fb810 0x7f6ff010c0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 >> 172.21.15.66:0/405510896 conn(0x7f6ff00723b0 msgr2=0x7f6ff00fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:11.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 shutdown_connections 2024-09-12T01:50:11.394 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.393+0000 7f6ff4c5d640 1 -- 172.21.15.66:0/405510896 wait complete. 2024-09-12T01:50:11.406 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:50:11.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 -- 172.21.15.66:0/534722849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1538064fc0 msgr2=0x7f1538065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 --2- 172.21.15.66:0/534722849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1538064fc0 0x7f1538065430 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f152c0048d0 tx=0x7f152c009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 -- 172.21.15.66:0/534722849 shutdown_connections 2024-09-12T01:50:11.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 --2- 172.21.15.66:0/534722849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1538064fc0 0x7f1538065430 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 --2- 172.21.15.66:0/534722849 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15380fe460 0x7f15380fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 -- 172.21.15.66:0/534722849 >> 172.21.15.66:0/534722849 conn(0x7f15380723b0 msgr2=0x7f15380727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:11.490 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:11 smithi066 ceph-mon[110996]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:11.490 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:11.490 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:11.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.489+0000 7f153e8b3640 1 -- 172.21.15.66:0/534722849 shutdown_connections 2024-09-12T01:50:11.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.490+0000 7f153e8b3640 1 -- 172.21.15.66:0/534722849 wait complete. 2024-09-12T01:50:11.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f153e8b3640 1 Processor -- start 2024-09-12T01:50:11.491 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f153e8b3640 1 -- start start 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f153e8b3640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 0x7f15381131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f153e8b3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15380fe460 0x7f1538113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f153e8b3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1538113d10 con 0x7f15380fe460 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f153e8b3640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153810d1a0 con 0x7f1538064fc0 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f15377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15380fe460 0x7f1538113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f1537fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 0x7f15381131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f1537fff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 0x7f15381131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:38968/0 (socket says 172.21.15.66:38968) 2024-09-12T01:50:11.492 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f1537fff640 1 -- 172.21.15.66:0/1821250355 learned_addr learned my addr 172.21.15.66:0/1821250355 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.491+0000 7f15377fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15380fe460 0x7f1538113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52984/0 (socket says 172.21.15.66:52984) 2024-09-12T01:50:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1537fff640 1 -- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15380fe460 msgr2=0x7f1538113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1537fff640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15380fe460 0x7f1538113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1537fff640 1 -- 172.21.15.66:0/1821250355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c005040 con 0x7f1538064fc0 2024-09-12T01:50:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1537fff640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 0x7f15381131d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f152800eb70 tx=0x7f152800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:11.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1528007c30 con 0x7f1538064fc0 2024-09-12T01:50:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f152800f040 con 0x7f1538064fc0 2024-09-12T01:50:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f152800ca60 con 0x7f1538064fc0 2024-09-12T01:50:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153810d420 con 0x7f1538064fc0 2024-09-12T01:50:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.492+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153810d8d0 con 0x7f1538064fc0 2024-09-12T01:50:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.494+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15380fdcf0 con 0x7f1538064fc0 2024-09-12T01:50:11.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.494+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f152800cbc0 con 0x7f1538064fc0 2024-09-12T01:50:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.495+0000 7f1534ff9640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f15200724c0 0x7f1520074970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.495+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f152808d6d0 con 0x7f1538064fc0 2024-09-12T01:50:11.495 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.495+0000 7f15377fe640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f15200724c0 0x7f1520074970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.496 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.495+0000 7f15377fe640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f15200724c0 0x7f1520074970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1538072d60 tx=0x7f152c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:11.499 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.499+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1528056b80 con 0x7f1538064fc0 2024-09-12T01:50:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:11 smithi153 ceph-mon[80899]: pgmap v89: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:11.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:11.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.723+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f153804b720 con 0x7f15200724c0 2024-09-12T01:50:11.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.725+0000 7f1534ff9640 1 -- 172.21.15.66:0/1821250355 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f153804b720 con 0x7f15200724c0 2024-09-12T01:50:11.727 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f15200724c0 msgr2=0x7f1520074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f15200724c0 0x7f1520074970 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1538072d60 tx=0x7f152c035040 comp rx=0 tx=0).stop 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 msgr2=0x7f15381131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 0x7f15381131d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f152800eb70 tx=0x7f152800b040 comp rx=0 tx=0).stop 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 shutdown_connections 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f15200724c0 0x7f1520074970 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15380fe460 0x7f1538113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 --2- 172.21.15.66:0/1821250355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538064fc0 0x7f15381131d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 >> 172.21.15.66:0/1821250355 conn(0x7f15380723b0 msgr2=0x7f15381053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 shutdown_connections 2024-09-12T01:50:11.728 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.727+0000 7f153e8b3640 1 -- 172.21.15.66:0/1821250355 wait complete. 2024-09-12T01:50:11.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.814+0000 7efc58867640 1 -- 172.21.15.66:0/2454149782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102ef0 msgr2=0x7efc540fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.814+0000 7efc58867640 1 --2- 172.21.15.66:0/2454149782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102ef0 0x7efc540fc5b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc480048d0 tx=0x7efc48009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.814+0000 7efc58867640 1 -- 172.21.15.66:0/2454149782 shutdown_connections 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.814+0000 7efc58867640 1 --2- 172.21.15.66:0/2454149782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102ef0 0x7efc540fc5b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.814+0000 7efc58867640 1 --2- 172.21.15.66:0/2454149782 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc54102550 0x7efc54102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.814+0000 7efc58867640 1 -- 172.21.15.66:0/2454149782 >> 172.21.15.66:0/2454149782 conn(0x7efc540f80d0 msgr2=0x7efc540fa4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.815+0000 7efc58867640 1 -- 172.21.15.66:0/2454149782 shutdown_connections 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.815+0000 7efc58867640 1 -- 172.21.15.66:0/2454149782 wait complete. 2024-09-12T01:50:11.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.815+0000 7efc58867640 1 Processor -- start 2024-09-12T01:50:11.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.815+0000 7efc58867640 1 -- start start 2024-09-12T01:50:11.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc58867640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 0x7efc5406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc58867640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc54102ef0 0x7efc5406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc58867640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc54070490 con 0x7efc54102550 2024-09-12T01:50:11.820 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc58867640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc54070600 con 0x7efc54102ef0 2024-09-12T01:50:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc5259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 0x7efc5406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.823 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc5259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 0x7efc5406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52990/0 (socket says 172.21.15.66:52990) 2024-09-12T01:50:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc5259c640 1 -- 172.21.15.66:0/974406324 learned_addr learned my addr 172.21.15.66:0/974406324 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc51d9b640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc54102ef0 0x7efc5406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc5259c640 1 -- 172.21.15.66:0/974406324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc54102ef0 msgr2=0x7efc5406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc5259c640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc54102ef0 0x7efc5406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.816+0000 7efc5259c640 1 -- 172.21.15.66:0/974406324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48005040 con 0x7efc54102550 2024-09-12T01:50:11.824 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.817+0000 7efc5259c640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 0x7efc5406fa10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c830 tx=0x7efc44004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.817+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc4400a7d0 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.817+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efc4400add0 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.817+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc54070890 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.817+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc440113a0 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.817+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc541198f0 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.819+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc540fdcd0 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.820+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efc44012400 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.820+0000 7efc42ffd640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efc3c06e0b0 0x7efc3c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.820+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efc4408dc70 con 0x7efc54102550 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.821+0000 7efc51d9b640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efc3c06e0b0 0x7efc3c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:11.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.821+0000 7efc51d9b640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efc3c06e0b0 0x7efc3c070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc480048a0 tx=0x7efc48035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:11.826 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:11.825+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efc44057070 con 0x7efc54102550 2024-09-12T01:50:12.012 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.011+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efc54071100 con 0x7efc3c06e0b0 2024-09-12T01:50:12.024 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.022+0000 7efc42ffd640 1 -- 172.21.15.66:0/974406324 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7efc54071100 con 0x7efc3c06e0b0 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (4m) 0s ago 14m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (101s) 0s ago 14m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (96s) 93s ago 14m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (4m) 0s ago 14m 82.6M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (9m) 0s ago 9m 14.7M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (9m) 0s ago 9m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (9m) 93s ago 9m 17.2M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:50:12.025 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (9m) 93s ago 9m 16.2M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (6m) 0s ago 16m 499M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (5m) 93s ago 13m 438M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (2m) 0s ago 16m 48.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (2m) 93s ago 13m 33.9M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (4m) 0s ago 14m 16.9M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (4m) 93s ago 13m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (76s) 0s ago 13m 101M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (41s) 0s ago 12m 98.8M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (6s) 0s ago 12m 12.1M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (11m) 93s ago 11m 277M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 2ee70e2c6706 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (11m) 93s ago 11m 253M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:50:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (10m) 93s ago 10m 233M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:50:12.027 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (4m) 0s ago 14m 62.5M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:50:12.027 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efc3c06e0b0 msgr2=0x7efc3c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efc3c06e0b0 0x7efc3c070560 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efc480048a0 tx=0x7efc48035040 comp rx=0 tx=0).stop 2024-09-12T01:50:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 msgr2=0x7efc5406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 0x7efc5406fa10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc4400c830 tx=0x7efc44004430 comp rx=0 tx=0).stop 2024-09-12T01:50:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 shutdown_connections 2024-09-12T01:50:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efc3c06e0b0 0x7efc3c070560 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc54102ef0 0x7efc5406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 --2- 172.21.15.66:0/974406324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc54102550 0x7efc5406fa10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.025+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 >> 172.21.15.66:0/974406324 conn(0x7efc540f80d0 msgr2=0x7efc540f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.026+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 shutdown_connections 2024-09-12T01:50:12.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.026+0000 7efc58867640 1 -- 172.21.15.66:0/974406324 wait complete. 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 -- 172.21.15.66:0/3221171005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba980fe450 msgr2=0x7fba980fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/3221171005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba980fe450 0x7fba980fe820 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0048d0 tx=0x7fba8c009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 -- 172.21.15.66:0/3221171005 shutdown_connections 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/3221171005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba98064fe0 0x7fba98065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/3221171005 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba980fe450 0x7fba980fe820 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 -- 172.21.15.66:0/3221171005 >> 172.21.15.66:0/3221171005 conn(0x7fba980723b0 msgr2=0x7fba980727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.127+0000 7fba9ebfc640 1 -- 172.21.15.66:0/3221171005 shutdown_connections 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.128+0000 7fba9ebfc640 1 -- 172.21.15.66:0/3221171005 wait complete. 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.129+0000 7fba9ebfc640 1 Processor -- start 2024-09-12T01:50:12.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.129+0000 7fba9ebfc640 1 -- start start 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba9ebfc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba98064fe0 0x7fba981133b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba9ebfc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 0x7fba9810d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba9ebfc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98113e70 con 0x7fba981138f0 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba9ebfc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98113fb0 con 0x7fba98064fe0 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 0x7fba9810d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 0x7fba9810d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:53006/0 (socket says 172.21.15.66:53006) 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba97fff640 1 -- 172.21.15.66:0/1646401513 learned_addr learned my addr 172.21.15.66:0/1646401513 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba9c998640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba98064fe0 0x7fba981133b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba97fff640 1 -- 172.21.15.66:0/1646401513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba98064fe0 msgr2=0x7fba981133b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba97fff640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba98064fe0 0x7fba981133b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.130+0000 7fba97fff640 1 -- 172.21.15.66:0/1646401513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c005040 con 0x7fba981138f0 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.131+0000 7fba97fff640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 0x7fba9810d330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba84002a50 tx=0x7fba84004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.131+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba84007c30 con 0x7fba981138f0 2024-09-12T01:50:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.131+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba8400f040 con 0x7fba981138f0 2024-09-12T01:50:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.131+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8400da10 con 0x7fba981138f0 2024-09-12T01:50:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.131+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9810d8d0 con 0x7fba981138f0 2024-09-12T01:50:12.135 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.131+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba9810de70 con 0x7fba981138f0 2024-09-12T01:50:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.132+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba980fdce0 con 0x7fba981138f0 2024-09-12T01:50:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.133+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fba8400dc80 con 0x7fba981138f0 2024-09-12T01:50:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.134+0000 7fba957fa640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fba8806e0b0 0x7fba88070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.134+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fba8408d3f0 con 0x7fba981138f0 2024-09-12T01:50:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.135+0000 7fba9c998640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fba8806e0b0 0x7fba88070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.136 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.135+0000 7fba9c998640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fba8806e0b0 0x7fba88070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0043d0 tx=0x7fba8c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.139+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fba84056820 con 0x7fba981138f0 2024-09-12T01:50:12.391 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.390+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fba9804b7b0 con 0x7fba981138f0 2024-09-12T01:50:12.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.391+0000 7fba957fa640 1 -- 172.21.15.66:0/1646401513 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fba84059ee0 con 0x7fba981138f0 2024-09-12T01:50:12.392 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:50:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:50:12.392 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:50:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:50:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:50:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:50:12.393 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 3, 2024-09-12T01:50:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:50:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:50:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:50:12.394 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:50:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 7, 2024-09-12T01:50:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 6 2024-09-12T01:50:12.395 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:50:12.395 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:50:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fba8806e0b0 msgr2=0x7fba88070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fba8806e0b0 0x7fba88070560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0043d0 tx=0x7fba8c035040 comp rx=0 tx=0).stop 2024-09-12T01:50:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 msgr2=0x7fba9810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.397 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 0x7fba9810d330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba84002a50 tx=0x7fba84004600 comp rx=0 tx=0).stop 2024-09-12T01:50:12.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 shutdown_connections 2024-09-12T01:50:12.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fba8806e0b0 0x7fba88070560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba981138f0 0x7fba9810d330 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 --2- 172.21.15.66:0/1646401513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba98064fe0 0x7fba981133b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.398 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 >> 172.21.15.66:0/1646401513 conn(0x7fba980723b0 msgr2=0x7fba980fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 shutdown_connections 2024-09-12T01:50:12.399 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.394+0000 7fba9ebfc640 1 -- 172.21.15.66:0/1646401513 wait complete. 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 -- 172.21.15.66:0/3452653228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 msgr2=0x7f68401029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 --2- 172.21.15.66:0/3452653228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401029f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f68300048d0 tx=0x7f6830009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 -- 172.21.15.66:0/3452653228 shutdown_connections 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 --2- 172.21.15.66:0/3452653228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68400fac80 0x7f68400fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 --2- 172.21.15.66:0/3452653228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401029f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 -- 172.21.15.66:0/3452653228 >> 172.21.15.66:0/3452653228 conn(0x7f6840070ce0 msgr2=0x7f68400710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.477 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 -- 172.21.15.66:0/3452653228 shutdown_connections 2024-09-12T01:50:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.476+0000 7f6846037640 1 -- 172.21.15.66:0/3452653228 wait complete. 2024-09-12T01:50:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f6846037640 1 Processor -- start 2024-09-12T01:50:12.478 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f6846037640 1 -- start start 2024-09-12T01:50:12.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f6846037640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68400fac80 0x7f68401131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f6846037640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f6846037640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6840113cf0 con 0x7f6840102620 2024-09-12T01:50:12.479 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f6846037640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684010d130 con 0x7f68400fac80 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f683effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f683effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57866/0 (socket says 172.21.15.66:57866) 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f683effd640 1 -- 172.21.15.66:0/3706167953 learned_addr learned my addr 172.21.15.66:0/3706167953 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.477+0000 7f683f7fe640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68400fac80 0x7f68401131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f683effd640 1 -- 172.21.15.66:0/3706167953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68400fac80 msgr2=0x7f68401131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f683effd640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68400fac80 0x7f68401131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f683effd640 1 -- 172.21.15.66:0/3706167953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830005040 con 0x7f6840102620 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f683effd640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401136f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f683400eb70 tx=0x7f683400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6834007c30 con 0x7f6840102620 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684010d3b0 con 0x7f6840102620 2024-09-12T01:50:12.480 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f683400f040 con 0x7f6840102620 2024-09-12T01:50:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683400ca60 con 0x7f6840102620 2024-09-12T01:50:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.478+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684010d950 con 0x7f6840102620 2024-09-12T01:50:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.479+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6840065790 con 0x7f6840102620 2024-09-12T01:50:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.480+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f683400cbc0 con 0x7f6840102620 2024-09-12T01:50:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.480+0000 7f6827fff640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f682806e0b0 0x7f6828070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.481 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.480+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f683408d750 con 0x7f6840102620 2024-09-12T01:50:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.480+0000 7f683f7fe640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f682806e0b0 0x7f6828070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.482 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.481+0000 7f683f7fe640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f682806e0b0 0x7f6828070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6830009ac0 tx=0x7f6830035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.484 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.485+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6834056b80 con 0x7f6840102620 2024-09-12T01:50:12.706 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.705+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f68401095a0 con 0x7f6840102620 2024-09-12T01:50:12.706 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.706 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.707 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:12 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1646401513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:12.707 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.706+0000 7f6827fff640 1 -- 172.21.15.66:0/3706167953 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7f683405a240 con 0x7f6840102620 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:50:12.708 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:50:12.709 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:50:12.710 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:12.711 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f682806e0b0 msgr2=0x7f6828070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f682806e0b0 0x7f6828070560 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6830009ac0 tx=0x7f6830035040 comp rx=0 tx=0).stop 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 msgr2=0x7f68401136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401136f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f683400eb70 tx=0x7f683400b040 comp rx=0 tx=0).stop 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 shutdown_connections 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f682806e0b0 0x7f6828070560 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6840102620 0x7f68401136f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 --2- 172.21.15.66:0/3706167953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68400fac80 0x7f68401131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 >> 172.21.15.66:0/3706167953 conn(0x7f6840070ce0 msgr2=0x7f6840100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.708+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 shutdown_connections 2024-09-12T01:50:12.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.709+0000 7f6846037640 1 -- 172.21.15.66:0/3706167953 wait complete. 2024-09-12T01:50:12.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.794+0000 7ff9c4481640 1 -- 172.21.15.66:0/3553894941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc06fff0 msgr2=0x7ff9bc070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.794+0000 7ff9c4481640 1 --2- 172.21.15.66:0/3553894941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc06fff0 0x7ff9bc070460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00048d0 tx=0x7ff9b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- 172.21.15.66:0/3553894941 shutdown_connections 2024-09-12T01:50:12.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 --2- 172.21.15.66:0/3553894941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc06fff0 0x7ff9bc070460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 --2- 172.21.15.66:0/3553894941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.798 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- 172.21.15.66:0/3553894941 >> 172.21.15.66:0/3553894941 conn(0x7ff9bc0f81a0 msgr2=0x7ff9bc0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- 172.21.15.66:0/3553894941 shutdown_connections 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- 172.21.15.66:0/3553894941 wait complete. 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 Processor -- start 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- start start 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc06fff0 0x7ff9bc119830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc119d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc11a450 con 0x7ff9bc0716e0 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.795+0000 7ff9c4481640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc1137d0 con 0x7ff9bc06fff0 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc119d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc119d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57890/0 (socket says 172.21.15.66:57890) 2024-09-12T01:50:12.799 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 -- 172.21.15.66:0/1925779640 learned_addr learned my addr 172.21.15.66:0/1925779640 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c221d640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc06fff0 0x7ff9bc119830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 -- 172.21.15.66:0/1925779640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc06fff0 msgr2=0x7ff9bc119830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc06fff0 0x7ff9bc119830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 -- 172.21.15.66:0/1925779640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0005040 con 0x7ff9bc0716e0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c1a1c640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc119d70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0003080 tx=0x7ff9b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b0038070 con 0x7ff9bc0716e0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff9b0032b20 con 0x7ff9bc0716e0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc113a00 con 0x7ff9bc0716e0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b003d990 con 0x7ff9bc0716e0 2024-09-12T01:50:12.800 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.796+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc113ec0 con 0x7ff9bc0716e0 2024-09-12T01:50:12.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.797+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9bc0711f0 con 0x7ff9bc0716e0 2024-09-12T01:50:12.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.798+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff9b0030020 con 0x7ff9bc0716e0 2024-09-12T01:50:12.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.798+0000 7ff9aeffd640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff9a806e0b0 0x7ff9a8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:12.801 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.798+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff9b00ae3c0 con 0x7ff9bc0716e0 2024-09-12T01:50:12.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.799+0000 7ff9c221d640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff9a806e0b0 0x7ff9a8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:12.802 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.799+0000 7ff9c221d640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff9a806e0b0 0x7ff9a8070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009b50 tx=0x7ff9b8009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:12.804 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:12.803+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff9b0077740 con 0x7ff9bc0716e0 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: pgmap v90: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='client.44193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:12 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1646401513' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:13.007 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.005+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9bc10fbd0 con 0x7ff9a806e0b0 2024-09-12T01:50:13.008 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.007+0000 7ff9aeffd640 1 -- 172.21.15.66:0/1925779640 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff9bc10fbd0 con 0x7ff9a806e0b0 2024-09-12T01:50:13.008 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:50:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:50:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:50:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:50:13.008 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "9/21 daemons upgraded", 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading osd daemons", 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:50:13.009 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:50:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff9a806e0b0 msgr2=0x7ff9a8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff9a806e0b0 0x7ff9a8070560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009b50 tx=0x7ff9b8009120 comp rx=0 tx=0).stop 2024-09-12T01:50:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 msgr2=0x7ff9bc119d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc119d70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff9b0003080 tx=0x7ff9b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.010 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 shutdown_connections 2024-09-12T01:50:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff9a806e0b0 0x7ff9a8070560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff9bc0716e0 0x7ff9bc119d70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 --2- 172.21.15.66:0/1925779640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9bc06fff0 0x7ff9bc119830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 >> 172.21.15.66:0/1925779640 conn(0x7ff9bc0f81a0 msgr2=0x7ff9bc0f9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 shutdown_connections 2024-09-12T01:50:13.011 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.009+0000 7ff9c4481640 1 -- 172.21.15.66:0/1925779640 wait complete. 2024-09-12T01:50:13.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 -- 172.21.15.66:0/2627015588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 msgr2=0x7fc0ec0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 --2- 172.21.15.66:0/2627015588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec0fb0f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80048d0 tx=0x7fc0e8009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 -- 172.21.15.66:0/2627015588 shutdown_connections 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 --2- 172.21.15.66:0/2627015588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec0fb0f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 --2- 172.21.15.66:0/2627015588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0ec102620 0x7fc0ec1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 -- 172.21.15.66:0/2627015588 >> 172.21.15.66:0/2627015588 conn(0x7fc0ec070ce0 msgr2=0x7fc0ec0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 -- 172.21.15.66:0/2627015588 shutdown_connections 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 -- 172.21.15.66:0/2627015588 wait complete. 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.092+0000 7fc0f4329640 1 Processor -- start 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f4329640 1 -- start start 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f4329640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f4329640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0ec102620 0x7fc0ec113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f4329640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec113d20 con 0x7fc0ec0fac80 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f4329640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ec10d160 con 0x7fc0ec102620 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:57902/0 (socket says 172.21.15.66:57902) 2024-09-12T01:50:13.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 -- 172.21.15.66:0/3254079184 learned_addr learned my addr 172.21.15.66:0/3254079184 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:13.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 -- 172.21.15.66:0/3254079184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0ec102620 msgr2=0x7fc0ec113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0ec102620 0x7fc0ec113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 -- 172.21.15.66:0/3254079184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8005040 con 0x7fc0ec0fac80 2024-09-12T01:50:13.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0f20c5640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec1131e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0002a50 tx=0x7fc0e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:13.096 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.093+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e0007c30 con 0x7fc0ec0fac80 2024-09-12T01:50:13.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.094+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc0e000f040 con 0x7fc0ec0fac80 2024-09-12T01:50:13.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.094+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec10d440 con 0x7fc0ec0fac80 2024-09-12T01:50:13.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.094+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0e000da90 con 0x7fc0ec0fac80 2024-09-12T01:50:13.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.094+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ec10d9e0 con 0x7fc0ec0fac80 2024-09-12T01:50:13.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.095+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ec0657b0 con 0x7fc0ec0fac80 2024-09-12T01:50:13.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.095+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc0e000dd00 con 0x7fc0ec0fac80 2024-09-12T01:50:13.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.096+0000 7fc0deffd640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc0d806e0b0 0x7fc0d8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:13.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.096+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc0e008d440 con 0x7fc0ec0fac80 2024-09-12T01:50:13.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.096+0000 7fc0f18c4640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc0d806e0b0 0x7fc0d8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:13.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.097+0000 7fc0f18c4640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc0d806e0b0 0x7fc0d8070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802a530 tx=0x7fc0e8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:13.104 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.102+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc0e00567c0 con 0x7fc0ec0fac80 2024-09-12T01:50:13.354 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.353+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc0ec1095f0 con 0x7fc0ec0fac80 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.353+0000 7fc0deffd640 1 -- 172.21.15.66:0/3254079184 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+884 (secure 0 0 0) 0x7fc0e0059e80 con 0x7fc0ec0fac80 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout: osd.2 (root=default,host=smithi066) is down 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 29/219 objects degraded (13.242%), 11 pgs degraded 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-12T01:50:13.355 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-12T01:50:13.356 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-12T01:50:13.356 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-12T01:50:13.356 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-12T01:50:13.356 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-12T01:50:13.356 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-12T01:50:13.356 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.355+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc0d806e0b0 msgr2=0x7fc0d8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.355+0000 7fc0f4329640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc0d806e0b0 0x7fc0d8070560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0e802a530 tx=0x7fc0e8009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.355+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 msgr2=0x7fc0ec1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.355+0000 7fc0f4329640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec1131e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0002a50 tx=0x7fc0e0004600 comp rx=0 tx=0).stop 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 shutdown_connections 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc0d806e0b0 0x7fc0d8070560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0ec102620 0x7fc0ec113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 --2- 172.21.15.66:0/3254079184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0ec0fac80 0x7fc0ec1131e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 >> 172.21.15.66:0/3254079184 conn(0x7fc0ec070ce0 msgr2=0x7fc0ec105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 shutdown_connections 2024-09-12T01:50:13.357 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:13.356+0000 7fc0f4329640 1 -- 172.21.15.66:0/3254079184 wait complete. 2024-09-12T01:50:13.615 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:13 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3706167953' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:50:13.615 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:13 smithi066 ceph-mon[110996]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:13.615 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:13 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3254079184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:50:13.889 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:13 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[133800]: 2024-09-12T01:50:13.762+0000 7f6241e70640 -1 osd.2 57 log_to_monitors true 2024-09-12T01:50:13.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:13 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3706167953' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:50:13.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:13 smithi153 ceph-mon[80899]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:13.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:13 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3254079184' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:50:14.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:14 smithi066 ceph-mon[110996]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:14.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:14 smithi066 ceph-mon[110996]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:14 smithi153 ceph-mon[80899]: pgmap v91: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:14.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:14 smithi153 ceph-mon[80899]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-12T01:50:15.824 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[133800]: 2024-09-12T01:50:15.421+0000 7f6235c02640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:50:15.824 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:50:15.824 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: osdmap e60: 6 total, 5 up, 6 in 2024-09-12T01:50:15.824 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:50:15.824 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-12T01:50:15.825 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:15 smithi066 ceph-mon[110996]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: osdmap e60: 6 total, 5 up, 6 in 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi066", "root=default"]}]: dispatch 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:15.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-12T01:50:15.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:15 smithi153 ceph-mon[80899]: from='osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458]' entity='osd.2' 2024-09-12T01:50:16.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:16 smithi066 ceph-mon[110996]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:16.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:16 smithi066 ceph-mon[110996]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:50:16.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:16 smithi066 ceph-mon[110996]: osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458] boot 2024-09-12T01:50:16.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:16 smithi066 ceph-mon[110996]: osdmap e61: 6 total, 6 up, 6 in 2024-09-12T01:50:16.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:16.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:16 smithi153 ceph-mon[80899]: pgmap v93: 65 pgs: 16 active+undersized, 11 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 29/219 objects degraded (13.242%) 2024-09-12T01:50:16.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:16 smithi153 ceph-mon[80899]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:50:16.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:16 smithi153 ceph-mon[80899]: osd.2 [v2:172.21.15.66:6818/3519918458,v1:172.21.15.66:6819/3519918458] boot 2024-09-12T01:50:16.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:16 smithi153 ceph-mon[80899]: osdmap e61: 6 total, 6 up, 6 in 2024-09-12T01:50:16.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-12T01:50:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:18 smithi066 ceph-mon[110996]: osdmap e62: 6 total, 6 up, 6 in 2024-09-12T01:50:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:18 smithi066 ceph-mon[110996]: pgmap v96: 65 pgs: 10 peering, 10 active+undersized, 7 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-09-12T01:50:18.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:18 smithi153 ceph-mon[80899]: osdmap e62: 6 total, 6 up, 6 in 2024-09-12T01:50:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:18 smithi153 ceph-mon[80899]: pgmap v96: 65 pgs: 10 peering, 10 active+undersized, 7 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-09-12T01:50:19.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:19 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:19 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:20.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:20 smithi066 ceph-mon[110996]: pgmap v97: 65 pgs: 10 peering, 10 active+undersized, 7 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-09-12T01:50:20.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:20 smithi153 ceph-mon[80899]: pgmap v97: 65 pgs: 10 peering, 10 active+undersized, 7 active+undersized+degraded, 38 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 22/219 objects degraded (10.046%) 2024-09-12T01:50:21.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:21 smithi153 ceph-mon[80899]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded) 2024-09-12T01:50:21.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:21 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:50:21.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:21 smithi066 ceph-mon[110996]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/219 objects degraded (10.046%), 7 pgs degraded) 2024-09-12T01:50:21.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:21 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:50:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:22 smithi066 ceph-mon[110996]: pgmap v98: 65 pgs: 10 peering, 55 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:22.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:22 smithi153 ceph-mon[80899]: pgmap v98: 65 pgs: 10 peering, 55 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:24 smithi066 ceph-mon[110996]: pgmap v99: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:24.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:24 smithi153 ceph-mon[80899]: pgmap v99: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:26.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:26 smithi066 ceph-mon[110996]: pgmap v100: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:26.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:26.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:26.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:26 smithi153 ceph-mon[80899]: pgmap v100: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:26.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:26.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:28.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:28 smithi066 ceph-mon[110996]: pgmap v101: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:28.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:28 smithi153 ceph-mon[80899]: pgmap v101: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:30.812 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:30 smithi153 ceph-mon[80899]: pgmap v102: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:30.812 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:30 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:30.812 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:30 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:30.812 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:30 smithi153 ceph-mon[80899]: Upgrade: osd.3 is safe to restart 2024-09-12T01:50:30.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:30 smithi066 ceph-mon[110996]: pgmap v102: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:30.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:30 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:30.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:30 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-12T01:50:30.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:30 smithi066 ceph-mon[110996]: Upgrade: osd.3 is safe to restart 2024-09-12T01:50:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: pgmap v103: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: Upgrade: Updating osd.3 2024-09-12T01:50:32.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:32.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:50:32.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:32.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:32 smithi066 ceph-mon[110996]: Deploying daemon osd.3 on smithi153 2024-09-12T01:50:32.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: pgmap v103: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: Upgrade: Updating osd.3 2024-09-12T01:50:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-12T01:50:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:32.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:32 smithi153 ceph-mon[80899]: Deploying daemon osd.3 on smithi153 2024-09-12T01:50:34.615 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:34 smithi153 ceph-mon[80899]: pgmap v104: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:34.616 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:34 smithi153 systemd[1]: Stopping Ceph osd.3 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:50:34.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:34 smithi066 ceph-mon[110996]: pgmap v104: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:34.904 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:34 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[40055]: 2024-09-12T01:50:34.618+0000 7fb322223640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:50:34.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:34 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[40055]: 2024-09-12T01:50:34.618+0000 7fb322223640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-12T01:50:34.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:34 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[40055]: 2024-09-12T01:50:34.618+0000 7fb322223640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:50:35.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:35 smithi066 ceph-mon[110996]: osd.3 marked itself down and dead 2024-09-12T01:50:35.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:35 smithi153 ceph-mon[80899]: osd.3 marked itself down and dead 2024-09-12T01:50:36.326 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:36 smithi153 podman[89721]: 2024-09-12 01:50:36.032485634 +0000 UTC m=+1.516475356 container died 2ee70e2c670692879ac985f66885a1ac4c14779e9347de5c1e8527075d0d1f01 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-554ba93, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True) 2024-09-12T01:50:36.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:36 smithi153 podman[89721]: 2024-09-12 01:50:36.443410964 +0000 UTC m=+1.927400682 container cleanup 2ee70e2c670692879ac985f66885a1ac4c14779e9347de5c1e8527075d0d1f01 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=quincy-554ba93) 2024-09-12T01:50:36.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:36 smithi153 bash[89721]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3 2024-09-12T01:50:36.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:36 smithi153 ceph-mon[80899]: pgmap v105: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:36.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:36 smithi153 ceph-mon[80899]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:50:36.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:36 smithi153 ceph-mon[80899]: osdmap e63: 6 total, 5 up, 6 in 2024-09-12T01:50:36.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:36 smithi066 ceph-mon[110996]: pgmap v105: 65 pgs: 65 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:36.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:36 smithi066 ceph-mon[110996]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:50:36.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:36 smithi066 ceph-mon[110996]: osdmap e63: 6 total, 5 up, 6 in 2024-09-12T01:50:37.005 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:36 smithi153 podman[89747]: 2024-09-12 01:50:36.694979703 +0000 UTC m=+0.665180978 container remove 2ee70e2c670692879ac985f66885a1ac4c14779e9347de5c1e8527075d0d1f01 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, RELEASE=quincy-554ba93, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-12T01:50:37.323 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89832]: 2024-09-12 01:50:36.908413212 +0000 UTC m=+0.015724862 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:37.323 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89832]: 2024-09-12 01:50:37.029169153 +0000 UTC m=+0.136480789 container create c0c11197740fc1406ed2c7c8e4d844c20c015876db78488e896fe70434e5e042 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T01:50:37.323 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89832]: 2024-09-12 01:50:37.240094468 +0000 UTC m=+0.347406104 container init c0c11197740fc1406ed2c7c8e4d844c20c015876db78488e896fe70434e5e042 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=) 2024-09-12T01:50:37.323 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89832]: 2024-09-12 01:50:37.243410678 +0000 UTC m=+0.350722322 container start c0c11197740fc1406ed2c7c8e4d844c20c015876db78488e896fe70434e5e042 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-12T01:50:37.323 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89832]: 2024-09-12 01:50:37.323441114 +0000 UTC m=+0.430752766 container attach c0c11197740fc1406ed2c7c8e4d844c20c015876db78488e896fe70434e5e042 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-09-12T01:50:37.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:37 smithi153 ceph-mon[80899]: osdmap e64: 6 total, 5 up, 6 in 2024-09-12T01:50:37.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89832]: 2024-09-12 01:50:37.426506683 +0000 UTC m=+0.533818331 container died c0c11197740fc1406ed2c7c8e4d844c20c015876db78488e896fe70434e5e042 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-12T01:50:37.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:37 smithi066 ceph-mon[110996]: osdmap e64: 6 total, 5 up, 6 in 2024-09-12T01:50:38.397 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 podman[89855]: 2024-09-12 01:50:37.968583599 +0000 UTC m=+0.535909222 container remove c0c11197740fc1406ed2c7c8e4d844c20c015876db78488e896fe70434e5e042 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-12T01:50:38.397 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-12T01:50:38.397 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 systemd[1]: Stopped Ceph osd.3 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:50:38.398 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:37 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.3.service: Consumed 1min 10.377s CPU time. 2024-09-12T01:50:38.398 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 systemd[1]: Starting Ceph osd.3 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:50:38.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:38 smithi153 ceph-mon[80899]: pgmap v108: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-09-12T01:50:38.651 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:38 smithi153 ceph-mon[80899]: Health check failed: Degraded data redundancy: 23/219 objects degraded (10.502%), 7 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:38.651 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 podman[89955]: 2024-09-12 01:50:38.300452913 +0000 UTC m=+0.015942612 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:38.651 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 podman[89955]: 2024-09-12 01:50:38.430893422 +0000 UTC m=+0.146383155 container create 5c7ca20dff6a66bdc75cb0c8e20d04ce618e852eb95e623eae6c3b5d490defc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-12T01:50:38.652 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 podman[89955]: 2024-09-12 01:50:38.651360771 +0000 UTC m=+0.366850459 container init 5c7ca20dff6a66bdc75cb0c8e20d04ce618e852eb95e623eae6c3b5d490defc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-12T01:50:38.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:38 smithi066 ceph-mon[110996]: pgmap v108: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-09-12T01:50:38.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:38 smithi066 ceph-mon[110996]: Health check failed: Degraded data redundancy: 23/219 objects degraded (10.502%), 7 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:38.904 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 podman[89955]: 2024-09-12 01:50:38.655187247 +0000 UTC m=+0.370676937 container start 5c7ca20dff6a66bdc75cb0c8e20d04ce618e852eb95e623eae6c3b5d490defc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:50:38.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 podman[89955]: 2024-09-12 01:50:38.726432051 +0000 UTC m=+0.441921753 container attach 5c7ca20dff6a66bdc75cb0c8e20d04ce618e852eb95e623eae6c3b5d490defc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T01:50:38.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:38.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 bash[89955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:38.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:38.905 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:38 smithi153 bash[89955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:50:39.801 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T01:50:39.801 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T01:50:39.801 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-12T01:50:39.801 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-12T01:50:40.055 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-12T01:50:40.055 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-12T01:50:40.055 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-12T01:50:40.055 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-12T01:50:40.055 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-12T01:50:40.056 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-12T01:50:40.056 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T01:50:40.056 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T01:50:40.056 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate[89970]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-12T01:50:40.056 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 bash[89955]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-12T01:50:40.056 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:39 smithi153 podman[90110]: 2024-09-12 01:50:39.855681562 +0000 UTC m=+0.016917356 container died 5c7ca20dff6a66bdc75cb0c8e20d04ce618e852eb95e623eae6c3b5d490defc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:50:40.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:40 smithi153 ceph-mon[80899]: pgmap v109: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-09-12T01:50:40.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 podman[90110]: 2024-09-12 01:50:40.340719643 +0000 UTC m=+0.501955440 container remove 5c7ca20dff6a66bdc75cb0c8e20d04ce618e852eb95e623eae6c3b5d490defc7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-activate, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T01:50:40.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 podman[90169]: 2024-09-12 01:50:40.451698428 +0000 UTC m=+0.016040700 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:50:40.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 podman[90169]: 2024-09-12 01:50:40.586133385 +0000 UTC m=+0.150475647 container create c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-12T01:50:40.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:40 smithi066 ceph-mon[110996]: pgmap v109: 65 pgs: 11 active+undersized, 6 stale+active+clean, 7 active+undersized+degraded, 41 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 23/219 objects degraded (10.502%) 2024-09-12T01:50:41.020 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 podman[90169]: 2024-09-12 01:50:40.830854152 +0000 UTC m=+0.395196414 container init c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:50:41.020 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 podman[90169]: 2024-09-12 01:50:40.834043336 +0000 UTC m=+0.398385596 container start c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-12T01:50:41.020 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 ceph-osd[90188]: -- 172.21.15.153:0/742933726 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562a404c41e0 con 0x562a3f671c00 2024-09-12T01:50:41.020 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 bash[90169]: c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 2024-09-12T01:50:41.020 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:40 smithi153 systemd[1]: Started Ceph osd.3 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:50:42.269 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:42.269 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:42.269 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:42.270 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:42.270 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:42.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:42.654 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:42 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:50:42.481+0000 7f1f6cea7640 -1 Falling back to public interface 2024-09-12T01:50:43.249 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:42 smithi153 ceph-mon[80899]: pgmap v110: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:43.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:42 smithi066 ceph-mon[110996]: pgmap v110: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.452+0000 7f18f4adc640 1 -- 172.21.15.66:0/3192036472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 msgr2=0x7f18f00fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.452+0000 7f18f4adc640 1 --2- 172.21.15.66:0/3192036472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f00fb0d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f18e00049c0 tx=0x7f18e000aeb0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.452+0000 7f18f4adc640 1 -- 172.21.15.66:0/3192036472 shutdown_connections 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.452+0000 7f18f4adc640 1 --2- 172.21.15.66:0/3192036472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f00fb0d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.452+0000 7f18f4adc640 1 --2- 172.21.15.66:0/3192036472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0100c70 0x7f18f0101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.452+0000 7f18f4adc640 1 -- 172.21.15.66:0/3192036472 >> 172.21.15.66:0/3192036472 conn(0x7f18f0070ce0 msgr2=0x7f18f00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.453+0000 7f18f4adc640 1 -- 172.21.15.66:0/3192036472 shutdown_connections 2024-09-12T01:50:43.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.453+0000 7f18f4adc640 1 -- 172.21.15.66:0/3192036472 wait complete. 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.453+0000 7f18f4adc640 1 Processor -- start 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.453+0000 7f18f4adc640 1 -- start start 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18f4adc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f0111060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18f4adc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0100c70 0x7f18f01115a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18f4adc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0111ba0 con 0x7f18f00fac80 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18f4adc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f010afe0 con 0x7f18f0100c70 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f0111060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f0111060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36430/0 (socket says 172.21.15.66:36430) 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 -- 172.21.15.66:0/1180637818 learned_addr learned my addr 172.21.15.66:0/1180637818 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18edd9b640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0100c70 0x7f18f01115a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 -- 172.21.15.66:0/1180637818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0100c70 msgr2=0x7f18f01115a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0100c70 0x7f18f01115a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 -- 172.21.15.66:0/1180637818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0005040 con 0x7f18f00fac80 2024-09-12T01:50:43.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.454+0000 7f18ee59c640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f0111060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f18d800eb70 tx=0x7f18d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:43.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.455+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d8007c30 con 0x7f18f00fac80 2024-09-12T01:50:43.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.455+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f18d800f040 con 0x7f18f00fac80 2024-09-12T01:50:43.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.455+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f010b260 con 0x7f18f00fac80 2024-09-12T01:50:43.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.455+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18d800ca60 con 0x7f18f00fac80 2024-09-12T01:50:43.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.455+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f010b800 con 0x7f18f00fac80 2024-09-12T01:50:43.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.456+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f00fc370 con 0x7f18f00fac80 2024-09-12T01:50:43.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.456+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f18d800cbc0 con 0x7f18f00fac80 2024-09-12T01:50:43.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.457+0000 7f18e6ffd640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f18dc06e0b0 0x7f18dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:43.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.457+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f18d808d770 con 0x7f18f00fac80 2024-09-12T01:50:43.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.457+0000 7f18edd9b640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f18dc06e0b0 0x7f18dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:43.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.458+0000 7f18edd9b640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f18dc06e0b0 0x7f18dc070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18f010c920 tx=0x7f18e0036040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:43.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.462+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f18d8056b70 con 0x7f18f00fac80 2024-09-12T01:50:43.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.657+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f004b720 con 0x7f18dc06e0b0 2024-09-12T01:50:43.658 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.658+0000 7f18e6ffd640 1 -- 172.21.15.66:0/1180637818 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f18f004b720 con 0x7f18dc06e0b0 2024-09-12T01:50:43.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f18dc06e0b0 msgr2=0x7f18dc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f18dc06e0b0 0x7f18dc070560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f18f010c920 tx=0x7f18e0036040 comp rx=0 tx=0).stop 2024-09-12T01:50:43.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 msgr2=0x7f18f0111060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f0111060 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f18d800eb70 tx=0x7f18d800b040 comp rx=0 tx=0).stop 2024-09-12T01:50:43.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 shutdown_connections 2024-09-12T01:50:43.661 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f18dc06e0b0 0x7f18dc070560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18f0100c70 0x7f18f01115a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 --2- 172.21.15.66:0/1180637818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18f00fac80 0x7f18f0111060 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 >> 172.21.15.66:0/1180637818 conn(0x7f18f0070ce0 msgr2=0x7f18f00fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:43.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 shutdown_connections 2024-09-12T01:50:43.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.661+0000 7f18f4adc640 1 -- 172.21.15.66:0/1180637818 wait complete. 2024-09-12T01:50:43.670 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 -- 172.21.15.66:0/2245689756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 msgr2=0x7f249c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/2245689756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c0fc5e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f24880048d0 tx=0x7f2488009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 -- 172.21.15.66:0/2245689756 shutdown_connections 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/2245689756 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c0fc5e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/2245689756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c102580 0x7f249c102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 -- 172.21.15.66:0/2245689756 >> 172.21.15.66:0/2245689756 conn(0x7f249c0f81a0 msgr2=0x7f249c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.743+0000 7f24a2fb5640 1 -- 172.21.15.66:0/2245689756 shutdown_connections 2024-09-12T01:50:43.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.744+0000 7f24a2fb5640 1 -- 172.21.15.66:0/2245689756 wait complete. 2024-09-12T01:50:43.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.744+0000 7f24a2fb5640 1 Processor -- start 2024-09-12T01:50:43.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.744+0000 7f24a2fb5640 1 -- start start 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f24a2fb5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c102580 0x7f249c113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f24a2fb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f24a2fb5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c113d40 con 0x7f249c102f20 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f24a2fb5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c10d180 con 0x7f249c102580 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f249bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f249bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36450/0 (socket says 172.21.15.66:36450) 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f249bfff640 1 -- 172.21.15.66:0/785226516 learned_addr learned my addr 172.21.15.66:0/785226516 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f24a0d51640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c102580 0x7f249c113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f249bfff640 1 -- 172.21.15.66:0/785226516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c102580 msgr2=0x7f249c113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f249bfff640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c102580 0x7f249c113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.745+0000 7f249bfff640 1 -- 172.21.15.66:0/785226516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488005040 con 0x7f249c102f20 2024-09-12T01:50:43.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.746+0000 7f249bfff640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c113740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24880043d0 tx=0x7f2488009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:43.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.746+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2488038070 con 0x7f249c102f20 2024-09-12T01:50:43.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.746+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f24880096e0 con 0x7f249c102f20 2024-09-12T01:50:43.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.746+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c10d400 con 0x7f249c102f20 2024-09-12T01:50:43.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.746+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248802c8a0 con 0x7f249c102f20 2024-09-12T01:50:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.746+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c10d940 con 0x7f249c102f20 2024-09-12T01:50:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.747+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c0fdd00 con 0x7f249c102f20 2024-09-12T01:50:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.748+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f2488030020 con 0x7f249c102f20 2024-09-12T01:50:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.748+0000 7f24997fa640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248c06e0b0 0x7f248c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:43.748 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.748+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f24880ad850 con 0x7f249c102f20 2024-09-12T01:50:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.748+0000 7f24a0d51640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248c06e0b0 0x7f248c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:43.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.749+0000 7f24a0d51640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248c06e0b0 0x7f248c070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2490004eb0 tx=0x7f249000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:43.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.753+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2488076c80 con 0x7f249c102f20 2024-09-12T01:50:43.944 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.944+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f249c109590 con 0x7f248c06e0b0 2024-09-12T01:50:43.945 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.945+0000 7f24997fa640 1 -- 172.21.15.66:0/785226516 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f249c109590 con 0x7f248c06e0b0 2024-09-12T01:50:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248c06e0b0 msgr2=0x7f248c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248c06e0b0 0x7f248c070560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2490004eb0 tx=0x7f249000b040 comp rx=0 tx=0).stop 2024-09-12T01:50:43.947 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 msgr2=0x7f249c113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c113740 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f24880043d0 tx=0x7f2488009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 shutdown_connections 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248c06e0b0 0x7f248c070560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f249c102f20 0x7f249c113740 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 --2- 172.21.15.66:0/785226516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f249c102580 0x7f249c113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 >> 172.21.15.66:0/785226516 conn(0x7f249c0f81a0 msgr2=0x7f249c0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 shutdown_connections 2024-09-12T01:50:43.948 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:43.947+0000 7f24a2fb5640 1 -- 172.21.15.66:0/785226516 wait complete. 2024-09-12T01:50:44.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 -- 172.21.15.66:0/3562394457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 msgr2=0x7f9a800fe870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 --2- 172.21.15.66:0/3562394457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fe870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9a700048d0 tx=0x7f9a70009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 -- 172.21.15.66:0/3562394457 shutdown_connections 2024-09-12T01:50:44.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 --2- 172.21.15.66:0/3562394457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a800fabe0 0x7f9a800fb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 --2- 172.21.15.66:0/3562394457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fe870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.031 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 -- 172.21.15.66:0/3562394457 >> 172.21.15.66:0/3562394457 conn(0x7f9a80071b00 msgr2=0x7f9a80071f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 -- 172.21.15.66:0/3562394457 shutdown_connections 2024-09-12T01:50:44.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.030+0000 7f9a86f02640 1 -- 172.21.15.66:0/3562394457 wait complete. 2024-09-12T01:50:44.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.031+0000 7f9a86f02640 1 Processor -- start 2024-09-12T01:50:44.032 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.031+0000 7f9a86f02640 1 -- start start 2024-09-12T01:50:44.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.031+0000 7f9a86f02640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a800fabe0 0x7f9a800fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.031+0000 7f9a86f02640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.031+0000 7f9a86f02640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800fc840 con 0x7f9a800fe4a0 2024-09-12T01:50:44.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.031+0000 7f9a86f02640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800fc9b0 con 0x7f9a800fabe0 2024-09-12T01:50:44.033 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a84c9e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a800fabe0 0x7f9a800fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36464/0 (socket says 172.21.15.66:36464) 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 -- 172.21.15.66:0/2433540516 learned_addr learned my addr 172.21.15.66:0/2433540516 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 -- 172.21.15.66:0/2433540516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a800fabe0 msgr2=0x7f9a800fbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a800fabe0 0x7f9a800fbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 -- 172.21.15.66:0/2433540516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70005040 con 0x7f9a800fe4a0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7ffff640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fc300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a74002a80 tx=0x7f9a74004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a74007c30 con 0x7f9a800fe4a0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9a7400f040 con 0x7f9a800fe4a0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a800fcc40 con 0x7f9a800fe4a0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a7400dab0 con 0x7f9a800fe4a0 2024-09-12T01:50:44.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.032+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a80119860 con 0x7f9a800fe4a0 2024-09-12T01:50:44.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.034+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a80064d50 con 0x7f9a800fe4a0 2024-09-12T01:50:44.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.034+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9a7400dc10 con 0x7f9a800fe4a0 2024-09-12T01:50:44.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.035+0000 7f9a7d7fa640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9a6806e0b0 0x7f9a68070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.035+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9a7408d300 con 0x7f9a800fe4a0 2024-09-12T01:50:44.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.035+0000 7f9a84c9e640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9a6806e0b0 0x7f9a68070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.035+0000 7f9a84c9e640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9a6806e0b0 0x7f9a68070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009ac0 tx=0x7f9a70035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.041 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.041+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9a740567b0 con 0x7f9a800fe4a0 2024-09-12T01:50:44.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.225+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a8004b720 con 0x7f9a6806e0b0 2024-09-12T01:50:44.234 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.234+0000 7f9a7d7fa640 1 -- 172.21.15.66:0/2433540516 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f9a8004b720 con 0x7f9a6806e0b0 2024-09-12T01:50:44.234 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:50:44.234 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (4m) 33s ago 15m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:50:44.234 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (2m) 33s ago 15m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:50:44.234 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (2m) 0s ago 14m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (4m) 33s ago 15m 82.6M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (9m) 33s ago 9m 14.7M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (9m) 33s ago 9m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (9m) 0s ago 9m 17.7M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (9m) 0s ago 9m 16.7M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (6m) 33s ago 16m 499M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (5m) 0s ago 14m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (3m) 33s ago 16m 48.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (2m) 0s ago 14m 36.4M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (5m) 33s ago 15m 16.9M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (5m) 0s ago 14m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (108s) 33s ago 13m 101M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (73s) 33s ago 13m 98.8M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:50:44.235 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (38s) 33s ago 12m 12.1M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:50:44.236 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (3s) 0s ago 12m 11.6M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:50:44.236 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (11m) 0s ago 11m 254M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 8b4e141fd205 2024-09-12T01:50:44.236 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (11m) 0s ago 11m 233M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:50:44.236 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (5m) 33s ago 14m 62.5M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:50:44.236 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9a6806e0b0 msgr2=0x7f9a68070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9a6806e0b0 0x7f9a68070560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009ac0 tx=0x7f9a70035040 comp rx=0 tx=0).stop 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 msgr2=0x7f9a800fc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fc300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a74002a80 tx=0x7f9a74004600 comp rx=0 tx=0).stop 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 shutdown_connections 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9a6806e0b0 0x7f9a68070560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a800fe4a0 0x7f9a800fc300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 --2- 172.21.15.66:0/2433540516 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a800fabe0 0x7f9a800fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 >> 172.21.15.66:0/2433540516 conn(0x7f9a80071b00 msgr2=0x7f9a800f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 shutdown_connections 2024-09-12T01:50:44.237 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.236+0000 7f9a86f02640 1 -- 172.21.15.66:0/2433540516 wait complete. 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 -- 172.21.15.66:0/645363900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 msgr2=0x7fc82c102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 --2- 172.21.15.66:0/645363900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c102930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009c50 tx=0x7fc81c004d10 comp rx=0 tx=0).stop 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 -- 172.21.15.66:0/645363900 shutdown_connections 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 --2- 172.21.15.66:0/645363900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc82c102f00 0x7fc82c0fc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 --2- 172.21.15.66:0/645363900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c102930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 -- 172.21.15.66:0/645363900 >> 172.21.15.66:0/645363900 conn(0x7fc82c0f8120 msgr2=0x7fc82c0fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 -- 172.21.15.66:0/645363900 shutdown_connections 2024-09-12T01:50:44.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.318+0000 7fc832f03640 1 -- 172.21.15.66:0/645363900 wait complete. 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.319+0000 7fc832f03640 1 Processor -- start 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.319+0000 7fc832f03640 1 -- start start 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.319+0000 7fc832f03640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.319+0000 7fc832f03640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc82c102f00 0x7fc82c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.319+0000 7fc832f03640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c070490 con 0x7fc82c102560 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.319+0000 7fc832f03640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c070600 con 0x7fc82c102f00 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.321 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36492/0 (socket says 172.21.15.66:36492) 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 -- 172.21.15.66:0/126510992 learned_addr learned my addr 172.21.15.66:0/126510992 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc82bfff640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc82c102f00 0x7fc82c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 -- 172.21.15.66:0/126510992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc82c102f00 msgr2=0x7fc82c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc82c102f00 0x7fc82c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 -- 172.21.15.66:0/126510992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0098b0 con 0x7fc82c102560 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.320+0000 7fc830c9f640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c06fa10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc81c004750 tx=0x7fc81c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.321+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc81c009590 con 0x7fc82c102560 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.321+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c070830 con 0x7fc82c102560 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.321+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc81c0096f0 con 0x7fc82c102560 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.321+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c1198f0 con 0x7fc82c102560 2024-09-12T01:50:44.322 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.321+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc81c03d960 con 0x7fc82c102560 2024-09-12T01:50:44.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.322+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c0fdce0 con 0x7fc82c102560 2024-09-12T01:50:44.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.323+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc81c02f030 con 0x7fc82c102560 2024-09-12T01:50:44.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.324+0000 7fc8297fa640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc81806e0b0 0x7fc818070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.324+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fc81c0aee40 con 0x7fc82c102560 2024-09-12T01:50:44.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.324+0000 7fc82bfff640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc81806e0b0 0x7fc818070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.324 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.324+0000 7fc82bfff640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc81806e0b0 0x7fc818070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc82c071350 tx=0x7fc81400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.328 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.328+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc81c078240 con 0x7fc82c102560 2024-09-12T01:50:44.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.581+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc82c0fbd60 con 0x7fc82c102560 2024-09-12T01:50:44.582 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.582+0000 7fc8297fa640 1 -- 172.21.15.66:0/126510992 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fc81c07b900 con 0x7fc82c102560 2024-09-12T01:50:44.582 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:50:44.582 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2, 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 3 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:50:44.583 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 6, 2024-09-12T01:50:44.584 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 7 2024-09-12T01:50:44.584 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:50:44.584 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:50:44.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc81806e0b0 msgr2=0x7fc818070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc81806e0b0 0x7fc818070560 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc82c071350 tx=0x7fc81400b040 comp rx=0 tx=0).stop 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 msgr2=0x7fc82c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c06fa10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc81c004750 tx=0x7fc81c004d10 comp rx=0 tx=0).stop 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 shutdown_connections 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc81806e0b0 0x7fc818070560 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc82c102f00 0x7fc82c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 --2- 172.21.15.66:0/126510992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c102560 0x7fc82c06fa10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 >> 172.21.15.66:0/126510992 conn(0x7fc82c0f8120 msgr2=0x7fc82c0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 shutdown_connections 2024-09-12T01:50:44.585 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.584+0000 7fc832f03640 1 -- 172.21.15.66:0/126510992 wait complete. 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 -- 172.21.15.66:0/2142150542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c101510 msgr2=0x7f8b3c1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/2142150542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c101510 0x7f8b3c1018e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c0048d0 tx=0x7f8b2c009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 -- 172.21.15.66:0/2142150542 shutdown_connections 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/2142150542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/2142150542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c101510 0x7f8b3c1018e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 -- 172.21.15.66:0/2142150542 >> 172.21.15.66:0/2142150542 conn(0x7f8b3c0f7090 msgr2=0x7f8b3c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 -- 172.21.15.66:0/2142150542 shutdown_connections 2024-09-12T01:50:44.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.665+0000 7f8b41bc7640 1 -- 172.21.15.66:0/2142150542 wait complete. 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b41bc7640 1 Processor -- start 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b41bc7640 1 -- start start 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b41bc7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c1120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b41bc7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c101510 0x7f8b3c1125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b41bc7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c112be0 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b41bc7640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3c10c020 con 0x7f8b3c101510 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.666+0000 7f8b3b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c1120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c1120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36514/0 (socket says 172.21.15.66:36514) 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3b7fe640 1 -- 172.21.15.66:0/1120731696 learned_addr learned my addr 172.21.15.66:0/1120731696 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:44.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3affd640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c101510 0x7f8b3c1125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3b7fe640 1 -- 172.21.15.66:0/1120731696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c101510 msgr2=0x7f8b3c1125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3b7fe640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c101510 0x7f8b3c1125e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3b7fe640 1 -- 172.21.15.66:0/1120731696 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2c005040 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3affd640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c101510 0x7f8b3c1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b3b7fe640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c1120a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c000c00 tx=0x7f8b2c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2c038070 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b3c10c2a0 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8b2c02ade0 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b2c02c7b0 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.667+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3c10c7e0 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.668+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b3c0fcc10 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.669+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8b2c030020 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.669+0000 7f8b23fff640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8b2406e0b0 0x7f8b24070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.669+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8b2c0adf90 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.669+0000 7f8b3affd640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8b2406e0b0 0x7f8b24070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.670+0000 7f8b3affd640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8b2406e0b0 0x7f8b24070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b30004fd0 tx=0x7f8b3000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.674+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8b2c077310 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.886+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8b3c04b720 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.886 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: pgmap v111: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:44.886 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.886 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:44.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:44.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:44.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:44 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/126510992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:44.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.886+0000 7f8b23fff640 1 -- 172.21.15.66:0/1120731696 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7f8b2c07a9d0 con 0x7f8b3c0fb4d0 2024-09-12T01:50:44.887 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:50:44.888 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:50:44.889 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:44.890 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:44.891 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:50:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:50:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8b2406e0b0 msgr2=0x7f8b24070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8b2406e0b0 0x7f8b24070560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b30004fd0 tx=0x7f8b3000b040 comp rx=0 tx=0).stop 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 msgr2=0x7f8b3c1120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c1120a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c000c00 tx=0x7f8b2c009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 shutdown_connections 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8b2406e0b0 0x7f8b24070560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b3c101510 0x7f8b3c1125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 --2- 172.21.15.66:0/1120731696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b3c0fb4d0 0x7f8b3c1120a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 >> 172.21.15.66:0/1120731696 conn(0x7f8b3c0f7090 msgr2=0x7f8b3c0f8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.888+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 shutdown_connections 2024-09-12T01:50:44.892 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.889+0000 7f8b41bc7640 1 -- 172.21.15.66:0/1120731696 wait complete. 2024-09-12T01:50:44.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: pgmap v111: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:44.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:44.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:44.913 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:44.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:44.914 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:44 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/126510992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.971+0000 7f25629e9640 1 -- 172.21.15.66:0/2999125924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 msgr2=0x7f255c1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.972 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.971+0000 7f25629e9640 1 --2- 172.21.15.66:0/2999125924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c1018e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f254c0048d0 tx=0x7f254c009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.971+0000 7f25629e9640 1 -- 172.21.15.66:0/2999125924 shutdown_connections 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.971+0000 7f25629e9640 1 --2- 172.21.15.66:0/2999125924 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c0fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.971+0000 7f25629e9640 1 --2- 172.21.15.66:0/2999125924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c1018e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.972+0000 7f25629e9640 1 -- 172.21.15.66:0/2999125924 >> 172.21.15.66:0/2999125924 conn(0x7f255c0f7090 msgr2=0x7f255c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.972+0000 7f25629e9640 1 -- 172.21.15.66:0/2999125924 shutdown_connections 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.972+0000 7f25629e9640 1 -- 172.21.15.66:0/2999125924 wait complete. 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.972+0000 7f25629e9640 1 Processor -- start 2024-09-12T01:50:44.973 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.972+0000 7f25629e9640 1 -- start start 2024-09-12T01:50:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f25629e9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c10e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f25629e9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c10e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f25629e9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c10ed10 con 0x7f255c101510 2024-09-12T01:50:44.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f25629e9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255c10ee80 con 0x7f255c0fb4d0 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c10e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c10e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255bfff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c10e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:60198/0 (socket says 172.21.15.66:60198) 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255bfff640 1 -- 172.21.15.66:0/1805348211 learned_addr learned my addr 172.21.15.66:0/1805348211 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255b7fe640 1 -- 172.21.15.66:0/1805348211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 msgr2=0x7f255c10e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255b7fe640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c10e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255b7fe640 1 -- 172.21.15.66:0/1805348211 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c005040 con 0x7f255c101510 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255bfff640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f255b7fe640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c10e6c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f255000eb40 tx=0x7f255000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2550007c30 con 0x7f255c101510 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255c1171f0 con 0x7f255c101510 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f255000f040 con 0x7f255c101510 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.973+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25500094b0 con 0x7f255c101510 2024-09-12T01:50:44.975 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.974+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255c1176b0 con 0x7f255c101510 2024-09-12T01:50:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.975+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255c0fcc10 con 0x7f255c101510 2024-09-12T01:50:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.975+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f255000cc40 con 0x7f255c101510 2024-09-12T01:50:44.976 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.976+0000 7f2558ff9640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f254406e0b0 0x7f2544070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.976+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f255008d7f0 con 0x7f255c101510 2024-09-12T01:50:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.976+0000 7f255bfff640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f254406e0b0 0x7f2544070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:44.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.976+0000 7f255bfff640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f254406e0b0 0x7f2544070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f254c009ac0 tx=0x7f254c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:44.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:44.980+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2550056c20 con 0x7f255c101510 2024-09-12T01:50:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.172+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f255c108550 con 0x7f254406e0b0 2024-09-12T01:50:45.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.173+0000 7f2558ff9640 1 -- 172.21.15.66:0/1805348211 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f254c039040 con 0x7f254406e0b0 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "10/21 daemons upgraded", 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading osd daemons", 2024-09-12T01:50:45.174 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:50:45.175 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f254406e0b0 msgr2=0x7f2544070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f254406e0b0 0x7f2544070560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f254c009ac0 tx=0x7f254c035040 comp rx=0 tx=0).stop 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 msgr2=0x7f255c10e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c10e6c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f255000eb40 tx=0x7f255000b040 comp rx=0 tx=0).stop 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 shutdown_connections 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f254406e0b0 0x7f2544070560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f255c101510 0x7f255c10e6c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 --2- 172.21.15.66:0/1805348211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f255c0fb4d0 0x7f255c10e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.175+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 >> 172.21.15.66:0/1805348211 conn(0x7f255c0f7090 msgr2=0x7f255c0f7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.176+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 shutdown_connections 2024-09-12T01:50:45.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.176+0000 7f25629e9640 1 -- 172.21.15.66:0/1805348211 wait complete. 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 -- 172.21.15.66:0/2699645273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 msgr2=0x7fd4ac0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 --2- 172.21.15.66:0/2699645273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac0fb0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd4940048d0 tx=0x7fd494009da0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 -- 172.21.15.66:0/2699645273 shutdown_connections 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 --2- 172.21.15.66:0/2699645273 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac0fb0f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 --2- 172.21.15.66:0/2699645273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac102620 0x7fd4ac1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 -- 172.21.15.66:0/2699645273 >> 172.21.15.66:0/2699645273 conn(0x7fd4ac070ce0 msgr2=0x7fd4ac0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 -- 172.21.15.66:0/2699645273 shutdown_connections 2024-09-12T01:50:45.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.256+0000 7fd4b1752640 1 -- 172.21.15.66:0/2699645273 wait complete. 2024-09-12T01:50:45.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4b1752640 1 Processor -- start 2024-09-12T01:50:45.258 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4b1752640 1 -- start start 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4b1752640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4b1752640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac102620 0x7fd4ac1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4b1752640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac113cf0 con 0x7fd4ac0fac80 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4b1752640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ac10d130 con 0x7fd4ac102620 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4aaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4aaffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:36550/0 (socket says 172.21.15.66:36550) 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.257+0000 7fd4aaffd640 1 -- 172.21.15.66:0/3641755478 learned_addr learned my addr 172.21.15.66:0/3641755478 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4a27fc640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac102620 0x7fd4ac1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.259 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4aaffd640 1 -- 172.21.15.66:0/3641755478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac102620 msgr2=0x7fd4ac1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4aaffd640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac102620 0x7fd4ac1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4aaffd640 1 -- 172.21.15.66:0/3641755478 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494005040 con 0x7fd4ac0fac80 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4aaffd640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac1131b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd49c002840 tx=0x7fd49c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c007c30 con 0x7fd4ac0fac80 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd49c00f040 con 0x7fd4ac0fac80 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ac10d410 con 0x7fd4ac0fac80 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd49c009410 con 0x7fd4ac0fac80 2024-09-12T01:50:45.260 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.258+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ac10d980 con 0x7fd4ac0fac80 2024-09-12T01:50:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.259+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ac065790 con 0x7fd4ac0fac80 2024-09-12T01:50:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.260+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd49c0096d0 con 0x7fd4ac0fac80 2024-09-12T01:50:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.260+0000 7fd4a3fff640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd49806e0b0 0x7fd498070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:50:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.260+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd49c08db20 con 0x7fd4ac0fac80 2024-09-12T01:50:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.260+0000 7fd4a27fc640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd49806e0b0 0x7fd498070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:50:45.261 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.261+0000 7fd4a27fc640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd49806e0b0 0x7fd498070560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0727d0 tx=0x7fd494035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:50:45.265 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.265+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd49c056ea0 con 0x7fd4ac0fac80 2024-09-12T01:50:45.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.507+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd4ac04b750 con 0x7fd4ac0fac80 2024-09-12T01:50:45.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.507+0000 7fd4a3fff640 1 -- 172.21.15.66:0/3641755478 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1216 (secure 0 0 0) 0x7fd49c05a560 con 0x7fd4ac0fac80 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: osd.3 (root=default,host=smithi153) is down 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-12T01:50:45.508 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-12T01:50:45.509 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd49806e0b0 msgr2=0x7fd498070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd49806e0b0 0x7fd498070560 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac0727d0 tx=0x7fd494035040 comp rx=0 tx=0).stop 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 msgr2=0x7fd4ac1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac1131b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd49c002840 tx=0x7fd49c004570 comp rx=0 tx=0).stop 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 shutdown_connections 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd49806e0b0 0x7fd498070560 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4ac102620 0x7fd4ac1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 --2- 172.21.15.66:0/3641755478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ac0fac80 0x7fd4ac1131b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:50:45.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.509+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 >> 172.21.15.66:0/3641755478 conn(0x7fd4ac070ce0 msgr2=0x7fd4ac0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:50:45.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.510+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 shutdown_connections 2024-09-12T01:50:45.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:50:45.510+0000 7fd4b1752640 1 -- 172.21.15.66:0/3641755478 wait complete. 2024-09-12T01:50:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:45 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1120731696' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:50:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:45 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:45 smithi066 ceph-mon[110996]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:45 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3641755478' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:50:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:45 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1120731696' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:50:45.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:45 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 48/219 objects degraded (21.918%), 17 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:45.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:45 smithi153 ceph-mon[80899]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:50:45.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:45 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3641755478' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:50:47.099 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:46 smithi153 ceph-mon[80899]: pgmap v112: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:47.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:46 smithi066 ceph-mon[110996]: pgmap v112: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:48.704 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:48.704 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:48.704 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:48.704 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:48.704 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:50:48.705 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-mon[80899]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: pgmap v113: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:48.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:50:48.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:50:48.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:50:48.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:48 smithi066 ceph-mon[110996]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-12T01:50:49.154 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:48 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:50:48.703+0000 7f1f6cea7640 -1 osd.3 62 log_to_monitors true 2024-09-12T01:50:49.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:49 smithi066 ceph-mon[110996]: from='osd.3 [v2:172.21.15.153:6800/3684684672,v1:172.21.15.153:6801/3684684672]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:49.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:49 smithi066 ceph-mon[110996]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:49.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:49 smithi153 ceph-mon[80899]: from='osd.3 [v2:172.21.15.153:6800/3684684672,v1:172.21.15.153:6801/3684684672]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:49.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:49 smithi153 ceph-mon[80899]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-12T01:50:50.654 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:50:50.268+0000 7f1f60c39640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:50:50.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-mon[80899]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:50.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-mon[80899]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:50:50.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-mon[80899]: osdmap e65: 6 total, 5 up, 6 in 2024-09-12T01:50:50.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-mon[80899]: from='osd.3 [v2:172.21.15.153:6800/3684684672,v1:172.21.15.153:6801/3684684672]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:50:50.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-mon[80899]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:50:50.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:50 smithi153 ceph-mon[80899]: from='osd.3 ' entity='osd.3' 2024-09-12T01:50:50.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:50 smithi066 ceph-mon[110996]: pgmap v114: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:50.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:50 smithi066 ceph-mon[110996]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-12T01:50:50.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:50 smithi066 ceph-mon[110996]: osdmap e65: 6 total, 5 up, 6 in 2024-09-12T01:50:50.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:50 smithi066 ceph-mon[110996]: from='osd.3 [v2:172.21.15.153:6800/3684684672,v1:172.21.15.153:6801/3684684672]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:50:50.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:50 smithi066 ceph-mon[110996]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:50:50.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:50 smithi066 ceph-mon[110996]: from='osd.3 ' entity='osd.3' 2024-09-12T01:50:51.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:51 smithi066 ceph-mon[110996]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:50:51.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:51 smithi066 ceph-mon[110996]: osd.3 [v2:172.21.15.153:6800/3684684672,v1:172.21.15.153:6801/3684684672] boot 2024-09-12T01:50:51.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:51 smithi066 ceph-mon[110996]: osdmap e66: 6 total, 6 up, 6 in 2024-09-12T01:50:51.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:51.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:51 smithi153 ceph-mon[80899]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:50:51.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:51 smithi153 ceph-mon[80899]: osd.3 [v2:172.21.15.153:6800/3684684672,v1:172.21.15.153:6801/3684684672] boot 2024-09-12T01:50:51.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:51 smithi153 ceph-mon[80899]: osdmap e66: 6 total, 6 up, 6 in 2024-09-12T01:50:51.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:51 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-12T01:50:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:53 smithi066 ceph-mon[110996]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:53 smithi066 ceph-mon[110996]: osdmap e67: 6 total, 6 up, 6 in 2024-09-12T01:50:53.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:53 smithi153 ceph-mon[80899]: pgmap v117: 65 pgs: 21 active+undersized, 17 active+undersized+degraded, 27 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48/219 objects degraded (21.918%) 2024-09-12T01:50:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:53 smithi153 ceph-mon[80899]: osdmap e67: 6 total, 6 up, 6 in 2024-09-12T01:50:54.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:54 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 42/219 objects degraded (19.178%), 15 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:54.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:54 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 42/219 objects degraded (19.178%), 15 pgs degraded (PG_DEGRADED) 2024-09-12T01:50:55.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:55 smithi066 ceph-mon[110996]: pgmap v119: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2024-09-12T01:50:55.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:55 smithi153 ceph-mon[80899]: pgmap v119: 65 pgs: 15 active+undersized, 15 active+undersized+degraded, 35 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 42/219 objects degraded (19.178%) 2024-09-12T01:50:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:56 smithi066 ceph-mon[110996]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/219 objects degraded (19.178%), 15 pgs degraded) 2024-09-12T01:50:56.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:56 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:50:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:56 smithi153 ceph-mon[80899]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 42/219 objects degraded (19.178%), 15 pgs degraded) 2024-09-12T01:50:56.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:56 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:50:57.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:57 smithi066 ceph-mon[110996]: pgmap v120: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:57.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:57.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:57.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:57 smithi153 ceph-mon[80899]: pgmap v120: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:57.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:50:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:50:59.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:50:59 smithi066 ceph-mon[110996]: pgmap v121: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:50:59.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:50:59 smithi153 ceph-mon[80899]: pgmap v121: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:01.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:01 smithi066 ceph-mon[110996]: pgmap v122: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:01.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:01 smithi153 ceph-mon[80899]: pgmap v122: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:02.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:02 smithi066 ceph-mon[110996]: pgmap v123: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:02.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:02.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:02 smithi153 ceph-mon[80899]: pgmap v123: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:02.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:03.876 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:51:03.876 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:03 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:51:03.876 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:03 smithi153 ceph-mon[80899]: Upgrade: osd.4 is safe to restart 2024-09-12T01:51:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:51:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:03 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-12T01:51:03.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:03 smithi066 ceph-mon[110996]: Upgrade: osd.4 is safe to restart 2024-09-12T01:51:05.232 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:04 smithi153 ceph-mon[80899]: pgmap v124: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:05.233 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:04 smithi153 ceph-mon[80899]: Upgrade: Updating osd.4 2024-09-12T01:51:05.233 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:04 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:05.233 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:04 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:51:05.233 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:04 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:05.233 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:04 smithi153 ceph-mon[80899]: Deploying daemon osd.4 on smithi153 2024-09-12T01:51:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:04 smithi066 ceph-mon[110996]: pgmap v124: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:04 smithi066 ceph-mon[110996]: Upgrade: Updating osd.4 2024-09-12T01:51:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:04 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:04 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-12T01:51:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:04 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:05.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:04 smithi066 ceph-mon[110996]: Deploying daemon osd.4 on smithi153 2024-09-12T01:51:07.035 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:06 smithi153 ceph-mon[80899]: pgmap v125: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:07.035 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:06 smithi153 systemd[1]: Stopping Ceph osd.4 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:51:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:06 smithi066 ceph-mon[110996]: pgmap v125: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:07.404 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:07 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[46829]: 2024-09-12T01:51:07.045+0000 7f5b2573c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:51:07.404 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:07 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[46829]: 2024-09-12T01:51:07.045+0000 7f5b2573c640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-12T01:51:07.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:07 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[46829]: 2024-09-12T01:51:07.045+0000 7f5b2573c640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:51:08.285 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:07 smithi153 ceph-mon[80899]: osd.4 marked itself down and dead 2024-09-12T01:51:08.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:07 smithi066 ceph-mon[110996]: osd.4 marked itself down and dead 2024-09-12T01:51:08.571 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:08 smithi153 podman[94983]: 2024-09-12 01:51:08.286561229 +0000 UTC m=+1.350428404 container died 8b4e141fd2052b8be5d4b377ba6444e5e19f87bbc49c4278c958ea46e86c6859 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, RELEASE=quincy-554ba93, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-12T01:51:08.904 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:08 smithi153 podman[94983]: 2024-09-12 01:51:08.662386837 +0000 UTC m=+1.726254002 container cleanup 8b4e141fd2052b8be5d4b377ba6444e5e19f87bbc49c4278c958ea46e86c6859 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=quincy-554ba93, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T01:51:08.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:08 smithi153 bash[94983]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4 2024-09-12T01:51:09.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:08 smithi066 ceph-mon[110996]: pgmap v126: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:09.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:08 smithi066 ceph-mon[110996]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:51:09.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:08 smithi066 ceph-mon[110996]: osdmap e68: 6 total, 5 up, 6 in 2024-09-12T01:51:09.281 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:08 smithi153 ceph-mon[80899]: pgmap v126: 65 pgs: 65 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:09.281 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:08 smithi153 ceph-mon[80899]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:51:09.281 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:08 smithi153 ceph-mon[80899]: osdmap e68: 6 total, 5 up, 6 in 2024-09-12T01:51:09.281 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:08 smithi153 podman[95008]: 2024-09-12 01:51:08.947071351 +0000 UTC m=+0.654999931 container remove 8b4e141fd2052b8be5d4b377ba6444e5e19f87bbc49c4278c958ea46e86c6859 (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-554ba93, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:09.544 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:09 smithi153 podman[95096]: 2024-09-12 01:51:09.184316876 +0000 UTC m=+0.015888802 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:51:09.544 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:09 smithi153 podman[95096]: 2024-09-12 01:51:09.327826479 +0000 UTC m=+0.159398395 container create b5fde23a445aebfa714ac3f8bd2a20ac5fccfdaf2bac71c770226b19fc5cd79d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-12T01:51:09.544 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:09 smithi153 podman[95096]: 2024-09-12 01:51:09.544237893 +0000 UTC m=+0.375809809 container init b5fde23a445aebfa714ac3f8bd2a20ac5fccfdaf2bac71c770226b19fc5cd79d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:51:09.904 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:09 smithi153 podman[95096]: 2024-09-12 01:51:09.548323928 +0000 UTC m=+0.379895851 container start b5fde23a445aebfa714ac3f8bd2a20ac5fccfdaf2bac71c770226b19fc5cd79d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:51:09.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:09 smithi153 podman[95096]: 2024-09-12 01:51:09.619143235 +0000 UTC m=+0.450715162 container attach b5fde23a445aebfa714ac3f8bd2a20ac5fccfdaf2bac71c770226b19fc5cd79d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:51:09.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:09 smithi153 podman[95096]: 2024-09-12 01:51:09.734308562 +0000 UTC m=+0.565880479 container died b5fde23a445aebfa714ac3f8bd2a20ac5fccfdaf2bac71c770226b19fc5cd79d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:51:10.363 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:09 smithi153 ceph-mon[80899]: osdmap e69: 6 total, 5 up, 6 in 2024-09-12T01:51:10.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:09 smithi066 ceph-mon[110996]: osdmap e69: 6 total, 5 up, 6 in 2024-09-12T01:51:10.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 podman[95119]: 2024-09-12 01:51:10.364389852 +0000 UTC m=+0.624183632 container remove b5fde23a445aebfa714ac3f8bd2a20ac5fccfdaf2bac71c770226b19fc5cd79d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-12T01:51:10.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-12T01:51:10.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 systemd[1]: Stopped Ceph osd.4 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:51:10.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.4.service: Consumed 59.734s CPU time. 2024-09-12T01:51:10.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 systemd[1]: Starting Ceph osd.4 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:51:11.089 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:10 smithi153 ceph-mon[80899]: pgmap v129: 65 pgs: 6 stale+active+clean, 59 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:11.089 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 podman[95218]: 2024-09-12 01:51:10.71491248 +0000 UTC m=+0.016899482 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:51:11.089 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:10 smithi153 podman[95218]: 2024-09-12 01:51:10.849570107 +0000 UTC m=+0.151557145 container create 8948e99faa6326b225be90edecb7ee1ae5a221fbe4aaf3872cc2f1d02cd1d93b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=) 2024-09-12T01:51:11.089 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 podman[95218]: 2024-09-12 01:51:11.085367917 +0000 UTC m=+0.387354911 container init 8948e99faa6326b225be90edecb7ee1ae5a221fbe4aaf3872cc2f1d02cd1d93b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-12T01:51:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:10 smithi066 ceph-mon[110996]: pgmap v129: 65 pgs: 6 stale+active+clean, 59 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:11.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 podman[95218]: 2024-09-12 01:51:11.088851089 +0000 UTC m=+0.390838091 container start 8948e99faa6326b225be90edecb7ee1ae5a221fbe4aaf3872cc2f1d02cd1d93b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-12T01:51:11.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 podman[95218]: 2024-09-12 01:51:11.168649625 +0000 UTC m=+0.470636627 container attach 8948e99faa6326b225be90edecb7ee1ae5a221fbe4aaf3872cc2f1d02cd1d93b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:11.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:11.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 bash[95218]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:11.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:11.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 bash[95218]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:12.241 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T01:51:12.241 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 bash[95218]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T01:51:12.241 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-12T01:51:12.242 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:11 smithi153 bash[95218]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-12T01:51:12.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-mon[80899]: pgmap v130: 65 pgs: 17 active+undersized, 1 stale+active+clean, 12 active+undersized+degraded, 35 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-09-12T01:51:12.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:12.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:12.554 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-mon[80899]: Health check failed: Degraded data redundancy: 33/219 objects degraded (15.068%), 12 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 bash[95218]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 bash[95218]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 bash[95218]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 bash[95218]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate[95234]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 bash[95218]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-12T01:51:12.555 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 podman[95218]: 2024-09-12 01:51:12.270859332 +0000 UTC m=+1.572846328 container died 8948e99faa6326b225be90edecb7ee1ae5a221fbe4aaf3872cc2f1d02cd1d93b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:12 smithi066 ceph-mon[110996]: pgmap v130: 65 pgs: 17 active+undersized, 1 stale+active+clean, 12 active+undersized+degraded, 35 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 33/219 objects degraded (15.068%) 2024-09-12T01:51:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:12 smithi066 ceph-mon[110996]: Health check failed: Degraded data redundancy: 33/219 objects degraded (15.068%), 12 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:13.154 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:12 smithi153 podman[95369]: 2024-09-12 01:51:12.8637463 +0000 UTC m=+0.586764442 container remove 8948e99faa6326b225be90edecb7ee1ae5a221fbe4aaf3872cc2f1d02cd1d93b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T01:51:13.155 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 podman[95427]: 2024-09-12 01:51:12.978925845 +0000 UTC m=+0.016175962 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:51:13.155 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 podman[95427]: 2024-09-12 01:51:13.097865976 +0000 UTC m=+0.135116084 container create 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T01:51:13.654 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 podman[95427]: 2024-09-12 01:51:13.317312557 +0000 UTC m=+0.354562665 container init 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T01:51:13.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 podman[95427]: 2024-09-12 01:51:13.32041047 +0000 UTC m=+0.357660579 container start 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T01:51:13.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 ceph-osd[95445]: -- 172.21.15.153:0/1354860807 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c17e9ee1e0 con 0x55c17db9bc00 2024-09-12T01:51:13.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 bash[95427]: 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 2024-09-12T01:51:13.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:13 smithi153 systemd[1]: Started Ceph osd.4 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:51:14.780 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:14 smithi153 ceph-mon[80899]: pgmap v131: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:14.780 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:14 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:14.780 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:14 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:14.780 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:14 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:14.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:14 smithi066 ceph-mon[110996]: pgmap v131: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:14.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:14 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:14.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:14 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:14.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:14 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:15.404 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:15 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:51:15.204+0000 7fba8a5f6640 -1 Falling back to public interface 2024-09-12T01:51:15.606 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 -- 172.21.15.66:0/3876107507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c0fb4d0 msgr2=0x7f7a1c0fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 --2- 172.21.15.66:0/3876107507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c0fb4d0 0x7f7a1c0fb940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0048d0 tx=0x7f7a0c009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 -- 172.21.15.66:0/3876107507 shutdown_connections 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 --2- 172.21.15.66:0/3876107507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c0fb4d0 0x7f7a1c0fb940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 --2- 172.21.15.66:0/3876107507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c101510 0x7f7a1c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 -- 172.21.15.66:0/3876107507 >> 172.21.15.66:0/3876107507 conn(0x7f7a1c0f7090 msgr2=0x7f7a1c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 -- 172.21.15.66:0/3876107507 shutdown_connections 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 -- 172.21.15.66:0/3876107507 wait complete. 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.605+0000 7f7a23b59640 1 Processor -- start 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a23b59640 1 -- start start 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a23b59640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0fb4d0 0x7f7a1c113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a23b59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 0x7f7a1c1136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a23b59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c113cc0 con 0x7f7a1c101510 2024-09-12T01:51:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a23b59640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c10d100 con 0x7f7a1c0fb4d0 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a210f4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 0x7f7a1c1136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a210f4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 0x7f7a1c1136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33312/0 (socket says 172.21.15.66:33312) 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a210f4640 1 -- 172.21.15.66:0/1432158398 learned_addr learned my addr 172.21.15.66:0/1432158398 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a218f5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0fb4d0 0x7f7a1c113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a210f4640 1 -- 172.21.15.66:0/1432158398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0fb4d0 msgr2=0x7f7a1c113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a210f4640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0fb4d0 0x7f7a1c113180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.606+0000 7f7a210f4640 1 -- 172.21.15.66:0/1432158398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c005040 con 0x7f7a1c101510 2024-09-12T01:51:15.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.607+0000 7f7a210f4640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 0x7f7a1c1136c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0043d0 tx=0x7f7a0c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:15.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.607+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c038070 con 0x7f7a1c101510 2024-09-12T01:51:15.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.607+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a0c0096e0 con 0x7f7a1c101510 2024-09-12T01:51:15.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.607+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c10d380 con 0x7f7a1c101510 2024-09-12T01:51:15.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.607+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a0c03d420 con 0x7f7a1c101510 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.607+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c10d8a0 con 0x7f7a1c101510 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.608+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c0fcc10 con 0x7f7a1c101510 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.609+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f7a0c030020 con 0x7f7a1c101510 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.609+0000 7f7a127fc640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7a0806e0b0 0x7f7a08070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.609+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f7a0c0ae010 con 0x7f7a1c101510 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.609+0000 7f7a218f5640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7a0806e0b0 0x7f7a08070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.610+0000 7f7a218f5640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7a0806e0b0 0x7f7a08070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009fd0 tx=0x7f7a1800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:15.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.614+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7a0c077390 con 0x7f7a1c101510 2024-09-12T01:51:15.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.809+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a1c108490 con 0x7f7a0806e0b0 2024-09-12T01:51:15.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.810+0000 7f7a127fc640 1 -- 172.21.15.66:0/1432158398 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7a1c108490 con 0x7f7a0806e0b0 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.812+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7a0806e0b0 msgr2=0x7f7a08070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.812+0000 7f7a23b59640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7a0806e0b0 0x7f7a08070560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009fd0 tx=0x7f7a1800b040 comp rx=0 tx=0).stop 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.812+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 msgr2=0x7f7a1c1136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.812+0000 7f7a23b59640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 0x7f7a1c1136c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0043d0 tx=0x7f7a0c009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 shutdown_connections 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f7a0806e0b0 0x7f7a08070560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a1c101510 0x7f7a1c1136c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 --2- 172.21.15.66:0/1432158398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a1c0fb4d0 0x7f7a1c113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 >> 172.21.15.66:0/1432158398 conn(0x7f7a1c0f7090 msgr2=0x7f7a1c065a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 shutdown_connections 2024-09-12T01:51:15.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.813+0000 7f7a23b59640 1 -- 172.21.15.66:0/1432158398 wait complete. 2024-09-12T01:51:15.822 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:51:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 -- 172.21.15.66:0/2400359657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 msgr2=0x7efe28102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/2400359657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe28102a30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efe180048d0 tx=0x7efe18009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.895 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 -- 172.21.15.66:0/2400359657 shutdown_connections 2024-09-12T01:51:15.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/2400359657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe280fac80 0x7efe280fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/2400359657 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe28102a30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 -- 172.21.15.66:0/2400359657 >> 172.21.15.66:0/2400359657 conn(0x7efe28070ce0 msgr2=0x7efe280710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:15.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 -- 172.21.15.66:0/2400359657 shutdown_connections 2024-09-12T01:51:15.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.895+0000 7efe2e9b6640 1 -- 172.21.15.66:0/2400359657 wait complete. 2024-09-12T01:51:15.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe2e9b6640 1 Processor -- start 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe2e9b6640 1 -- start start 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe2e9b6640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe280fac80 0x7efe28113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe2e9b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe281136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe2e9b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe28113cb0 con 0x7efe28102660 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe2e9b6640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe28113e20 con 0x7efe280fac80 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe277fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe281136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe277fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe281136b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33324/0 (socket says 172.21.15.66:33324) 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe277fe640 1 -- 172.21.15.66:0/1198366447 learned_addr learned my addr 172.21.15.66:0/1198366447 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe27fff640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe280fac80 0x7efe28113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe277fe640 1 -- 172.21.15.66:0/1198366447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe280fac80 msgr2=0x7efe28113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe277fe640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe280fac80 0x7efe28113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.896+0000 7efe277fe640 1 -- 172.21.15.66:0/1198366447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18005040 con 0x7efe28102660 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.897+0000 7efe277fe640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe281136b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe1c002a50 tx=0x7efe1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:15.898 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.897+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c007c30 con 0x7efe28102660 2024-09-12T01:51:15.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.897+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2810d2a0 con 0x7efe28102660 2024-09-12T01:51:15.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.897+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe1c00f040 con 0x7efe28102660 2024-09-12T01:51:15.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.897+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1c00da10 con 0x7efe28102660 2024-09-12T01:51:15.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.897+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2810d840 con 0x7efe28102660 2024-09-12T01:51:15.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.898+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe280657d0 con 0x7efe28102660 2024-09-12T01:51:15.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.899+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7efe1c00dc80 con 0x7efe28102660 2024-09-12T01:51:15.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.899+0000 7efe24ff9640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efe1006e0b0 0x7efe10070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:15.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.899+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7efe1c08d300 con 0x7efe28102660 2024-09-12T01:51:15.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.899+0000 7efe27fff640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efe1006e0b0 0x7efe10070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:15.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.900+0000 7efe27fff640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efe1006e0b0 0x7efe10070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe18009ac0 tx=0x7efe18035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:15.903 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:15.903+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efe1c056730 con 0x7efe28102660 2024-09-12T01:51:16.098 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.097+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe2804b720 con 0x7efe1006e0b0 2024-09-12T01:51:16.099 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.099+0000 7efe24ff9640 1 -- 172.21.15.66:0/1198366447 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efe2804b720 con 0x7efe1006e0b0 2024-09-12T01:51:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efe1006e0b0 msgr2=0x7efe10070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efe1006e0b0 0x7efe10070560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efe18009ac0 tx=0x7efe18035040 comp rx=0 tx=0).stop 2024-09-12T01:51:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 msgr2=0x7efe281136b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe281136b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe1c002a50 tx=0x7efe1c004600 comp rx=0 tx=0).stop 2024-09-12T01:51:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 shutdown_connections 2024-09-12T01:51:16.101 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7efe1006e0b0 0x7efe10070560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe28102660 0x7efe281136b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 --2- 172.21.15.66:0/1198366447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe280fac80 0x7efe28113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 >> 172.21.15.66:0/1198366447 conn(0x7efe28070ce0 msgr2=0x7efe280fa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 shutdown_connections 2024-09-12T01:51:16.102 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.101+0000 7efe2e9b6640 1 -- 172.21.15.66:0/1198366447 wait complete. 2024-09-12T01:51:16.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 -- 172.21.15.66:0/634690815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 msgr2=0x7f50fc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 --2- 172.21.15.66:0/634690815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc0fd3d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f50e40048d0 tx=0x7f50e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 -- 172.21.15.66:0/634690815 shutdown_connections 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 --2- 172.21.15.66:0/634690815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc0fd3d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 --2- 172.21.15.66:0/634690815 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50fc0fb810 0x7f50fc0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 -- 172.21.15.66:0/634690815 >> 172.21.15.66:0/634690815 conn(0x7f50fc0723b0 msgr2=0x7f50fc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 -- 172.21.15.66:0/634690815 shutdown_connections 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 -- 172.21.15.66:0/634690815 wait complete. 2024-09-12T01:51:16.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.182+0000 7f5102990640 1 Processor -- start 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f5102990640 1 -- start start 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f5102990640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50fc0fb810 0x7f50fc113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f5102990640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f5102990640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc113de0 con 0x7f50fc0fcf80 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f5102990640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc10d190 con 0x7f50fc0fb810 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f50fb7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33344/0 (socket says 172.21.15.66:33344) 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f50fb7fe640 1 -- 172.21.15.66:0/2686700878 learned_addr learned my addr 172.21.15.66:0/2686700878 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f50fbfff640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50fc0fb810 0x7f50fc113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f50fb7fe640 1 -- 172.21.15.66:0/2686700878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50fc0fb810 msgr2=0x7f50fc113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.183+0000 7f50fb7fe640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50fc0fb810 0x7f50fc113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f50fb7fe640 1 -- 172.21.15.66:0/2686700878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e4005040 con 0x7f50fc0fcf80 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f50fb7fe640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc113750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50e4003080 tx=0x7f50e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e4038070 con 0x7f50fc0fcf80 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc10d410 con 0x7f50fc0fcf80 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc10d8d0 con 0x7f50fc0fcf80 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f50e40097e0 con 0x7f50fc0fcf80 2024-09-12T01:51:16.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.184+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50e402c7c0 con 0x7f50fc0fcf80 2024-09-12T01:51:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.185+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc005210 con 0x7f50fc0fcf80 2024-09-12T01:51:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.186+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f50e4030020 con 0x7f50fc0fcf80 2024-09-12T01:51:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.186+0000 7f50f8ff9640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f50e806e0b0 0x7f50e8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.187+0000 7f50fbfff640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f50e806e0b0 0x7f50e8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.187+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f50e40adc00 con 0x7f50fc0fcf80 2024-09-12T01:51:16.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.187+0000 7f50fbfff640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f50e806e0b0 0x7f50e8070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009b50 tx=0x7f50ec009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.191 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.191+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f50e40b3020 con 0x7f50fc0fcf80 2024-09-12T01:51:16.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.375+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50dc000bc0 con 0x7f50e806e0b0 2024-09-12T01:51:16.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.384+0000 7f50f8ff9640 1 -- 172.21.15.66:0/2686700878 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f50dc000bc0 con 0x7f50e806e0b0 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (5m) 65s ago 15m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (2m) 65s ago 15m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (2m) 0s ago 15m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (5m) 65s ago 15m 82.6M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (10m) 65s ago 10m 14.7M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (10m) 65s ago 10m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (10m) 0s ago 10m 17.9M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (10m) 0s ago 10m 16.8M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (7m) 65s ago 17m 499M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:51:16.385 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (6m) 0s ago 14m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (3m) 65s ago 17m 48.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (3m) 0s ago 14m 37.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (6m) 65s ago 15m 16.9M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (5m) 0s ago 15m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (2m) 65s ago 14m 101M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (105s) 65s ago 13m 98.8M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (70s) 65s ago 13m 12.1M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (35s) 0s ago 12m 109M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (3s) 0s ago 12m 12.1M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 6b77ec5616ac 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (12m) 0s ago 12m 234M 2581M 17.2.7-1609-g554ba93e d4c538e492e4 733be44696b3 2024-09-12T01:51:16.386 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (5m) 65s ago 15m 62.5M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f50e806e0b0 msgr2=0x7f50e8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f50e806e0b0 0x7f50e8070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f50ec009b50 tx=0x7f50ec009120 comp rx=0 tx=0).stop 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 msgr2=0x7f50fc113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc113750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f50e4003080 tx=0x7f50e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 shutdown_connections 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f50e806e0b0 0x7f50e8070560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50fc0fcf80 0x7f50fc113750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.387 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 --2- 172.21.15.66:0/2686700878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50fc0fb810 0x7f50fc113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.386+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 >> 172.21.15.66:0/2686700878 conn(0x7f50fc0723b0 msgr2=0x7f50fc0fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.387+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 shutdown_connections 2024-09-12T01:51:16.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.387+0000 7f5102990640 1 -- 172.21.15.66:0/2686700878 wait complete. 2024-09-12T01:51:16.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 -- 172.21.15.66:0/4246941176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 msgr2=0x7f81bc0fb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 --2- 172.21.15.66:0/4246941176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc0fb140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f81b80049c0 tx=0x7f81b800aeb0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.468 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 -- 172.21.15.66:0/4246941176 shutdown_connections 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 --2- 172.21.15.66:0/4246941176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc0fb140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 --2- 172.21.15.66:0/4246941176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81bc100d10 0x7f81bc1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 -- 172.21.15.66:0/4246941176 >> 172.21.15.66:0/4246941176 conn(0x7f81bc070d50 msgr2=0x7f81bc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 -- 172.21.15.66:0/4246941176 shutdown_connections 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.467+0000 7f81c4525640 1 -- 172.21.15.66:0/4246941176 wait complete. 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c4525640 1 Processor -- start 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c4525640 1 -- start start 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c4525640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c4525640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81bc100d10 0x7f81bc113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c4525640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc113d20 con 0x7f81bc0facf0 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c4525640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc10d160 con 0x7f81bc100d10 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c22c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.469 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c22c1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc1131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33362/0 (socket says 172.21.15.66:33362) 2024-09-12T01:51:16.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c22c1640 1 -- 172.21.15.66:0/3462628467 learned_addr learned my addr 172.21.15.66:0/3462628467 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:16.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.468+0000 7f81c1ac0640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81bc100d10 0x7f81bc113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81c22c1640 1 -- 172.21.15.66:0/3462628467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81bc100d10 msgr2=0x7f81bc113720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.470 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81c22c1640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81bc100d10 0x7f81bc113720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81c22c1640 1 -- 172.21.15.66:0/3462628467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b8005040 con 0x7f81bc0facf0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81c22c1640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc1131e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81ac002a80 tx=0x7f81ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81ac007c30 con 0x7f81bc0facf0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc10d440 con 0x7f81bc0facf0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f81ac00f040 con 0x7f81bc0facf0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81ac009470 con 0x7f81bc0facf0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.469+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc10d9e0 con 0x7f81bc0facf0 2024-09-12T01:51:16.471 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.470+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81bc0fc3d0 con 0x7f81bc0facf0 2024-09-12T01:51:16.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.471+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f81ac009650 con 0x7f81bc0facf0 2024-09-12T01:51:16.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.471+0000 7f81b2ffd640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f81a806e0b0 0x7f81a8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.471+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f81ac08d8d0 con 0x7f81bc0facf0 2024-09-12T01:51:16.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.471+0000 7f81c1ac0640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f81a806e0b0 0x7f81a8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.472 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.472+0000 7f81c1ac0640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f81a806e0b0 0x7f81a8070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81bc10eaa0 tx=0x7f81b800aeb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.475 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.475+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f81ac056c50 con 0x7f81bc0facf0 2024-09-12T01:51:16.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.720+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f81bc074c70 con 0x7f81bc0facf0 2024-09-12T01:51:16.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.721+0000 7f81b2ffd640 1 -- 172.21.15.66:0/3462628467 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f81ac05a310 con 0x7f81bc0facf0 2024-09-12T01:51:16.721 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:51:16.721 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:51:16.721 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:51:16.721 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:16.721 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 1, 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 4 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 5, 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 8 2024-09-12T01:51:16.722 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:51:16.723 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:51:16.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f81a806e0b0 msgr2=0x7f81a8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f81a806e0b0 0x7f81a8070560 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81bc10eaa0 tx=0x7f81b800aeb0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 msgr2=0x7f81bc1131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc1131e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81ac002a80 tx=0x7f81ac004600 comp rx=0 tx=0).stop 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 shutdown_connections 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f81a806e0b0 0x7f81a8070560 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81bc100d10 0x7f81bc113720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 --2- 172.21.15.66:0/3462628467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81bc0facf0 0x7f81bc1131e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 >> 172.21.15.66:0/3462628467 conn(0x7f81bc070d50 msgr2=0x7f81bc0f9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 shutdown_connections 2024-09-12T01:51:16.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.723+0000 7f81c4525640 1 -- 172.21.15.66:0/3462628467 wait complete. 2024-09-12T01:51:16.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 -- 172.21.15.66:0/2099388432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf800fac80 msgr2=0x7fcf800fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 --2- 172.21.15.66:0/2099388432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf800fac80 0x7fcf800fb0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf700048d0 tx=0x7fcf70009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 -- 172.21.15.66:0/2099388432 shutdown_connections 2024-09-12T01:51:16.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 --2- 172.21.15.66:0/2099388432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf800fac80 0x7fcf800fb0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 --2- 172.21.15.66:0/2099388432 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf80102620 0x7fcf801029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.805 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 -- 172.21.15.66:0/2099388432 >> 172.21.15.66:0/2099388432 conn(0x7fcf80070ce0 msgr2=0x7fcf800710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:16.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 -- 172.21.15.66:0/2099388432 shutdown_connections 2024-09-12T01:51:16.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.804+0000 7fcf8862d640 1 -- 172.21.15.66:0/2099388432 wait complete. 2024-09-12T01:51:16.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf8862d640 1 Processor -- start 2024-09-12T01:51:16.806 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf8862d640 1 -- start start 2024-09-12T01:51:16.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf8862d640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf800fac80 0x7fcf800fbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf8862d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 0x7fcf800fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf8862d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800fc8e0 con 0x7fcf80102620 2024-09-12T01:51:16.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf8862d640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800fca50 con 0x7fcf800fac80 2024-09-12T01:51:16.807 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.805+0000 7fcf85bc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 0x7fcf800fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf85bc8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 0x7fcf800fc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33376/0 (socket says 172.21.15.66:33376) 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf85bc8640 1 -- 172.21.15.66:0/38294761 learned_addr learned my addr 172.21.15.66:0/38294761 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf863c9640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf800fac80 0x7fcf800fbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf85bc8640 1 -- 172.21.15.66:0/38294761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf800fac80 msgr2=0x7fcf800fbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf85bc8640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf800fac80 0x7fcf800fbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf85bc8640 1 -- 172.21.15.66:0/38294761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf70005040 con 0x7fcf80102620 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf85bc8640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 0x7fcf800fc3a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf70000c00 tx=0x7fcf70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf70038070 con 0x7fcf80102620 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf7002ade0 con 0x7fcf80102620 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf800fcc80 con 0x7fcf80102620 2024-09-12T01:51:16.808 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf7002c7b0 con 0x7fcf80102620 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.806+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf80119860 con 0x7fcf80102620 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.807+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf800657b0 con 0x7fcf80102620 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.808+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fcf70030020 con 0x7fcf80102620 2024-09-12T01:51:16.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.809+0000 7fcf76ffd640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fcf6c06e0b0 0x7fcf6c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:16.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.809+0000 7fcf863c9640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fcf6c06e0b0 0x7fcf6c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:16.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.809+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fcf700adea0 con 0x7fcf80102620 2024-09-12T01:51:16.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.809+0000 7fcf863c9640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fcf6c06e0b0 0x7fcf6c070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009af0 tx=0x7fcf7c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:16.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:16.813+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf700772a0 con 0x7fcf80102620 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.028+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf8004b720 con 0x7fcf80102620 2024-09-12T01:51:17.029 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.029+0000 7fcf76ffd640 1 -- 172.21.15.66:0/38294761 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7fcf7007a960 con 0x7fcf80102620 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:51:17.030 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:51:17.031 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:51:17.032 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:17.033 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fcf6c06e0b0 msgr2=0x7fcf6c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fcf6c06e0b0 0x7fcf6c070560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009af0 tx=0x7fcf7c00b040 comp rx=0 tx=0).stop 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 msgr2=0x7fcf800fc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 0x7fcf800fc3a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf70000c00 tx=0x7fcf70009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 shutdown_connections 2024-09-12T01:51:17.034 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fcf6c06e0b0 0x7fcf6c070560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf80102620 0x7fcf800fc3a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 --2- 172.21.15.66:0/38294761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf800fac80 0x7fcf800fbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 >> 172.21.15.66:0/38294761 conn(0x7fcf80070ce0 msgr2=0x7fcf80105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.031+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 shutdown_connections 2024-09-12T01:51:17.035 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.032+0000 7fcf8862d640 1 -- 172.21.15.66:0/38294761 wait complete. 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.113+0000 7fe3648e1640 1 -- 172.21.15.66:0/4249634162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102ed0 msgr2=0x7fe3600fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.113+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4249634162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102ed0 0x7fe3600fc590 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3480048d0 tx=0x7fe348009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- 172.21.15.66:0/4249634162 shutdown_connections 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4249634162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102ed0 0x7fe3600fc590 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4249634162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe360102530 0x7fe360102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- 172.21.15.66:0/4249634162 >> 172.21.15.66:0/4249634162 conn(0x7fe3600f80f0 msgr2=0x7fe3600fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:17.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- 172.21.15.66:0/4249634162 shutdown_connections 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- 172.21.15.66:0/4249634162 wait complete. 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 Processor -- start 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- start start 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 0x7fe36006fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe360102ed0 0x7fe36006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360070490 con 0x7fe360102530 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.114+0000 7fe3648e1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360070600 con 0x7fe360102ed0 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 0x7fe36006fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 0x7fe36006fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33390/0 (socket says 172.21.15.66:33390) 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 -- 172.21.15.66:0/4127923276 learned_addr learned my addr 172.21.15.66:0/4127923276 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35dd9b640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe360102ed0 0x7fe36006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 -- 172.21.15.66:0/4127923276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe360102ed0 msgr2=0x7fe36006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe360102ed0 0x7fe36006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 -- 172.21.15.66:0/4127923276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348005040 con 0x7fe360102530 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe35e59c640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 0x7fe36006fa10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe35800ece0 tx=0x7fe35800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe35800ee40 con 0x7fe360102530 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe35800f040 con 0x7fe360102530 2024-09-12T01:51:17.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe358009580 con 0x7fe360102530 2024-09-12T01:51:17.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe360070890 con 0x7fe360102530 2024-09-12T01:51:17.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.115+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3601198f0 con 0x7fe360102530 2024-09-12T01:51:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.116+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3600fdcb0 con 0x7fe360102530 2024-09-12T01:51:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.117+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe35800ccc0 con 0x7fe360102530 2024-09-12T01:51:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.117+0000 7fe356ffd640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe34c06e0b0 0x7fe34c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.118+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fe35808e0c0 con 0x7fe360102530 2024-09-12T01:51:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.118+0000 7fe35dd9b640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe34c06e0b0 0x7fe34c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.120 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.118+0000 7fe35dd9b640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe34c06e0b0 0x7fe34c070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c00 tx=0x7fe348035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:17.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.122+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe35805aff0 con 0x7fe360102530 2024-09-12T01:51:17.315 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.315+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe360071100 con 0x7fe34c06e0b0 2024-09-12T01:51:17.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: pgmap v132: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3462628467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.316 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:17 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/38294761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.316+0000 7fe356ffd640 1 -- 172.21.15.66:0/4127923276 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe360071100 con 0x7fe34c06e0b0 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:51:17.317 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "11/21 daemons upgraded", 2024-09-12T01:51:17.318 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading osd daemons", 2024-09-12T01:51:17.318 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:51:17.318 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe34c06e0b0 msgr2=0x7fe34c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe34c06e0b0 0x7fe34c070560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c00 tx=0x7fe348035040 comp rx=0 tx=0).stop 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 msgr2=0x7fe36006fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 0x7fe36006fa10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe35800ece0 tx=0x7fe35800b040 comp rx=0 tx=0).stop 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 shutdown_connections 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe34c06e0b0 0x7fe34c070560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe360102ed0 0x7fe36006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 --2- 172.21.15.66:0/4127923276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe360102530 0x7fe36006fa10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.318+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 >> 172.21.15.66:0/4127923276 conn(0x7fe3600f80f0 msgr2=0x7fe3600f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.319+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 shutdown_connections 2024-09-12T01:51:17.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.319+0000 7fe3648e1640 1 -- 172.21.15.66:0/4127923276 wait complete. 2024-09-12T01:51:17.400 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.399+0000 7fb8260a1640 1 -- 172.21.15.66:0/3960810666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 msgr2=0x7fb8201065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.399+0000 7fb8260a1640 1 --2- 172.21.15.66:0/3960810666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8201065a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb8140048d0 tx=0x7fb814009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 -- 172.21.15.66:0/3960810666 shutdown_connections 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 --2- 172.21.15.66:0/3960810666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8201065a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 --2- 172.21.15.66:0/3960810666 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8200fd760 0x7fb8200fdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 -- 172.21.15.66:0/3960810666 >> 172.21.15.66:0/3960810666 conn(0x7fb8200f7030 msgr2=0x7fb8200f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 -- 172.21.15.66:0/3960810666 shutdown_connections 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 -- 172.21.15.66:0/3960810666 wait complete. 2024-09-12T01:51:17.401 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.400+0000 7fb8260a1640 1 Processor -- start 2024-09-12T01:51:17.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb8260a1640 1 -- start start 2024-09-12T01:51:17.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb8260a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8200fd760 0x7fb8200fb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb8260a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8200fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb8260a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200fbe70 con 0x7fb8200fe100 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb8260a1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200fbfe0 con 0x7fb8200fd760 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8200fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8200fb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:33420/0 (socket says 172.21.15.66:33420) 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 -- 172.21.15.66:0/2940313730 learned_addr learned my addr 172.21.15.66:0/2940313730 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81f7fe640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8200fd760 0x7fb8200fb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 -- 172.21.15.66:0/2940313730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8200fd760 msgr2=0x7fb8200fb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8200fd760 0x7fb8200fb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 -- 172.21.15.66:0/2940313730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814005040 con 0x7fb8200fe100 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.401+0000 7fb81effd640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8200fb930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb814000c00 tx=0x7fb814009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.402+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb814038070 con 0x7fb8200fe100 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.402+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8200fc210 con 0x7fb8200fe100 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.402+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8201199e0 con 0x7fb8200fe100 2024-09-12T01:51:17.403 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.402+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb8140096e0 con 0x7fb8200fe100 2024-09-12T01:51:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.402+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81402c880 con 0x7fb8200fe100 2024-09-12T01:51:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.403+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8200fac90 con 0x7fb8200fe100 2024-09-12T01:51:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.403+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fb814030020 con 0x7fb8200fe100 2024-09-12T01:51:17.404 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.404+0000 7fb807fff640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb80806e0b0 0x7fb808070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:17.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.404+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fb8140ae0c0 con 0x7fb8200fe100 2024-09-12T01:51:17.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.404+0000 7fb81f7fe640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb80806e0b0 0x7fb808070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:17.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.404+0000 7fb81f7fe640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb80806e0b0 0x7fb808070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb810004ed0 tx=0x7fb81000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:17.408 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.408+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb814077440 con 0x7fb8200fe100 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: pgmap v132: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3462628467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.497 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:17.498 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:17 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/38294761' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:17.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.651+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb8200fcae0 con 0x7fb8200fe100 2024-09-12T01:51:17.651 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.651+0000 7fb807fff640 1 -- 172.21.15.66:0/2940313730 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1050 (secure 0 0 0) 0x7fb81407ab00 con 0x7fb8200fe100 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: osd.4 (root=default,host=smithi153) is down 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-12T01:51:17.652 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-12T01:51:17.653 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb80806e0b0 msgr2=0x7fb808070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb80806e0b0 0x7fb808070560 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb810004ed0 tx=0x7fb81000b040 comp rx=0 tx=0).stop 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 msgr2=0x7fb8200fb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8200fb930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb814000c00 tx=0x7fb814009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 shutdown_connections 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fb80806e0b0 0x7fb808070560 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8200fe100 0x7fb8200fb930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 --2- 172.21.15.66:0/2940313730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb8200fd760 0x7fb8200fb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.653+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 >> 172.21.15.66:0/2940313730 conn(0x7fb8200f7030 msgr2=0x7fb8200f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.654+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 shutdown_connections 2024-09-12T01:51:17.654 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:17.654+0000 7fb8260a1640 1 -- 172.21.15.66:0/2940313730 wait complete. 2024-09-12T01:51:18.487 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:18 smithi153 ceph-mon[80899]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:18.488 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:18 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2940313730' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:51:18.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:18 smithi066 ceph-mon[110996]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:18.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:18 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2940313730' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:51:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:19 smithi066 ceph-mon[110996]: pgmap v133: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:19.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:19 smithi153 ceph-mon[80899]: pgmap v133: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:20.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:20.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:20.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:20.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:20 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:20.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 37/219 objects degraded (16.895%), 14 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:20.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:20 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:21.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:21 smithi066 ceph-mon[110996]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:21.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:21 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:21.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:21 smithi066 ceph-mon[110996]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-12T01:51:21.654 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:21 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:51:21.324+0000 7fba8a5f6640 -1 osd.4 67 log_to_monitors true 2024-09-12T01:51:21.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:21 smithi153 ceph-mon[80899]: pgmap v134: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:21.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:21 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:21.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:21 smithi153 ceph-mon[80899]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-12T01:51:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:22 smithi153 ceph-mon[80899]: from='osd.4 [v2:172.21.15.153:6808/2772399654,v1:172.21.15.153:6809/2772399654]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:22 smithi153 ceph-mon[80899]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:22 smithi066 ceph-mon[110996]: from='osd.4 [v2:172.21.15.153:6808/2772399654,v1:172.21.15.153:6809/2772399654]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:22 smithi066 ceph-mon[110996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-12T01:51:23.404 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:51:23.096+0000 7fba7e388640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:51:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-mon[80899]: pgmap v135: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-mon[80899]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:51:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-mon[80899]: osdmap e70: 6 total, 5 up, 6 in 2024-09-12T01:51:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-mon[80899]: from='osd.4 [v2:172.21.15.153:6808/2772399654,v1:172.21.15.153:6809/2772399654]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-mon[80899]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:23 smithi153 ceph-mon[80899]: from='osd.4 ' entity='osd.4' 2024-09-12T01:51:23.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:23 smithi066 ceph-mon[110996]: pgmap v135: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:23.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:23 smithi066 ceph-mon[110996]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-12T01:51:23.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:23 smithi066 ceph-mon[110996]: osdmap e70: 6 total, 5 up, 6 in 2024-09-12T01:51:23.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:23 smithi066 ceph-mon[110996]: from='osd.4 [v2:172.21.15.153:6808/2772399654,v1:172.21.15.153:6809/2772399654]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:23.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:23 smithi066 ceph-mon[110996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:23.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:23 smithi066 ceph-mon[110996]: from='osd.4 ' entity='osd.4' 2024-09-12T01:51:24.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:24 smithi066 ceph-mon[110996]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:51:24.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:24 smithi066 ceph-mon[110996]: osd.4 [v2:172.21.15.153:6808/2772399654,v1:172.21.15.153:6809/2772399654] boot 2024-09-12T01:51:24.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:24 smithi066 ceph-mon[110996]: osdmap e71: 6 total, 6 up, 6 in 2024-09-12T01:51:24.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:24 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:24.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:24 smithi153 ceph-mon[80899]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:51:24.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:24 smithi153 ceph-mon[80899]: osd.4 [v2:172.21.15.153:6808/2772399654,v1:172.21.15.153:6809/2772399654] boot 2024-09-12T01:51:24.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:24 smithi153 ceph-mon[80899]: osdmap e71: 6 total, 6 up, 6 in 2024-09-12T01:51:24.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:24 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-12T01:51:25.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:25 smithi066 ceph-mon[110996]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:25.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:25 smithi066 ceph-mon[110996]: osdmap e72: 6 total, 6 up, 6 in 2024-09-12T01:51:25.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:25 smithi153 ceph-mon[80899]: pgmap v137: 65 pgs: 20 active+undersized, 14 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 37/219 objects degraded (16.895%) 2024-09-12T01:51:25.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:25 smithi153 ceph-mon[80899]: osdmap e72: 6 total, 6 up, 6 in 2024-09-12T01:51:26.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:26 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:26.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:26 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:27 smithi066 ceph-mon[110996]: pgmap v140: 65 pgs: 24 peering, 7 active+undersized, 3 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:51:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:27.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:27 smithi153 ceph-mon[80899]: pgmap v140: 65 pgs: 24 peering, 7 active+undersized, 3 active+undersized+degraded, 31 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:51:27.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:27.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:28.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:28 smithi066 ceph-mon[110996]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded) 2024-09-12T01:51:28.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:28 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:51:28.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:28 smithi153 ceph-mon[80899]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded) 2024-09-12T01:51:28.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:28 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:51:29.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:29 smithi066 ceph-mon[110996]: pgmap v141: 65 pgs: 24 peering, 41 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:29.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:29 smithi153 ceph-mon[80899]: pgmap v141: 65 pgs: 24 peering, 41 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:31 smithi066 ceph-mon[110996]: pgmap v142: 65 pgs: 24 peering, 41 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:31.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:31 smithi153 ceph-mon[80899]: pgmap v142: 65 pgs: 24 peering, 41 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:33.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:33 smithi066 ceph-mon[110996]: pgmap v143: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:33.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:33 smithi153 ceph-mon[80899]: pgmap v143: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:35.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:35 smithi066 ceph-mon[110996]: pgmap v144: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:35.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:35 smithi153 ceph-mon[80899]: pgmap v144: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:35.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:36.495 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:36 smithi153 ceph-mon[80899]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:36.496 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:36 smithi153 ceph-mon[80899]: Upgrade: osd.5 is safe to restart 2024-09-12T01:51:36.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:36 smithi066 ceph-mon[110996]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-12T01:51:36.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:36 smithi066 ceph-mon[110996]: Upgrade: osd.5 is safe to restart 2024-09-12T01:51:37.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:37 smithi066 ceph-mon[110996]: pgmap v145: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:37.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:37 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:37.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:37 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:37.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:37 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:51:37.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:37 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:37.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:37 smithi153 ceph-mon[80899]: pgmap v145: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:37.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:37 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:37.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:37 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:37.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:37 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-12T01:51:37.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:37 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:38.455 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:38 smithi153 ceph-mon[80899]: Upgrade: Updating osd.5 2024-09-12T01:51:38.456 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:38 smithi153 ceph-mon[80899]: Deploying daemon osd.5 on smithi153 2024-09-12T01:51:38.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:38 smithi066 ceph-mon[110996]: Upgrade: Updating osd.5 2024-09-12T01:51:38.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:38 smithi066 ceph-mon[110996]: Deploying daemon osd.5 on smithi153 2024-09-12T01:51:39.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:39 smithi153 ceph-mon[80899]: pgmap v146: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:39.655 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:39 smithi153 systemd[1]: Stopping Ceph osd.5 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:51:39.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:39 smithi066 ceph-mon[110996]: pgmap v146: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:40.154 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[53245]: 2024-09-12T01:51:39.688+0000 7feacb759640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:51:40.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[53245]: 2024-09-12T01:51:39.688+0000 7feacb759640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-12T01:51:40.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[53245]: 2024-09-12T01:51:39.688+0000 7feacb759640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:51:40.640 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:40 smithi153 ceph-mon[80899]: pgmap v147: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:40.640 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:40 smithi153 ceph-mon[80899]: osd.5 marked itself down and dead 2024-09-12T01:51:40.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:40 smithi066 ceph-mon[110996]: pgmap v147: 65 pgs: 65 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:40.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:40 smithi066 ceph-mon[110996]: osd.5 marked itself down and dead 2024-09-12T01:51:40.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:40 smithi153 podman[99991]: 2024-09-12 01:51:40.788228837 +0000 UTC m=+1.198885505 container died 733be44696b388910a664f486c20a4f1ef88d9d2b9976e2e889d4504b02a8a3e (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=quincy-554ba93, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-12T01:51:41.400 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:41 smithi153 podman[99991]: 2024-09-12 01:51:41.155455311 +0000 UTC m=+1.566111979 container cleanup 733be44696b388910a664f486c20a4f1ef88d9d2b9976e2e889d4504b02a8a3e (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-554ba93, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-12T01:51:41.400 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:41 smithi153 bash[99991]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5 2024-09-12T01:51:41.400 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:41 smithi153 ceph-mon[80899]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:51:41.401 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:41 smithi153 ceph-mon[80899]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-12T01:51:41.401 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:41 smithi153 ceph-mon[80899]: osdmap e73: 6 total, 5 up, 6 in 2024-09-12T01:51:41.654 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:41 smithi153 podman[100016]: 2024-09-12 01:51:41.415117688 +0000 UTC m=+0.628210848 container remove 733be44696b388910a664f486c20a4f1ef88d9d2b9976e2e889d4504b02a8a3e (image=quay.ceph.io/ceph-ci/ceph@sha256:1d6b991a5d53c65a63d37f1edf5a9814ccf53360f688add723a7066b667f96e1, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=quincy-554ba93, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:51:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:41 smithi066 ceph-mon[110996]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-12T01:51:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:41 smithi066 ceph-mon[110996]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-12T01:51:41.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:41 smithi066 ceph-mon[110996]: osdmap e73: 6 total, 5 up, 6 in 2024-09-12T01:51:42.084 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:41 smithi153 podman[100103]: 2024-09-12 01:51:41.676204318 +0000 UTC m=+0.016089523 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:51:42.085 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:41 smithi153 podman[100103]: 2024-09-12 01:51:41.78264562 +0000 UTC m=+0.122530860 container create 6e8698899e2a69007f199f061dd4d43900448691b094c6d33ee12ef6baaa50b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:42.085 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 podman[100103]: 2024-09-12 01:51:42.001658038 +0000 UTC m=+0.341543232 container init 6e8698899e2a69007f199f061dd4d43900448691b094c6d33ee12ef6baaa50b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:42.085 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 podman[100103]: 2024-09-12 01:51:42.004866367 +0000 UTC m=+0.344751562 container start 6e8698899e2a69007f199f061dd4d43900448691b094c6d33ee12ef6baaa50b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:51:42.405 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 podman[100103]: 2024-09-12 01:51:42.084743803 +0000 UTC m=+0.424629006 container attach 6e8698899e2a69007f199f061dd4d43900448691b094c6d33ee12ef6baaa50b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T01:51:42.405 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 podman[100103]: 2024-09-12 01:51:42.195924455 +0000 UTC m=+0.535809663 container died 6e8698899e2a69007f199f061dd4d43900448691b094c6d33ee12ef6baaa50b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: osdmap e74: 6 total, 5 up, 6 in 2024-09-12T01:51:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 5]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5, 0, 1]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 2]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]: dispatch 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: pgmap v150: 65 pgs: 13 stale+active+clean, 52 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:42.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:42.771 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: osdmap e74: 6 total, 5 up, 6 in 2024-09-12T01:51:42.771 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]}]: dispatch 2024-09-12T01:51:42.771 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 5]}]: dispatch 2024-09-12T01:51:42.771 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5, 0, 1]}]: dispatch 2024-09-12T01:51:42.771 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]: dispatch 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 2]}]: dispatch 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]: dispatch 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]: dispatch 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]: dispatch 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]: dispatch 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: pgmap v150: 65 pgs: 13 stale+active+clean, 52 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:42.772 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:43.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 podman[100127]: 2024-09-12 01:51:42.771451419 +0000 UTC m=+0.565757102 container remove 6e8698899e2a69007f199f061dd4d43900448691b094c6d33ee12ef6baaa50b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T01:51:43.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-12T01:51:43.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 systemd[1]: Stopped Ceph osd.5 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:51:43.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:42 smithi153 systemd[1]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.5.service: Consumed 59.176s CPU time. 2024-09-12T01:51:43.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 systemd[1]: Starting Ceph osd.5 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:51:43.516 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]}]': finished 2024-09-12T01:51:43.516 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 5]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5, 0, 1]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 2]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]': finished 2024-09-12T01:51:43.517 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-mon[80899]: osdmap e75: 6 total, 5 up, 6 in 2024-09-12T01:51:43.517 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 podman[100226]: 2024-09-12 01:51:43.116802299 +0000 UTC m=+0.015748432 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:51:43.517 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 podman[100226]: 2024-09-12 01:51:43.239804285 +0000 UTC m=+0.138750418 container create 367a75a8c36d3529ba49e7c3165677b6e6941246e99e3ac8d1520323cc1d5980 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-12T01:51:43.517 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 podman[100226]: 2024-09-12 01:51:43.43374385 +0000 UTC m=+0.332689982 container init 367a75a8c36d3529ba49e7c3165677b6e6941246e99e3ac8d1520323cc1d5980 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:51:43.518 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 podman[100226]: 2024-09-12 01:51:43.437187201 +0000 UTC m=+0.336133339 container start 367a75a8c36d3529ba49e7c3165677b6e6941246e99e3ac8d1520323cc1d5980 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-12T01:51:43.518 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 podman[100226]: 2024-09-12 01:51:43.516932239 +0000 UTC m=+0.415878385 container attach 367a75a8c36d3529ba49e7c3165677b6e6941246e99e3ac8d1520323cc1d5980 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-12T01:51:43.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [0, 2]}]': finished 2024-09-12T01:51:43.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 5]}]': finished 2024-09-12T01:51:43.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [3, 5, 0, 1]}]': finished 2024-09-12T01:51:43.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [0, 2]}]': finished 2024-09-12T01:51:43.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [3, 2]}]': finished 2024-09-12T01:51:43.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 0]}]': finished 2024-09-12T01:51:43.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [1, 0]}]': finished 2024-09-12T01:51:43.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.15", "id": [3, 5]}]': finished 2024-09-12T01:51:43.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [4, 5]}]': finished 2024-09-12T01:51:43.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:43 smithi066 ceph-mon[110996]: osdmap e75: 6 total, 5 up, 6 in 2024-09-12T01:51:43.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:43.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 bash[100226]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:43.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:43.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:43 smithi153 bash[100226]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-12T01:51:44.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-mon[80899]: osdmap e76: 6 total, 5 up, 6 in 2024-09-12T01:51:44.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-mon[80899]: pgmap v153: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:51:44.585 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-mon[80899]: osdmap e77: 6 total, 5 up, 6 in 2024-09-12T01:51:44.585 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T01:51:44.585 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T01:51:44.586 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-12T01:51:44.586 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-12T01:51:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:44 smithi066 ceph-mon[110996]: osdmap e76: 6 total, 5 up, 6 in 2024-09-12T01:51:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:44 smithi066 ceph-mon[110996]: pgmap v153: 65 pgs: 4 active+undersized, 9 stale+active+clean, 3 active+undersized+degraded, 49 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6/219 objects degraded (2.740%) 2024-09-12T01:51:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:44 smithi066 ceph-mon[110996]: osdmap e77: 6 total, 5 up, 6 in 2024-09-12T01:51:44.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-12T01:51:44.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate[100241]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 bash[100226]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-12T01:51:44.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:44 smithi153 podman[100226]: 2024-09-12 01:51:44.619880373 +0000 UTC m=+1.518826514 container died 367a75a8c36d3529ba49e7c3165677b6e6941246e99e3ac8d1520323cc1d5980 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-12T01:51:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:45 smithi153 ceph-mon[80899]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:45.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:45 smithi153 ceph-mon[80899]: osdmap e78: 6 total, 5 up, 6 in 2024-09-12T01:51:45.655 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 podman[100370]: 2024-09-12 01:51:45.337641049 +0000 UTC m=+0.710942546 container remove 367a75a8c36d3529ba49e7c3165677b6e6941246e99e3ac8d1520323cc1d5980 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-12T01:51:45.655 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 podman[100428]: 2024-09-12 01:51:45.454548031 +0000 UTC m=+0.017225238 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:51:45.656 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 podman[100428]: 2024-09-12 01:51:45.572202355 +0000 UTC m=+0.134879548 container create 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:51:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:45 smithi066 ceph-mon[110996]: Health check failed: Degraded data redundancy: 6/219 objects degraded (2.740%), 3 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:45.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:45 smithi066 ceph-mon[110996]: osdmap e78: 6 total, 5 up, 6 in 2024-09-12T01:51:46.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 podman[100428]: 2024-09-12 01:51:45.833006212 +0000 UTC m=+0.395683408 container init 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:51:46.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 podman[100428]: 2024-09-12 01:51:45.836184396 +0000 UTC m=+0.398861589 container start 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T01:51:46.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 ceph-osd[100447]: -- 172.21.15.153:0/335296523 <== mon.1 v2:172.21.15.153:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fce20f41e0 con 0x55fce1309c00 2024-09-12T01:51:46.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 bash[100428]: 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b 2024-09-12T01:51:46.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:45 smithi153 systemd[1]: Started Ceph osd.5 for f9344df4-70a6-11ef-bcea-c7b262605968. 2024-09-12T01:51:47.230 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:46 smithi153 ceph-mon[80899]: pgmap v156: 65 pgs: 1 remapped+peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+undersized+remapped, 3 active+clean+remapped, 1 active+recovering+undersized+degraded+remapped, 15 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 59/219 objects degraded (26.941%); 733/219 objects misplaced (334.703%); 2.0 MiB/s, 13 objects/s recovering 2024-09-12T01:51:47.230 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:46 smithi153 ceph-mon[80899]: osdmap e79: 6 total, 5 up, 6 in 2024-09-12T01:51:47.230 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:46 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:47.230 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:46 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:47.230 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:46 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:46 smithi066 ceph-mon[110996]: pgmap v156: 65 pgs: 1 remapped+peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+undersized+remapped, 3 active+clean+remapped, 1 active+recovering+undersized+degraded+remapped, 15 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 59/219 objects degraded (26.941%); 733/219 objects misplaced (334.703%); 2.0 MiB/s, 13 objects/s recovering 2024-09-12T01:51:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:46 smithi066 ceph-mon[110996]: osdmap e79: 6 total, 5 up, 6 in 2024-09-12T01:51:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:46 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:47.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:46 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:47.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:46 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 -- 172.21.15.66:0/3640601112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fb810 msgr2=0x7f59300fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 --2- 172.21.15.66:0/3640601112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fb810 0x7f59300fbbe0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f59200048d0 tx=0x7f5920009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 -- 172.21.15.66:0/3640601112 shutdown_connections 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 --2- 172.21.15.66:0/3640601112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fcf80 0x7f59300fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 --2- 172.21.15.66:0/3640601112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fb810 0x7f59300fbbe0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 -- 172.21.15.66:0/3640601112 >> 172.21.15.66:0/3640601112 conn(0x7f59300723b0 msgr2=0x7f59300727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 -- 172.21.15.66:0/3640601112 shutdown_connections 2024-09-12T01:51:47.749 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.748+0000 7f59363dc640 1 -- 172.21.15.66:0/3640601112 wait complete. 2024-09-12T01:51:47.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f59363dc640 1 Processor -- start 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f59363dc640 1 -- start start 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f59363dc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fb810 0x7f593010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f59363dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 0x7f593010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f59363dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593010ca00 con 0x7f59300fcf80 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f59363dc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593010cb40 con 0x7f59300fb810 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 0x7f593010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:47.751 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f592ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fb810 0x7f593010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f592f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 0x7f593010c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59072/0 (socket says 172.21.15.66:59072) 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f592ffff640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fb810 0x7f593010bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:36916/0 (socket says 172.21.15.66:36916) 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.749+0000 7f592f7fe640 1 -- 172.21.15.66:0/272024114 learned_addr learned my addr 172.21.15.66:0/272024114 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592f7fe640 1 -- 172.21.15.66:0/272024114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fb810 msgr2=0x7f593010bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592f7fe640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fb810 0x7f593010bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592f7fe640 1 -- 172.21.15.66:0/272024114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920005040 con 0x7f59300fcf80 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592f7fe640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 0x7f593010c4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5924002a50 tx=0x7f5924004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5924007c30 con 0x7f59300fcf80 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f592400f040 con 0x7f59300fcf80 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59301195f0 con 0x7f59300fcf80 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f592400da10 con 0x7f59300fcf80 2024-09-12T01:51:47.752 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.750+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59301199a0 con 0x7f59300fcf80 2024-09-12T01:51:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.751+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59300fcbc0 con 0x7f59300fcf80 2024-09-12T01:51:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.752+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f592400dc80 con 0x7f59300fcf80 2024-09-12T01:51:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.752+0000 7f592cff9640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f591806e0b0 0x7f5918070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.753+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6943+0+0 (secure 0 0 0) 0x7f592408d490 con 0x7f59300fcf80 2024-09-12T01:51:47.753 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.753+0000 7f592ffff640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f591806e0b0 0x7f5918070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:47.754 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.753+0000 7f592ffff640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f591806e0b0 0x7f5918070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5920009ac0 tx=0x7f5920035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:47.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.757+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f59240566b0 con 0x7f59300fcf80 2024-09-12T01:51:47.964 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.964+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f593004b720 con 0x7f591806e0b0 2024-09-12T01:51:47.965 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.965+0000 7f592cff9640 1 -- 172.21.15.66:0/272024114 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f593004b720 con 0x7f591806e0b0 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f591806e0b0 msgr2=0x7f5918070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f591806e0b0 0x7f5918070560 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5920009ac0 tx=0x7f5920035040 comp rx=0 tx=0).stop 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 msgr2=0x7f593010c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 0x7f593010c4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5924002a50 tx=0x7f5924004600 comp rx=0 tx=0).stop 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 shutdown_connections 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f591806e0b0 0x7f5918070560 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59300fcf80 0x7f593010c4c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 --2- 172.21.15.66:0/272024114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59300fb810 0x7f593010bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.967+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 >> 172.21.15.66:0/272024114 conn(0x7f59300723b0 msgr2=0x7f59300fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.968+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 shutdown_connections 2024-09-12T01:51:47.968 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:47.968+0000 7f59363dc640 1 -- 172.21.15.66:0/272024114 wait complete. 2024-09-12T01:51:47.976 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:51:48.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 -- 172.21.15.66:0/306472239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102f20 msgr2=0x7fd59c0fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.049 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/306472239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102f20 0x7fd59c0fc5e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0048d0 tx=0x7fd58c009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.050 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:47 smithi066 ceph-mon[110996]: osdmap e80: 6 total, 5 up, 6 in 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 -- 172.21.15.66:0/306472239 shutdown_connections 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/306472239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102f20 0x7fd59c0fc5e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/306472239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c102580 0x7fd59c102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 -- 172.21.15.66:0/306472239 >> 172.21.15.66:0/306472239 conn(0x7fd59c0f81a0 msgr2=0x7fd59c0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 -- 172.21.15.66:0/306472239 shutdown_connections 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.049+0000 7fd5a2a78640 1 -- 172.21.15.66:0/306472239 wait complete. 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a2a78640 1 Processor -- start 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a2a78640 1 -- start start 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a2a78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 0x7fd59c06fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a2a78640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c102f20 0x7fd59c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a2a78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c070490 con 0x7fd59c102580 2024-09-12T01:51:48.052 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a2a78640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c070600 con 0x7fd59c102f20 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a0814640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 0x7fd59c06fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a0814640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 0x7fd59c06fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59094/0 (socket says 172.21.15.66:59094) 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.050+0000 7fd5a0814640 1 -- 172.21.15.66:0/2299008041 learned_addr learned my addr 172.21.15.66:0/2299008041 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd59bfff640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c102f20 0x7fd59c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5a0814640 1 -- 172.21.15.66:0/2299008041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c102f20 msgr2=0x7fd59c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5a0814640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c102f20 0x7fd59c06ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5a0814640 1 -- 172.21.15.66:0/2299008041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c005040 con 0x7fd59c102580 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5a0814640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 0x7fd59c06fa10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c790 tx=0x7fd5840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd58400a7a0 con 0x7fd59c102580 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd58400ada0 con 0x7fd59c102580 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c070890 con 0x7fd59c102580 2024-09-12T01:51:48.053 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5840113a0 con 0x7fd59c102580 2024-09-12T01:51:48.054 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.051+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c119920 con 0x7fd59c102580 2024-09-12T01:51:48.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.052+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c0fdd00 con 0x7fd59c102580 2024-09-12T01:51:48.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.053+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd58400a900 con 0x7fd59c102580 2024-09-12T01:51:48.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.053+0000 7fd5997fa640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd58806e0b0 0x7fd588070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.054+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6943+0+0 (secure 0 0 0) 0x7fd58408de60 con 0x7fd59c102580 2024-09-12T01:51:48.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.054+0000 7fd59bfff640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd58806e0b0 0x7fd588070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.055 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.054+0000 7fd59bfff640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd58806e0b0 0x7fd588070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0048a0 tx=0x7fd58c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.058 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.058+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd584057050 con 0x7fd59c102580 2024-09-12T01:51:48.140 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:47 smithi153 ceph-mon[80899]: osdmap e80: 6 total, 5 up, 6 in 2024-09-12T01:51:48.141 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:47 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:51:47.731+0000 7f21d6b06640 -1 Falling back to public interface 2024-09-12T01:51:48.252 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.252+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd59c071100 con 0x7fd58806e0b0 2024-09-12T01:51:48.253 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.253+0000 7fd5997fa640 1 -- 172.21.15.66:0/2299008041 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd59c071100 con 0x7fd58806e0b0 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.255+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd58806e0b0 msgr2=0x7fd588070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.255+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd58806e0b0 0x7fd588070560 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0048a0 tx=0x7fd58c035040 comp rx=0 tx=0).stop 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.255+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 msgr2=0x7fd59c06fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.255+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 0x7fd59c06fa10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c790 tx=0x7fd5840043c0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 shutdown_connections 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd58806e0b0 0x7fd588070560 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd59c102f20 0x7fd59c06ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 --2- 172.21.15.66:0/2299008041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd59c102580 0x7fd59c06fa10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 >> 172.21.15.66:0/2299008041 conn(0x7fd59c0f81a0 msgr2=0x7fd59c0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.256 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 shutdown_connections 2024-09-12T01:51:48.257 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.256+0000 7fd5a2a78640 1 -- 172.21.15.66:0/2299008041 wait complete. 2024-09-12T01:51:48.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.337+0000 7f90ceffa640 1 -- 172.21.15.66:0/1212999603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 msgr2=0x7f90c8102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.337+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1212999603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c8102950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f90b00048d0 tx=0x7f90b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.338 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 -- 172.21.15.66:0/1212999603 shutdown_connections 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1212999603 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90c8102f20 0x7f90c80fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1212999603 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c8102950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 -- 172.21.15.66:0/1212999603 >> 172.21.15.66:0/1212999603 conn(0x7f90c80f81a0 msgr2=0x7f90c80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 -- 172.21.15.66:0/1212999603 shutdown_connections 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 -- 172.21.15.66:0/1212999603 wait complete. 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 Processor -- start 2024-09-12T01:51:48.339 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.338+0000 7f90ceffa640 1 -- start start 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ceffa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ceffa640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90c8102f20 0x7f90c806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ceffa640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8070490 con 0x7f90c8102580 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ceffa640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8070600 con 0x7f90c8102f20 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c806fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59120/0 (socket says 172.21.15.66:59120) 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 -- 172.21.15.66:0/1198349864 learned_addr learned my addr 172.21.15.66:0/1198349864 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90c7fff640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90c8102f20 0x7f90c806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.341 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 -- 172.21.15.66:0/1198349864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90c8102f20 msgr2=0x7f90c806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90c8102f20 0x7f90c806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 -- 172.21.15.66:0/1198349864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0005040 con 0x7f90c8102580 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.339+0000 7f90ccd96640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c806fa10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90b00043d0 tx=0x7f90b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.340+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b0038070 con 0x7f90c8102580 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.340+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c8070830 con 0x7f90c8102580 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.340+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90b00096e0 con 0x7f90c8102580 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.340+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b003d420 con 0x7f90c8102580 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.340+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c8119870 con 0x7f90c8102580 2024-09-12T01:51:48.342 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.341+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c80fdd00 con 0x7f90c8102580 2024-09-12T01:51:48.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.341+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f90b0030020 con 0x7f90c8102580 2024-09-12T01:51:48.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.342+0000 7f90c57fa640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90b406e0b0 0x7f90b4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.342+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6943+0+0 (secure 0 0 0) 0x7f90b00ae220 con 0x7f90c8102580 2024-09-12T01:51:48.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.342+0000 7f90c7fff640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90b406e0b0 0x7f90b4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.343 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.342+0000 7f90c7fff640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90b406e0b0 0x7f90b4070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90c8071350 tx=0x7f90b8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.346 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.346+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90b0077390 con 0x7f90c8102580 2024-09-12T01:51:48.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.531+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f90c8071100 con 0x7f90b406e0b0 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.540+0000 7f90c57fa640 1 -- 172.21.15.66:0/1198349864 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f90c8071100 con 0x7f90b406e0b0 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (5m) 97s ago 16m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (3m) 97s ago 16m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (3m) 32s ago 15m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (5m) 97s ago 16m 82.6M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:51:48.540 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (11m) 97s ago 11m 14.7M - 17.2.7-1609-g554ba93e d4c538e492e4 bfb0a31d6f38 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (10m) 97s ago 10m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (10m) 32s ago 10m 17.9M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (11m) 32s ago 11m 16.8M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (7m) 97s ago 17m 499M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (6m) 32s ago 15m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (4m) 97s ago 17m 48.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (3m) 32s ago 15m 37.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (6m) 97s ago 16m 16.9M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (6m) 32s ago 15m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (2m) 97s ago 14m 101M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (2m) 97s ago 14m 98.8M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (102s) 97s ago 13m 12.1M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:51:48.541 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (68s) 32s ago 13m 109M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:51:48.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (35s) 32s ago 12m 12.1M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 6b77ec5616ac 2024-09-12T01:51:48.542 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 starting - - - 2581M 2024-09-12T01:51:48.542 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (6m) 97s ago 15m 62.5M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:51:48.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90b406e0b0 msgr2=0x7f90b4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.542 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90b406e0b0 0x7f90b4070560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90c8071350 tx=0x7f90b8009040 comp rx=0 tx=0).stop 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 msgr2=0x7f90c806fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c806fa10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90b00043d0 tx=0x7f90b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 shutdown_connections 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90b406e0b0 0x7f90b4070560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90c8102f20 0x7f90c806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 --2- 172.21.15.66:0/1198349864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90c8102580 0x7f90c806fa10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 >> 172.21.15.66:0/1198349864 conn(0x7f90c80f81a0 msgr2=0x7f90c80f9210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 shutdown_connections 2024-09-12T01:51:48.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.542+0000 7f90ceffa640 1 -- 172.21.15.66:0/1198349864 wait complete. 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 -- 172.21.15.66:0/2186214791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 msgr2=0x7ff860101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 --2- 172.21.15.66:0/2186214791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff860101880 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff8500048d0 tx=0x7ff850009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 -- 172.21.15.66:0/2186214791 shutdown_connections 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 --2- 172.21.15.66:0/2186214791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8600fb470 0x7ff8600fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 --2- 172.21.15.66:0/2186214791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff860101880 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 -- 172.21.15.66:0/2186214791 >> 172.21.15.66:0/2186214791 conn(0x7ff8600f7030 msgr2=0x7ff8600f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 -- 172.21.15.66:0/2186214791 shutdown_connections 2024-09-12T01:51:48.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.629+0000 7ff865322640 1 -- 172.21.15.66:0/2186214791 wait complete. 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.630+0000 7ff865322640 1 Processor -- start 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.630+0000 7ff865322640 1 -- start start 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.630+0000 7ff865322640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8600fb470 0x7ff8601120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.630+0000 7ff865322640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff8601125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff865322640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860112be0 con 0x7ff8601014b0 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff865322640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86010c020 con 0x7ff8600fb470 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff8601125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff8601125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59138/0 (socket says 172.21.15.66:59138) 2024-09-12T01:51:48.632 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 -- 172.21.15.66:0/2736508911 learned_addr learned my addr 172.21.15.66:0/2736508911 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85effd640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8600fb470 0x7ff8601120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 -- 172.21.15.66:0/2736508911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8600fb470 msgr2=0x7ff8601120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8600fb470 0x7ff8601120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 -- 172.21.15.66:0/2736508911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850005040 con 0x7ff8601014b0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.631+0000 7ff85e7fc640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff8601125e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff85400eb70 tx=0x7ff85400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.632+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff854007c30 con 0x7ff8601014b0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.632+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff85400f040 con 0x7ff8601014b0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.632+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff854009550 con 0x7ff8601014b0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.632+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86010c2a0 con 0x7ff8601014b0 2024-09-12T01:51:48.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.632+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86010c840 con 0x7ff8601014b0 2024-09-12T01:51:48.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.633+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8600fcbb0 con 0x7ff8601014b0 2024-09-12T01:51:48.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.634+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff8540097c0 con 0x7ff8601014b0 2024-09-12T01:51:48.634 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.634+0000 7ff8477fe640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff84806e0b0 0x7ff848070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.634+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6943+0+0 (secure 0 0 0) 0x7ff85408da40 con 0x7ff8601014b0 2024-09-12T01:51:48.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.634+0000 7ff85effd640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff84806e0b0 0x7ff848070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.635 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.635+0000 7ff85effd640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff84806e0b0 0x7ff848070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff850004540 tx=0x7ff850037040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.640 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.639+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff854056c60 con 0x7ff8601014b0 2024-09-12T01:51:48.890 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.890+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff860108430 con 0x7ff8601014b0 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.891+0000 7ff8477fe640 1 -- 172.21.15.66:0/2736508911 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7ff85405a320 con 0x7ff8601014b0 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:51:48.891 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 5 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 4, 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 9 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:51:48.892 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:51:48.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff84806e0b0 msgr2=0x7ff848070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.893 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff84806e0b0 0x7ff848070560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff850004540 tx=0x7ff850037040 comp rx=0 tx=0).stop 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 msgr2=0x7ff8601125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff8601125e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff85400eb70 tx=0x7ff85400b040 comp rx=0 tx=0).stop 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 shutdown_connections 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff84806e0b0 0x7ff848070560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8601014b0 0x7ff8601125e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 --2- 172.21.15.66:0/2736508911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8600fb470 0x7ff8601120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 >> 172.21.15.66:0/2736508911 conn(0x7ff8600f7030 msgr2=0x7ff8600f88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 shutdown_connections 2024-09-12T01:51:48.894 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.893+0000 7ff865322640 1 -- 172.21.15.66:0/2736508911 wait complete. 2024-09-12T01:51:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 -- 172.21.15.66:0/2674490593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 msgr2=0x7f82200fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 --2- 172.21.15.66:0/2674490593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f82200fe820 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f82100048d0 tx=0x7f8210009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 -- 172.21.15.66:0/2674490593 shutdown_connections 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 --2- 172.21.15.66:0/2674490593 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220064fe0 0x7f8220065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 --2- 172.21.15.66:0/2674490593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f82200fe820 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 -- 172.21.15.66:0/2674490593 >> 172.21.15.66:0/2674490593 conn(0x7f82200723b0 msgr2=0x7f82200727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 -- 172.21.15.66:0/2674490593 shutdown_connections 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.975+0000 7f8225357640 1 -- 172.21.15.66:0/2674490593 wait complete. 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f8225357640 1 Processor -- start 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f8225357640 1 -- start start 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f8225357640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220064fe0 0x7f8220113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.979 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f8225357640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f8220113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f8225357640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8220113d50 con 0x7f82200fe450 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f8225357640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822010d190 con 0x7f8220064fe0 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f821e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f8220113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f821e7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f8220113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59156/0 (socket says 172.21.15.66:59156) 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f821e7fc640 1 -- 172.21.15.66:0/2984512378 learned_addr learned my addr 172.21.15.66:0/2984512378 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.976+0000 7f821effd640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220064fe0 0x7f8220113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f821e7fc640 1 -- 172.21.15.66:0/2984512378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220064fe0 msgr2=0x7f8220113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f821e7fc640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220064fe0 0x7f8220113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f821e7fc640 1 -- 172.21.15.66:0/2984512378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8210005040 con 0x7f82200fe450 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f821e7fc640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f8220113750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8214002a50 tx=0x7f8214004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8214007c30 con 0x7f82200fe450 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822010d470 con 0x7f82200fe450 2024-09-12T01:51:48.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.977+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f821400f040 con 0x7f82200fe450 2024-09-12T01:51:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.978+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f821400da10 con 0x7f82200fe450 2024-09-12T01:51:48.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.978+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822010d990 con 0x7f82200fe450 2024-09-12T01:51:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.979+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f821400dc50 con 0x7f82200fe450 2024-09-12T01:51:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.979+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82200fdce0 con 0x7f82200fe450 2024-09-12T01:51:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.979+0000 7f82077fe640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f820806dea0 0x7f8208070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.979+0000 7f821effd640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f820806dea0 0x7f8208070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.979+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6943+0+0 (secure 0 0 0) 0x7f821408d3f0 con 0x7f82200fe450 2024-09-12T01:51:48.983 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.980+0000 7f821effd640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f820806dea0 0x7f8208070350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8210009ac0 tx=0x7f8210035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:48.984 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:48.984+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8214092060 con 0x7f82200fe450 2024-09-12T01:51:49.201 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.200+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f822010e880 con 0x7f82200fe450 2024-09-12T01:51:49.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: pgmap v159: 65 pgs: 1 remapped+peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+undersized+remapped, 4 active+clean+remapped, 1 active+recovering+undersized+degraded+remapped, 14 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 59/219 objects degraded (26.941%); 733/219 objects misplaced (334.703%); 2.0 MiB/s, 184 objects/s recovering 2024-09-12T01:51:49.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: osdmap e81: 6 total, 5 up, 6 in 2024-09-12T01:51:49.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:49.201 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:49.202 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:49.202 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:49.202 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:48 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2736508911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:49.202 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.201+0000 7f82077fe640 1 -- 172.21.15.66:0/2984512378 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1914 (secure 0 0 0) 0x7f8214017070 con 0x7f82200fe450 2024-09-12T01:51:49.202 INFO:teuthology.orchestra.run.smithi066.stdout:e16 2024-09-12T01:51:49.202 INFO:teuthology.orchestra.run.smithi066.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-12T01:51:49.202 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:51:49.202 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 16 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:40:59.057757+0000 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:51:49.203 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 44 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=14462} 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:51:49.204 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{0:14462} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.66:6828/299983733,v1:172.21.15.66:6829/299983733] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:14478} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/2183385729,v1:172.21.15.66:6827/2183385729] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:24277} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:49.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 16 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f820806dea0 msgr2=0x7f8208070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f820806dea0 0x7f8208070350 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8210009ac0 tx=0x7f8210035040 comp rx=0 tx=0).stop 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 msgr2=0x7f8220113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f8220113750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8214002a50 tx=0x7f8214004600 comp rx=0 tx=0).stop 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 shutdown_connections 2024-09-12T01:51:49.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f820806dea0 0x7f8208070350 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82200fe450 0x7f8220113750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 --2- 172.21.15.66:0/2984512378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8220064fe0 0x7f8220113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 >> 172.21.15.66:0/2984512378 conn(0x7f82200723b0 msgr2=0x7f82200fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:49.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 shutdown_connections 2024-09-12T01:51:49.207 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.203+0000 7f8225357640 1 -- 172.21.15.66:0/2984512378 wait complete. 2024-09-12T01:51:49.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.286+0000 7f8552442640 1 -- 172.21.15.66:0/3828663658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 msgr2=0x7f854c102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.286+0000 7f8552442640 1 --2- 172.21.15.66:0/3828663658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c102a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f853c0048d0 tx=0x7f853c009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.287 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 -- 172.21.15.66:0/3828663658 shutdown_connections 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 --2- 172.21.15.66:0/3828663658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 0x7f854c0fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 --2- 172.21.15.66:0/3828663658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c102a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 -- 172.21.15.66:0/3828663658 >> 172.21.15.66:0/3828663658 conn(0x7f854c070ce0 msgr2=0x7f854c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 -- 172.21.15.66:0/3828663658 shutdown_connections 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 -- 172.21.15.66:0/3828663658 wait complete. 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 Processor -- start 2024-09-12T01:51:49.288 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.287+0000 7f8552442640 1 -- start start 2024-09-12T01:51:49.289 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f8552442640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 0x7f854c10af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f8552442640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c10b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f8552442640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c10b9b0 con 0x7f854c102660 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f8552442640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c10bb20 con 0x7f854c0fac80 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c10b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c10b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59174/0 (socket says 172.21.15.66:59174) 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 -- 172.21.15.66:0/1171290570 learned_addr learned my addr 172.21.15.66:0/1171290570 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854bfff640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 0x7f854c10af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 -- 172.21.15.66:0/1171290570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 msgr2=0x7f854c10af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 0x7f854c10af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 -- 172.21.15.66:0/1171290570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c005040 con 0x7f854c102660 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854bfff640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 0x7f854c10af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f854b7fe640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c10b470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f854000eb70 tx=0x7f854000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.288+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8540007c30 con 0x7f854c102660 2024-09-12T01:51:49.290 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.289+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c10bda0 con 0x7f854c102660 2024-09-12T01:51:49.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.289+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f854000f040 con 0x7f854c102660 2024-09-12T01:51:49.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.289+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8540009470 con 0x7f854c102660 2024-09-12T01:51:49.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.289+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c11dcc0 con 0x7f854c102660 2024-09-12T01:51:49.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.290+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c0657d0 con 0x7f854c102660 2024-09-12T01:51:49.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.290+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f85400096e0 con 0x7f854c102660 2024-09-12T01:51:49.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.291+0000 7f8548ff9640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f853406e0b0 0x7f8534070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:49.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.291+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6943+0+0 (secure 0 0 0) 0x7f854008d7d0 con 0x7f854c102660 2024-09-12T01:51:49.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.291+0000 7f854bfff640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f853406e0b0 0x7f8534070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:49.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.291+0000 7f854bfff640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f853406e0b0 0x7f8534070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f853c009ac0 tx=0x7f853c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:49.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.295+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f85400569f0 con 0x7f854c102660 2024-09-12T01:51:49.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: pgmap v159: 65 pgs: 1 remapped+peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+undersized+remapped, 4 active+clean+remapped, 1 active+recovering+undersized+degraded+remapped, 14 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 59/219 objects degraded (26.941%); 733/219 objects misplaced (334.703%); 2.0 MiB/s, 184 objects/s recovering 2024-09-12T01:51:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: osdmap e81: 6 total, 5 up, 6 in 2024-09-12T01:51:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:48 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2736508911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:49.489 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.489+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f854c10bda0 con 0x7f853406e0b0 2024-09-12T01:51:49.490 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.490+0000 7f8548ff9640 1 -- 172.21.15.66:0/1171290570 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f854c10bda0 con 0x7f853406e0b0 2024-09-12T01:51:49.490 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:51:49.490 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:51:49.490 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:51:49.490 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:51:49.490 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "osd", 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "12/21 daemons upgraded", 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading osd daemons", 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:51:49.491 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:51:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f853406e0b0 msgr2=0x7f8534070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f853406e0b0 0x7f8534070560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f853c009ac0 tx=0x7f853c035040 comp rx=0 tx=0).stop 2024-09-12T01:51:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 msgr2=0x7f854c10b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.493 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c10b470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f854000eb70 tx=0x7f854000b040 comp rx=0 tx=0).stop 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 shutdown_connections 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f853406e0b0 0x7f8534070560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c102660 0x7f854c10b470 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 --2- 172.21.15.66:0/1171290570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f854c0fac80 0x7f854c10af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 >> 172.21.15.66:0/1171290570 conn(0x7f854c070ce0 msgr2=0x7f854c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 shutdown_connections 2024-09-12T01:51:49.494 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.492+0000 7f8552442640 1 -- 172.21.15.66:0/1171290570 wait complete. 2024-09-12T01:51:49.575 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 -- 172.21.15.66:0/4175779873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 msgr2=0x7ff34c101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 --2- 172.21.15.66:0/4175779873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c101040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff3480048d0 tx=0x7ff348009da0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 -- 172.21.15.66:0/4175779873 shutdown_connections 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 --2- 172.21.15.66:0/4175779873 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff34c0fac80 0x7ff34c0fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 --2- 172.21.15.66:0/4175779873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c101040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 -- 172.21.15.66:0/4175779873 >> 172.21.15.66:0/4175779873 conn(0x7ff34c070ce0 msgr2=0x7ff34c0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 -- 172.21.15.66:0/4175779873 shutdown_connections 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.573+0000 7ff353827640 1 -- 172.21.15.66:0/4175779873 wait complete. 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff353827640 1 Processor -- start 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff353827640 1 -- start start 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff353827640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff34c0fac80 0x7ff34c1131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff353827640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c1136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:49.576 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff353827640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c113ce0 con 0x7ff34c100c70 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff353827640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c10d120 con 0x7ff34c0fac80 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff350dc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c1136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff350dc2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c1136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59194/0 (socket says 172.21.15.66:59194) 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff350dc2640 1 -- 172.21.15.66:0/3406643492 learned_addr learned my addr 172.21.15.66:0/3406643492 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff3515c3640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff34c0fac80 0x7ff34c1131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff350dc2640 1 -- 172.21.15.66:0/3406643492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff34c0fac80 msgr2=0x7ff34c1131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff350dc2640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff34c0fac80 0x7ff34c1131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.574+0000 7ff350dc2640 1 -- 172.21.15.66:0/3406643492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348005040 con 0x7ff34c100c70 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.575+0000 7ff350dc2640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c1136e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0041d0 tx=0x7ff33c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.575+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33c00f040 con 0x7ff34c100c70 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.575+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff33c00deb0 con 0x7ff34c100c70 2024-09-12T01:51:49.577 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.575+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c10d400 con 0x7ff34c100c70 2024-09-12T01:51:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.575+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff33c0133e0 con 0x7ff34c100c70 2024-09-12T01:51:49.578 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.575+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c10d9a0 con 0x7ff34c100c70 2024-09-12T01:51:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.576+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c0fc370 con 0x7ff34c100c70 2024-09-12T01:51:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.577+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff33c00da10 con 0x7ff34c100c70 2024-09-12T01:51:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.577+0000 7ff341ffb640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff33806e0b0 0x7ff338070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:51:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.577+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6943+0+0 (secure 0 0 0) 0x7ff33c08d9e0 con 0x7ff34c100c70 2024-09-12T01:51:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.577+0000 7ff3515c3640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff33806e0b0 0x7ff338070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:51:49.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.578+0000 7ff3515c3640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff33806e0b0 0x7ff338070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff348009ac0 tx=0x7ff348035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:51:49.581 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.582+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff33c056c80 con 0x7ff34c100c70 2024-09-12T01:51:49.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.824+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff34c074c00 con 0x7ff34c100c70 2024-09-12T01:51:49.825 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.825+0000 7ff341ffb640 1 -- 172.21.15.66:0/3406643492 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1301 (secure 0 0 0) 0x7ff33c019090 con 0x7ff34c100c70 2024-09-12T01:51:49.825 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 59/219 objects degraded (26.941%), 13 pgs degraded 2024-09-12T01:51:49.825 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-12T01:51:49.825 INFO:teuthology.orchestra.run.smithi066.stdout: osd.5 (root=default,host=smithi153) is down 2024-09-12T01:51:49.825 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 59/219 objects degraded (26.941%), 13 pgs degraded 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.c is active+recovering+undersized+degraded+remapped, acting [2,0] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.12 is active+recovery_wait+undersized+degraded+remapped, acting [3,1] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.14 is active+recovery_wait+undersized+degraded+remapped, acting [3,4] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-12T01:51:49.826 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-12T01:51:49.827 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-12T01:51:49.827 INFO:teuthology.orchestra.run.smithi066.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-12T01:51:49.827 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff33806e0b0 msgr2=0x7ff338070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff33806e0b0 0x7ff338070560 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff348009ac0 tx=0x7ff348035040 comp rx=0 tx=0).stop 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 msgr2=0x7ff34c1136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c1136e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0041d0 tx=0x7ff33c00c040 comp rx=0 tx=0).stop 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 shutdown_connections 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff33806e0b0 0x7ff338070560 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff34c100c70 0x7ff34c1136e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 --2- 172.21.15.66:0/3406643492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff34c0fac80 0x7ff34c1131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 >> 172.21.15.66:0/3406643492 conn(0x7ff34c070ce0 msgr2=0x7ff34c1039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 shutdown_connections 2024-09-12T01:51:49.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:51:49.827+0000 7ff353827640 1 -- 172.21.15.66:0/3406643492 wait complete. 2024-09-12T01:51:50.060 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:49 smithi153 ceph-mon[80899]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:50.060 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:49 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2984512378' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:50.060 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:49 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:50.060 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:49 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:50.060 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:49 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3406643492' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:51:50.060 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:49 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 59/219 objects degraded (26.941%), 13 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:50.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:49 smithi066 ceph-mon[110996]: from='client.34356 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:50.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:49 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2984512378' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:51:50.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:49 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:50.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:49 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:50.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:49 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3406643492' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:51:50.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:49 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 59/219 objects degraded (26.941%), 13 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:51.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:51 smithi066 ceph-mon[110996]: pgmap v161: 65 pgs: 1 remapped+peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+undersized+remapped, 4 active+clean+remapped, 1 active+recovering+undersized+degraded+remapped, 14 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 59/219 objects degraded (26.941%); 733/219 objects misplaced (334.703%); 902 KiB/s, 157 objects/s recovering 2024-09-12T01:51:51.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:51 smithi066 ceph-mon[110996]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:51.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:51 smithi153 ceph-mon[80899]: pgmap v161: 65 pgs: 1 remapped+peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovery_wait+undersized+remapped, 4 active+clean+remapped, 1 active+recovering+undersized+degraded+remapped, 14 active+undersized, 10 active+undersized+degraded, 32 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 59/219 objects degraded (26.941%); 733/219 objects misplaced (334.703%); 902 KiB/s, 157 objects/s recovering 2024-09-12T01:51:51.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:51 smithi153 ceph-mon[80899]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:51:53.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: pgmap v162: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%); 11/219 objects misplaced (5.023%); 1.3 MiB/s, 240 objects/s recovering 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-12T01:51:53.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-12T01:51:53.654 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:51:53.424+0000 7f21d6b06640 -1 osd.5 72 log_to_monitors true 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: pgmap v162: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%); 11/219 objects misplaced (5.023%); 1.3 MiB/s, 240 objects/s recovering 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-12T01:51:53.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-12T01:51:53.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-12T01:51:53.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-12T01:51:53.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-12T01:51:53.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all osd 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: Upgrade: Setting require_osd_release to 19 squid 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: from='osd.5 [v2:172.21.15.153:6816/3728538740,v1:172.21.15.153:6817/3728538740]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: osdmap e82: 6 total, 5 up, 6 in 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: from='osd.5 [v2:172.21.15.153:6816/3728538740,v1:172.21.15.153:6817/3728538740]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:54.547 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:54 smithi066 ceph-mon[110996]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:54.621 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all osd 2024-09-12T01:51:54.621 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: Upgrade: Setting require_osd_release to 19 squid 2024-09-12T01:51:54.621 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: from='osd.5 [v2:172.21.15.153:6816/3728538740,v1:172.21.15.153:6817/3728538740]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: osdmap e82: 6 total, 5 up, 6 in 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: from='osd.5 [v2:172.21.15.153:6816/3728538740,v1:172.21.15.153:6817/3728538740]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:54.622 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-mon[80899]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi153", "root=default"]}]: dispatch 2024-09-12T01:51:54.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:51:54 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:51:54.621+0000 7f21ca898640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:51:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:55 smithi066 ceph-mon[110996]: pgmap v163: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%); 11/219 objects misplaced (5.023%); 1.1 MiB/s, 191 objects/s recovering 2024-09-12T01:51:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:55 smithi066 ceph-mon[110996]: from='osd.5 ' entity='osd.5' 2024-09-12T01:51:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:55 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 24/219 objects degraded (10.959%), 10 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:55.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:55 smithi153 ceph-mon[80899]: pgmap v163: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 199 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24/219 objects degraded (10.959%); 11/219 objects misplaced (5.023%); 1.1 MiB/s, 191 objects/s recovering 2024-09-12T01:51:55.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:55 smithi153 ceph-mon[80899]: from='osd.5 ' entity='osd.5' 2024-09-12T01:51:55.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:55 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 24/219 objects degraded (10.959%), 10 pgs degraded (PG_DEGRADED) 2024-09-12T01:51:56.744 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: Upgrade: Updating mds.cephfs.smithi066.ipygev 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: Deploying daemon mds.cephfs.smithi066.ipygev on smithi066 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: pgmap v165: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 199 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 24/219 objects degraded (10.959%); 11/219 objects misplaced (5.023%); 1024 KiB/s, 94 objects/s recovering 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: osd.5 [v2:172.21.15.153:6816/3728538740,v1:172.21.15.153:6817/3728538740] boot 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: osdmap e83: 6 total, 6 up, 6 in 2024-09-12T01:51:56.745 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: Upgrade: Updating mds.cephfs.smithi066.ipygev 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.ipygev", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: Deploying daemon mds.cephfs.smithi066.ipygev on smithi066 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: pgmap v165: 65 pgs: 8 active+clean+remapped, 14 active+undersized, 10 active+undersized+degraded, 33 active+clean; 199 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 24/219 objects degraded (10.959%); 11/219 objects misplaced (5.023%); 1024 KiB/s, 94 objects/s recovering 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-12T01:51:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: osd.5 [v2:172.21.15.153:6816/3728538740,v1:172.21.15.153:6817/3728538740] boot 2024-09-12T01:51:56.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: osdmap e83: 6 total, 6 up, 6 in 2024-09-12T01:51:56.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-12T01:51:57.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:57.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:57.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:57 smithi066 ceph-mon[110996]: osdmap e84: 6 total, 6 up, 6 in 2024-09-12T01:51:57.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:51:57.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:51:57.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:57 smithi153 ceph-mon[80899]: osdmap e84: 6 total, 6 up, 6 in 2024-09-12T01:51:58.797 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:58 smithi066 ceph-mon[110996]: pgmap v168: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 8 active+undersized+degraded, 36 active+clean; 199 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 21/219 objects degraded (9.589%); 11/219 objects misplaced (5.023%) 2024-09-12T01:51:58.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:58 smithi066 ceph-mon[110996]: osdmap e85: 6 total, 6 up, 6 in 2024-09-12T01:51:58.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:58 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 2 up:standby 2024-09-12T01:51:58.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:58 smithi153 ceph-mon[80899]: pgmap v168: 65 pgs: 8 active+clean+remapped, 13 active+undersized, 8 active+undersized+degraded, 36 active+clean; 199 MiB data, 811 MiB used, 536 GiB / 536 GiB avail; 21/219 objects degraded (9.589%); 11/219 objects misplaced (5.023%) 2024-09-12T01:51:58.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:58 smithi153 ceph-mon[80899]: osdmap e85: 6 total, 6 up, 6 in 2024-09-12T01:51:58.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:58 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 2 up:standby 2024-09-12T01:51:59.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:51:59 smithi066 ceph-mon[110996]: osdmap e86: 6 total, 6 up, 6 in 2024-09-12T01:51:59.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:51:59 smithi153 ceph-mon[80899]: osdmap e86: 6 total, 6 up, 6 in 2024-09-12T01:52:00.883 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:00 smithi066 ceph-mon[110996]: pgmap v171: 65 pgs: 1 peering, 4 active+clean+remapped, 6 active+undersized, 5 active+undersized+degraded, 49 active+clean; 199 MiB data, 839 MiB used, 536 GiB / 536 GiB avail; 14/219 objects degraded (6.393%); 6/219 objects misplaced (2.740%); 3.0 MiB/s, 0 objects/s recovering 2024-09-12T01:52:00.883 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:00 smithi066 ceph-mon[110996]: osdmap e87: 6 total, 6 up, 6 in 2024-09-12T01:52:00.883 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:00 smithi066 ceph-mon[110996]: Health check update: Degraded data redundancy: 14/219 objects degraded (6.393%), 5 pgs degraded (PG_DEGRADED) 2024-09-12T01:52:00.883 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:00 smithi066 ceph-mon[110996]: osdmap e88: 6 total, 6 up, 6 in 2024-09-12T01:52:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:00 smithi153 ceph-mon[80899]: pgmap v171: 65 pgs: 1 peering, 4 active+clean+remapped, 6 active+undersized, 5 active+undersized+degraded, 49 active+clean; 199 MiB data, 839 MiB used, 536 GiB / 536 GiB avail; 14/219 objects degraded (6.393%); 6/219 objects misplaced (2.740%); 3.0 MiB/s, 0 objects/s recovering 2024-09-12T01:52:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:00 smithi153 ceph-mon[80899]: osdmap e87: 6 total, 6 up, 6 in 2024-09-12T01:52:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:00 smithi153 ceph-mon[80899]: Health check update: Degraded data redundancy: 14/219 objects degraded (6.393%), 5 pgs degraded (PG_DEGRADED) 2024-09-12T01:52:00.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:00 smithi153 ceph-mon[80899]: osdmap e88: 6 total, 6 up, 6 in 2024-09-12T01:52:02.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:01 smithi066 ceph-mon[110996]: osdmap e89: 6 total, 6 up, 6 in 2024-09-12T01:52:02.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:01 smithi153 ceph-mon[80899]: osdmap e89: 6 total, 6 up, 6 in 2024-09-12T01:52:03.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:02 smithi066 ceph-mon[110996]: pgmap v175: 65 pgs: 1 active+recovering+undersized+remapped, 1 peering, 1 active+clean+remapped, 62 active+clean; 199 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s, 0 objects/s recovering 2024-09-12T01:52:03.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:02 smithi066 ceph-mon[110996]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/219 objects degraded (6.393%), 5 pgs degraded) 2024-09-12T01:52:03.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:02 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:52:03.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:03.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:03.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:02 smithi153 ceph-mon[80899]: pgmap v175: 65 pgs: 1 active+recovering+undersized+remapped, 1 peering, 1 active+clean+remapped, 62 active+clean; 199 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s, 0 objects/s recovering 2024-09-12T01:52:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:02 smithi153 ceph-mon[80899]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/219 objects degraded (6.393%), 5 pgs degraded) 2024-09-12T01:52:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:02 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:52:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:03.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:03 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:boot 2024-09-12T01:52:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:03 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:52:04.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:03 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:52:04.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:03 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:boot 2024-09-12T01:52:04.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:03 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi066.jacfsu=up:active} 3 up:standby 2024-09-12T01:52:04.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:03 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:52:05.243 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:04 smithi066 ceph-mon[110996]: pgmap v176: 65 pgs: 1 active+recovering+undersized+remapped, 1 peering, 1 active+clean+remapped, 62 active+clean; 199 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s, 0 objects/s recovering 2024-09-12T01:52:05.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:04 smithi153 ceph-mon[80899]: pgmap v176: 65 pgs: 1 active+recovering+undersized+remapped, 1 peering, 1 active+clean+remapped, 62 active+clean; 199 MiB data, 832 MiB used, 536 GiB / 536 GiB avail; 3.2 MiB/s, 0 objects/s recovering 2024-09-12T01:52:07.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:06 smithi066 ceph-mon[110996]: pgmap v177: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s, 231 objects/s recovering 2024-09-12T01:52:07.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:06 smithi153 ceph-mon[80899]: pgmap v177: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s, 231 objects/s recovering 2024-09-12T01:52:08.529 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.530 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.530 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.530 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:08 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:08.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:08 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:09.592 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:09 smithi066 ceph-mon[110996]: pgmap v178: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 513 KiB/s, 173 objects/s recovering 2024-09-12T01:52:09.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:09 smithi153 ceph-mon[80899]: pgmap v178: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 513 KiB/s, 173 objects/s recovering 2024-09-12T01:52:11.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:11 smithi066 ceph-mon[110996]: pgmap v179: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 82 objects/s recovering 2024-09-12T01:52:11.457 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:11 smithi153 ceph-mon[80899]: pgmap v179: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 82 objects/s recovering 2024-09-12T01:52:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: pgmap v180: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 74 objects/s recovering 2024-09-12T01:52:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: pgmap v180: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 74 objects/s recovering 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:12.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:12.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:12.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:12.906 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:14.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:14 smithi066 ceph-mon[110996]: Upgrade: Updating mds.cephfs.smithi066.jacfsu 2024-09-12T01:52:14.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:14 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:14.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:14 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:52:14.366 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:14 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.367 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:14 smithi066 ceph-mon[110996]: Deploying daemon mds.cephfs.smithi066.jacfsu on smithi066 2024-09-12T01:52:14.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:14 smithi153 ceph-mon[80899]: Upgrade: Updating mds.cephfs.smithi066.jacfsu 2024-09-12T01:52:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:14 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:14 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi066.jacfsu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:52:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:14 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:14.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:14 smithi153 ceph-mon[80899]: Deploying daemon mds.cephfs.smithi066.jacfsu on smithi066 2024-09-12T01:52:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:14 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[110992]: 2024-09-12T01:52:14.903+0000 7f25a80f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:52:15.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: pgmap v181: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 65 objects/s recovering 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: osdmap e90: 6 total, 6 up, 6 in 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: Standby daemon mds.cephfs.smithi153.cbdplo assigned to filesystem cephfs as rank 0 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-12T01:52:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:15 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi153.cbdplo=up:replay} 2 up:standby 2024-09-12T01:52:15.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: pgmap v181: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 0 B/s, 65 objects/s recovering 2024-09-12T01:52:15.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:52:15.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:52:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: osdmap e90: 6 total, 6 up, 6 in 2024-09-12T01:52:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: Standby daemon mds.cephfs.smithi153.cbdplo assigned to filesystem cephfs as rank 0 2024-09-12T01:52:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:52:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-12T01:52:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:15 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi153.cbdplo=up:replay} 2 up:standby 2024-09-12T01:52:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:17 smithi066 ceph-mon[110996]: pgmap v183: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-12T01:52:17.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:17 smithi153 ceph-mon[80899]: pgmap v183: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-12T01:52:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:52:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:52:19.341 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:19 smithi066 ceph-mon[110996]: pgmap v184: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-12T01:52:19.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:19 smithi153 ceph-mon[80899]: pgmap v184: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 819 KiB/s rd, 0 op/s 2024-09-12T01:52:19.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 -- 172.21.15.66:0/1981553775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f0064fe0 msgr2=0x7f39f0065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 --2- 172.21.15.66:0/1981553775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f0064fe0 0x7f39f0065430 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f39e40048d0 tx=0x7f39e4009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 -- 172.21.15.66:0/1981553775 shutdown_connections 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 --2- 172.21.15.66:0/1981553775 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f0064fe0 0x7f39f0065430 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 --2- 172.21.15.66:0/1981553775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f00fe450 0x7f39f00fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 -- 172.21.15.66:0/1981553775 >> 172.21.15.66:0/1981553775 conn(0x7f39f00723b0 msgr2=0x7f39f00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 -- 172.21.15.66:0/1981553775 shutdown_connections 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.911+0000 7f39f568a640 1 -- 172.21.15.66:0/1981553775 wait complete. 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39f568a640 1 Processor -- start 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39f568a640 1 -- start start 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39f568a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 0x7f39f01131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39f568a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 0x7f39f01136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39f568a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0113cf0 con 0x7f39f00fe450 2024-09-12T01:52:19.915 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39f568a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f010d130 con 0x7f39f0064fe0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39ee7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 0x7f39f01136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39eeffd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 0x7f39f01131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39ee7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 0x7f39f01136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59098/0 (socket says 172.21.15.66:59098) 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39ee7fc640 1 -- 172.21.15.66:0/727660693 learned_addr learned my addr 172.21.15.66:0/727660693 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.912+0000 7f39eeffd640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 0x7f39f01131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.66:60912/0 (socket says 172.21.15.66:60912) 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39eeffd640 1 -- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 msgr2=0x7f39f01136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39eeffd640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 0x7f39f01136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39eeffd640 1 -- 172.21.15.66:0/727660693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4005040 con 0x7f39f0064fe0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39ee7fc640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 0x7f39f01136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39eeffd640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 0x7f39f01131b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39e000e910 tx=0x7f39e000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mon.1 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e000eea0 con 0x7f39f0064fe0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f010d3b0 con 0x7f39f0064fe0 2024-09-12T01:52:19.916 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mon.1 v2:172.21.15.153:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39e000f040 con 0x7f39f0064fe0 2024-09-12T01:52:19.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mon.1 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39e0009410 con 0x7f39f0064fe0 2024-09-12T01:52:19.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.913+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f010d950 con 0x7f39f0064fe0 2024-09-12T01:52:19.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.914+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f00fdce0 con 0x7f39f0064fe0 2024-09-12T01:52:19.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.915+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mon.1 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f39e0007c30 con 0x7f39f0064fe0 2024-09-12T01:52:19.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.915+0000 7f39d77fe640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f39d806e0b0 0x7f39d8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:19.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.916+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mon.1 v2:172.21.15.153:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f39e008d7f0 con 0x7f39f0064fe0 2024-09-12T01:52:19.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.916+0000 7f39ee7fc640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f39d806e0b0 0x7f39d8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:19.918 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.916+0000 7f39ee7fc640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f39d806e0b0 0x7f39d8070560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39f010ea70 tx=0x7f39e4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:19.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:19.924+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mon.1 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f39e0056a60 con 0x7f39f0064fe0 2024-09-12T01:52:20.139 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.137+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39f004b720 con 0x7f39d806e0b0 2024-09-12T01:52:20.140 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.139+0000 7f39d77fe640 1 -- 172.21.15.66:0/727660693 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f39f004b720 con 0x7f39d806e0b0 2024-09-12T01:52:20.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f39d806e0b0 msgr2=0x7f39d8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.142 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f39d806e0b0 0x7f39d8070560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39f010ea70 tx=0x7f39e4035040 comp rx=0 tx=0).stop 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 msgr2=0x7f39f01131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 0x7f39f01131b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f39e000e910 tx=0x7f39e000b040 comp rx=0 tx=0).stop 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 shutdown_connections 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f39d806e0b0 0x7f39d8070560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39f00fe450 0x7f39f01136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 --2- 172.21.15.66:0/727660693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0064fe0 0x7f39f01131b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 >> 172.21.15.66:0/727660693 conn(0x7f39f00723b0 msgr2=0x7f39f0105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 shutdown_connections 2024-09-12T01:52:20.143 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.141+0000 7f39f568a640 1 -- 172.21.15.66:0/727660693 wait complete. 2024-09-12T01:52:20.151 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.223+0000 7f5007b1c640 1 -- 172.21.15.66:0/4238236854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000065520 msgr2=0x7f5000065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.223+0000 7f5007b1c640 1 --2- 172.21.15.66:0/4238236854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000065520 0x7f5000065970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00048d0 tx=0x7f4ff0009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.223+0000 7f5007b1c640 1 -- 172.21.15.66:0/4238236854 shutdown_connections 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.223+0000 7f5007b1c640 1 --2- 172.21.15.66:0/4238236854 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000065520 0x7f5000065970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.223+0000 7f5007b1c640 1 --2- 172.21.15.66:0/4238236854 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000101540 0x7f5000064fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.223+0000 7f5007b1c640 1 -- 172.21.15.66:0/4238236854 >> 172.21.15.66:0/4238236854 conn(0x7f50000723b0 msgr2=0x7f50000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.224+0000 7f5007b1c640 1 -- 172.21.15.66:0/4238236854 shutdown_connections 2024-09-12T01:52:20.225 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.224+0000 7f5007b1c640 1 -- 172.21.15.66:0/4238236854 wait complete. 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.224+0000 7f5007b1c640 1 Processor -- start 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.224+0000 7f5007b1c640 1 -- start start 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.224+0000 7f5007b1c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000065520 0x7f50001197b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.224+0000 7f5007b1c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 0x7f5000119cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f5007b1c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500011a340 con 0x7f5000101540 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f5007b1c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5000113750 con 0x7f5000065520 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 0x7f5000119cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 0x7f5000119cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59112/0 (socket says 172.21.15.66:59112) 2024-09-12T01:52:20.227 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 -- 172.21.15.66:0/3255260607 learned_addr learned my addr 172.21.15.66:0/3255260607 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50058b8640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000065520 0x7f50001197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 -- 172.21.15.66:0/3255260607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000065520 msgr2=0x7f50001197b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000065520 0x7f50001197b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 -- 172.21.15.66:0/3255260607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0005040 con 0x7f5000101540 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50058b8640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000065520 0x7f50001197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.225+0000 7f50050b7640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 0x7f5000119cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0000c00 tx=0x7f4ff0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.226+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff0038070 con 0x7f5000101540 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.226+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4ff002ade0 con 0x7f5000101540 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.226+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ff002c7b0 con 0x7f5000101540 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.226+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50001139d0 con 0x7f5000101540 2024-09-12T01:52:20.228 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.226+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5000113ec0 con 0x7f5000101540 2024-09-12T01:52:20.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.227+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50000fbae0 con 0x7f5000101540 2024-09-12T01:52:20.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.228+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f4ff0030020 con 0x7f5000101540 2024-09-12T01:52:20.229 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.228+0000 7f4ff67fc640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f4fec06e0b0 0x7f4fec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.228+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f4ff00ae000 con 0x7f5000101540 2024-09-12T01:52:20.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.229+0000 7f50058b8640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f4fec06e0b0 0x7f4fec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.230 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.229+0000 7f50058b8640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f4fec06e0b0 0x7f4fec070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004ab0 tx=0x7f4ffc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.237+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4ff0077220 con 0x7f5000101540 2024-09-12T01:52:20.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.437+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5000114e20 con 0x7f4fec06e0b0 2024-09-12T01:52:20.439 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.438+0000 7f4ff67fc640 1 -- 172.21.15.66:0/3255260607 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5000114e20 con 0x7f4fec06e0b0 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f4fec06e0b0 msgr2=0x7f4fec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f4fec06e0b0 0x7f4fec070560 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc004ab0 tx=0x7f4ffc00b040 comp rx=0 tx=0).stop 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 msgr2=0x7f5000119cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 0x7f5000119cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0000c00 tx=0x7f4ff0009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 shutdown_connections 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f4fec06e0b0 0x7f4fec070560 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5000101540 0x7f5000119cf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 --2- 172.21.15.66:0/3255260607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5000065520 0x7f50001197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.440+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 >> 172.21.15.66:0/3255260607 conn(0x7f50000723b0 msgr2=0x7f50000fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.441+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 shutdown_connections 2024-09-12T01:52:20.442 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.441+0000 7f5007b1c640 1 -- 172.21.15.66:0/3255260607 wait complete. 2024-09-12T01:52:20.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 -- 172.21.15.66:0/751400046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102f20 msgr2=0x7f59740fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 --2- 172.21.15.66:0/751400046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102f20 0x7f59740fc5e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f59680048d0 tx=0x7f5968009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 -- 172.21.15.66:0/751400046 shutdown_connections 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 --2- 172.21.15.66:0/751400046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102f20 0x7f59740fc5e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 --2- 172.21.15.66:0/751400046 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102580 0x7f5974102950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 -- 172.21.15.66:0/751400046 >> 172.21.15.66:0/751400046 conn(0x7f59740f81a0 msgr2=0x7f59740fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 -- 172.21.15.66:0/751400046 shutdown_connections 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.521+0000 7f59789f8640 1 -- 172.21.15.66:0/751400046 wait complete. 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f59789f8640 1 Processor -- start 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f59789f8640 1 -- start start 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f59789f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 0x7f597406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f59789f8640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102f20 0x7f597406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f59789f8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974070490 con 0x7f5974102580 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f59789f8640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974070600 con 0x7f5974102f20 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f597259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 0x7f597406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f597259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 0x7f597406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59128/0 (socket says 172.21.15.66:59128) 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f597259c640 1 -- 172.21.15.66:0/2741731624 learned_addr learned my addr 172.21.15.66:0/2741731624 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.522+0000 7f5971d9b640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102f20 0x7f597406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f597259c640 1 -- 172.21.15.66:0/2741731624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102f20 msgr2=0x7f597406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f597259c640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102f20 0x7f597406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f597259c640 1 -- 172.21.15.66:0/2741731624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968005040 con 0x7f5974102580 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f5971d9b640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102f20 0x7f597406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f597259c640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 0x7f597406fa10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f596400eb70 tx=0x7f596400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5964007c30 con 0x7f5974102580 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f596400f040 con 0x7f5974102580 2024-09-12T01:52:20.526 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974070830 con 0x7f5974102580 2024-09-12T01:52:20.527 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5964009470 con 0x7f5974102580 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.523+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974119860 con 0x7f5974102580 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.524+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59740fdd00 con 0x7f5974102580 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.525+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f59640096e0 con 0x7f5974102580 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.525+0000 7f5962ffd640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f595c06e0b0 0x7f595c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.525+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f596408d8e0 con 0x7f5974102580 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.526+0000 7f5971d9b640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f595c06e0b0 0x7f595c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.528 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.526+0000 7f5971d9b640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f595c06e0b0 0x7f595c070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5968000c00 tx=0x7f5968035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.531 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.530+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5964056bb0 con 0x7f5974102580 2024-09-12T01:52:20.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.719+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f597404b7b0 con 0x7f595c06e0b0 2024-09-12T01:52:20.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.728+0000 7f5962ffd640 1 -- 172.21.15.66:0/2741731624 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f597404b7b0 con 0x7f595c06e0b0 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (6m) 13s ago 16m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (3m) 13s ago 17m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (3m) 32s ago 16m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (6m) 13s ago 16m 82.8M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (19s) 13s ago 11m 10.9M - 19.1.1-298-gb53b6d3e 54467abc55f8 29e4ff8a116d 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (11m) 13s ago 11m 149M - 17.2.7-1609-g554ba93e d4c538e492e4 ef7d69a3b161 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (11m) 32s ago 11m 18.0M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (11m) 32s ago 11m 16.9M - 17.2.7-1609-g554ba93e d4c538e492e4 151d853c0c90 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (8m) 13s ago 18m 503M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (7m) 32s ago 16m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:52:20.730 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (4m) 13s ago 18m 52.1M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (4m) 32s ago 15m 37.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (7m) 13s ago 17m 16.6M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (7m) 32s ago 16m 16.8M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (3m) 13s ago 15m 150M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (2m) 13s ago 14m 141M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (2m) 13s ago 14m 146M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (100s) 32s ago 13m 114M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (67s) 32s ago 13m 138M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 6b77ec5616ac 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (35s) 32s ago 13m 12.1M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 1c0a4ea58d83 2024-09-12T01:52:20.731 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (6m) 13s ago 16m 64.6M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:52:20.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f595c06e0b0 msgr2=0x7f595c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f595c06e0b0 0x7f595c070560 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5968000c00 tx=0x7f5968035040 comp rx=0 tx=0).stop 2024-09-12T01:52:20.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 msgr2=0x7f597406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.732 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 0x7f597406fa10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f596400eb70 tx=0x7f596400b040 comp rx=0 tx=0).stop 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 shutdown_connections 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f595c06e0b0 0x7f595c070560 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5974102f20 0x7f597406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 --2- 172.21.15.66:0/2741731624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5974102580 0x7f597406fa10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 >> 172.21.15.66:0/2741731624 conn(0x7f59740f81a0 msgr2=0x7f59740f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 shutdown_connections 2024-09-12T01:52:20.733 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.731+0000 7f59789f8640 1 -- 172.21.15.66:0/2741731624 wait complete. 2024-09-12T01:52:20.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 -- 172.21.15.66:0/1246805002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 msgr2=0x7f3f500fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 --2- 172.21.15.66:0/1246805002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f500fd3d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0048d0 tx=0x7f3f4c009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 -- 172.21.15.66:0/1246805002 shutdown_connections 2024-09-12T01:52:20.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 --2- 172.21.15.66:0/1246805002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f500fd3d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.812 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 --2- 172.21.15.66:0/1246805002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f500fb810 0x7f3f500fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 -- 172.21.15.66:0/1246805002 >> 172.21.15.66:0/1246805002 conn(0x7f3f500723b0 msgr2=0x7f3f500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:20.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 -- 172.21.15.66:0/1246805002 shutdown_connections 2024-09-12T01:52:20.813 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 -- 172.21.15.66:0/1246805002 wait complete. 2024-09-12T01:52:20.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 Processor -- start 2024-09-12T01:52:20.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.811+0000 7f3f577f9640 1 -- start start 2024-09-12T01:52:20.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f577f9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f500fb810 0x7f3f501120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f577f9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f501125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f577f9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50112bf0 con 0x7f3f500fcf80 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f577f9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5010c030 con 0x7f3f500fb810 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f501125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f501125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59154/0 (socket says 172.21.15.66:59154) 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 -- 172.21.15.66:0/4260120254 learned_addr learned my addr 172.21.15.66:0/4260120254 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f55595640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f500fb810 0x7f3f501120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 -- 172.21.15.66:0/4260120254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f500fb810 msgr2=0x7f3f501120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f500fb810 0x7f3f501120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 -- 172.21.15.66:0/4260120254 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c005040 con 0x7f3f500fcf80 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.812+0000 7f3f54d94640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f501125f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c000c00 tx=0x7f3f4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.813+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f4c038070 con 0x7f3f500fcf80 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.813+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3f4c02ade0 con 0x7f3f500fcf80 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.813+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5010c2b0 con 0x7f3f500fcf80 2024-09-12T01:52:20.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.813+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f4c02c7e0 con 0x7f3f500fcf80 2024-09-12T01:52:20.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.813+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5010c770 con 0x7f3f500fcf80 2024-09-12T01:52:20.816 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.814+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500fcbc0 con 0x7f3f500fcf80 2024-09-12T01:52:20.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.815+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3f4c030020 con 0x7f3f500fcf80 2024-09-12T01:52:20.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.815+0000 7f3f41ffb640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3f3c06e0b0 0x7f3f3c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:20.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.815+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f3f4c0ad920 con 0x7f3f500fcf80 2024-09-12T01:52:20.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.815+0000 7f3f55595640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3f3c06e0b0 0x7f3f3c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:20.817 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.816+0000 7f3f55595640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3f3c06e0b0 0x7f3f3c070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009fd0 tx=0x7f3f4400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:20.821 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:20.820+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3f4c076bf0 con 0x7f3f500fcf80 2024-09-12T01:52:21.066 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.065+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3f5010d720 con 0x7f3f500fcf80 2024-09-12T01:52:21.067 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:21 smithi066 ceph-mon[110996]: pgmap v185: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 1 op/s 2024-09-12T01:52:21.067 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:21 smithi066 ceph-mon[110996]: from='client.44307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:21.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.066+0000 7f3f41ffb640 1 -- 172.21.15.66:0/4260120254 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f3f4c07a2b0 con 0x7f3f500fcf80 2024-09-12T01:52:21.067 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 6 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2, 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 1 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:21.068 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:52:21.069 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 2, 2024-09-12T01:52:21.069 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 11 2024-09-12T01:52:21.069 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:52:21.069 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3f3c06e0b0 msgr2=0x7f3f3c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3f3c06e0b0 0x7f3f3c070560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009fd0 tx=0x7f3f4400b040 comp rx=0 tx=0).stop 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 msgr2=0x7f3f501125f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f501125f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c000c00 tx=0x7f3f4c009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 shutdown_connections 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3f3c06e0b0 0x7f3f3c070560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f500fcf80 0x7f3f501125f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 --2- 172.21.15.66:0/4260120254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f500fb810 0x7f3f501120b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 >> 172.21.15.66:0/4260120254 conn(0x7f3f500723b0 msgr2=0x7f3f500fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 shutdown_connections 2024-09-12T01:52:21.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.068+0000 7f3f577f9640 1 -- 172.21.15.66:0/4260120254 wait complete. 2024-09-12T01:52:21.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 -- 172.21.15.66:0/723423056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 msgr2=0x7f47ec0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.151 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 --2- 172.21.15.66:0/723423056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec0fe820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0048d0 tx=0x7f47dc009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 -- 172.21.15.66:0/723423056 shutdown_connections 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 --2- 172.21.15.66:0/723423056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47ec064fe0 0x7f47ec065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 --2- 172.21.15.66:0/723423056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec0fe820 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 -- 172.21.15.66:0/723423056 >> 172.21.15.66:0/723423056 conn(0x7f47ec0723b0 msgr2=0x7f47ec0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 -- 172.21.15.66:0/723423056 shutdown_connections 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 -- 172.21.15.66:0/723423056 wait complete. 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 Processor -- start 2024-09-12T01:52:21.152 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.150+0000 7f47f1488640 1 -- start start 2024-09-12T01:52:21.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47f1488640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47ec064fe0 0x7f47ec1153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47f1488640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec1158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.153 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47f1488640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec115ee0 con 0x7f47ec0fe450 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47f1488640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec116050 con 0x7f47ec064fe0 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec1158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec1158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59168/0 (socket says 172.21.15.66:59168) 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 -- 172.21.15.66:0/2100487543 learned_addr learned my addr 172.21.15.66:0/2100487543 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47eaffd640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47ec064fe0 0x7f47ec1153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 -- 172.21.15.66:0/2100487543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47ec064fe0 msgr2=0x7f47ec1153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47ec064fe0 0x7f47ec1153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 -- 172.21.15.66:0/2100487543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc005040 con 0x7f47ec0fe450 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47ea7fc640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec1158e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47e0002a80 tx=0x7f47e0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.151+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47e0007c30 con 0x7f47ec0fe450 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.152+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec10f4d0 con 0x7f47ec0fe450 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.152+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f47e000f040 con 0x7f47ec0fe450 2024-09-12T01:52:21.154 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.152+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47e000dab0 con 0x7f47ec0fe450 2024-09-12T01:52:21.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.152+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec10f9f0 con 0x7f47ec0fe450 2024-09-12T01:52:21.155 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.153+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec0fdce0 con 0x7f47ec0fe450 2024-09-12T01:52:21.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.153+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f47e000dc30 con 0x7f47ec0fe450 2024-09-12T01:52:21.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.154+0000 7f47d37fe640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f47d406e0b0 0x7f47d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.154+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7f47e008d470 con 0x7f47ec0fe450 2024-09-12T01:52:21.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.154+0000 7f47eaffd640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f47d406e0b0 0x7f47d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.156 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.154+0000 7f47eaffd640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f47d406e0b0 0x7f47d4070560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ac0 tx=0x7f47dc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:21.159 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.158+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47e00567c0 con 0x7f47ec0fe450 2024-09-12T01:52:21.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.370+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f47ec072ec0 con 0x7f47ec0fe450 2024-09-12T01:52:21.371 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.370+0000 7f47d37fe640 1 -- 172.21.15.66:0/2100487543 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1739 (secure 0 0 0) 0x7f47e0059e80 con 0x7f47ec0fe450 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:e20 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:btime 2024-09-12T01:52:14:909817+0000 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:52:21.372 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 20 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:52:14.909804+0000 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 90 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:52:21.373 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=24277} 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 0 members: 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{0:24277} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:21.374 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:21.375 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:52:21.375 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:21.375 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:24285} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:52:21.375 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:34376} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:52:21.375 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 20 2024-09-12T01:52:21.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.372+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f47d406e0b0 msgr2=0x7f47d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.372+0000 7f47f1488640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f47d406e0b0 0x7f47d4070560 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ac0 tx=0x7f47dc035040 comp rx=0 tx=0).stop 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.372+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 msgr2=0x7f47ec1158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.372+0000 7f47f1488640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec1158e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f47e0002a80 tx=0x7f47e0004600 comp rx=0 tx=0).stop 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 shutdown_connections 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f47d406e0b0 0x7f47d4070560 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec0fe450 0x7f47ec1158e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 --2- 172.21.15.66:0/2100487543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47ec064fe0 0x7f47ec1153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 >> 172.21.15.66:0/2100487543 conn(0x7f47ec0723b0 msgr2=0x7f47ec101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 shutdown_connections 2024-09-12T01:52:21.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.373+0000 7f47f1488640 1 -- 172.21.15.66:0/2100487543 wait complete. 2024-09-12T01:52:21.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:21 smithi153 ceph-mon[80899]: pgmap v185: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 1 op/s 2024-09-12T01:52:21.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:21 smithi153 ceph-mon[80899]: from='client.44307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:21.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 -- 172.21.15.66:0/4209557067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c064fc0 msgr2=0x7fda0c065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 --2- 172.21.15.66:0/4209557067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c064fc0 0x7fda0c065430 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fda000048d0 tx=0x7fda00009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 -- 172.21.15.66:0/4209557067 shutdown_connections 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 --2- 172.21.15.66:0/4209557067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c064fc0 0x7fda0c065430 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 --2- 172.21.15.66:0/4209557067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda0c0fe460 0x7fda0c0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 -- 172.21.15.66:0/4209557067 >> 172.21.15.66:0/4209557067 conn(0x7fda0c0723b0 msgr2=0x7fda0c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 -- 172.21.15.66:0/4209557067 shutdown_connections 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 -- 172.21.15.66:0/4209557067 wait complete. 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 Processor -- start 2024-09-12T01:52:21.457 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.455+0000 7fda133ba640 1 -- start start 2024-09-12T01:52:21.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda133ba640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda0c064fc0 0x7fda0c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda133ba640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 0x7fda0c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.458 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda133ba640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c113cf0 con 0x7fda0c0fe460 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda133ba640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c10d180 con 0x7fda0c064fc0 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 0x7fda0c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 0x7fda0c1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59184/0 (socket says 172.21.15.66:59184) 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 -- 172.21.15.66:0/1807430071 learned_addr learned my addr 172.21.15.66:0/1807430071 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda11156640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda0c064fc0 0x7fda0c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 -- 172.21.15.66:0/1807430071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda0c064fc0 msgr2=0x7fda0c1131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda0c064fc0 0x7fda0c1131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 -- 172.21.15.66:0/1807430071 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00005040 con 0x7fda0c0fe460 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda10955640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 0x7fda0c1136f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda000043d0 tx=0x7fda00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda00038070 con 0x7fda0c0fe460 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fda000096e0 con 0x7fda0c0fe460 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c10d400 con 0x7fda0c0fe460 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.456+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0003d420 con 0x7fda0c0fe460 2024-09-12T01:52:21.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.457+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c10d9a0 con 0x7fda0c0fe460 2024-09-12T01:52:21.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.458+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0c0fdcf0 con 0x7fda0c0fe460 2024-09-12T01:52:21.460 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.458+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fda00030020 con 0x7fda0c0fe460 2024-09-12T01:52:21.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.459+0000 7fda09ffb640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd9f406e0b0 0x7fd9f4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.459+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fda000ae170 con 0x7fda0c0fe460 2024-09-12T01:52:21.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.459+0000 7fda11156640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd9f406e0b0 0x7fd9f4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.459+0000 7fda11156640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd9f406e0b0 0x7fd9f4070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda04007fd0 tx=0x7fda04009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:21.464 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.463+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fda00077390 con 0x7fda0c0fe460 2024-09-12T01:52:21.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.657+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda0c10e820 con 0x7fd9f406e0b0 2024-09-12T01:52:21.659 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.658+0000 7fda09ffb640 1 -- 172.21.15.66:0/1807430071 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fda0c10e820 con 0x7fd9f406e0b0 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "osd", 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:52:21.660 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:52:21.661 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "13/21 daemons upgraded", 2024-09-12T01:52:21.661 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading mds daemons", 2024-09-12T01:52:21.661 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:52:21.661 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.660+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd9f406e0b0 msgr2=0x7fd9f4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.660+0000 7fda133ba640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd9f406e0b0 0x7fd9f4070560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda04007fd0 tx=0x7fda04009040 comp rx=0 tx=0).stop 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.660+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 msgr2=0x7fda0c1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.660+0000 7fda133ba640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 0x7fda0c1136f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda000043d0 tx=0x7fda00009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 shutdown_connections 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd9f406e0b0 0x7fd9f4070560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda0c0fe460 0x7fda0c1136f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 --2- 172.21.15.66:0/1807430071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda0c064fc0 0x7fda0c1131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.662 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 >> 172.21.15.66:0/1807430071 conn(0x7fda0c0723b0 msgr2=0x7fda0c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 shutdown_connections 2024-09-12T01:52:21.663 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.661+0000 7fda133ba640 1 -- 172.21.15.66:0/1807430071 wait complete. 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 -- 172.21.15.66:0/2890617403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 msgr2=0x7fc1540fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 --2- 172.21.15.66:0/2890617403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc1540fc590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc1440048d0 tx=0x7fc144009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 -- 172.21.15.66:0/2890617403 shutdown_connections 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 --2- 172.21.15.66:0/2890617403 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc1540fc590 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 --2- 172.21.15.66:0/2890617403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc154102530 0x7fc154102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 -- 172.21.15.66:0/2890617403 >> 172.21.15.66:0/2890617403 conn(0x7fc1540f80f0 msgr2=0x7fc1540fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 -- 172.21.15.66:0/2890617403 shutdown_connections 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.741+0000 7fc15c210640 1 -- 172.21.15.66:0/2890617403 wait complete. 2024-09-12T01:52:21.743 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc15c210640 1 Processor -- start 2024-09-12T01:52:21.744 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc15c210640 1 -- start start 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc15c210640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc154102530 0x7fc15406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc15c210640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc15406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc15c210640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc154070490 con 0x7fc154102ed0 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc15c210640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc154070600 con 0x7fc154102530 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc1597ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc15406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc1597ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc15406ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:59216/0 (socket says 172.21.15.66:59216) 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc1597ab640 1 -- 172.21.15.66:0/3966720033 learned_addr learned my addr 172.21.15.66:0/3966720033 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:21.745 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc159fac640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc154102530 0x7fc15406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc1597ab640 1 -- 172.21.15.66:0/3966720033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc154102530 msgr2=0x7fc15406fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc1597ab640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc154102530 0x7fc15406fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.742+0000 7fc1597ab640 1 -- 172.21.15.66:0/3966720033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc144005040 con 0x7fc154102ed0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.743+0000 7fc1597ab640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc15406ff50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc14402a530 tx=0x7fc144009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.743+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc144038070 con 0x7fc154102ed0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.743+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc14402ade0 con 0x7fc154102ed0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.743+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc154070830 con 0x7fc154102ed0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.743+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc14402c7a0 con 0x7fc154102ed0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.743+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc154119870 con 0x7fc154102ed0 2024-09-12T01:52:21.746 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.744+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1540fdcb0 con 0x7fc154102ed0 2024-09-12T01:52:21.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.744+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fc144030020 con 0x7fc154102ed0 2024-09-12T01:52:21.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.745+0000 7fc14a7fc640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc14006e0b0 0x7fc140070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:21.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.745+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6765+0+0 (secure 0 0 0) 0x7fc1440adff0 con 0x7fc154102ed0 2024-09-12T01:52:21.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.745+0000 7fc159fac640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc14006e0b0 0x7fc140070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:21.747 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.745+0000 7fc159fac640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc14006e0b0 0x7fc140070560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc150009af0 tx=0x7fc15000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:21.750 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.749+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc144077290 con 0x7fc154102ed0 2024-09-12T01:52:21.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.992+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc1540fbd30 con 0x7fc154102ed0 2024-09-12T01:52:21.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.993+0000 7fc14a7fc640 1 -- 172.21.15.66:0/3966720033 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fc14407a950 con 0x7fc154102ed0 2024-09-12T01:52:21.994 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-12T01:52:21.994 INFO:teuthology.orchestra.run.smithi066.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-12T01:52:21.995 INFO:teuthology.orchestra.run.smithi066.stdout: fs cephfs is degraded 2024-09-12T01:52:21.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc14006e0b0 msgr2=0x7fc140070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc14006e0b0 0x7fc140070560 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc150009af0 tx=0x7fc15000b040 comp rx=0 tx=0).stop 2024-09-12T01:52:21.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 msgr2=0x7fc15406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc15406ff50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc14402a530 tx=0x7fc144009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 shutdown_connections 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fc14006e0b0 0x7fc140070560 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc154102ed0 0x7fc15406ff50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 --2- 172.21.15.66:0/3966720033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc154102530 0x7fc15406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 >> 172.21.15.66:0/3966720033 conn(0x7fc1540f80f0 msgr2=0x7fc1540f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 shutdown_connections 2024-09-12T01:52:21.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:21.995+0000 7fc15c210640 1 -- 172.21.15.66:0/3966720033 wait complete. 2024-09-12T01:52:22.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:22 smithi066 ceph-mon[110996]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:22.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:22 smithi066 ceph-mon[110996]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:22.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:22 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4260120254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:22.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:22 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2100487543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:52:22.315 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:22 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3966720033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:52:22.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:22 smithi153 ceph-mon[80899]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:22 smithi153 ceph-mon[80899]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:22 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4260120254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:22 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2100487543' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:52:22.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:22 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3966720033' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:52:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:23 smithi066 ceph-mon[110996]: pgmap v186: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:52:23.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:23 smithi066 ceph-mon[110996]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:23 smithi153 ceph-mon[80899]: pgmap v186: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:52:23.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:23 smithi153 ceph-mon[80899]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:24.327 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:24 smithi066 ceph-mon[110996]: reconnect by client.24311 v1:192.168.0.1:0/1436831423 after 0 2024-09-12T01:52:24.327 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:24 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:reconnect 2024-09-12T01:52:24.327 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:24 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi153.cbdplo=up:reconnect} 2 up:standby 2024-09-12T01:52:24.327 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:24 smithi066 ceph-mon[110996]: reconnect by client.24305 v1:172.21.15.66:0/2556098362 after 0.00399993 2024-09-12T01:52:24.329 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:24 smithi153 ceph-mon[80899]: reconnect by client.24311 v1:192.168.0.1:0/1436831423 after 0 2024-09-12T01:52:24.329 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:24 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:reconnect 2024-09-12T01:52:24.329 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:24 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi153.cbdplo=up:reconnect} 2 up:standby 2024-09-12T01:52:24.329 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:24 smithi153 ceph-mon[80899]: reconnect by client.24305 v1:172.21.15.66:0/2556098362 after 0.00399993 2024-09-12T01:52:25.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:25 smithi066 ceph-mon[110996]: pgmap v187: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:52:25.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:25 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:rejoin 2024-09-12T01:52:25.290 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:25 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi153.cbdplo=up:rejoin} 2 up:standby 2024-09-12T01:52:25.291 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:25 smithi066 ceph-mon[110996]: daemon mds.cephfs.smithi153.cbdplo is now active in filesystem cephfs as rank 0 2024-09-12T01:52:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:25 smithi153 ceph-mon[80899]: pgmap v187: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:52:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:25 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:rejoin 2024-09-12T01:52:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:25 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi153.cbdplo=up:rejoin} 2 up:standby 2024-09-12T01:52:25.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:25 smithi153 ceph-mon[80899]: daemon mds.cephfs.smithi153.cbdplo is now active in filesystem cephfs as rank 0 2024-09-12T01:52:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:52:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:52:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:active 2024-09-12T01:52:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi153.cbdplo=up:active} 2 up:standby 2024-09-12T01:52:26.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:26.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:26.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6824/27089229,v1:172.21.15.153:6825/27089229] up:active 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi153.cbdplo=up:active} 2 up:standby 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:26.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:27.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:27 smithi066 ceph-mon[110996]: pgmap v188: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 193 B/s wr, 6 op/s 2024-09-12T01:52:27.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:27 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.66:6828/1762724759,v1:172.21.15.66:6829/1762724759] up:boot 2024-09-12T01:52:27.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:27 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi153.cbdplo=up:active} 3 up:standby 2024-09-12T01:52:27.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:52:27.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:27.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:27 smithi153 ceph-mon[80899]: pgmap v188: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 193 B/s wr, 6 op/s 2024-09-12T01:52:27.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:27 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.66:6828/1762724759,v1:172.21.15.66:6829/1762724759] up:boot 2024-09-12T01:52:27.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:27 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi153.cbdplo=up:active} 3 up:standby 2024-09-12T01:52:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:52:27.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:29.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:29 smithi066 ceph-mon[110996]: pgmap v189: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:52:29.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:29 smithi153 ceph-mon[80899]: pgmap v189: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:52:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:31 smithi066 ceph-mon[110996]: pgmap v190: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-12T01:52:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:31 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:31 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:31 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:31 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:31 smithi153 ceph-mon[80899]: pgmap v190: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-12T01:52:31.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:31 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:31 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:31 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:31.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:31 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:33.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:33 smithi066 ceph-mon[110996]: pgmap v191: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-12T01:52:33.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:33 smithi153 ceph-mon[80899]: pgmap v191: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.1 KiB/s wr, 8 op/s 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:35.352 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:35.353 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.353 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.353 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.353 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:35 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: pgmap v192: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:52:35.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:35.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:35 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:36 smithi066 ceph-mon[110996]: pgmap v193: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:52:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:36 smithi066 ceph-mon[110996]: Upgrade: Updating mds.cephfs.smithi153.cbdplo 2024-09-12T01:52:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:52:37.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:36 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:37.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:36 smithi066 ceph-mon[110996]: Deploying daemon mds.cephfs.smithi153.cbdplo on smithi153 2024-09-12T01:52:37.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:36 smithi153 ceph-mon[80899]: pgmap v193: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:52:37.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:36 smithi153 ceph-mon[80899]: Upgrade: Updating mds.cephfs.smithi153.cbdplo 2024-09-12T01:52:37.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:37.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.cbdplo", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:52:37.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:36 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:37.156 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:36 smithi153 ceph-mon[80899]: Deploying daemon mds.cephfs.smithi153.cbdplo on smithi153 2024-09-12T01:52:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:37 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[110992]: 2024-09-12T01:52:37.732+0000 7f25a80f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:52:38.154 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:52:37 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:52:37.754+0000 7f1f46bfc640 -1 bdev(0x562a404b2c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 7 2024-09-12T01:52:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2024-09-12T01:52:39.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:52:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:52:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: osdmap e91: 6 total, 6 up, 6 in 2024-09-12T01:52:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: Standby daemon mds.cephfs.smithi153.aiydtj assigned to filesystem cephfs as rank 0 2024-09-12T01:52:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:52:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-12T01:52:39.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:38 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi153.aiydtj=up:replay} 2 up:standby 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: pgmap v194: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: osdmap e91: 6 total, 6 up, 6 in 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: Standby daemon mds.cephfs.smithi153.aiydtj assigned to filesystem cephfs as rank 0 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-12T01:52:39.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:38 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi153.aiydtj=up:replay} 2 up:standby 2024-09-12T01:52:41.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:40 smithi066 ceph-mon[110996]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-12T01:52:41.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:40 smithi153 ceph-mon[80899]: pgmap v196: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-12T01:52:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:42 smithi066 ceph-mon[110996]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-12T01:52:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:42.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:42.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:42 smithi153 ceph-mon[80899]: pgmap v197: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 8.4 MiB/s rd, 3 op/s 2024-09-12T01:52:42.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:42.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:44.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:44 smithi066 ceph-mon[110996]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-09-12T01:52:44.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:44 smithi153 ceph-mon[80899]: pgmap v198: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 3 op/s 2024-09-12T01:52:46.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:46 smithi066 ceph-mon[110996]: pgmap v199: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-12T01:52:46.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:46 smithi066 ceph-mon[110996]: reconnect by client.24311 v1:192.168.0.1:0/1436831423 after 0 2024-09-12T01:52:46.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:46 smithi066 ceph-mon[110996]: reconnect by client.24305 v1:172.21.15.66:0/2556098362 after 0.000999982 2024-09-12T01:52:46.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:46 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:reconnect 2024-09-12T01:52:46.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:46 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi153.aiydtj=up:reconnect} 2 up:standby 2024-09-12T01:52:46.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:46 smithi153 ceph-mon[80899]: pgmap v199: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-12T01:52:46.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:46 smithi153 ceph-mon[80899]: reconnect by client.24311 v1:192.168.0.1:0/1436831423 after 0 2024-09-12T01:52:46.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:46 smithi153 ceph-mon[80899]: reconnect by client.24305 v1:172.21.15.66:0/2556098362 after 0.000999982 2024-09-12T01:52:46.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:46 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:reconnect 2024-09-12T01:52:46.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:46 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi153.aiydtj=up:reconnect} 2 up:standby 2024-09-12T01:52:47.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:47 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:rejoin 2024-09-12T01:52:47.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:47 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi153.aiydtj=up:rejoin} 2 up:standby 2024-09-12T01:52:47.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:47 smithi066 ceph-mon[110996]: daemon mds.cephfs.smithi153.aiydtj is now active in filesystem cephfs as rank 0 2024-09-12T01:52:47.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:47 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:rejoin 2024-09-12T01:52:47.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:47 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi153.aiydtj=up:rejoin} 2 up:standby 2024-09-12T01:52:47.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:47 smithi153 ceph-mon[80899]: daemon mds.cephfs.smithi153.aiydtj is now active in filesystem cephfs as rank 0 2024-09-12T01:52:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:48 smithi066 ceph-mon[110996]: pgmap v200: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-12T01:52:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:48 smithi066 ceph-mon[110996]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:52:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:48 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:52:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:48 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:active 2024-09-12T01:52:48.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:48 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi153.aiydtj=up:active} 2 up:standby 2024-09-12T01:52:48.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:48 smithi153 ceph-mon[80899]: pgmap v200: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-12T01:52:48.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:48 smithi153 ceph-mon[80899]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:52:48.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:48 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:52:48.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:48 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] up:active 2024-09-12T01:52:48.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:48 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi153.aiydtj=up:active} 2 up:standby 2024-09-12T01:52:51.383 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: pgmap v201: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:52:51.383 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:51.384 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:51.384 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:51.384 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6824/3647246533,v1:172.21.15.153:6825/3647246533] up:boot 2024-09-12T01:52:51.384 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi153.aiydtj=up:active} 3 up:standby 2024-09-12T01:52:51.384 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:51 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:52:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: pgmap v201: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:52:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:51.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6824/3647246533,v1:172.21.15.153:6825/3647246533] up:boot 2024-09-12T01:52:51.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi153.aiydtj=up:active} 3 up:standby 2024-09-12T01:52:51.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:51 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 -- 172.21.15.66:0/3802585467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 msgr2=0x7f39000fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 --2- 172.21.15.66:0/3802585467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f39000fd990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38f00048d0 tx=0x7f38f0009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 -- 172.21.15.66:0/3802585467 shutdown_connections 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 --2- 172.21.15.66:0/3802585467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39000fdf60 0x7f39001065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 --2- 172.21.15.66:0/3802585467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f39000fd990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 -- 172.21.15.66:0/3802585467 >> 172.21.15.66:0/3802585467 conn(0x7f39000f7050 msgr2=0x7f39000f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 -- 172.21.15.66:0/3802585467 shutdown_connections 2024-09-12T01:52:52.092 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.091+0000 7f3906470640 1 -- 172.21.15.66:0/3802585467 wait complete. 2024-09-12T01:52:52.093 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.092+0000 7f3906470640 1 Processor -- start 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.092+0000 7f3906470640 1 -- start start 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.092+0000 7f3906470640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f3900115420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.092+0000 7f3906470640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39000fdf60 0x7f3900115960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.092+0000 7f3906470640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900115f60 con 0x7f39000fd5c0 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.092+0000 7f3906470640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39001160d0 con 0x7f39000fdf60 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f3900115420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f3900115420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55504/0 (socket says 172.21.15.66:55504) 2024-09-12T01:52:52.094 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 -- 172.21.15.66:0/3042584378 learned_addr learned my addr 172.21.15.66:0/3042584378 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38ff7fe640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39000fdf60 0x7f3900115960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 -- 172.21.15.66:0/3042584378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39000fdf60 msgr2=0x7f3900115960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39000fdf60 0x7f3900115960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 -- 172.21.15.66:0/3042584378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005040 con 0x7f39000fd5c0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fffff640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f3900115420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38f0000c00 tx=0x7f38f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f0038070 con 0x7f39000fd5c0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38f002ade0 con 0x7f39000fd5c0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390010f4f0 con 0x7f39000fd5c0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f002c7b0 con 0x7f39000fd5c0 2024-09-12T01:52:52.095 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.093+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390010f9b0 con 0x7f39000fd5c0 2024-09-12T01:52:52.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.095+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3900066330 con 0x7f39000fd5c0 2024-09-12T01:52:52.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.095+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f38f0030020 con 0x7f39000fd5c0 2024-09-12T01:52:52.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.095+0000 7f38fcff9640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f38e806e0b0 0x7f38e8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.096+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7f38f00ae210 con 0x7f39000fd5c0 2024-09-12T01:52:52.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.096+0000 7f38ff7fe640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f38e806e0b0 0x7f38e8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.097 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.096+0000 7f38ff7fe640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f38e806e0b0 0x7f38e8070560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3900110d20 tx=0x7f38f400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.100 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.100+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f38f00773d0 con 0x7f39000fd5c0 2024-09-12T01:52:52.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.293+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f390004b7b0 con 0x7f38e806e0b0 2024-09-12T01:52:52.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.294+0000 7f38fcff9640 1 -- 172.21.15.66:0/3042584378 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f390004b7b0 con 0x7f38e806e0b0 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f38e806e0b0 msgr2=0x7f38e8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f38e806e0b0 0x7f38e8070560 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3900110d20 tx=0x7f38f400b040 comp rx=0 tx=0).stop 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 msgr2=0x7f3900115420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f3900115420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f38f0000c00 tx=0x7f38f0009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 shutdown_connections 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f38e806e0b0 0x7f38e8070560 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39000fdf60 0x7f3900115960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 --2- 172.21.15.66:0/3042584378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39000fd5c0 0x7f3900115420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 >> 172.21.15.66:0/3042584378 conn(0x7f39000f7050 msgr2=0x7f39000f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.296+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 shutdown_connections 2024-09-12T01:52:52.297 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.297+0000 7f3906470640 1 -- 172.21.15.66:0/3042584378 wait complete. 2024-09-12T01:52:52.306 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 -- 172.21.15.66:0/2216110339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 msgr2=0x7ff1640fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/2216110339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1640fe0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff1580048d0 tx=0x7ff158009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 -- 172.21.15.66:0/2216110339 shutdown_connections 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/2216110339 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1640fe0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/2216110339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 0x7ff1640656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 -- 172.21.15.66:0/2216110339 >> 172.21.15.66:0/2216110339 conn(0x7ff1640723b0 msgr2=0x7ff1640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 -- 172.21.15.66:0/2216110339 shutdown_connections 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.379+0000 7ff16a7a9640 1 -- 172.21.15.66:0/2216110339 wait complete. 2024-09-12T01:52:52.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff16a7a9640 1 Processor -- start 2024-09-12T01:52:52.381 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff16a7a9640 1 -- start start 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff16a7a9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 0x7ff1641131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff16a7a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1641136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff16a7a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff164113cf0 con 0x7ff164065c10 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff16a7a9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16410d130 con 0x7ff164065300 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff1637fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1641136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff1637fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1641136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42308/0 (socket says 172.21.15.66:42308) 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff1637fe640 1 -- 172.21.15.66:0/3120343882 learned_addr learned my addr 172.21.15.66:0/3120343882 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:52.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.380+0000 7ff163fff640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 0x7ff1641131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff1637fe640 1 -- 172.21.15.66:0/3120343882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 msgr2=0x7ff1641131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff1637fe640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 0x7ff1641131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff1637fe640 1 -- 172.21.15.66:0/3120343882 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158005040 con 0x7ff164065c10 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff163fff640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 0x7ff1641131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff1637fe640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1641136f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1580043d0 tx=0x7ff158009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff158038070 con 0x7ff164065c10 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff1580096e0 con 0x7ff164065c10 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16410d3b0 con 0x7ff164065c10 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff15803d420 con 0x7ff164065c10 2024-09-12T01:52:52.383 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.381+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16410d950 con 0x7ff164065c10 2024-09-12T01:52:52.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.382+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1640fdce0 con 0x7ff164065c10 2024-09-12T01:52:52.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.383+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff158030020 con 0x7ff164065c10 2024-09-12T01:52:52.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.383+0000 7ff160ff9640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff14c06e0b0 0x7ff14c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.384+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7ff1580ae110 con 0x7ff164065c10 2024-09-12T01:52:52.384 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.384+0000 7ff163fff640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff14c06e0b0 0x7ff14c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.385 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.384+0000 7ff163fff640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff14c06e0b0 0x7ff14c070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff154004fd0 tx=0x7ff15400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.388 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.388+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff158077350 con 0x7ff164065c10 2024-09-12T01:52:52.579 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.579+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff16410e820 con 0x7ff14c06e0b0 2024-09-12T01:52:52.580 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.580+0000 7ff160ff9640 1 -- 172.21.15.66:0/3120343882 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff16410e820 con 0x7ff14c06e0b0 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff14c06e0b0 msgr2=0x7ff14c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff14c06e0b0 0x7ff14c070560 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff154004fd0 tx=0x7ff15400b040 comp rx=0 tx=0).stop 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 msgr2=0x7ff1641136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1641136f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff1580043d0 tx=0x7ff158009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 shutdown_connections 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff14c06e0b0 0x7ff14c070560 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.583 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff164065c10 0x7ff1641136f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 --2- 172.21.15.66:0/3120343882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff164065300 0x7ff1641131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 >> 172.21.15.66:0/3120343882 conn(0x7ff1640723b0 msgr2=0x7ff1640fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 shutdown_connections 2024-09-12T01:52:52.584 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.583+0000 7ff16a7a9640 1 -- 172.21.15.66:0/3120343882 wait complete. 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.667+0000 7fd6cbb82640 1 -- 172.21.15.66:0/4066855153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 msgr2=0x7fd6c4102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.667+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/4066855153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4102950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009c50 tx=0x7fd6c0004d10 comp rx=0 tx=0).stop 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.667+0000 7fd6cbb82640 1 -- 172.21.15.66:0/4066855153 shutdown_connections 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.667+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/4066855153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 0x7fd6c40fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.667+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/4066855153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4102950 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.667+0000 7fd6cbb82640 1 -- 172.21.15.66:0/4066855153 >> 172.21.15.66:0/4066855153 conn(0x7fd6c40f81a0 msgr2=0x7fd6c40fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 -- 172.21.15.66:0/4066855153 shutdown_connections 2024-09-12T01:52:52.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 -- 172.21.15.66:0/4066855153 wait complete. 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 Processor -- start 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 -- start start 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 0x7fd6c4113760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c4113d60 con 0x7fd6c4102580 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.668+0000 7fd6cbb82640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c410d1a0 con 0x7fd6c4102f20 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42336/0 (socket says 172.21.15.66:42336) 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 -- 172.21.15.66:0/2487330614 learned_addr learned my addr 172.21.15.66:0/2487330614 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c911d640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 0x7fd6c4113760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 -- 172.21.15.66:0/2487330614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 msgr2=0x7fd6c4113760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 0x7fd6c4113760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 -- 172.21.15.66:0/2487330614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00098b0 con 0x7fd6c4102580 2024-09-12T01:52:52.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c911d640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 0x7fd6c4113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:52:52.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6c991e640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4113220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0004750 tx=0x7fd6c0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c0009590 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c410d420 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6c00096f0 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c003d960 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.669+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c410d9c0 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.670+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c40fdd00 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.671+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd6c002f030 con 0x7fd6c4102580 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.671+0000 7fd6ba7fc640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd6b006e0b0 0x7fd6b0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.671+0000 7fd6c911d640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd6b006e0b0 0x7fd6b0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.671+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7fd6c00af110 con 0x7fd6c4102580 2024-09-12T01:52:52.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.672+0000 7fd6c911d640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd6b006e0b0 0x7fd6b0070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4004fd0 tx=0x7fd6b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.676 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.676+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd6c0078390 con 0x7fd6c4102580 2024-09-12T01:52:52.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.858+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6c404b720 con 0x7fd6b006e0b0 2024-09-12T01:52:52.866 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.866+0000 7fd6ba7fc640 1 -- 172.21.15.66:0/2487330614 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd6c404b720 con 0x7fd6b006e0b0 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (7m) 22s ago 17m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (4m) 22s ago 17m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (4m) 0s ago 16m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (6m) 22s ago 17m 83.3M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (51s) 22s ago 12m 12.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 29e4ff8a116d 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (27s) 22s ago 12m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 7c30799cb039 2024-09-12T01:52:52.867 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (11m) 0s ago 11m 82.4M - 17.2.7-1609-g554ba93e d4c538e492e4 6107d7e1c526 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (3s) 0s ago 12m 14.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 7907c9c2d5ff 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (8m) 22s ago 18m 504M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (7m) 0s ago 16m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (5m) 22s ago 18m 52.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (4m) 0s ago 16m 41.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (7m) 22s ago 17m 16.5M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (7m) 0s ago 16m 17.0M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (3m) 22s ago 15m 152M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (3m) 22s ago 15m 148M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (2m) 22s ago 14m 140M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:52:52.868 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (2m) 0s ago 14m 119M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:52:52.869 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (99s) 0s ago 14m 142M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 6b77ec5616ac 2024-09-12T01:52:52.869 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (67s) 0s ago 13m 118M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 1c0a4ea58d83 2024-09-12T01:52:52.869 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (7m) 22s ago 16m 64.6M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:52:52.869 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.868+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd6b006e0b0 msgr2=0x7fd6b0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.868+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd6b006e0b0 0x7fd6b0070560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4004fd0 tx=0x7fd6b400b040 comp rx=0 tx=0).stop 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.868+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 msgr2=0x7fd6c4113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.868+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4113220 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0004750 tx=0x7fd6c0004d10 comp rx=0 tx=0).stop 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.868+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 shutdown_connections 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.869+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd6b006e0b0 0x7fd6b0070560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.869+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6c4102f20 0x7fd6c4113760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.869+0000 7fd6cbb82640 1 --2- 172.21.15.66:0/2487330614 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6c4102580 0x7fd6c4113220 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.869+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 >> 172.21.15.66:0/2487330614 conn(0x7fd6c40f81a0 msgr2=0x7fd6c40f91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.869+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 shutdown_connections 2024-09-12T01:52:52.870 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.869+0000 7fd6cbb82640 1 -- 172.21.15.66:0/2487330614 wait complete. 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 -- 172.21.15.66:0/1246816276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 msgr2=0x7f3cec0fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 --2- 172.21.15.66:0/1246816276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec0fb0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00048d0 tx=0x7f3ce0009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 -- 172.21.15.66:0/1246816276 shutdown_connections 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 --2- 172.21.15.66:0/1246816276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec0fb0f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 --2- 172.21.15.66:0/1246816276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cec102620 0x7f3cec1029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 -- 172.21.15.66:0/1246816276 >> 172.21.15.66:0/1246816276 conn(0x7f3cec070ce0 msgr2=0x7f3cec0710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:52.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 -- 172.21.15.66:0/1246816276 shutdown_connections 2024-09-12T01:52:52.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.948+0000 7f3cf0852640 1 -- 172.21.15.66:0/1246816276 wait complete. 2024-09-12T01:52:52.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.949+0000 7f3cf0852640 1 Processor -- start 2024-09-12T01:52:52.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.949+0000 7f3cf0852640 1 -- start start 2024-09-12T01:52:52.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.949+0000 7f3cf0852640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cf0852640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cec102620 0x7f3cec1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cf0852640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec113cf0 con 0x7f3cec0fac80 2024-09-12T01:52:52.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cf0852640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec10d180 con 0x7f3cec102620 2024-09-12T01:52:52.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42354/0 (socket says 172.21.15.66:42354) 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 -- 172.21.15.66:0/835238549 learned_addr learned my addr 172.21.15.66:0/835238549 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3ce9d9b640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cec102620 0x7f3cec1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 -- 172.21.15.66:0/835238549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cec102620 msgr2=0x7f3cec1136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cec102620 0x7f3cec1136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 -- 172.21.15.66:0/835238549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce0005040 con 0x7f3cec0fac80 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cea59c640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec1131b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc002a80 tx=0x7f3cdc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.950+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cdc007c30 con 0x7f3cec0fac80 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.951+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec10d460 con 0x7f3cec0fac80 2024-09-12T01:52:52.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.951+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3cdc00f040 con 0x7f3cec0fac80 2024-09-12T01:52:52.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.951+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec10d950 con 0x7f3cec0fac80 2024-09-12T01:52:52.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.951+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cdc00dab0 con 0x7f3cec0fac80 2024-09-12T01:52:52.953 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.952+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec0657b0 con 0x7f3cec0fac80 2024-09-12T01:52:52.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.952+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3cdc00dc30 con 0x7f3cec0fac80 2024-09-12T01:52:52.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.953+0000 7f3cdaffd640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3cd406e0b0 0x7f3cd4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:52.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.953+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7f3cdc08d580 con 0x7f3cec0fac80 2024-09-12T01:52:52.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.953+0000 7f3ce9d9b640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3cd406e0b0 0x7f3cd4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:52.954 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.953+0000 7f3ce9d9b640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3cd406e0b0 0x7f3cd4070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009ac0 tx=0x7f3ce0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:52.957 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:52.957+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3cdc0567f0 con 0x7f3cec0fac80 2024-09-12T01:52:53.205 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.205+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3cec04b720 con 0x7f3cec0fac80 2024-09-12T01:52:53.206 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:53 smithi066 ceph-mon[110996]: pgmap v202: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:52:53.206 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:53 smithi066 ceph-mon[110996]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:53.206 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:53.206 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:53 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:53.206 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.206+0000 7f3cdaffd640 1 -- 172.21.15.66:0/835238549 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f3cdc059eb0 con 0x7f3cec0fac80 2024-09-12T01:52:53.206 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 6 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 1, 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 3 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:52:53.207 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:52:53.208 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 17.2.7-1609-g554ba93e (554ba93e80bae18b3c5f0b2f10382dfb620c171f) quincy (stable)": 1, 2024-09-12T01:52:53.208 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 13 2024-09-12T01:52:53.208 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:52:53.208 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:52:53.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3cd406e0b0 msgr2=0x7f3cd4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.208 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3cd406e0b0 0x7f3cd4070560 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009ac0 tx=0x7f3ce0035040 comp rx=0 tx=0).stop 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 msgr2=0x7f3cec1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec1131b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc002a80 tx=0x7f3cdc004600 comp rx=0 tx=0).stop 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 shutdown_connections 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3cd406e0b0 0x7f3cd4070560 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cec102620 0x7f3cec1136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 --2- 172.21.15.66:0/835238549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cec0fac80 0x7f3cec1131b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 >> 172.21.15.66:0/835238549 conn(0x7f3cec070ce0 msgr2=0x7f3cec100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 shutdown_connections 2024-09-12T01:52:53.209 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.208+0000 7f3cf0852640 1 -- 172.21.15.66:0/835238549 wait complete. 2024-09-12T01:52:53.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 -- 172.21.15.66:0/888705391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9740fb470 msgr2=0x7fd9740fb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.291 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/888705391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9740fb470 0x7fd9740fb8e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd9680048d0 tx=0x7fd968009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 -- 172.21.15.66:0/888705391 shutdown_connections 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/888705391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9740fb470 0x7fd9740fb8e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/888705391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9741014b0 0x7fd974101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 -- 172.21.15.66:0/888705391 >> 172.21.15.66:0/888705391 conn(0x7fd9740f7030 msgr2=0x7fd9740f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 -- 172.21.15.66:0/888705391 shutdown_connections 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 -- 172.21.15.66:0/888705391 wait complete. 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 Processor -- start 2024-09-12T01:52:53.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.291+0000 7fd97b9cb640 1 -- start start 2024-09-12T01:52:53.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd97b9cb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740fb470 0x7fd974113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd97b9cb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 0x7fd9741136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd97b9cb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd974113cd0 con 0x7fd9741014b0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd97b9cb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97410d110 con 0x7fd9740fb470 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 0x7fd9741136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 0x7fd9741136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42378/0 (socket says 172.21.15.66:42378) 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 -- 172.21.15.66:0/1127410396 learned_addr learned my addr 172.21.15.66:0/1127410396 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd979767640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740fb470 0x7fd974113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 -- 172.21.15.66:0/1127410396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740fb470 msgr2=0x7fd974113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740fb470 0x7fd974113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 -- 172.21.15.66:0/1127410396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968005040 con 0x7fd9741014b0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd978f66640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 0x7fd9741136d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd968000c00 tx=0x7fd968009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.292+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd968038070 con 0x7fd9741014b0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.293+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd96802ade0 con 0x7fd9741014b0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.293+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97410d390 con 0x7fd9741014b0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.293+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96802c7b0 con 0x7fd9741014b0 2024-09-12T01:52:53.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.293+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97410d8d0 con 0x7fd9741014b0 2024-09-12T01:52:53.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.294+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9740fcbb0 con 0x7fd9741014b0 2024-09-12T01:52:53.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.294+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fd968030020 con 0x7fd9741014b0 2024-09-12T01:52:53.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.295+0000 7fd971ffb640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd95c06e0b0 0x7fd95c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.295+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7fd9680ae150 con 0x7fd9741014b0 2024-09-12T01:52:53.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.295+0000 7fd979767640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd95c06e0b0 0x7fd95c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.295+0000 7fd979767640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd95c06e0b0 0x7fd95c070560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009af0 tx=0x7fd96c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:53.299 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.299+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd968077310 con 0x7fd9741014b0 2024-09-12T01:52:53.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:53 smithi153 ceph-mon[80899]: pgmap v202: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-12T01:52:53.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:53 smithi153 ceph-mon[80899]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:53.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:53.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:53 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:53.518 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.518+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd974108450 con 0x7fd9741014b0 2024-09-12T01:52:53.519 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.519+0000 7fd971ffb640 1 -- 172.21.15.66:0/1127410396 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1932 (secure 0 0 0) 0x7fd96807a9d0 con 0x7fd9741014b0 2024-09-12T01:52:53.519 INFO:teuthology.orchestra.run.smithi066.stdout:e30 2024-09-12T01:52:53.519 INFO:teuthology.orchestra.run.smithi066.stdout:btime 2024-09-12T01:52:50:500205+0000 2024-09-12T01:52:53.519 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:52:53.519 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 29 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:52:47.492277+0000 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:52:53.520 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 91 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=24285} 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:52:53.521 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 24285 members: 24285 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{0:24285} state up:active seq 181 join_fscid=1 addr [v2:172.21.15.153:6826/3033263442,v1:172.21.15.153:6827/3033263442] compat {c=[1],r=[1],i=[7ff]}] 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{-1:34376} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{-1:34408} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6828/1762724759,v1:172.21.15.66:6829/1762724759] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:52:53.522 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:44337} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3647246533,v1:172.21.15.153:6825/3647246533] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:52:53.523 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 30 2024-09-12T01:52:53.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd95c06e0b0 msgr2=0x7fd95c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd95c06e0b0 0x7fd95c070560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009af0 tx=0x7fd96c00b040 comp rx=0 tx=0).stop 2024-09-12T01:52:53.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 msgr2=0x7fd9741136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 0x7fd9741136d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd968000c00 tx=0x7fd968009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.523 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 shutdown_connections 2024-09-12T01:52:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fd95c06e0b0 0x7fd95c070560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd9741014b0 0x7fd9741136d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 --2- 172.21.15.66:0/1127410396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9740fb470 0x7fd974113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.522+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 >> 172.21.15.66:0/1127410396 conn(0x7fd9740f7030 msgr2=0x7fd974065810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.523+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 shutdown_connections 2024-09-12T01:52:53.524 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.523+0000 7fd97b9cb640 1 -- 172.21.15.66:0/1127410396 wait complete. 2024-09-12T01:52:53.608 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 -- 172.21.15.66:0/1313335383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 msgr2=0x7f2494065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 --2- 172.21.15.66:0/1313335383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f2494065430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f247c0048d0 tx=0x7f247c009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 -- 172.21.15.66:0/1313335383 shutdown_connections 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 --2- 172.21.15.66:0/1313335383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f2494065430 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 --2- 172.21.15.66:0/1313335383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24940fe450 0x7f24940fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 -- 172.21.15.66:0/1313335383 >> 172.21.15.66:0/1313335383 conn(0x7f24940723b0 msgr2=0x7f24940727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 -- 172.21.15.66:0/1313335383 shutdown_connections 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 -- 172.21.15.66:0/1313335383 wait complete. 2024-09-12T01:52:53.609 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.608+0000 7f249a95a640 1 Processor -- start 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f249a95a640 1 -- start start 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f249a95a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f24940fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f249a95a640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24940fe450 0x7f24940fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f249a95a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940fbfe0 con 0x7f2494064fe0 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f249a95a640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24940fc150 con 0x7f24940fe450 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f2493fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f24940fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f2493fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f24940fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42388/0 (socket says 172.21.15.66:42388) 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f2493fff640 1 -- 172.21.15.66:0/1906476996 learned_addr learned my addr 172.21.15.66:0/1906476996 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f24937fe640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24940fe450 0x7f24940fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f2493fff640 1 -- 172.21.15.66:0/1906476996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24940fe450 msgr2=0x7f24940fbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f2493fff640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24940fe450 0x7f24940fbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.609+0000 7f2493fff640 1 -- 172.21.15.66:0/1906476996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c005040 con 0x7f2494064fe0 2024-09-12T01:52:53.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.610+0000 7f2493fff640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f24940fb560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2484002a80 tx=0x7f2484004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:53.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.610+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2484007c30 con 0x7f2494064fe0 2024-09-12T01:52:53.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.610+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f248400f040 con 0x7f2494064fe0 2024-09-12T01:52:53.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.610+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24940fc3e0 con 0x7f2494064fe0 2024-09-12T01:52:53.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.610+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f248400dab0 con 0x7f2494064fe0 2024-09-12T01:52:53.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.610+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2494119830 con 0x7f2494064fe0 2024-09-12T01:52:53.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.611+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24940fdce0 con 0x7f2494064fe0 2024-09-12T01:52:53.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.611+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f248400dc30 con 0x7f2494064fe0 2024-09-12T01:52:53.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.612+0000 7f2490ff9640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248006e0b0 0x7f2480070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.612+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7f248408d4d0 con 0x7f2494064fe0 2024-09-12T01:52:53.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.612+0000 7f24937fe640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248006e0b0 0x7f2480070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.613+0000 7f24937fe640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248006e0b0 0x7f2480070560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f247c009ac0 tx=0x7f247c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:53.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.616+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f24840567c0 con 0x7f2494064fe0 2024-09-12T01:52:53.809 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.809+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f249404b7b0 con 0x7f248006e0b0 2024-09-12T01:52:53.810 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.810+0000 7f2490ff9640 1 -- 172.21.15.66:0/1906476996 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f249404b7b0 con 0x7f248006e0b0 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66", 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": true, 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [ 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr", 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "crash", 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "osd", 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "mon" 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: ], 2024-09-12T01:52:53.811 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": "15/21 daemons upgraded", 2024-09-12T01:52:53.812 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "Currently upgrading mds daemons", 2024-09-12T01:52:53.812 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:52:53.812 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:52:53.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248006e0b0 msgr2=0x7f2480070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248006e0b0 0x7f2480070560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f247c009ac0 tx=0x7f247c035040 comp rx=0 tx=0).stop 2024-09-12T01:52:53.814 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 msgr2=0x7f24940fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f24940fb560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2484002a80 tx=0x7f2484004600 comp rx=0 tx=0).stop 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 shutdown_connections 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f248006e0b0 0x7f2480070560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24940fe450 0x7f24940fbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 --2- 172.21.15.66:0/1906476996 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2494064fe0 0x7f24940fb560 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 >> 172.21.15.66:0/1906476996 conn(0x7f24940723b0 msgr2=0x7f2494105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.813+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 shutdown_connections 2024-09-12T01:52:53.815 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.814+0000 7f249a95a640 1 -- 172.21.15.66:0/1906476996 wait complete. 2024-09-12T01:52:53.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.894+0000 7ff6ef163640 1 -- 172.21.15.66:0/3807181441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 msgr2=0x7ff6e81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.894+0000 7ff6ef163640 1 --2- 172.21.15.66:0/3807181441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e81029f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff6d80048d0 tx=0x7ff6d8009da0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.894+0000 7ff6ef163640 1 -- 172.21.15.66:0/3807181441 shutdown_connections 2024-09-12T01:52:53.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.894+0000 7ff6ef163640 1 --2- 172.21.15.66:0/3807181441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80fac80 0x7ff6e80fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.894+0000 7ff6ef163640 1 --2- 172.21.15.66:0/3807181441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e81029f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.896 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 -- 172.21.15.66:0/3807181441 >> 172.21.15.66:0/3807181441 conn(0x7ff6e8070ce0 msgr2=0x7ff6e80710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 -- 172.21.15.66:0/3807181441 shutdown_connections 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 -- 172.21.15.66:0/3807181441 wait complete. 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 Processor -- start 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 -- start start 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80fac80 0x7ff6e81131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e8113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8113dc0 con 0x7ff6e8102620 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.895+0000 7ff6ef163640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e810d170 con 0x7ff6e80fac80 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e8113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e8113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:42418/0 (socket says 172.21.15.66:42418) 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 -- 172.21.15.66:0/2346165901 learned_addr learned my addr 172.21.15.66:0/2346165901 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6eceff640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80fac80 0x7ff6e81131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 -- 172.21.15.66:0/2346165901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80fac80 msgr2=0x7ff6e81131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80fac80 0x7ff6e81131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:53.897 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 -- 172.21.15.66:0/2346165901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8005040 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e7fff640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e8113730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bbb0 tx=0x7ff6d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d000c9c0 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff6d00092e0 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e810d450 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6d0007640 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.896+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e810d970 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.897+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e80657b0 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.898+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff6d0012070 con 0x7ff6e8102620 2024-09-12T01:52:53.899 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.899+0000 7ff6e57fa640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff6d406e0b0 0x7ff6d4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:52:53.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.899+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6851+0+0 (secure 0 0 0) 0x7ff6d008ded0 con 0x7ff6e8102620 2024-09-12T01:52:53.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.899+0000 7ff6eceff640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff6d406e0b0 0x7ff6d4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:52:53.900 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.899+0000 7ff6eceff640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff6d406e0b0 0x7ff6d4070560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009ac0 tx=0x7ff6d8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:52:53.905 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:53.903+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff6d0057090 con 0x7ff6e8102620 2024-09-12T01:52:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:54 smithi066 ceph-mon[110996]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:54 smithi066 ceph-mon[110996]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:54 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/835238549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:54 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:54 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:54.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:54 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1127410396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:52:54.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.147+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff6e81095f0 con 0x7ff6e8102620 2024-09-12T01:52:54.147 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.147+0000 7ff6e57fa640 1 -- 172.21.15.66:0/2346165901 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff6d005a750 con 0x7ff6e8102620 2024-09-12T01:52:54.148 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_OK 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.149+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff6d406e0b0 msgr2=0x7ff6d4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.149+0000 7ff6ef163640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff6d406e0b0 0x7ff6d4070560 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009ac0 tx=0x7ff6d8035040 comp rx=0 tx=0).stop 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.149+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 msgr2=0x7ff6e8113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.149+0000 7ff6ef163640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e8113730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bbb0 tx=0x7ff6d0009840 comp rx=0 tx=0).stop 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 shutdown_connections 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff6d406e0b0 0x7ff6d4070560 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6e8102620 0x7ff6e8113730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 --2- 172.21.15.66:0/2346165901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6e80fac80 0x7ff6e81131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 >> 172.21.15.66:0/2346165901 conn(0x7ff6e8070ce0 msgr2=0x7ff6e8105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 shutdown_connections 2024-09-12T01:52:54.150 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:52:54.150+0000 7ff6ef163640 1 -- 172.21.15.66:0/2346165901 wait complete. 2024-09-12T01:52:54.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:54 smithi153 ceph-mon[80899]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:54.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:54 smithi153 ceph-mon[80899]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:54.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:54 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/835238549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:54.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:54 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:54.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:54 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:54.219 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:54 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1127410396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:52:55.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:55 smithi153 ceph-mon[80899]: pgmap v203: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:52:55.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:55 smithi153 ceph-mon[80899]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:55.106 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:55 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2346165901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:52:55.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:55 smithi066 ceph-mon[110996]: pgmap v203: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:52:55.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:55 smithi066 ceph-mon[110996]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:52:55.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:55 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2346165901' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:52:57.122 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: pgmap v204: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:57.123 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.124 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.124 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.124 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: pgmap v204: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 8.9 MiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-09-12T01:52:57.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:52:57.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:57.391 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:52:59.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:58 smithi066 ceph-mon[110996]: pgmap v205: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:52:59.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:58 smithi066 ceph-mon[110996]: Upgrade: Updating mds.cephfs.smithi153.aiydtj 2024-09-12T01:52:59.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:58 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:59.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:58 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:52:59.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:58 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:59.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:58 smithi066 ceph-mon[110996]: Deploying daemon mds.cephfs.smithi153.aiydtj on smithi153 2024-09-12T01:52:59.250 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:58 smithi153 ceph-mon[80899]: pgmap v205: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:52:59.250 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:58 smithi153 ceph-mon[80899]: Upgrade: Updating mds.cephfs.smithi153.aiydtj 2024-09-12T01:52:59.251 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:58 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:52:59.251 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:58 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi153.aiydtj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-12T01:52:59.251 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:58 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:52:59.251 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:58 smithi153 ceph-mon[80899]: Deploying daemon mds.cephfs.smithi153.aiydtj on smithi153 2024-09-12T01:53:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[110992]: 2024-09-12T01:52:59.964+0000 7f25a80f3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:53:00.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:53:00.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:53:00.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: osdmap e92: 6 total, 6 up, 6 in 2024-09-12T01:53:00.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: Standby daemon mds.cephfs.smithi066.ipygev assigned to filesystem cephfs as rank 0 2024-09-12T01:53:00.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:53:00.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-12T01:53:00.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:52:59 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi066.ipygev=up:replay} 2 up:standby 2024-09-12T01:53:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-12T01:53:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:53:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: osdmap e92: 6 total, 6 up, 6 in 2024-09-12T01:53:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: Standby daemon mds.cephfs.smithi066.ipygev assigned to filesystem cephfs as rank 0 2024-09-12T01:53:00.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-12T01:53:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-12T01:53:00.406 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:52:59 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi066.ipygev=up:replay} 2 up:standby 2024-09-12T01:53:01.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:00 smithi066 ceph-mon[110996]: pgmap v206: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:01.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:00 smithi153 ceph-mon[80899]: pgmap v206: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:02 smithi066 ceph-mon[110996]: pgmap v208: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-12T01:53:03.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:02 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:53:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:02 smithi153 ceph-mon[80899]: pgmap v208: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 307 B/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-12T01:53:03.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:02 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:53:05.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:04 smithi066 ceph-mon[110996]: pgmap v209: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-12T01:53:05.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:04 smithi153 ceph-mon[80899]: pgmap v209: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 4.7 KiB/s wr, 2 op/s 2024-09-12T01:53:07.355 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:06 smithi153 ceph-mon[80899]: pgmap v210: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-12T01:53:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:06 smithi066 ceph-mon[110996]: pgmap v210: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-12T01:53:09.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:09 smithi066 ceph-mon[110996]: pgmap v211: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:53:09.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:09 smithi066 ceph-mon[110996]: reconnect by client.24305 v1:172.21.15.66:0/2556098362 after 0 2024-09-12T01:53:09.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:09 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:reconnect 2024-09-12T01:53:09.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:09 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi066.ipygev=up:reconnect} 2 up:standby 2024-09-12T01:53:09.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:09 smithi066 ceph-mon[110996]: reconnect by client.24311 v1:192.168.0.1:0/1436831423 after 0.00399997 2024-09-12T01:53:09.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:09 smithi153 ceph-mon[80899]: pgmap v211: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-12T01:53:09.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:09 smithi153 ceph-mon[80899]: reconnect by client.24305 v1:172.21.15.66:0/2556098362 after 0 2024-09-12T01:53:09.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:09 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:reconnect 2024-09-12T01:53:09.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:09 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi066.ipygev=up:reconnect} 2 up:standby 2024-09-12T01:53:09.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:09 smithi153 ceph-mon[80899]: reconnect by client.24311 v1:192.168.0.1:0/1436831423 after 0.00399997 2024-09-12T01:53:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:10 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:rejoin 2024-09-12T01:53:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:10 smithi153 ceph-mon[80899]: fsmap cephfs:1/1 {0=cephfs.smithi066.ipygev=up:rejoin} 2 up:standby 2024-09-12T01:53:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:10 smithi153 ceph-mon[80899]: daemon mds.cephfs.smithi066.ipygev is now active in filesystem cephfs as rank 0 2024-09-12T01:53:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:10 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:10 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:10.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:10 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:10.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:10 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:rejoin 2024-09-12T01:53:10.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:10 smithi066 ceph-mon[110996]: fsmap cephfs:1/1 {0=cephfs.smithi066.ipygev=up:rejoin} 2 up:standby 2024-09-12T01:53:10.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:10 smithi066 ceph-mon[110996]: daemon mds.cephfs.smithi066.ipygev is now active in filesystem cephfs as rank 0 2024-09-12T01:53:10.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:10 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:10.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:10 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:10.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:10 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-12T01:53:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:53:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: Cluster is now healthy 2024-09-12T01:53:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:active 2024-09-12T01:53:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: mds.? [v2:172.21.15.153:6826/1172093134,v1:172.21.15.153:6827/1172093134] up:boot 2024-09-12T01:53:11.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:53:11.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:53:11.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: pgmap v212: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-12T01:53:11.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-12T01:53:11.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: Cluster is now healthy 2024-09-12T01:53:11.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] up:active 2024-09-12T01:53:11.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: mds.? [v2:172.21.15.153:6826/1172093134,v1:172.21.15.153:6827/1172093134] up:boot 2024-09-12T01:53:11.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:53:11.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:53:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:12 smithi066 ceph-mon[110996]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 177 B/s wr, 5 op/s 2024-09-12T01:53:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.752 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.752 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.753 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:12.753 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:12 smithi153 ceph-mon[80899]: pgmap v213: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 177 B/s wr, 5 op/s 2024-09-12T01:53:12.753 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:12.753 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:14.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:14 smithi066 ceph-mon[110996]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:53:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:14 smithi153 ceph-mon[80899]: pgmap v214: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 170 B/s wr, 5 op/s 2024-09-12T01:53:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.ipygev"}]': finished 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:53:16.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.jacfsu"}]': finished 2024-09-12T01:53:16.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:53:16.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.aiydtj"}]': finished 2024-09-12T01:53:16.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:53:16.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.cbdplo"}]': finished 2024-09-12T01:53:16.641 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-12T01:53:16.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.ipygev"}]: dispatch 2024-09-12T01:53:16.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.ipygev"}]': finished 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.jacfsu"}]: dispatch 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi066.jacfsu"}]': finished 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.aiydtj"}]: dispatch 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.aiydtj"}]': finished 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.cbdplo"}]: dispatch 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi153.cbdplo"}]': finished 2024-09-12T01:53:16.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-09-12T01:53:17.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-12T01:53:17.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all mds 2024-09-12T01:53:17.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: Upgrade: Setting filesystem cephfs Joinable 2024-09-12T01:53:17.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.656 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-12T01:53:17.657 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-12T01:53:17.658 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:17.659 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:17.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:17.660 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: pgmap v215: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.1 KiB/s wr, 10 op/s 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all mds 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: Upgrade: Setting filesystem cephfs Joinable 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: fsmap cephfs:1 {0=cephfs.smithi066.ipygev=up:active} 3 up:standby 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.890 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:17.891 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-12T01:53:17.892 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.893 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:53:17.894 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:18.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all rgw 2024-09-12T01:53:18.798 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all rbd-mirror 2024-09-12T01:53:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all ceph-exporter 2024-09-12T01:53:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all iscsi 2024-09-12T01:53:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all nfs 2024-09-12T01:53:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Setting container_image for all nvmeof 2024-09-12T01:53:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Finalizing container_image settings 2024-09-12T01:53:18.799 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:18 smithi066 ceph-mon[110996]: Upgrade: Complete! 2024-09-12T01:53:18.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all rgw 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all rbd-mirror 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all ceph-exporter 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all iscsi 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all nfs 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Setting container_image for all nvmeof 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Finalizing container_image settings 2024-09-12T01:53:18.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:18 smithi153 ceph-mon[80899]: Upgrade: Complete! 2024-09-12T01:53:19.694 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:19 smithi066 ceph-mon[110996]: pgmap v216: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:19.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:19 smithi153 ceph-mon[80899]: pgmap v216: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:20.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:20 smithi066 ceph-mon[110996]: pgmap v217: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:20.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:20 smithi153 ceph-mon[80899]: pgmap v217: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:22 smithi066 ceph-mon[110996]: pgmap v218: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:22.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:22 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:22.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:22 smithi153 ceph-mon[80899]: pgmap v218: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-09-12T01:53:22.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:22 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 -- 172.21.15.66:0/3065594618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 msgr2=0x7f43601029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 --2- 172.21.15.66:0/3065594618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f43601029f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f43500048d0 tx=0x7f4350009da0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 -- 172.21.15.66:0/3065594618 shutdown_connections 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 --2- 172.21.15.66:0/3065594618 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 0x7f43600fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 --2- 172.21.15.66:0/3065594618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f43601029f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 -- 172.21.15.66:0/3065594618 >> 172.21.15.66:0/3065594618 conn(0x7f4360070ce0 msgr2=0x7f43600710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 -- 172.21.15.66:0/3065594618 shutdown_connections 2024-09-12T01:53:24.246 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.245+0000 7f4364d0b640 1 -- 172.21.15.66:0/3065594618 wait complete. 2024-09-12T01:53:24.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f4364d0b640 1 Processor -- start 2024-09-12T01:53:24.247 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f4364d0b640 1 -- start start 2024-09-12T01:53:24.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f4364d0b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 0x7f43601131f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f4364d0b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f4360113730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f4364d0b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360113d30 con 0x7f4360102620 2024-09-12T01:53:24.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f4364d0b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436010d170 con 0x7f43600fac80 2024-09-12T01:53:24.248 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f435dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f4360113730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f435e59c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 0x7f43601131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f435dd9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f4360113730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44612/0 (socket says 172.21.15.66:44612) 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.246+0000 7f435dd9b640 1 -- 172.21.15.66:0/2714993495 learned_addr learned my addr 172.21.15.66:0/2714993495 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f435dd9b640 1 -- 172.21.15.66:0/2714993495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 msgr2=0x7f43601131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f435dd9b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 0x7f43601131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f435dd9b640 1 -- 172.21.15.66:0/2714993495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350005040 con 0x7f4360102620 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f435e59c640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 0x7f43601131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f435dd9b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f4360113730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4354002a50 tx=0x7f4354004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4354007c30 con 0x7f4360102620 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f435400f040 con 0x7f4360102620 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436010d450 con 0x7f4360102620 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f435400da50 con 0x7f4360102620 2024-09-12T01:53:24.249 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.247+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436010d9f0 con 0x7f4360102620 2024-09-12T01:53:24.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.248+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43600657b0 con 0x7f4360102620 2024-09-12T01:53:24.250 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.249+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f435400dbf0 con 0x7f4360102620 2024-09-12T01:53:24.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.249+0000 7f434effd640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f434806e0b0 0x7f4348070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:24.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.250+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f435408d4a0 con 0x7f4360102620 2024-09-12T01:53:24.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.250+0000 7f435e59c640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f434806e0b0 0x7f4348070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:24.251 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.250+0000 7f435e59c640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f434806e0b0 0x7f4348070560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ac0 tx=0x7f4350035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:24.254 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.254+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f43540566c0 con 0x7f4360102620 2024-09-12T01:53:24.451 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.451+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4360109590 con 0x7f434806e0b0 2024-09-12T01:53:24.452 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.452+0000 7f434effd640 1 -- 172.21.15.66:0/2714993495 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f4360109590 con 0x7f434806e0b0 2024-09-12T01:53:24.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.454+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f434806e0b0 msgr2=0x7f4348070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.454+0000 7f4364d0b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f434806e0b0 0x7f4348070560 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4350009ac0 tx=0x7f4350035040 comp rx=0 tx=0).stop 2024-09-12T01:53:24.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.454+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 msgr2=0x7f4360113730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:24.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.454+0000 7f4364d0b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f4360113730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4354002a50 tx=0x7f4354004600 comp rx=0 tx=0).stop 2024-09-12T01:53:24.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 shutdown_connections 2024-09-12T01:53:24.455 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f434806e0b0 0x7f4348070560 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4360102620 0x7f4360113730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 --2- 172.21.15.66:0/2714993495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43600fac80 0x7f43601131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:24.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 >> 172.21.15.66:0/2714993495 conn(0x7f4360070ce0 msgr2=0x7f4360105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:24.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 shutdown_connections 2024-09-12T01:53:24.456 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:24.455+0000 7f4364d0b640 1 -- 172.21.15.66:0/2714993495 wait complete. 2024-09-12T01:53:24.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:24 smithi066 ceph-mon[110996]: pgmap v219: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-12T01:53:24.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:24 smithi153 ceph-mon[80899]: pgmap v219: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-12T01:53:25.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch ps' 2024-09-12T01:53:25.489 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:53:25.824 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:25 smithi066 ceph-mon[110996]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:25.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:25 smithi153 ceph-mon[80899]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:26.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:26 smithi066 ceph-mon[110996]: pgmap v220: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-12T01:53:26.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:26.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:26 smithi153 ceph-mon[80899]: pgmap v220: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 3.9 KiB/s wr, 4 op/s 2024-09-12T01:53:26.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:27.166 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.164+0000 7f805c07c640 1 -- 172.21.15.66:0/2463620158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102550 msgr2=0x7f8054102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.164+0000 7f805c07c640 1 --2- 172.21.15.66:0/2463620158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102550 0x7f8054102920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8044009c50 tx=0x7f8044004d10 comp rx=0 tx=0).stop 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.164+0000 7f805c07c640 1 -- 172.21.15.66:0/2463620158 shutdown_connections 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 --2- 172.21.15.66:0/2463620158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8054102ef0 0x7f80540fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 --2- 172.21.15.66:0/2463620158 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102550 0x7f8054102920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 -- 172.21.15.66:0/2463620158 >> 172.21.15.66:0/2463620158 conn(0x7f80540f80f0 msgr2=0x7f80540fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 -- 172.21.15.66:0/2463620158 shutdown_connections 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 -- 172.21.15.66:0/2463620158 wait complete. 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 Processor -- start 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 -- start start 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.165+0000 7f805c07c640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8054102550 0x7f8054113540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f805c07c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 0x7f8054113a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f805c07c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80541140d0 con 0x7f8054102ef0 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f805c07c640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805410d4e0 con 0x7f8054102550 2024-09-12T01:53:27.167 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 0x7f8054113a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 0x7f8054113a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44626/0 (socket says 172.21.15.66:44626) 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 -- 172.21.15.66:0/4214504118 learned_addr learned my addr 172.21.15.66:0/4214504118 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059e18640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8054102550 0x7f8054113540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 -- 172.21.15.66:0/4214504118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8054102550 msgr2=0x7f8054113540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8054102550 0x7f8054113540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 -- 172.21.15.66:0/4214504118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440098b0 con 0x7f8054102ef0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f8059617640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 0x7f8054113a80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8048002840 tx=0x7f8048004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8048007c30 con 0x7f8054102ef0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f804800f040 con 0x7f8054102ef0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805410d7c0 con 0x7f8054102ef0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8048009410 con 0x7f8054102ef0 2024-09-12T01:53:27.168 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.166+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805410dd60 con 0x7f8054102ef0 2024-09-12T01:53:27.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.167+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80540fdcd0 con 0x7f8054102ef0 2024-09-12T01:53:27.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.168+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f80480096d0 con 0x7f8054102ef0 2024-09-12T01:53:27.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.169+0000 7f80527fc640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f803c06e0b0 0x7f803c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:27.169 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.169+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f804808d590 con 0x7f8054102ef0 2024-09-12T01:53:27.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.169+0000 7f8059e18640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f803c06e0b0 0x7f803c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:27.170 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.169+0000 7f8059e18640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f803c06e0b0 0x7f803c070560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8044009c20 tx=0x7f8044004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:27.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.173+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f80480567b0 con 0x7f8054102ef0 2024-09-12T01:53:27.358 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.357+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8054109630 con 0x7f803c06e0b0 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.367+0000 7f80527fc640 1 -- 172.21.15.66:0/4214504118 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8054109630 con 0x7f803c06e0b0 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (7m) 56s ago 17m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (4m) 56s ago 18m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (4m) 15s ago 17m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (7m) 56s ago 17m 83.3M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (85s) 56s ago 12m 12.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 29e4ff8a116d 2024-09-12T01:53:27.367 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (61s) 56s ago 12m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 7c30799cb039 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (18s) 15s ago 12m 11.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 976d06b8e891 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (37s) 15s ago 12m 15.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 7907c9c2d5ff 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (9m) 56s ago 19m 504M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (8m) 15s ago 17m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (5m) 56s ago 19m 52.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (5m) 15s ago 17m 42.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (8m) 56s ago 18m 16.5M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (8m) 15s ago 17m 16.7M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (4m) 56s ago 16m 152M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (3m) 56s ago 15m 148M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (3m) 56s ago 15m 140M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (2m) 15s ago 15m 120M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (2m) 15s ago 14m 143M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 6b77ec5616ac 2024-09-12T01:53:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (101s) 15s ago 14m 119M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 1c0a4ea58d83 2024-09-12T01:53:27.369 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (7m) 56s ago 17m 64.6M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:53:27.369 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f803c06e0b0 msgr2=0x7f803c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f803c06e0b0 0x7f803c070560 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8044009c20 tx=0x7f8044004d10 comp rx=0 tx=0).stop 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 msgr2=0x7f8054113a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 0x7f8054113a80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8048002840 tx=0x7f8048004570 comp rx=0 tx=0).stop 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 shutdown_connections 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f803c06e0b0 0x7f803c070560 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8054102ef0 0x7f8054113a80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 --2- 172.21.15.66:0/4214504118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8054102550 0x7f8054113540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 >> 172.21.15.66:0/4214504118 conn(0x7f80540f80f0 msgr2=0x7f80540f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 shutdown_connections 2024-09-12T01:53:27.370 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:27.369+0000 7f805c07c640 1 -- 172.21.15.66:0/4214504118 wait complete. 2024-09-12T01:53:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:27 smithi066 ceph-mon[110996]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:27.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:27 smithi153 ceph-mon[80899]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:27.953 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch upgrade status' 2024-09-12T01:53:28.211 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:53:28.613 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:28 smithi066 ceph-mon[110996]: pgmap v221: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:28.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:28 smithi153 ceph-mon[80899]: pgmap v221: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:29.852 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 -- 172.21.15.66:0/3628166153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 msgr2=0x7fe1fc102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 --2- 172.21.15.66:0/3628166153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc102950 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009c50 tx=0x7fe1ec004d10 comp rx=0 tx=0).stop 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 -- 172.21.15.66:0/3628166153 shutdown_connections 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 --2- 172.21.15.66:0/3628166153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1fc102f20 0x7fe1fc0fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 --2- 172.21.15.66:0/3628166153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc102950 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 -- 172.21.15.66:0/3628166153 >> 172.21.15.66:0/3628166153 conn(0x7fe1fc0f81a0 msgr2=0x7fe1fc0fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 -- 172.21.15.66:0/3628166153 shutdown_connections 2024-09-12T01:53:29.853 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.852+0000 7fe202b08640 1 -- 172.21.15.66:0/3628166153 wait complete. 2024-09-12T01:53:29.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe202b08640 1 Processor -- start 2024-09-12T01:53:29.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe202b08640 1 -- start start 2024-09-12T01:53:29.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe202b08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:29.855 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe202b08640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1fc102f20 0x7fe1fc113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe202b08640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc113e00 con 0x7fe1fc102580 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe202b08640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc10d1b0 con 0x7fe1fc102f20 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe2008a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe2008a4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:44644/0 (socket says 172.21.15.66:44644) 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe2008a4640 1 -- 172.21.15.66:0/3893260783 learned_addr learned my addr 172.21.15.66:0/3893260783 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.853+0000 7fe1fbfff640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1fc102f20 0x7fe1fc113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe2008a4640 1 -- 172.21.15.66:0/3893260783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1fc102f20 msgr2=0x7fe1fc113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe2008a4640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1fc102f20 0x7fe1fc113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe2008a4640 1 -- 172.21.15.66:0/3893260783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec0098b0 con 0x7fe1fc102580 2024-09-12T01:53:29.856 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe2008a4640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc113230 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004a30 tx=0x7fe1ec004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:29.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1ec032880 con 0x7fe1fc102580 2024-09-12T01:53:29.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc10d430 con 0x7fe1fc102580 2024-09-12T01:53:29.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1ec032e80 con 0x7fe1fc102580 2024-09-12T01:53:29.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1ec03dda0 con 0x7fe1fc102580 2024-09-12T01:53:29.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.854+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc10d950 con 0x7fe1fc102580 2024-09-12T01:53:29.857 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.855+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc0fdd00 con 0x7fe1fc102580 2024-09-12T01:53:29.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.856+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7fe1ec02f030 con 0x7fe1fc102580 2024-09-12T01:53:29.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.856+0000 7fe1f97fa640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe1e806e0b0 0x7fe1e8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:29.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.856+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7fe1ec0af170 con 0x7fe1fc102580 2024-09-12T01:53:29.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.856+0000 7fe1fbfff640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe1e806e0b0 0x7fe1e8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:29.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.857+0000 7fe1fbfff640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe1e806e0b0 0x7fe1e8070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc10eaf0 tx=0x7fe1e4009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:29.861 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:29.861+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe1ec0782e0 con 0x7fe1fc102580 2024-09-12T01:53:30.056 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.056+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1fc04b720 con 0x7fe1e806e0b0 2024-09-12T01:53:30.057 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.057+0000 7fe1f97fa640 1 -- 172.21.15.66:0/3893260783 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fe1fc04b720 con 0x7fe1e806e0b0 2024-09-12T01:53:30.057 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:53:30.057 INFO:teuthology.orchestra.run.smithi066.stdout: "target_image": null, 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout: "in_progress": false, 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout: "which": "", 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout: "services_complete": [], 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout: "progress": null, 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout: "message": "", 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout: "is_paused": false 2024-09-12T01:53:30.058 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:53:30.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe1e806e0b0 msgr2=0x7fe1e8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe1e806e0b0 0x7fe1e8070560 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc10eaf0 tx=0x7fe1e4009120 comp rx=0 tx=0).stop 2024-09-12T01:53:30.060 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 msgr2=0x7fe1fc113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc113230 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec004a30 tx=0x7fe1ec004d10 comp rx=0 tx=0).stop 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 shutdown_connections 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7fe1e806e0b0 0x7fe1e8070560 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1fc102f20 0x7fe1fc113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 --2- 172.21.15.66:0/3893260783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1fc102580 0x7fe1fc113230 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 >> 172.21.15.66:0/3893260783 conn(0x7fe1fc0f81a0 msgr2=0x7fe1fc0f91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 shutdown_connections 2024-09-12T01:53:30.061 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:30.060+0000 7fe202b08640 1 -- 172.21.15.66:0/3893260783 wait complete. 2024-09-12T01:53:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:30 smithi066 ceph-mon[110996]: pgmap v222: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:30.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:30 smithi066 ceph-mon[110996]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:30.691 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph health detail' 2024-09-12T01:53:30.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:30 smithi153 ceph-mon[80899]: pgmap v222: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:30.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:30 smithi153 ceph-mon[80899]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:53:30.948 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:53:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 -- 172.21.15.66:0/1703570093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 msgr2=0x7f74c80fb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 --2- 172.21.15.66:0/1703570093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c80fb4f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0048d0 tx=0x7f74bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 -- 172.21.15.66:0/1703570093 shutdown_connections 2024-09-12T01:53:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 --2- 172.21.15.66:0/1703570093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c80fb4f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 --2- 172.21.15.66:0/1703570093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74c81015a0 0x7f74c8101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.435 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 -- 172.21.15.66:0/1703570093 >> 172.21.15.66:0/1703570093 conn(0x7f74c80f7030 msgr2=0x7f74c80f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 -- 172.21.15.66:0/1703570093 shutdown_connections 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.416+0000 7f74cdf05640 1 -- 172.21.15.66:0/1703570093 wait complete. 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.417+0000 7f74cdf05640 1 Processor -- start 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.417+0000 7f74cdf05640 1 -- start start 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.417+0000 7f74cdf05640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74c81015a0 0x7f74c8113390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.417+0000 7f74cdf05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c81138d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.417+0000 7f74cdf05640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8113ed0 con 0x7f74c8101f40 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.417+0000 7f74cdf05640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8114040 con 0x7f74c81015a0 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c81138d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c81138d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45594/0 (socket says 172.21.15.66:45594) 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 -- 172.21.15.66:0/3680465847 learned_addr learned my addr 172.21.15.66:0/3680465847 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c77fe640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74c81015a0 0x7f74c8113390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:32.436 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 -- 172.21.15.66:0/3680465847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74c81015a0 msgr2=0x7f74c8113390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74c81015a0 0x7f74c8113390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 -- 172.21.15.66:0/3680465847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc005040 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74c6ffd640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c81138d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f74bc003080 tx=0x7f74bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc038070 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f74bc009760 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c810d460 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc033420 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.418+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c810d8c0 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.419+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c80fac90 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.420+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f74bc030020 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.420+0000 7f74affff640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f74b006e0b0 0x7f74b0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.421+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f74bc0ada50 con 0x7f74c8101f40 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.421+0000 7f74c77fe640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f74b006e0b0 0x7f74b0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:32.437 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.421+0000 7f74c77fe640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f74b006e0b0 0x7f74b0070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74b80041d0 tx=0x7f74b8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:32.438 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.425+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f74bc076bc0 con 0x7f74c8101f40 2024-09-12T01:53:32.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.670+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f74c810ea40 con 0x7f74c8101f40 2024-09-12T01:53:32.670 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:32 smithi066 ceph-mon[110996]: pgmap v223: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:32.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.670+0000 7f74affff640 1 -- 172.21.15.66:0/3680465847 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f74bc07fe60 con 0x7f74c8101f40 2024-09-12T01:53:32.671 INFO:teuthology.orchestra.run.smithi066.stdout:HEALTH_OK 2024-09-12T01:53:32.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f74b006e0b0 msgr2=0x7f74b0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:32.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f74b006e0b0 0x7f74b0070560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f74b80041d0 tx=0x7f74b8009040 comp rx=0 tx=0).stop 2024-09-12T01:53:32.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 msgr2=0x7f74c81138d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:32.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c81138d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f74bc003080 tx=0x7f74bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.674 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 shutdown_connections 2024-09-12T01:53:32.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f74b006e0b0 0x7f74b0070560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f74c8101f40 0x7f74c81138d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 --2- 172.21.15.66:0/3680465847 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f74c81015a0 0x7f74c8113390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:32.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 >> 172.21.15.66:0/3680465847 conn(0x7f74c80f7030 msgr2=0x7f74c8065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:32.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 shutdown_connections 2024-09-12T01:53:32.675 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:32.674+0000 7f74cdf05640 1 -- 172.21.15.66:0/3680465847 wait complete. 2024-09-12T01:53:32.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:32 smithi153 ceph-mon[80899]: pgmap v223: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:33.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions' 2024-09-12T01:53:33.530 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:53:33.866 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:33 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3680465847' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:53:33.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:33 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3680465847' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-12T01:53:34.578 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:34 smithi066 ceph-mon[110996]: pgmap v224: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:34.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:34 smithi153 ceph-mon[80899]: pgmap v224: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.119+0000 7f9df8d96640 1 -- 172.21.15.66:0/1268411658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fded0 msgr2=0x7f9df41065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:35.121 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.119+0000 7f9df8d96640 1 --2- 172.21.15.66:0/1268411658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fded0 0x7f9df41065a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc004900 tx=0x7f9ddc009da0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- 172.21.15.66:0/1268411658 shutdown_connections 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 --2- 172.21.15.66:0/1268411658 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fded0 0x7f9df41065a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 --2- 172.21.15.66:0/1268411658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df40fd530 0x7f9df40fd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- 172.21.15.66:0/1268411658 >> 172.21.15.66:0/1268411658 conn(0x7f9df40f7030 msgr2=0x7f9df40f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- 172.21.15.66:0/1268411658 shutdown_connections 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- 172.21.15.66:0/1268411658 wait complete. 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 Processor -- start 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- start start 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 0x7f9df4113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df40fded0 0x7f9df4113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4113d80 con 0x7f9df40fd530 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.120+0000 7f9df8d96640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df410d1c0 con 0x7f9df40fded0 2024-09-12T01:53:35.122 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 0x7f9df4113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 0x7f9df4113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:45610/0 (socket says 172.21.15.66:45610) 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 -- 172.21.15.66:0/2640951867 learned_addr learned my addr 172.21.15.66:0/2640951867 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9debfff640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df40fded0 0x7f9df4113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 -- 172.21.15.66:0/2640951867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df40fded0 msgr2=0x7f9df4113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df40fded0 0x7f9df4113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 -- 172.21.15.66:0/2640951867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc005040 con 0x7f9df40fd530 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df259c640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 0x7f9df4113240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9de4002a50 tx=0x7f9de4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de4007c30 con 0x7f9df40fd530 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9de400f040 con 0x7f9df40fd530 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df410d4a0 con 0x7f9df40fd530 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de400da10 con 0x7f9df40fd530 2024-09-12T01:53:35.123 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.121+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df410d9c0 con 0x7f9df40fd530 2024-09-12T01:53:35.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.122+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df4066330 con 0x7f9df40fd530 2024-09-12T01:53:35.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.123+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9de400dc80 con 0x7f9df40fd530 2024-09-12T01:53:35.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.123+0000 7f9deaffd640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9de006e0b0 0x7f9de0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:53:35.124 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.123+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f9de408d510 con 0x7f9df40fd530 2024-09-12T01:53:35.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.123+0000 7f9debfff640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9de006e0b0 0x7f9de0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:53:35.125 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.124+0000 7f9debfff640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9de006e0b0 0x7f9de0070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc004540 tx=0x7f9ddc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:53:35.128 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.128+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9de4056730 con 0x7f9df40fd530 2024-09-12T01:53:35.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.376+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9df404b750 con 0x7f9df40fd530 2024-09-12T01:53:35.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.376+0000 7f9deaffd640 1 -- 172.21.15.66:0/2640951867 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f9de4059df0 con 0x7f9df40fd530 2024-09-12T01:53:35.376 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 6 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:53:35.377 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 4 2024-09-12T01:53:35.378 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:53:35.378 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:53:35.378 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 14 2024-09-12T01:53:35.378 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:53:35.378 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9de006e0b0 msgr2=0x7f9de0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9de006e0b0 0x7f9de0070560 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc004540 tx=0x7f9ddc035040 comp rx=0 tx=0).stop 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 msgr2=0x7f9df4113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 0x7f9df4113240 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9de4002a50 tx=0x7f9de4004600 comp rx=0 tx=0).stop 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 shutdown_connections 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9de006e0b0 0x7f9de0070560 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9df40fded0 0x7f9df4113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 --2- 172.21.15.66:0/2640951867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df40fd530 0x7f9df4113240 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:53:35.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 >> 172.21.15.66:0/2640951867 conn(0x7f9df40f7030 msgr2=0x7f9df40f85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:53:35.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 shutdown_connections 2024-09-12T01:53:35.380 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:53:35.379+0000 7f9df8d96640 1 -- 172.21.15.66:0/2640951867 wait complete. 2024-09-12T01:53:35.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:35 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2640951867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:35.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:35 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2640951867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:53:35.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-12T01:53:36.194 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:53:36.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:36 smithi066 ceph-mon[110996]: pgmap v225: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:36.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:36 smithi153 ceph-mon[80899]: pgmap v225: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:37.779 INFO:teuthology.orchestra.run.smithi066.stdout:wait for servicemap items w/ changing names to refresh 2024-09-12T01:53:38.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'sleep 60' 2024-09-12T01:53:38.637 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:53:38.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:38 smithi066 ceph-mon[110996]: pgmap v226: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:38.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:38 smithi153 ceph-mon[80899]: pgmap v226: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:40.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:40 smithi066 ceph-mon[110996]: pgmap v227: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:40.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:40 smithi153 ceph-mon[80899]: pgmap v227: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:41.678 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:41.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:42.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:42 smithi066 ceph-mon[110996]: pgmap v228: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:42.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:42 smithi153 ceph-mon[80899]: pgmap v228: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:44.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:44 smithi066 ceph-mon[110996]: pgmap v229: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:44.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:44 smithi153 ceph-mon[80899]: pgmap v229: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:46.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:46 smithi066 ceph-mon[110996]: pgmap v230: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:46.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:46 smithi153 ceph-mon[80899]: pgmap v230: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:48.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:48 smithi066 ceph-mon[110996]: pgmap v231: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:48.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:48 smithi153 ceph-mon[80899]: pgmap v231: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:50.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:50 smithi066 ceph-mon[110996]: pgmap v232: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:50.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:50 smithi153 ceph-mon[80899]: pgmap v232: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:52.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:52 smithi066 ceph-mon[110996]: pgmap v233: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:52.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:52 smithi153 ceph-mon[80899]: pgmap v233: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:54.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:54 smithi066 ceph-mon[110996]: pgmap v234: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:54.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:54 smithi153 ceph-mon[80899]: pgmap v234: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:56 smithi066 ceph-mon[110996]: pgmap v235: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:56.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:56 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:56.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:56 smithi153 ceph-mon[80899]: pgmap v235: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:56.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:56 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:53:58.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:53:58 smithi066 ceph-mon[110996]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:53:58.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:53:58 smithi153 ceph-mon[80899]: pgmap v236: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:00.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:00 smithi066 ceph-mon[110996]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:00.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:00 smithi153 ceph-mon[80899]: pgmap v237: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:02.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:02 smithi066 ceph-mon[110996]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:02.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:02 smithi153 ceph-mon[80899]: pgmap v238: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:04.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:04 smithi066 ceph-mon[110996]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:04.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:04 smithi153 ceph-mon[80899]: pgmap v239: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:07.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:06 smithi066 ceph-mon[110996]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:07.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:06 smithi153 ceph-mon[80899]: pgmap v240: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:09.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:08 smithi066 ceph-mon[110996]: pgmap v241: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:09.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:08 smithi153 ceph-mon[80899]: pgmap v241: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:11.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:10 smithi066 ceph-mon[110996]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:11.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:10 smithi153 ceph-mon[80899]: pgmap v242: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:12.306 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:11 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:12.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:11 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:13.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:12 smithi066 ceph-mon[110996]: pgmap v243: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:13.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:12 smithi153 ceph-mon[80899]: pgmap v243: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:15.390 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:14 smithi066 ceph-mon[110996]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:15.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:14 smithi153 ceph-mon[80899]: pgmap v244: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:16 smithi066 ceph-mon[110996]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:17.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:16 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:17.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:16 smithi153 ceph-mon[80899]: pgmap v245: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:17.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:16 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:54:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:18.389 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:54:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:54:18.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:54:18.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:54:19.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:19 smithi066 ceph-mon[110996]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:19.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:19 smithi153 ceph-mon[80899]: pgmap v246: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:21.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:21 smithi066 ceph-mon[110996]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:21.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:21 smithi153 ceph-mon[80899]: pgmap v247: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:23.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:23 smithi066 ceph-mon[110996]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:23.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:23 smithi153 ceph-mon[80899]: pgmap v248: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:25.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:25 smithi066 ceph-mon[110996]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:25.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:25 smithi153 ceph-mon[80899]: pgmap v249: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:27 smithi066 ceph-mon[110996]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:27.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:27 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:27.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:27 smithi153 ceph-mon[80899]: pgmap v250: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:27.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:27 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:29.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:29 smithi066 ceph-mon[110996]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:29.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:29 smithi153 ceph-mon[80899]: pgmap v251: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:31.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:31 smithi066 ceph-mon[110996]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:31.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:31 smithi153 ceph-mon[80899]: pgmap v252: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:33.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:33 smithi066 ceph-mon[110996]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:33.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:33 smithi153 ceph-mon[80899]: pgmap v253: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:35.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:35 smithi066 ceph-mon[110996]: pgmap v254: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:35.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:35 smithi153 ceph-mon[80899]: pgmap v254: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:37.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:37 smithi066 ceph-mon[110996]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:37.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:37 smithi153 ceph-mon[80899]: pgmap v255: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:39.640 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:39 smithi066 ceph-mon[110996]: pgmap v256: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:39.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:39 smithi153 ceph-mon[80899]: pgmap v256: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:40.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph orch ps' 2024-09-12T01:54:41.160 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:41.582 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:41 smithi066 ceph-mon[110996]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:41.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:41 smithi153 ceph-mon[80899]: pgmap v257: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:42.568 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:42 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:42.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:42 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 -- 172.21.15.66:0/2925358224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849406fa30 msgr2=0x7f849406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 --2- 172.21.15.66:0/2925358224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849406fa30 0x7f849406fe00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84900048d0 tx=0x7f8490009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 -- 172.21.15.66:0/2925358224 shutdown_connections 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 --2- 172.21.15.66:0/2925358224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8494070340 0x7f84941088f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 --2- 172.21.15.66:0/2925358224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849406fa30 0x7f849406fe00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 -- 172.21.15.66:0/2925358224 >> 172.21.15.66:0/2925358224 conn(0x7f84940f80f0 msgr2=0x7f84940fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 -- 172.21.15.66:0/2925358224 shutdown_connections 2024-09-12T01:54:42.781 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 -- 172.21.15.66:0/2925358224 wait complete. 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.770+0000 7f849babf640 1 Processor -- start 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849babf640 1 -- start start 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849babf640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f849406fa30 0x7f84941153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849babf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 0x7f8494115910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849babf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494115f10 con 0x7f8494070340 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849babf640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849410f350 con 0x7f849406fa30 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 0x7f8494115910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 0x7f8494115910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39072/0 (socket says 172.21.15.66:39072) 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 -- 172.21.15.66:0/4016222934 learned_addr learned my addr 172.21.15.66:0/4016222934 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849985b640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f849406fa30 0x7f84941153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 -- 172.21.15.66:0/4016222934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f849406fa30 msgr2=0x7f84941153d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.782 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f849406fa30 0x7f84941153d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 -- 172.21.15.66:0/4016222934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490005040 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f849905a640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 0x7f8494115910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8484002a80 tx=0x7f8484004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.771+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8484007c30 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.772+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f848400f040 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.772+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849410f630 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.772+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f848400dab0 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.772+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849410fb50 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.772+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8494071170 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.773+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f848400dc10 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.774+0000 7f848a7fc640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f848006e0b0 0x7f8480070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.774+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f848408d5d0 con 0x7f8494070340 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.774+0000 7f849985b640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f848006e0b0 0x7f8480070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.774+0000 7f849985b640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f848006e0b0 0x7f8480070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8490009ac0 tx=0x7f8490035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:42.783 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.779+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f84840567f0 con 0x7f8494070340 2024-09-12T01:54:42.962 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.962+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 --> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f849410b770 con 0x7f848006e0b0 2024-09-12T01:54:42.971 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.971+0000 7f848a7fc640 1 -- 172.21.15.66:0/4016222934 <== mgr.34104 v2:172.21.15.66:6800/1244181255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f849410b770 con 0x7f848006e0b0 2024-09-12T01:54:42.971 INFO:teuthology.orchestra.run.smithi066.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-12T01:54:42.971 INFO:teuthology.orchestra.run.smithi066.stdout:alertmanager.smithi066 smithi066 *:9093,9094 running (8m) 2m ago 19m 27.0M - 0.25.0 c8568f914cd2 316df72a411c 2024-09-12T01:54:42.971 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi066 smithi066 running (6m) 2m ago 19m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 bbc84fff4f66 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:crash.smithi153 smithi153 running (6m) 91s ago 18m 6895k - 19.1.1-298-gb53b6d3e 54467abc55f8 41f02e74f2c6 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:grafana.smithi066 smithi066 *:3000 running (8m) 2m ago 19m 83.3M - 9.4.12 2bacad6d85d8 cdfd559367fa 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.ipygev smithi066 running (2m) 2m ago 13m 12.2M - 19.1.1-298-gb53b6d3e 54467abc55f8 29e4ff8a116d 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi066.jacfsu smithi066 running (2m) 2m ago 13m 13.0M - 19.1.1-298-gb53b6d3e 54467abc55f8 7c30799cb039 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.aiydtj smithi153 running (94s) 91s ago 13m 11.8M - 19.1.1-298-gb53b6d3e 54467abc55f8 976d06b8e891 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mds.cephfs.smithi153.cbdplo smithi153 running (113s) 91s ago 13m 15.3M - 19.1.1-298-gb53b6d3e 54467abc55f8 7907c9c2d5ff 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi066.qdwcrh smithi066 *:8443,9283,8765 running (10m) 2m ago 20m 504M - 19.1.1-298-gb53b6d3e 54467abc55f8 09b10d89fe2d 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mgr.smithi153.jpnqza smithi153 *:8443,9283,8765 running (9m) 91s ago 18m 441M - 19.1.1-298-gb53b6d3e 54467abc55f8 07287aef2375 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi066 smithi066 running (7m) 2m ago 20m 52.7M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 f2fa86e9baad 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:mon.smithi153 smithi153 running (6m) 91s ago 18m 42.5M 2048M 19.1.1-298-gb53b6d3e 54467abc55f8 d8441d45e143 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi066 smithi066 *:9100 running (9m) 2m ago 19m 16.5M - 1.5.0 0da6a335fe13 671fbb6e176a 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:node-exporter.smithi153 smithi153 *:9100 running (9m) 91s ago 18m 16.7M - 1.5.0 0da6a335fe13 1886c50ea1d7 2024-09-12T01:54:42.972 INFO:teuthology.orchestra.run.smithi066.stdout:osd.0 smithi066 running (5m) 2m ago 17m 152M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 617a3556d4e2 2024-09-12T01:54:42.973 INFO:teuthology.orchestra.run.smithi066.stdout:osd.1 smithi066 running (5m) 2m ago 17m 148M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 f1b35e4354cf 2024-09-12T01:54:42.973 INFO:teuthology.orchestra.run.smithi066.stdout:osd.2 smithi066 running (4m) 2m ago 16m 140M 1557M 19.1.1-298-gb53b6d3e 54467abc55f8 a2f1864adfe4 2024-09-12T01:54:42.973 INFO:teuthology.orchestra.run.smithi066.stdout:osd.3 smithi153 running (4m) 91s ago 16m 120M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 c13a64c952ec 2024-09-12T01:54:42.973 INFO:teuthology.orchestra.run.smithi066.stdout:osd.4 smithi153 running (3m) 91s ago 15m 143M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 6b77ec5616ac 2024-09-12T01:54:42.973 INFO:teuthology.orchestra.run.smithi066.stdout:osd.5 smithi153 running (2m) 91s ago 15m 119M 2581M 19.1.1-298-gb53b6d3e 54467abc55f8 1c0a4ea58d83 2024-09-12T01:54:42.973 INFO:teuthology.orchestra.run.smithi066.stdout:prometheus.smithi066 smithi066 *:9095 running (9m) 2m ago 18m 64.6M - 2.43.0 a07b618ecd1d 18aa5267989f 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f848006e0b0 msgr2=0x7f8480070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f848006e0b0 0x7f8480070560 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8490009ac0 tx=0x7f8490035040 comp rx=0 tx=0).stop 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 msgr2=0x7f8494115910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 0x7f8494115910 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8484002a80 tx=0x7f8484004600 comp rx=0 tx=0).stop 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 shutdown_connections 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f848006e0b0 0x7f8480070560 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8494070340 0x7f8494115910 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 --2- 172.21.15.66:0/4016222934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f849406fa30 0x7f84941153d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 >> 172.21.15.66:0/4016222934 conn(0x7f84940f80f0 msgr2=0x7f84940f9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 shutdown_connections 2024-09-12T01:54:42.974 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:42.973+0000 7f849babf640 1 -- 172.21.15.66:0/4016222934 wait complete. 2024-09-12T01:54:43.543 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:43 smithi066 ceph-mon[110996]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:43.569 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions' 2024-09-12T01:54:43.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:43 smithi153 ceph-mon[80899]: pgmap v258: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:43.837 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:44.634 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:44 smithi066 ceph-mon[110996]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:44.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:44 smithi153 ceph-mon[80899]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-12T01:54:45.496 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:45 smithi066 ceph-mon[110996]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 -- 172.21.15.66:0/3533653486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 msgr2=0x7ff65806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 --2- 172.21.15.66:0/3533653486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff65806fab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6540048d0 tx=0x7ff654009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 -- 172.21.15.66:0/3533653486 shutdown_connections 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 --2- 172.21.15.66:0/3533653486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff65806fff0 0x7ff658070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 --2- 172.21.15.66:0/3533653486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff65806fab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 -- 172.21.15.66:0/3533653486 >> 172.21.15.66:0/3533653486 conn(0x7ff6580f81a0 msgr2=0x7ff6580fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 -- 172.21.15.66:0/3533653486 shutdown_connections 2024-09-12T01:54:45.588 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.577+0000 7ff65f76f640 1 -- 172.21.15.66:0/3533653486 wait complete. 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65f76f640 1 Processor -- start 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65f76f640 1 -- start start 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65f76f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff65806fff0 0x7ff6581198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65f76f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff658119de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65f76f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65811a430 con 0x7ff6580716e0 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65f76f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff658113840 con 0x7ff65806fff0 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65cd0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff658119de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65cd0a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff658119de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39090/0 (socket says 172.21.15.66:39090) 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65cd0a640 1 -- 172.21.15.66:0/2654628719 learned_addr learned my addr 172.21.15.66:0/2654628719 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65d50b640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff65806fff0 0x7ff6581198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65cd0a640 1 -- 172.21.15.66:0/2654628719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff65806fff0 msgr2=0x7ff6581198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.589 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.578+0000 7ff65cd0a640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff65806fff0 0x7ff6581198a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff65cd0a640 1 -- 172.21.15.66:0/2654628719 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654005040 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff65cd0a640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff658119de0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff648002a50 tx=0x7ff648004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff648007c30 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff64800f040 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff658113b20 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff64800da90 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.579+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff658114040 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.580+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6580711f0 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.581+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7ff64800dd00 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.581+0000 7ff64dffb640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff64406e0b0 0x7ff644070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.581+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7ff64808d650 con 0x7ff6580716e0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.581+0000 7ff65d50b640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff64406e0b0 0x7ff644070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:45.590 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.582+0000 7ff65d50b640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff64406e0b0 0x7ff644070560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff65402a5e0 tx=0x7ff654009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:45.591 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.585+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff6480567c0 con 0x7ff6580716e0 2024-09-12T01:54:45.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:45 smithi153 ceph-mon[80899]: pgmap v259: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:45.828 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.828+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff65810fb70 con 0x7ff6580716e0 2024-09-12T01:54:45.829 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.829+0000 7ff64dffb640 1 -- 172.21.15.66:0/2654628719 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff648059e80 con 0x7ff6580716e0 2024-09-12T01:54:45.829 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2024-09-12T01:54:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "mon": { 2024-09-12T01:54:45.829 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "mgr": { 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 2 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "osd": { 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 6 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "mds": { 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 4 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "overall": { 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)": 14 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout: } 2024-09-12T01:54:45.830 INFO:teuthology.orchestra.run.smithi066.stdout:} 2024-09-12T01:54:45.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff64406e0b0 msgr2=0x7ff644070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff64406e0b0 0x7ff644070560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff65402a5e0 tx=0x7ff654009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.831 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 msgr2=0x7ff658119de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff658119de0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff648002a50 tx=0x7ff648004600 comp rx=0 tx=0).stop 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 shutdown_connections 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7ff64406e0b0 0x7ff644070560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6580716e0 0x7ff658119de0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 --2- 172.21.15.66:0/2654628719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff65806fff0 0x7ff6581198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 >> 172.21.15.66:0/2654628719 conn(0x7ff6580f81a0 msgr2=0x7ff6580f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 shutdown_connections 2024-09-12T01:54:45.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:45.831+0000 7ff65f76f640 1 -- 172.21.15.66:0/2654628719 wait complete. 2024-09-12T01:54:46.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-12T01:54:46.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:46 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2654628719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:54:46.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:46 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2654628719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:54:46.714 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:47.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:47 smithi066 ceph-mon[110996]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:47.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:47 smithi153 ceph-mon[80899]: pgmap v260: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:48.176 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3698195260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b8102d80 msgr2=0x7f89b80faad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3698195260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b8102d80 0x7f89b80faad0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0048d0 tx=0x7f89ac009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3698195260 shutdown_connections 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3698195260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b8102d80 0x7f89b80faad0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3698195260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b81023e0 0x7f89b81027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3698195260 >> 172.21.15.66:0/3698195260 conn(0x7f89b8070b30 msgr2=0x7f89b8070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3698195260 shutdown_connections 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.174+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3698195260 wait complete. 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89bd3a1640 1 Processor -- start 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89bd3a1640 1 -- start start 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89bd3a1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 0x7f89b81154b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89bd3a1640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8102d80 0x7f89b81159f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.177 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89bd3a1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8116040 con 0x7f89b81023e0 2024-09-12T01:54:48.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89bd3a1640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b810f450 con 0x7f89b8102d80 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89b7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 0x7f89b81154b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89b7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 0x7f89b81154b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39112/0 (socket says 172.21.15.66:39112) 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.175+0000 7f89b7fff640 1 -- 172.21.15.66:0/3089826839 learned_addr learned my addr 172.21.15.66:0/3089826839 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b77fe640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8102d80 0x7f89b81159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b7fff640 1 -- 172.21.15.66:0/3089826839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8102d80 msgr2=0x7f89b81159f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b7fff640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8102d80 0x7f89b81159f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b7fff640 1 -- 172.21.15.66:0/3089826839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac005040 con 0x7f89b81023e0 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b7fff640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 0x7f89b81154b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89a800c830 tx=0x7f89a8004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a800a7d0 con 0x7f89b81023e0 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f89a800add0 con 0x7f89b81023e0 2024-09-12T01:54:48.179 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b810f730 con 0x7f89b81023e0 2024-09-12T01:54:48.180 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a80113a0 con 0x7f89b81023e0 2024-09-12T01:54:48.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.176+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b810fc20 con 0x7f89b81023e0 2024-09-12T01:54:48.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.177+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80655f0 con 0x7f89b81023e0 2024-09-12T01:54:48.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.178+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f89a8012400 con 0x7f89b81023e0 2024-09-12T01:54:48.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.178+0000 7f89b4ff9640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f89a006e0b0 0x7f89a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:48.181 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.179+0000 7f89b77fe640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f89a006e0b0 0x7f89a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:48.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.179+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f89a808dd70 con 0x7f89b81023e0 2024-09-12T01:54:48.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.179+0000 7f89b77fe640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f89a006e0b0 0x7f89a0070560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0048a0 tx=0x7f89ac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:48.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.183+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f89a8057000 con 0x7f89b81023e0 2024-09-12T01:54:48.427 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.427+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89b804b720 con 0x7f89b81023e0 2024-09-12T01:54:48.428 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.428+0000 7f89b4ff9640 1 -- 172.21.15.66:0/3089826839 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f89a805a6c0 con 0x7f89b81023e0 2024-09-12T01:54:48.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f89a006e0b0 msgr2=0x7f89a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f89a006e0b0 0x7f89a0070560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0048a0 tx=0x7f89ac035040 comp rx=0 tx=0).stop 2024-09-12T01:54:48.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 msgr2=0x7f89b81154b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:48.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 0x7f89b81154b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f89a800c830 tx=0x7f89a8004430 comp rx=0 tx=0).stop 2024-09-12T01:54:48.430 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 shutdown_connections 2024-09-12T01:54:48.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f89a006e0b0 0x7f89a0070560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8102d80 0x7f89b81159f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 --2- 172.21.15.66:0/3089826839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b81023e0 0x7f89b81154b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:48.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 >> 172.21.15.66:0/3089826839 conn(0x7f89b8070b30 msgr2=0x7f89b80f9570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:48.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 shutdown_connections 2024-09-12T01:54:48.431 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:48.430+0000 7f89bd3a1640 1 -- 172.21.15.66:0/3089826839 wait complete. 2024-09-12T01:54:48.439 INFO:teuthology.orchestra.run.smithi066.stdout:true 2024-09-12T01:54:49.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -e sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-12T01:54:49.265 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:49.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:49 smithi066 ceph-mon[110996]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:49.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:49 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3089826839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:54:49.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:49 smithi153 ceph-mon[80899]: pgmap v261: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:49.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:49 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3089826839' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:54:50.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 -- 172.21.15.66:0/3551679632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 msgr2=0x7f06d41088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:50.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 --2- 172.21.15.66:0/3551679632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d41088f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0048d0 tx=0x7f06bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 -- 172.21.15.66:0/3551679632 shutdown_connections 2024-09-12T01:54:50.720 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 --2- 172.21.15.66:0/3551679632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d41088f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 --2- 172.21.15.66:0/3551679632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d406fa30 0x7f06d406fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 -- 172.21.15.66:0/3551679632 >> 172.21.15.66:0/3551679632 conn(0x7f06d40f80f0 msgr2=0x7f06d40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 -- 172.21.15.66:0/3551679632 shutdown_connections 2024-09-12T01:54:50.721 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.720+0000 7f06d9a43640 1 -- 172.21.15.66:0/3551679632 wait complete. 2024-09-12T01:54:50.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d9a43640 1 Processor -- start 2024-09-12T01:54:50.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d9a43640 1 -- start start 2024-09-12T01:54:50.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d9a43640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d406fa30 0x7f06d40fc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:50.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d9a43640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d40fca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:50.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d9a43640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4100670 con 0x7f06d4070340 2024-09-12T01:54:50.722 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d9a43640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40fcfd0 con 0x7f06d406fa30 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d40fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d27fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d40fca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:39126/0 (socket says 172.21.15.66:39126) 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d27fc640 1 -- 172.21.15.66:0/867757520 learned_addr learned my addr 172.21.15.66:0/867757520 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d2ffd640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d406fa30 0x7f06d40fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d27fc640 1 -- 172.21.15.66:0/867757520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d406fa30 msgr2=0x7f06d40fc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d27fc640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d406fa30 0x7f06d40fc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.721+0000 7f06d27fc640 1 -- 172.21.15.66:0/867757520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc005040 con 0x7f06d4070340 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.722+0000 7f06d27fc640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d40fca90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06bc003080 tx=0x7f06bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.722+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06bc038070 con 0x7f06d4070340 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.722+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f06bc0097e0 con 0x7f06d4070340 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.722+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06bc03d420 con 0x7f06d4070340 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.722+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d40fd250 con 0x7f06d4070340 2024-09-12T01:54:50.723 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.722+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d411ddb0 con 0x7f06d4070340 2024-09-12T01:54:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.723+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4071170 con 0x7f06d4070340 2024-09-12T01:54:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.724+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f06bc030020 con 0x7f06d4070340 2024-09-12T01:54:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.724+0000 7f06cb7fe640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f06c006e0b0 0x7f06c0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.724+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f06bc0ae180 con 0x7f06d4070340 2024-09-12T01:54:50.724 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.724+0000 7f06d2ffd640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f06c006e0b0 0x7f06c0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:50.725 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.725+0000 7f06d2ffd640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f06c006e0b0 0x7f06c0070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0041d0 tx=0x7f06cc004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:50.729 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.729+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f06bc077370 con 0x7f06d4070340 2024-09-12T01:54:50.977 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.977+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f06d40fbd30 con 0x7f06d4070340 2024-09-12T01:54:50.978 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.978+0000 7f06cb7fe640 1 -- 172.21.15.66:0/867757520 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f06bc07aa30 con 0x7f06d4070340 2024-09-12T01:54:50.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f06c006e0b0 msgr2=0x7f06c0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:50.980 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f06c006e0b0 0x7f06c0070560 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0041d0 tx=0x7f06cc004330 comp rx=0 tx=0).stop 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 msgr2=0x7f06d40fca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d40fca90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f06bc003080 tx=0x7f06bc009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 shutdown_connections 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f06c006e0b0 0x7f06c0070560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d4070340 0x7f06d40fca90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 --2- 172.21.15.66:0/867757520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d406fa30 0x7f06d40fc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 >> 172.21.15.66:0/867757520 conn(0x7f06d40f80f0 msgr2=0x7f06d40f9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 shutdown_connections 2024-09-12T01:54:50.981 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:50.980+0000 7f06d9a43640 1 -- 172.21.15.66:0/867757520 wait complete. 2024-09-12T01:54:50.988 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph version 19.1.1-298-gb53b6d3e (b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc) squid (stable)" 2024-09-12T01:54:51.599 DEBUG:teuthology.parallel:result is None 2024-09-12T01:54:51.599 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-12T01:54:51.613 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:54:51.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-12T01:54:51.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:51 smithi066 ceph-mon[110996]: pgmap v262: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:51.638 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:51 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/867757520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:54:51.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:51 smithi153 ceph-mon[80899]: pgmap v262: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:51.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:51 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/867757520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-12T01:54:51.873 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 -- 172.21.15.66:0/2899370236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 msgr2=0x7f823c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 --2- 172.21.15.66:0/2899370236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c101890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82380048d0 tx=0x7f8238009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 -- 172.21.15.66:0/2899370236 shutdown_connections 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 --2- 172.21.15.66:0/2899370236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0fb480 0x7f823c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 --2- 172.21.15.66:0/2899370236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c101890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 -- 172.21.15.66:0/2899370236 >> 172.21.15.66:0/2899370236 conn(0x7f823c0f7000 msgr2=0x7f823c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 -- 172.21.15.66:0/2899370236 shutdown_connections 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.373+0000 7f8243e59640 1 -- 172.21.15.66:0/2899370236 wait complete. 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8243e59640 1 Processor -- start 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8243e59640 1 -- start start 2024-09-12T01:54:53.375 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8243e59640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0fb480 0x7f823c10bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8243e59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c10c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8243e59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c10c9f0 con 0x7f823c1014c0 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8243e59640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c10cb30 con 0x7f823c0fb480 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f82413f4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c10c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f82413f4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c10c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51154/0 (socket says 172.21.15.66:51154) 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f82413f4640 1 -- 172.21.15.66:0/3869416772 learned_addr learned my addr 172.21.15.66:0/3869416772 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.374+0000 7f8241bf5640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0fb480 0x7f823c10bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82413f4640 1 -- 172.21.15.66:0/3869416772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0fb480 msgr2=0x7f823c10bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82413f4640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0fb480 0x7f823c10bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82413f4640 1 -- 172.21.15.66:0/3869416772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8238005040 con 0x7f823c1014c0 2024-09-12T01:54:53.376 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82413f4640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c10c4b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f822c00c790 tx=0x7f822c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822c00a7a0 con 0x7f823c1014c0 2024-09-12T01:54:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f822c00ada0 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c1195e0 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822c0113a0 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.375+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c119990 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.376+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c0fcbc0 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.376+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f822c00a900 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.377+0000 7f82327fc640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f822806e0b0 0x7f8228070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.377+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f822c08dd00 con 0x7f823c1014c0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.377+0000 7f8241bf5640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f822806e0b0 0x7f8228070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.378+0000 7f8241bf5640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f822806e0b0 0x7f8228070560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8238009ac0 tx=0x7f8238035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:53.382 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.381+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f822c091030 con 0x7f823c1014c0 2024-09-12T01:54:53.595 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.595+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f823c0fac40 con 0x7f823c1014c0 2024-09-12T01:54:53.595 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:53 smithi066 ceph-mon[110996]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:53.596 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.595+0000 7f82327fc640 1 -- 172.21.15.66:0/3869416772 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) v1 ==== 76+0+1976 (secure 0 0 0) 0x7f822c05aac0 con 0x7f823c1014c0 2024-09-12T01:54:53.596 INFO:teuthology.orchestra.run.smithi066.stdout:e36 2024-09-12T01:54:53.596 INFO:teuthology.orchestra.run.smithi066.stdout:btime 2024-09-12T01:53:16:545728+0000 2024-09-12T01:54:53.596 INFO:teuthology.orchestra.run.smithi066.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-12T01:54:53.596 INFO:teuthology.orchestra.run.smithi066.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-12T01:54:53.596 INFO:teuthology.orchestra.run.smithi066.stdout:legacy client fscid: 1 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:Filesystem 'cephfs' (1) 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:fs_name cephfs 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:epoch 36 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:created 2024-09-12T01:40:40.932485+0000 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:modified 2024-09-12T01:53:15.548703+0000 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:tableserver 0 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:root 0 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:session_timeout 60 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:session_autoclose 300 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:max_file_size 1099511627776 2024-09-12T01:54:53.597 INFO:teuthology.orchestra.run.smithi066.stdout:max_xattr_size 65536 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:required_client_features {} 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure 0 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:last_failure_osd_epoch 92 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:max_mds 1 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:in 0 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:up {0=34376} 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:failed 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:damaged 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:stopped 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:data_pools [3] 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:metadata_pool 2 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:inline_data disabled 2024-09-12T01:54:53.598 INFO:teuthology.orchestra.run.smithi066.stdout:balancer 2024-09-12T01:54:53.599 INFO:teuthology.orchestra.run.smithi066.stdout:bal_rank_mask -1 2024-09-12T01:54:53.599 INFO:teuthology.orchestra.run.smithi066.stdout:standby_count_wanted 1 2024-09-12T01:54:53.599 INFO:teuthology.orchestra.run.smithi066.stdout:qdb_cluster leader: 34376 members: 34376 2024-09-12T01:54:53.599 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.ipygev{0:34376} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.66:6826/274923982,v1:172.21.15.66:6827/274923982] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout:Standby daemons: 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi066.jacfsu{-1:34408} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.66:6828/1762724759,v1:172.21.15.66:6829/1762724759] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.cbdplo{-1:44337} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6824/3647246533,v1:172.21.15.153:6825/3647246533] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:54:53.601 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.cephfs.smithi153.aiydtj{-1:44367} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.153:6826/1172093134,v1:172.21.15.153:6827/1172093134] compat {c=[1],r=[1],i=[1fff]}] 2024-09-12T01:54:53.602 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-09-12T01:54:53.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f822806e0b0 msgr2=0x7f8228070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:53.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f822806e0b0 0x7f8228070560 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8238009ac0 tx=0x7f8238035040 comp rx=0 tx=0).stop 2024-09-12T01:54:53.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 msgr2=0x7f823c10c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:53.602 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c10c4b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f822c00c790 tx=0x7f822c0043c0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 shutdown_connections 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f822806e0b0 0x7f8228070560 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f823c1014c0 0x7f823c10c4b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 --2- 172.21.15.66:0/3869416772 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f823c0fb480 0x7f823c10bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 >> 172.21.15.66:0/3869416772 conn(0x7f823c0f7000 msgr2=0x7f823c0f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 shutdown_connections 2024-09-12T01:54:53.603 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:53.598+0000 7f8243e59640 1 -- 172.21.15.66:0/3869416772 wait complete. 2024-09-12T01:54:53.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:53 smithi153 ceph-mon[80899]: pgmap v263: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:54.180 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-12T01:54:54.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-12T01:54:54.485 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:54.607 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:54 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3869416772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:54:54.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:54 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3869416772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-12T01:54:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:55 smithi066 ceph-mon[110996]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:55.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:55 smithi153 ceph-mon[80899]: pgmap v264: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 -- 172.21.15.66:0/1163695951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc0fe460 msgr2=0x7f66cc0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 --2- 172.21.15.66:0/1163695951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc0fe460 0x7f66cc0fe830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f66c80048d0 tx=0x7f66c8009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 -- 172.21.15.66:0/1163695951 shutdown_connections 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 --2- 172.21.15.66:0/1163695951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66cc064fc0 0x7f66cc065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 --2- 172.21.15.66:0/1163695951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc0fe460 0x7f66cc0fe830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 -- 172.21.15.66:0/1163695951 >> 172.21.15.66:0/1163695951 conn(0x7f66cc0723b0 msgr2=0x7f66cc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:56.306 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 -- 172.21.15.66:0/1163695951 shutdown_connections 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.286+0000 7f66d379e640 1 -- 172.21.15.66:0/1163695951 wait complete. 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d379e640 1 Processor -- start 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d379e640 1 -- start start 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d379e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 0x7f66cc113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d379e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66cc0fe460 0x7f66cc1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d379e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc113cd0 con 0x7f66cc064fc0 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d379e640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc10d110 con 0x7f66cc0fe460 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d153a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 0x7f66cc113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d153a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 0x7f66cc113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51174/0 (socket says 172.21.15.66:51174) 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d153a640 1 -- 172.21.15.66:0/985219692 learned_addr learned my addr 172.21.15.66:0/985219692 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d0d39640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66cc0fe460 0x7f66cc1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d153a640 1 -- 172.21.15.66:0/985219692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66cc0fe460 msgr2=0x7f66cc1136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d153a640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66cc0fe460 0x7f66cc1136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.287+0000 7f66d153a640 1 -- 172.21.15.66:0/985219692 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8005040 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.288+0000 7f66d153a640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 0x7f66cc113190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66c8003080 tx=0x7f66c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.288+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c8038070 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.288+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc10d390 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.288+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f66c80097e0 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.288+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66c803d420 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.288+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc10d8d0 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.289+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66cc0fdcf0 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.290+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f66c8030020 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.290+0000 7f66c1ffb640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f66b806e0b0 0x7f66b8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.290+0000 7f66d0d39640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f66b806e0b0 0x7f66b8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.290+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f66c80ae300 con 0x7f66cc064fc0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.291+0000 7f66d0d39640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f66b806e0b0 0x7f66b8070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66cc10ea50 tx=0x7f66bc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:56.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.295+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f66c8077470 con 0x7f66cc064fc0 2024-09-12T01:54:56.506 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.506+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66cc04b720 con 0x7f66cc064fc0 2024-09-12T01:54:56.507 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.507+0000 7f66c1ffb640 1 -- 172.21.15.66:0/985219692 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+5252 (secure 0 0 0) 0x7f66c807ab30 con 0x7f66cc064fc0 2024-09-12T01:54:56.507 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:54:56.507 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":36,"btime":"2024-09-12T01:53:16:545728+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44367,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6827/1172093134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1172093134},{"type":"v1","addr":"172.21.15.153:6827","nonce":1172093134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:53:15.548703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34376":{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":0,"incarnation":32,"state":"up:active","state_seq":20,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34376,"qdb_cluster":[34376]},"id":1}]} 2024-09-12T01:54:56.507 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 36 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f66b806e0b0 msgr2=0x7f66b8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f66b806e0b0 0x7f66b8070560 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f66cc10ea50 tx=0x7f66bc009040 comp rx=0 tx=0).stop 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 msgr2=0x7f66cc113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 0x7f66cc113190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66c8003080 tx=0x7f66c8009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 shutdown_connections 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f66b806e0b0 0x7f66b8070560 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66cc0fe460 0x7f66cc1136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 --2- 172.21.15.66:0/985219692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f66cc064fc0 0x7f66cc113190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 >> 172.21.15.66:0/985219692 conn(0x7f66cc0723b0 msgr2=0x7f66cc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 shutdown_connections 2024-09-12T01:54:56.511 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:56.510+0000 7f66d379e640 1 -- 172.21.15.66:0/985219692 wait complete. 2024-09-12T01:54:57.068 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 18} 2024-09-12T01:54:57.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 17 2024-09-12T01:54:57.328 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:54:57.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:57 smithi153 ceph-mon[80899]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:57 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:57.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:57 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/985219692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:57.686 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:57 smithi066 ceph-mon[110996]: pgmap v265: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:57.686 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:57 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:54:57.687 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:57 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/985219692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-12T01:54:58.910 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 -- 172.21.15.66:0/2060706225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c00fb4d0 msgr2=0x7f86c00fb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/2060706225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c00fb4d0 0x7f86c00fb940 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f86b00048d0 tx=0x7f86b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 -- 172.21.15.66:0/2060706225 shutdown_connections 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/2060706225 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c00fb4d0 0x7f86c00fb940 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/2060706225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c0101510 0x7f86c01018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 -- 172.21.15.66:0/2060706225 >> 172.21.15.66:0/2060706225 conn(0x7f86c00f7090 msgr2=0x7f86c00f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 -- 172.21.15.66:0/2060706225 shutdown_connections 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.908+0000 7f86c7a6f640 1 -- 172.21.15.66:0/2060706225 wait complete. 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c7a6f640 1 Processor -- start 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c7a6f640 1 -- start start 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c7a6f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c00fb4d0 0x7f86c01131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:58.911 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c7a6f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 0x7f86c0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c7a6f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c0113d10 con 0x7f86c0101510 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c7a6f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c010d150 con 0x7f86c00fb4d0 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c500a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 0x7f86c0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c500a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 0x7f86c0113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51192/0 (socket says 172.21.15.66:51192) 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c500a640 1 -- 172.21.15.66:0/1624261728 learned_addr learned my addr 172.21.15.66:0/1624261728 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c580b640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c00fb4d0 0x7f86c01131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c500a640 1 -- 172.21.15.66:0/1624261728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c00fb4d0 msgr2=0x7f86c01131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c500a640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c00fb4d0 0x7f86c01131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c500a640 1 -- 172.21.15.66:0/1624261728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b0005040 con 0x7f86c0101510 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.909+0000 7f86c580b640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c00fb4d0 0x7f86c01131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.910+0000 7f86c500a640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 0x7f86c0113710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f86b0000c00 tx=0x7f86b0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:58.912 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.910+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86b0038070 con 0x7f86c0101510 2024-09-12T01:54:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.910+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f86b002ade0 con 0x7f86c0101510 2024-09-12T01:54:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.910+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c010d3d0 con 0x7f86c0101510 2024-09-12T01:54:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.910+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86b002c7e0 con 0x7f86c0101510 2024-09-12T01:54:58.913 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.910+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c010d910 con 0x7f86c0101510 2024-09-12T01:54:58.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.911+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c00fcc10 con 0x7f86c0101510 2024-09-12T01:54:58.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.912+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f86b0030020 con 0x7f86c0101510 2024-09-12T01:54:58.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.912+0000 7f86b67fc640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86ac06e0b0 0x7f86ac070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:54:58.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.912+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f86b00ad930 con 0x7f86c0101510 2024-09-12T01:54:58.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.912+0000 7f86c580b640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86ac06e0b0 0x7f86ac070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:54:58.914 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.913+0000 7f86c580b640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86ac06e0b0 0x7f86ac070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f86bc004d80 tx=0x7f86bc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:54:58.917 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:58.917+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f86b0076bd0 con 0x7f86c0101510 2024-09-12T01:54:59.129 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.128+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f86c01084b0 con 0x7f86c0101510 2024-09-12T01:54:59.130 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.129+0000 7f86b67fc640 1 -- 172.21.15.66:0/1624261728 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v36) v1 ==== 107+0+4117 (secure 0 0 0) 0x7f86b007a290 con 0x7f86c0101510 2024-09-12T01:54:59.130 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:54:59.130 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":17,"btime":"2024-09-12T01:51:57:619703+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:40:59.057757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14462":{"gid":14462,"name":"cephfs.smithi066.jacfsu","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.66:6829/299983733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":299983733},{"type":"v1","addr":"172.21.15.66:6829","nonce":299983733}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:54:59.131 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 17 2024-09-12T01:54:59.132 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86ac06e0b0 msgr2=0x7f86ac070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86ac06e0b0 0x7f86ac070560 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f86bc004d80 tx=0x7f86bc00b040 comp rx=0 tx=0).stop 2024-09-12T01:54:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 msgr2=0x7f86c0113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:54:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 0x7f86c0113710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f86b0000c00 tx=0x7f86b0009da0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 shutdown_connections 2024-09-12T01:54:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86ac06e0b0 0x7f86ac070560 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.133 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c0101510 0x7f86c0113710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 --2- 172.21.15.66:0/1624261728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f86c00fb4d0 0x7f86c01131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:54:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 >> 172.21.15.66:0/1624261728 conn(0x7f86c00f7090 msgr2=0x7f86c00659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:54:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 shutdown_connections 2024-09-12T01:54:59.134 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:54:59.132+0000 7f86c7a6f640 1 -- 172.21.15.66:0/1624261728 wait complete. 2024-09-12T01:54:59.654 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:59 smithi153 ceph-mon[80899]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:59.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:54:59 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1624261728' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-12T01:54:59.655 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:59 smithi066 ceph-mon[110996]: pgmap v266: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:54:59.655 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:54:59 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1624261728' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-09-12T01:54:59.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 18 2024-09-12T01:54:59.915 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:01.576 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:01 smithi066 ceph-mon[110996]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:01.655 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:01 smithi153 ceph-mon[80899]: pgmap v267: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:01.665 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 -- 172.21.15.66:0/1171686099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 msgr2=0x7feaf8065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 --2- 172.21.15.66:0/1171686099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8065430 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feae00048d0 tx=0x7feae0009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 -- 172.21.15.66:0/1171686099 shutdown_connections 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 --2- 172.21.15.66:0/1171686099 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8065430 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 --2- 172.21.15.66:0/1171686099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 0x7feaf80fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 -- 172.21.15.66:0/1171686099 >> 172.21.15.66:0/1171686099 conn(0x7feaf80723b0 msgr2=0x7feaf80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.666 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 -- 172.21.15.66:0/1171686099 shutdown_connections 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.660+0000 7feafd6fd640 1 -- 172.21.15.66:0/1171686099 wait complete. 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feafd6fd640 1 Processor -- start 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feafd6fd640 1 -- start start 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feafd6fd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feafd6fd640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 0x7feaf8113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feafd6fd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8113e00 con 0x7feaf8064fc0 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feafd6fd640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf810d1b0 con 0x7feaf80fe460 2024-09-12T01:55:01.667 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feaf6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feaf6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:51216/0 (socket says 172.21.15.66:51216) 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feaf6ffd640 1 -- 172.21.15.66:0/2318252908 learned_addr learned my addr 172.21.15.66:0/2318252908 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.661+0000 7feaf67fc640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 0x7feaf8113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaf6ffd640 1 -- 172.21.15.66:0/2318252908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 msgr2=0x7feaf8113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaf6ffd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 0x7feaf8113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaf6ffd640 1 -- 172.21.15.66:0/2318252908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0005040 con 0x7feaf8064fc0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaf67fc640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 0x7feaf8113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaf6ffd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8113230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b790 tx=0x7feaf00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf000c700 con 0x7feaf8064fc0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf810d490 con 0x7feaf8064fc0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feaf000cd00 con 0x7feaf8064fc0 2024-09-12T01:55:01.668 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feaf0015e70 con 0x7feaf8064fc0 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.662+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf810d980 con 0x7feaf8064fc0 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.663+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf80fdcf0 con 0x7feaf8064fc0 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.664+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7feaf0012070 con 0x7feaf8064fc0 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.664+0000 7feaef7fe640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feae406e0b0 0x7feae4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.664+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7feaf008d870 con 0x7feaf8064fc0 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.664+0000 7feaf67fc640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feae406e0b0 0x7feae4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:01.669 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.665+0000 7feaf67fc640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feae406e0b0 0x7feae4070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feaf8072e00 tx=0x7feae0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:01.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.669+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feaf0056a60 con 0x7feaf8064fc0 2024-09-12T01:55:01.881 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.881+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7feaf804b7b0 con 0x7feaf8064fc0 2024-09-12T01:55:01.882 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.882+0000 7feaef7fe640 1 -- 172.21.15.66:0/2318252908 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v36) v1 ==== 107+0+4961 (secure 0 0 0) 0x7feaf005a120 con 0x7feaf8064fc0 2024-09-12T01:55:01.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:01.883 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":18,"btime":"2024-09-12T01:52:02:924714+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:40:59.057757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14462":{"gid":14462,"name":"cephfs.smithi066.jacfsu","rank":0,"incarnation":13,"state":"up:active","state_seq":5,"addr":"172.21.15.66:6829/299983733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":299983733},{"type":"v1","addr":"172.21.15.66:6829","nonce":299983733}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:01.883 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 18 2024-09-12T01:55:01.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feae406e0b0 msgr2=0x7feae4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.885 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feae406e0b0 0x7feae4070560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7feaf8072e00 tx=0x7feae0035040 comp rx=0 tx=0).stop 2024-09-12T01:55:01.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 msgr2=0x7feaf8113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:01.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8113230 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7feaf000b790 tx=0x7feaf00091d0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 shutdown_connections 2024-09-12T01:55:01.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feae406e0b0 0x7feae4070560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.886 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feaf80fe460 0x7feaf8113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 --2- 172.21.15.66:0/2318252908 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feaf8064fc0 0x7feaf8113230 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:01.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 >> 172.21.15.66:0/2318252908 conn(0x7feaf80723b0 msgr2=0x7feaf8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:01.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 shutdown_connections 2024-09-12T01:55:01.887 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:01.885+0000 7feafd6fd640 1 -- 172.21.15.66:0/2318252908 wait complete. 2024-09-12T01:55:02.538 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:02 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2318252908' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-12T01:55:02.565 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 19 2024-09-12T01:55:02.824 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:02.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:02 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2318252908' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-09-12T01:55:03.512 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:03 smithi066 ceph-mon[110996]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:03.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:03 smithi153 ceph-mon[80899]: pgmap v268: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:04.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 -- 172.21.15.66:0/2532879112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 msgr2=0x7f84ac1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 --2- 172.21.15.66:0/2532879112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac1018b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f84a80048d0 tx=0x7f84a8009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 -- 172.21.15.66:0/2532879112 shutdown_connections 2024-09-12T01:55:04.238 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 --2- 172.21.15.66:0/2532879112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 0x7f84ac0fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 --2- 172.21.15.66:0/2532879112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac1018b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 -- 172.21.15.66:0/2532879112 >> 172.21.15.66:0/2532879112 conn(0x7f84ac0f7020 msgr2=0x7f84ac0f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 -- 172.21.15.66:0/2532879112 shutdown_connections 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.236+0000 7f84b3647640 1 -- 172.21.15.66:0/2532879112 wait complete. 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b3647640 1 Processor -- start 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b3647640 1 -- start start 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b3647640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 0x7f84ac1120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b3647640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b3647640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac112c10 con 0x7f84ac1014e0 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b3647640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac10c050 con 0x7f84ac0fb4a0 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b0be2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b0be2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52142/0 (socket says 172.21.15.66:52142) 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.237+0000 7f84b0be2640 1 -- 172.21.15.66:0/4279116747 learned_addr learned my addr 172.21.15.66:0/4279116747 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:04.239 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b13e3640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 0x7f84ac1120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b0be2640 1 -- 172.21.15.66:0/4279116747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 msgr2=0x7f84ac1120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b0be2640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 0x7f84ac1120d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b0be2640 1 -- 172.21.15.66:0/4279116747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8005040 con 0x7f84ac1014e0 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b13e3640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 0x7f84ac1120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b0be2640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac112610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f84a000cb10 tx=0x7f84a0007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a0004200 con 0x7f84ac1014e0 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac10c330 con 0x7f84ac1014e0 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f84a000acc0 con 0x7f84ac1014e0 2024-09-12T01:55:04.240 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84a0003cd0 con 0x7f84ac1014e0 2024-09-12T01:55:04.241 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.238+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac10c8d0 con 0x7f84ac1014e0 2024-09-12T01:55:04.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.239+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac0fcbe0 con 0x7f84ac1014e0 2024-09-12T01:55:04.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.240+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f84a000a820 con 0x7f84ac1014e0 2024-09-12T01:55:04.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.240+0000 7f849dffb640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f84980702c0 0x7f8498072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:04.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.240+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f84a008e410 con 0x7f84ac1014e0 2024-09-12T01:55:04.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.240+0000 7f84b13e3640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f84980702c0 0x7f8498072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:04.242 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.241+0000 7f84b13e3640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f84980702c0 0x7f8498072770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007ac0 tx=0x7f84a8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:04.245 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.245+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f84a0057600 con 0x7f84ac1014e0 2024-09-12T01:55:04.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.458+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f84ac108480 con 0x7f84ac1014e0 2024-09-12T01:55:04.459 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.459+0000 7f849dffb640 1 -- 172.21.15.66:0/4279116747 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v36) v1 ==== 107+0+4174 (secure 0 0 0) 0x7f84a005acc0 con 0x7f84ac1014e0 2024-09-12T01:55:04.459 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:04.459 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":19,"btime":"2024-09-12T01:52:14:905228+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:14.904938+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:04.460 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 19 2024-09-12T01:55:04.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f84980702c0 msgr2=0x7f8498072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.461 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f84980702c0 0x7f8498072770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f84a8007ac0 tx=0x7f84a8035040 comp rx=0 tx=0).stop 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 msgr2=0x7f84ac112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac112610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f84a000cb10 tx=0x7f84a0007ee0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 shutdown_connections 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f84980702c0 0x7f8498072770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84ac1014e0 0x7f84ac112610 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 --2- 172.21.15.66:0/4279116747 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84ac0fb4a0 0x7f84ac1120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 >> 172.21.15.66:0/4279116747 conn(0x7f84ac0f7020 msgr2=0x7f84ac0f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 shutdown_connections 2024-09-12T01:55:04.462 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:04.461+0000 7f84b3647640 1 -- 172.21.15.66:0/4279116747 wait complete. 2024-09-12T01:55:05.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 20 2024-09-12T01:55:05.383 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:05.667 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:05 smithi066 ceph-mon[110996]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:05.667 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:05 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4279116747' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-12T01:55:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:05 smithi153 ceph-mon[80899]: pgmap v269: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:05.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:05 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4279116747' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-09-12T01:55:06.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 -- 172.21.15.66:0/2722614009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 msgr2=0x7f8714102a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:06.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2722614009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714102a30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87040048d0 tx=0x7f8704009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 -- 172.21.15.66:0/2722614009 shutdown_connections 2024-09-12T01:55:06.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2722614009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 0x7f87140fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2722614009 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714102a30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.993 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 -- 172.21.15.66:0/2722614009 >> 172.21.15.66:0/2722614009 conn(0x7f8714070ce0 msgr2=0x7f87140710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:06.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 -- 172.21.15.66:0/2722614009 shutdown_connections 2024-09-12T01:55:06.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.992+0000 7f8718bbb640 1 -- 172.21.15.66:0/2722614009 wait complete. 2024-09-12T01:55:06.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.993+0000 7f8718bbb640 1 Processor -- start 2024-09-12T01:55:06.994 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.993+0000 7f8718bbb640 1 -- start start 2024-09-12T01:55:06.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.993+0000 7f8718bbb640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 0x7f87141131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.993+0000 7f8718bbb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.993+0000 7f8718bbb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8714113d10 con 0x7f8714102660 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.993+0000 7f8718bbb640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871410d150 con 0x7f87140fac80 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52158/0 (socket says 172.21.15.66:52158) 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 -- 172.21.15.66:0/2693290704 learned_addr learned my addr 172.21.15.66:0/2693290704 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f871259c640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 0x7f87141131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 -- 172.21.15.66:0/2693290704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 msgr2=0x7f87141131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 0x7f87141131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 -- 172.21.15.66:0/2693290704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704005040 con 0x7f8714102660 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f871259c640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 0x7f87141131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8711d9b640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714113710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f870800c830 tx=0x7f8708004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870800a850 con 0x7f8714102660 2024-09-12T01:55:06.996 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871410d430 con 0x7f8714102660 2024-09-12T01:55:06.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f870800ae50 con 0x7f8714102660 2024-09-12T01:55:06.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87080113a0 con 0x7f8714102660 2024-09-12T01:55:06.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.994+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871410d9d0 con 0x7f8714102660 2024-09-12T01:55:06.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.995+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87140657d0 con 0x7f8714102660 2024-09-12T01:55:06.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.996+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8708012400 con 0x7f8714102660 2024-09-12T01:55:06.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.996+0000 7f8702ffd640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86fc06e0b0 0x7f86fc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:06.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.997+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f870808df90 con 0x7f8714102660 2024-09-12T01:55:06.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.997+0000 7f871259c640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86fc06e0b0 0x7f86fc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:06.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:06.997+0000 7f871259c640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86fc06e0b0 0x7f86fc070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8704007ac0 tx=0x7f8704035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:07.001 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.001+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8708057180 con 0x7f8714102660 2024-09-12T01:55:07.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.213+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f8714074c00 con 0x7f8714102660 2024-09-12T01:55:07.213 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.213+0000 7f8702ffd640 1 -- 172.21.15.66:0/2693290704 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v36) v1 ==== 107+0+4185 (secure 0 0 0) 0x7f870805a840 con 0x7f8714102660 2024-09-12T01:55:07.214 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:07.214 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":20,"btime":"2024-09-12T01:52:14:909817+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:14.909804+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":0,"incarnation":20,"state":"up:replay","state_seq":3,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:07.214 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 20 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.215+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86fc06e0b0 msgr2=0x7f86fc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.215+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86fc06e0b0 0x7f86fc070560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8704007ac0 tx=0x7f8704035040 comp rx=0 tx=0).stop 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 msgr2=0x7f8714113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714113710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f870800c830 tx=0x7f8708004430 comp rx=0 tx=0).stop 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 shutdown_connections 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f86fc06e0b0 0x7f86fc070560 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8714102660 0x7f8714113710 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 --2- 172.21.15.66:0/2693290704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87140fac80 0x7f87141131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:07.216 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 >> 172.21.15.66:0/2693290704 conn(0x7f8714070ce0 msgr2=0x7f87140fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 shutdown_connections 2024-09-12T01:55:07.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:07.216+0000 7f8718bbb640 1 -- 172.21.15.66:0/2693290704 wait complete. 2024-09-12T01:55:07.540 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:07 smithi066 ceph-mon[110996]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:07.540 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:07 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2693290704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-12T01:55:07.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 21 2024-09-12T01:55:07.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:07 smithi153 ceph-mon[80899]: pgmap v270: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:07.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:07 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2693290704' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-12T01:55:08.075 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.607+0000 7f9e15d14640 1 -- 172.21.15.66:0/4146496446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 msgr2=0x7f9e100fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.607+0000 7f9e15d14640 1 --2- 172.21.15.66:0/4146496446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e100fb8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9e040048d0 tx=0x7f9e04009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 -- 172.21.15.66:0/4146496446 shutdown_connections 2024-09-12T01:55:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 --2- 172.21.15.66:0/4146496446 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e100fb8f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.610 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 --2- 172.21.15.66:0/4146496446 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e101014c0 0x7f9e10101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 -- 172.21.15.66:0/4146496446 >> 172.21.15.66:0/4146496446 conn(0x7f9e100f7020 msgr2=0x7f9e100f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 -- 172.21.15.66:0/4146496446 shutdown_connections 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 -- 172.21.15.66:0/4146496446 wait complete. 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 Processor -- start 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 -- start start 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e1010e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.608+0000 7f9e15d14640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e101014c0 0x7f9e1010e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e15d14640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1010ee50 con 0x7f9e100fb480 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e15d14640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1010efc0 con 0x7f9e101014c0 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e1010e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e1010e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:52176/0 (socket says 172.21.15.66:52176) 2024-09-12T01:55:09.611 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 -- 172.21.15.66:0/3803521991 learned_addr learned my addr 172.21.15.66:0/3803521991 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0effd640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e101014c0 0x7f9e1010e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 -- 172.21.15.66:0/3803521991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e101014c0 msgr2=0x7f9e1010e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e101014c0 0x7f9e1010e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 -- 172.21.15.66:0/3803521991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04005040 con 0x7f9e100fb480 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e0f7fe640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e1010e230 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000b790 tx=0x7f9e000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e0000c700 con 0x7f9e100fb480 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e101172a0 con 0x7f9e100fb480 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e0000cd00 con 0x7f9e100fb480 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.609+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e00015e80 con 0x7f9e100fb480 2024-09-12T01:55:09.612 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.610+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e10117790 con 0x7f9e100fb480 2024-09-12T01:55:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.611+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e100fcbc0 con 0x7f9e100fb480 2024-09-12T01:55:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.611+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f9e00012070 con 0x7f9e100fb480 2024-09-12T01:55:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.611+0000 7f9df7fff640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9df806e0b0 0x7f9df8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:09.613 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.612+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f9e0008d640 con 0x7f9e100fb480 2024-09-12T01:55:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.612+0000 7f9e0effd640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9df806e0b0 0x7f9df8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:09.614 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.612+0000 7f9e0effd640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9df806e0b0 0x7f9df8070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009ac0 tx=0x7f9e04035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:09.616 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.616+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9e000567b0 con 0x7f9e100fb480 2024-09-12T01:55:09.832 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.832+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f9e1004b750 con 0x7f9e100fb480 2024-09-12T01:55:09.833 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:09 smithi066 ceph-mon[110996]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:09.833 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.832+0000 7f9df7fff640 1 -- 172.21.15.66:0/3803521991 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v36) v1 ==== 107+0+4190 (secure 0 0 0) 0x7f9e00059e70 con 0x7f9e100fb480 2024-09-12T01:55:09.833 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:09.833 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":21,"btime":"2024-09-12T01:52:23:066180+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:22.097561+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":175,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:09.834 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 21 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9df806e0b0 msgr2=0x7f9df8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9df806e0b0 0x7f9df8070560 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009ac0 tx=0x7f9e04035040 comp rx=0 tx=0).stop 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 msgr2=0x7f9e1010e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e1010e230 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000b790 tx=0x7f9e000091d0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 shutdown_connections 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f9df806e0b0 0x7f9df8070560 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e101014c0 0x7f9e1010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 --2- 172.21.15.66:0/3803521991 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100fb480 0x7f9e1010e230 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 >> 172.21.15.66:0/3803521991 conn(0x7f9e100f7020 msgr2=0x7f9e100f8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 shutdown_connections 2024-09-12T01:55:09.836 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:09.835+0000 7f9e15d14640 1 -- 172.21.15.66:0/3803521991 wait complete. 2024-09-12T01:55:09.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:09 smithi153 ceph-mon[80899]: pgmap v271: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:10.408 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 22 2024-09-12T01:55:10.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:10 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3803521991' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-12T01:55:10.682 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:10.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:10 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3803521991' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-12T01:55:11.812 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:11 smithi066 ceph-mon[110996]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:11.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:11 smithi153 ceph-mon[80899]: pgmap v272: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:12.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.314+0000 7f1fd102f640 1 -- 172.21.15.66:0/2973051582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc1025f0 msgr2=0x7f1fcc1029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.314+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2973051582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc1025f0 0x7f1fcc1029c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009c50 tx=0x7f1fbc004d10 comp rx=0 tx=0).stop 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 -- 172.21.15.66:0/2973051582 shutdown_connections 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2973051582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc0fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2973051582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc1025f0 0x7f1fcc1029c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 -- 172.21.15.66:0/2973051582 >> 172.21.15.66:0/2973051582 conn(0x7f1fcc070c80 msgr2=0x7f1fcc071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 -- 172.21.15.66:0/2973051582 shutdown_connections 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 -- 172.21.15.66:0/2973051582 wait complete. 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 Processor -- start 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.315+0000 7f1fd102f640 1 -- start start 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fd102f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fd102f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc1025f0 0x7f1fcc113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fd102f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc113d10 con 0x7f1fcc0fac60 2024-09-12T01:55:12.317 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fd102f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc10d150 con 0x7f1fcc1025f0 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc1131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56796/0 (socket says 172.21.15.66:56796) 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 -- 172.21.15.66:0/2545806264 learned_addr learned my addr 172.21.15.66:0/2545806264 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fca59c640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc1025f0 0x7f1fcc113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 -- 172.21.15.66:0/2545806264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc1025f0 msgr2=0x7f1fcc113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc1025f0 0x7f1fcc113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 -- 172.21.15.66:0/2545806264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0098b0 con 0x7f1fcc0fac60 2024-09-12T01:55:12.318 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fcad9d640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc1131d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc004750 tx=0x7f1fbc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:12.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.316+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fbc009610 con 0x7f1fcc0fac60 2024-09-12T01:55:12.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.317+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1fbc032b10 con 0x7f1fcc0fac60 2024-09-12T01:55:12.319 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.317+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc10d3d0 con 0x7f1fcc0fac60 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.317+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fbc03d990 con 0x7f1fcc0fac60 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.317+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc10d970 con 0x7f1fcc0fac60 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.318+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc065810 con 0x7f1fcc0fac60 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.318+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1fbc02f030 con 0x7f1fcc0fac60 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.319+0000 7f1fc37fe640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1fb806e0b0 0x7f1fb8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.319+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f1fbc0aed10 con 0x7f1fcc0fac60 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.319+0000 7f1fca59c640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1fb806e0b0 0x7f1fb8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:12.320 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.319+0000 7f1fca59c640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1fb806e0b0 0x7f1fb8070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc10ea90 tx=0x7f1fb400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:12.323 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.323+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1fbc077f00 con 0x7f1fcc0fac60 2024-09-12T01:55:12.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.540+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f1fcc04b720 con 0x7f1fcc0fac60 2024-09-12T01:55:12.541 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.541+0000 7f1fc37fe640 1 -- 172.21.15.66:0/2545806264 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v36) v1 ==== 107+0+4187 (secure 0 0 0) 0x7f1fbc07b5c0 con 0x7f1fcc0fac60 2024-09-12T01:55:12.541 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:12.542 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":22,"btime":"2024-09-12T01:52:24:071867+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:23.074166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":176,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:12.542 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 22 2024-09-12T01:55:12.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1fb806e0b0 msgr2=0x7f1fb8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:12.543 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1fb806e0b0 0x7f1fb8070560 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc10ea90 tx=0x7f1fb400b040 comp rx=0 tx=0).stop 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 msgr2=0x7f1fcc1131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc1131d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc004750 tx=0x7f1fbc004d10 comp rx=0 tx=0).stop 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 shutdown_connections 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1fb806e0b0 0x7f1fb8070560 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1fcc1025f0 0x7f1fcc113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 --2- 172.21.15.66:0/2545806264 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fcc0fac60 0x7f1fcc1131d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 >> 172.21.15.66:0/2545806264 conn(0x7f1fcc070c80 msgr2=0x7f1fcc0f9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 shutdown_connections 2024-09-12T01:55:12.544 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:12.543+0000 7f1fd102f640 1 -- 172.21.15.66:0/2545806264 wait complete. 2024-09-12T01:55:12.806 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:12 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:55:12.887 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:12 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:55:13.290 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 23 2024-09-12T01:55:13.570 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:13.578 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:13 smithi066 ceph-mon[110996]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:13.578 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:13 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2545806264' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-12T01:55:13.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:13 smithi153 ceph-mon[80899]: pgmap v273: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:13.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:13 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2545806264' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-12T01:55:14.847 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:14 smithi066 ceph-mon[110996]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:14.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:14 smithi153 ceph-mon[80899]: pgmap v274: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 -- 172.21.15.66:0/3019568570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102580 msgr2=0x7f90b8102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 --2- 172.21.15.66:0/3019568570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102580 0x7f90b8102950 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f90a80048d0 tx=0x7f90a8009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 -- 172.21.15.66:0/3019568570 shutdown_connections 2024-09-12T01:55:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 --2- 172.21.15.66:0/3019568570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102f20 0x7f90b80fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 --2- 172.21.15.66:0/3019568570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102580 0x7f90b8102950 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 -- 172.21.15.66:0/3019568570 >> 172.21.15.66:0/3019568570 conn(0x7f90b80f81a0 msgr2=0x7f90b80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 -- 172.21.15.66:0/3019568570 shutdown_connections 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.169+0000 7f90bdff9640 1 -- 172.21.15.66:0/3019568570 wait complete. 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90bdff9640 1 Processor -- start 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90bdff9640 1 -- start start 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90bdff9640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102580 0x7f90b806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90bdff9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 0x7f90b806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90bdff9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b8070490 con 0x7f90b8102f20 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90bdff9640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b8070600 con 0x7f90b8102580 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90b6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 0x7f90b806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90b6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 0x7f90b806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56808/0 (socket says 172.21.15.66:56808) 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90b6ffd640 1 -- 172.21.15.66:0/4156687577 learned_addr learned my addr 172.21.15.66:0/4156687577 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:15.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.170+0000 7f90b77fe640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102580 0x7f90b806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90b6ffd640 1 -- 172.21.15.66:0/4156687577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102580 msgr2=0x7f90b806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90b6ffd640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102580 0x7f90b806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90b6ffd640 1 -- 172.21.15.66:0/4156687577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8005040 con 0x7f90b8102f20 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90b77fe640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102580 0x7f90b806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90b6ffd640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 0x7f90b806ff50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90ac002840 tx=0x7f90ac004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90ac007c30 con 0x7f90b8102f20 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90ac00f040 con 0x7f90b8102f20 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b8070890 con 0x7f90b8102f20 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90ac009510 con 0x7f90b8102f20 2024-09-12T01:55:15.173 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.171+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b8119960 con 0x7f90b8102f20 2024-09-12T01:55:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.172+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b80fdd00 con 0x7f90b8102f20 2024-09-12T01:55:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.173+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f90ac009670 con 0x7f90b8102f20 2024-09-12T01:55:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.173+0000 7f909ffff640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90a006e0b0 0x7f90a0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.173+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f90ac08d4f0 con 0x7f90b8102f20 2024-09-12T01:55:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.173+0000 7f90b77fe640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90a006e0b0 0x7f90a0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:15.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.174+0000 7f90b77fe640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90a006e0b0 0x7f90a0070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f90a8007ac0 tx=0x7f90a8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:15.178 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.178+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90ac0566e0 con 0x7f90b8102f20 2024-09-12T01:55:15.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.389+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f90b81095f0 con 0x7f90b8102f20 2024-09-12T01:55:15.390 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.389+0000 7f909ffff640 1 -- 172.21.15.66:0/4156687577 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v36) v1 ==== 107+0+4196 (secure 0 0 0) 0x7f90ac059da0 con 0x7f90b8102f20 2024-09-12T01:55:15.390 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:15.390 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":23,"btime":"2024-09-12T01:52:25:076531+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:25.076527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":0,"incarnation":20,"state":"up:active","state_seq":177,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-12T01:55:15.391 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 23 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.391+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90a006e0b0 msgr2=0x7f90a0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.391+0000 7f90bdff9640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90a006e0b0 0x7f90a0070560 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f90a8007ac0 tx=0x7f90a8035040 comp rx=0 tx=0).stop 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.391+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 msgr2=0x7f90b806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.391+0000 7f90bdff9640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 0x7f90b806ff50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f90ac002840 tx=0x7f90ac004570 comp rx=0 tx=0).stop 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 shutdown_connections 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f90a006e0b0 0x7f90a0070560 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.392 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90b8102f20 0x7f90b806ff50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 --2- 172.21.15.66:0/4156687577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90b8102580 0x7f90b806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 >> 172.21.15.66:0/4156687577 conn(0x7f90b80f81a0 msgr2=0x7f90b80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 shutdown_connections 2024-09-12T01:55:15.393 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:15.392+0000 7f90bdff9640 1 -- 172.21.15.66:0/4156687577 wait complete. 2024-09-12T01:55:15.735 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:15 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4156687577' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-12T01:55:15.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:15 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4156687577' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-12T01:55:16.011 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 24 2024-09-12T01:55:16.269 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:16.714 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:16 smithi066 ceph-mon[110996]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:16.905 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:16 smithi153 ceph-mon[80899]: pgmap v275: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:17.509 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:17 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:17.904 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:17 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 -- 172.21.15.66:0/3696355024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 msgr2=0x7f71e00fc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 --2- 172.21.15.66:0/3696355024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e00fc590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f71d00048d0 tx=0x7f71d0009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 -- 172.21.15.66:0/3696355024 shutdown_connections 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 --2- 172.21.15.66:0/3696355024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e00fc590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 --2- 172.21.15.66:0/3696355024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0102530 0x7f71e0102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 -- 172.21.15.66:0/3696355024 >> 172.21.15.66:0/3696355024 conn(0x7f71e00f80f0 msgr2=0x7f71e00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 -- 172.21.15.66:0/3696355024 shutdown_connections 2024-09-12T01:55:17.995 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.994+0000 7f71e7238640 1 -- 172.21.15.66:0/3696355024 wait complete. 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.995+0000 7f71e7238640 1 Processor -- start 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.995+0000 7f71e7238640 1 -- start start 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.995+0000 7f71e7238640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0102530 0x7f71e01153a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.995+0000 7f71e7238640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e01158e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.995+0000 7f71e7238640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0115ee0 con 0x7f71e0102ed0 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.995+0000 7f71e7238640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e0116050 con 0x7f71e0102530 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e01158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e01158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56828/0 (socket says 172.21.15.66:56828) 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 -- 172.21.15.66:0/4083873518 learned_addr learned my addr 172.21.15.66:0/4083873518 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71e4fd4640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0102530 0x7f71e01153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 -- 172.21.15.66:0/4083873518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0102530 msgr2=0x7f71e01153a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0102530 0x7f71e01153a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:17.997 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 -- 172.21.15.66:0/4083873518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0005040 con 0x7f71e0102ed0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dffff640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e01158e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f71d00043d0 tx=0x7f71d0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.996+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d0038070 con 0x7f71e0102ed0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.997+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e010f470 con 0x7f71e0102ed0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.997+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f71d00096e0 con 0x7f71e0102ed0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.997+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e010f9b0 con 0x7f71e0102ed0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.997+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71d002c8a0 con 0x7f71e0102ed0 2024-09-12T01:55:17.998 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.998+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e00fdcb0 con 0x7f71e0102ed0 2024-09-12T01:55:17.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.998+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f71d0030020 con 0x7f71e0102ed0 2024-09-12T01:55:17.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.999+0000 7f71dd7fa640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f71cc06e0b0 0x7f71cc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:17.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.999+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f71d00ade10 con 0x7f71e0102ed0 2024-09-12T01:55:17.999 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:17.999+0000 7f71e4fd4640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f71cc06e0b0 0x7f71cc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:18.000 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.000+0000 7f71e4fd4640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f71cc06e0b0 0x7f71cc070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71c8004eb0 tx=0x7f71c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:18.003 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.003+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f71d0077170 con 0x7f71e0102ed0 2024-09-12T01:55:18.217 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.217+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f71e00fbd30 con 0x7f71e0102ed0 2024-09-12T01:55:18.218 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.218+0000 7f71dd7fa640 1 -- 172.21.15.66:0/4083873518 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v36) v1 ==== 107+0+5043 (secure 0 0 0) 0x7f71d007a830 con 0x7f71e0102ed0 2024-09-12T01:55:18.218 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:18.218 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":24,"btime":"2024-09-12T01:52:26:082154+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:25.076527+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24277":{"gid":24277,"name":"cephfs.smithi153.cbdplo","rank":0,"incarnation":20,"state":"up:active","state_seq":177,"addr":"172.21.15.153:6825/27089229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":27089229},{"type":"v1","addr":"172.21.15.153:6825","nonce":27089229}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24277,"qdb_cluster":[24277]},"id":1}]} 2024-09-12T01:55:18.219 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 24 2024-09-12T01:55:18.220 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f71cc06e0b0 msgr2=0x7f71cc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f71cc06e0b0 0x7f71cc070560 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f71c8004eb0 tx=0x7f71c800b040 comp rx=0 tx=0).stop 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 msgr2=0x7f71e01158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e01158e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f71d00043d0 tx=0x7f71d0009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 shutdown_connections 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f71cc06e0b0 0x7f71cc070560 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71e0102ed0 0x7f71e01158e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 --2- 172.21.15.66:0/4083873518 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71e0102530 0x7f71e01153a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 >> 172.21.15.66:0/4083873518 conn(0x7f71e00f80f0 msgr2=0x7f71e00f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 shutdown_connections 2024-09-12T01:55:18.221 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:18.220+0000 7f71e7238640 1 -- 172.21.15.66:0/4083873518 wait complete. 2024-09-12T01:55:18.835 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 25 2024-09-12T01:55:19.093 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:19.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:55:19.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:55:19.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/4083873518' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-12T01:55:19.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:19.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:19.140 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:18 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:55:19.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: pgmap v276: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:55:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:55:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/4083873518' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-12T01:55:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-12T01:55:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-12T01:55:19.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:18 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 -- 172.21.15.66:0/881572837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 msgr2=0x7f8f20102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 --2- 172.21.15.66:0/881572837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20102950 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8f100048d0 tx=0x7f8f10009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 -- 172.21.15.66:0/881572837 shutdown_connections 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 --2- 172.21.15.66:0/881572837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f20102f20 0x7f8f200fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 --2- 172.21.15.66:0/881572837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20102950 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 -- 172.21.15.66:0/881572837 >> 172.21.15.66:0/881572837 conn(0x7f8f200f81a0 msgr2=0x7f8f200fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:20.625 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 -- 172.21.15.66:0/881572837 shutdown_connections 2024-09-12T01:55:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.624+0000 7f8f268df640 1 -- 172.21.15.66:0/881572837 wait complete. 2024-09-12T01:55:20.626 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.625+0000 7f8f268df640 1 Processor -- start 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.625+0000 7f8f268df640 1 -- start start 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f268df640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f268df640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f20102f20 0x7f8f20113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f268df640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20113d70 con 0x7f8f20102580 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f268df640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2010d1b0 con 0x7f8f20102f20 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:56842/0 (socket says 172.21.15.66:56842) 2024-09-12T01:55:20.627 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 -- 172.21.15.66:0/61340439 learned_addr learned my addr 172.21.15.66:0/61340439 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1f7fe640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f20102f20 0x7f8f20113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 -- 172.21.15.66:0/61340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f20102f20 msgr2=0x7f8f20113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f20102f20 0x7f8f20113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 -- 172.21.15.66:0/61340439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10005040 con 0x7f8f20102580 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.626+0000 7f8f1ffff640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20113230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8f10000c00 tx=0x7f8f10009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.627+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f10038070 con 0x7f8f20102580 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.627+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2010d430 con 0x7f8f20102580 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.627+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f1002ade0 con 0x7f8f20102580 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.627+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f1002c7e0 con 0x7f8f20102580 2024-09-12T01:55:20.628 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.627+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2010d970 con 0x7f8f20102580 2024-09-12T01:55:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.628+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f200fdd00 con 0x7f8f20102580 2024-09-12T01:55:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.628+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8f10030020 con 0x7f8f20102580 2024-09-12T01:55:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.629+0000 7f8f1cff9640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8f0806e0b0 0x7f8f08070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.629+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f8f100ad9d0 con 0x7f8f20102580 2024-09-12T01:55:20.629 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.629+0000 7f8f1f7fe640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8f0806e0b0 0x7f8f08070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:20.630 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.629+0000 7f8f1f7fe640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8f0806e0b0 0x7f8f08070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f2010eaf0 tx=0x7f8f1400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:20.633 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.633+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8f10076bf0 con 0x7f8f20102580 2024-09-12T01:55:20.844 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.844+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f8f2004b720 con 0x7f8f20102580 2024-09-12T01:55:20.845 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.845+0000 7f8f1cff9640 1 -- 172.21.15.66:0/61340439 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v36) v1 ==== 107+0+4245 (secure 0 0 0) 0x7f8f1007a2b0 con 0x7f8f20102580 2024-09-12T01:55:20.845 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:20.845 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":25,"btime":"2024-09-12T01:52:37:733674+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:37.733671+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:20.845 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 25 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8f0806e0b0 msgr2=0x7f8f08070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8f0806e0b0 0x7f8f08070560 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8f2010eaf0 tx=0x7f8f1400b040 comp rx=0 tx=0).stop 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 msgr2=0x7f8f20113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20113230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8f10000c00 tx=0x7f8f10009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 shutdown_connections 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8f0806e0b0 0x7f8f08070560 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f20102f20 0x7f8f20113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 --2- 172.21.15.66:0/61340439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f20102580 0x7f8f20113230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 >> 172.21.15.66:0/61340439 conn(0x7f8f200f81a0 msgr2=0x7f8f200f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 shutdown_connections 2024-09-12T01:55:20.848 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:20.847+0000 7f8f268df640 1 -- 172.21.15.66:0/61340439 wait complete. 2024-09-12T01:55:21.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:20 smithi066 ceph-mon[110996]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:21.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:20 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/61340439' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-12T01:55:21.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:20 smithi153 ceph-mon[80899]: pgmap v277: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:21.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:20 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/61340439' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-12T01:55:21.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 26 2024-09-12T01:55:21.699 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:22.984 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:22 smithi066 ceph-mon[110996]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:23.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:22 smithi153 ceph-mon[80899]: pgmap v278: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:23.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 -- 172.21.15.66:0/965704221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 msgr2=0x7f8fc8102950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 --2- 172.21.15.66:0/965704221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8102950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8009c50 tx=0x7f8fb8004d10 comp rx=0 tx=0).stop 2024-09-12T01:55:23.182 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 -- 172.21.15.66:0/965704221 shutdown_connections 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 --2- 172.21.15.66:0/965704221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc8102f20 0x7f8fc80fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 --2- 172.21.15.66:0/965704221 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8102950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 -- 172.21.15.66:0/965704221 >> 172.21.15.66:0/965704221 conn(0x7f8fc80f81a0 msgr2=0x7f8fc80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 -- 172.21.15.66:0/965704221 shutdown_connections 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 -- 172.21.15.66:0/965704221 wait complete. 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 Processor -- start 2024-09-12T01:55:23.183 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 -- start start 2024-09-12T01:55:23.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8113230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.182+0000 7f8fd0144640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc8102f20 0x7f8fc8113770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fd0144640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc8113d70 con 0x7f8fc8102580 2024-09-12T01:55:23.185 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fd0144640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc810d1b0 con 0x7f8fc8102f20 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8113230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8113230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41492/0 (socket says 172.21.15.66:41492) 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 -- 172.21.15.66:0/1165220184 learned_addr learned my addr 172.21.15.66:0/1165220184 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcd6df640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc8102f20 0x7f8fc8113770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 -- 172.21.15.66:0/1165220184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc8102f20 msgr2=0x7f8fc8113770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc8102f20 0x7f8fc8113770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 -- 172.21.15.66:0/1165220184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80098b0 con 0x7f8fc8102580 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fcdee0640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8113230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8004750 tx=0x7f8fb8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb8009540 con 0x7f8fc8102580 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8fb80096a0 con 0x7f8fc8102580 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.183+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc810d430 con 0x7f8fc8102580 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.184+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fb803d960 con 0x7f8fc8102580 2024-09-12T01:55:23.186 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.184+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc810d9d0 con 0x7f8fc8102580 2024-09-12T01:55:23.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.185+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc80fdd00 con 0x7f8fc8102580 2024-09-12T01:55:23.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.185+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f8fb802f030 con 0x7f8fc8102580 2024-09-12T01:55:23.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.186+0000 7f8fc67fc640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8fb006e0b0 0x7f8fb0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:23.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.186+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f8fb80aec40 con 0x7f8fc8102580 2024-09-12T01:55:23.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.186+0000 7f8fcd6df640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8fb006e0b0 0x7f8fb0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:23.187 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.186+0000 7f8fcd6df640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8fb006e0b0 0x7f8fb0070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8fc810eaf0 tx=0x7f8fbc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:23.190 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.190+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8fb8077db0 con 0x7f8fc8102580 2024-09-12T01:55:23.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.401+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f8fc80fbda0 con 0x7f8fc8102580 2024-09-12T01:55:23.402 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.402+0000 7f8fc67fc640 1 -- 172.21.15.66:0/1165220184 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v36) v1 ==== 107+0+4256 (secure 0 0 0) 0x7f8fb807b470 con 0x7f8fc8102580 2024-09-12T01:55:23.403 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:23.403 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":26,"btime":"2024-09-12T01:52:37:738635+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:37.738621+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":0,"incarnation":26,"state":"up:replay","state_seq":2,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:23.403 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 26 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8fb006e0b0 msgr2=0x7f8fb0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8fb006e0b0 0x7f8fb0070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8fc810eaf0 tx=0x7f8fbc00b040 comp rx=0 tx=0).stop 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 msgr2=0x7f8fc8113230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8113230 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8004750 tx=0x7f8fb8004d10 comp rx=0 tx=0).stop 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 shutdown_connections 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f8fb006e0b0 0x7f8fb0070560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fc8102f20 0x7f8fc8113770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 --2- 172.21.15.66:0/1165220184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8fc8102580 0x7f8fc8113230 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 >> 172.21.15.66:0/1165220184 conn(0x7f8fc80f81a0 msgr2=0x7f8fc80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:23.405 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 shutdown_connections 2024-09-12T01:55:23.406 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:23.404+0000 7f8fd0144640 1 -- 172.21.15.66:0/1165220184 wait complete. 2024-09-12T01:55:23.979 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 27 2024-09-12T01:55:24.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:23 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1165220184' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-12T01:55:24.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:23 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1165220184' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-12T01:55:24.236 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:25.053 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:24 smithi066 ceph-mon[110996]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:25.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:24 smithi153 ceph-mon[80899]: pgmap v279: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 -- 172.21.15.66:0/2668942275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 msgr2=0x7f6924102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 --2- 172.21.15.66:0/2668942275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924102980 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f69200048d0 tx=0x7f6920009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 -- 172.21.15.66:0/2668942275 shutdown_connections 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 --2- 172.21.15.66:0/2668942275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 0x7f69240fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 --2- 172.21.15.66:0/2668942275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924102980 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 -- 172.21.15.66:0/2668942275 >> 172.21.15.66:0/2668942275 conn(0x7f6924070ce0 msgr2=0x7f69240710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 -- 172.21.15.66:0/2668942275 shutdown_connections 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 -- 172.21.15.66:0/2668942275 wait complete. 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 Processor -- start 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.844+0000 7f692b969640 1 -- start start 2024-09-12T01:55:25.858 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f692b969640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 0x7f6924113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f692b969640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f692b969640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924113d80 con 0x7f69241025b0 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f692b969640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692410d1c0 con 0x7f69240fac80 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41500/0 (socket says 172.21.15.66:41500) 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 -- 172.21.15.66:0/2908775218 learned_addr learned my addr 172.21.15.66:0/2908775218 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6929705640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 0x7f6924113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 -- 172.21.15.66:0/2908775218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 msgr2=0x7f6924113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 0x7f6924113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 -- 172.21.15.66:0/2908775218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920005040 con 0x7f69241025b0 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6929705640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 0x7f6924113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6928f04640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924113780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6914002a50 tx=0x7f6914004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6914007c30 con 0x7f69241025b0 2024-09-12T01:55:25.859 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f691400f040 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692410d4a0 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.845+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f691400da90 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.846+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692410d9c0 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.847+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69240657d0 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.847+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f691400dd00 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.847+0000 7f6919ffb640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f691006e0b0 0x7f6910070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.847+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f691408d650 con 0x7f69241025b0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.848+0000 7f6929705640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f691006e0b0 0x7f6910070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.848+0000 7f6929705640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f691006e0b0 0x7f6910070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6920007ac0 tx=0x7f6920035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:25.860 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:25.852+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f69140567c0 con 0x7f69241025b0 2024-09-12T01:55:26.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.066+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f6924074c00 con 0x7f69241025b0 2024-09-12T01:55:26.067 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.067+0000 7f6919ffb640 1 -- 172.21.15.66:0/2908775218 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v36) v1 ==== 107+0+4261 (secure 0 0 0) 0x7f6914059e80 con 0x7f69241025b0 2024-09-12T01:55:26.068 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:26.068 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":27,"btime":"2024-09-12T01:52:45:475735+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:44.889790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":179,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:26.068 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 27 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f691006e0b0 msgr2=0x7f6910070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f691006e0b0 0x7f6910070560 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6920007ac0 tx=0x7f6920035040 comp rx=0 tx=0).stop 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 msgr2=0x7f6924113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924113780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6914002a50 tx=0x7f6914004600 comp rx=0 tx=0).stop 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 shutdown_connections 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f691006e0b0 0x7f6910070560 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69241025b0 0x7f6924113780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 --2- 172.21.15.66:0/2908775218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f69240fac80 0x7f6924113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 >> 172.21.15.66:0/2908775218 conn(0x7f6924070ce0 msgr2=0x7f6924105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 shutdown_connections 2024-09-12T01:55:26.070 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:26.069+0000 7f692b969640 1 -- 172.21.15.66:0/2908775218 wait complete. 2024-09-12T01:55:26.726 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 28 2024-09-12T01:55:26.984 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:27.109 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:26 smithi066 ceph-mon[110996]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:27.109 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:26 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2908775218' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-12T01:55:27.109 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:26 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:55:27.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:26 smithi153 ceph-mon[80899]: pgmap v280: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:27.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:26 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2908775218' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-12T01:55:27.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:26 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:55:28.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 -- 172.21.15.66:0/2907194585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 msgr2=0x7f55b0106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 --2- 172.21.15.66:0/2907194585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b0106620 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5598004900 tx=0x7f5598009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.670 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 -- 172.21.15.66:0/2907194585 shutdown_connections 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 --2- 172.21.15.66:0/2907194585 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b0106620 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 --2- 172.21.15.66:0/2907194585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b00fd5b0 0x7f55b00fd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 -- 172.21.15.66:0/2907194585 >> 172.21.15.66:0/2907194585 conn(0x7f55b00f7090 msgr2=0x7f55b00f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 -- 172.21.15.66:0/2907194585 shutdown_connections 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.658+0000 7f55b6926640 1 -- 172.21.15.66:0/2907194585 wait complete. 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55b6926640 1 Processor -- start 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55b6926640 1 -- start start 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55b6926640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b00fd5b0 0x7f55b00fb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55b6926640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b00fb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55b6926640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00fbf40 con 0x7f55b00fdf50 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55b6926640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b00fc0b0 con 0x7f55b00fd5b0 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b00fb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.671 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b00fb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41518/0 (socket says 172.21.15.66:41518) 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 -- 172.21.15.66:0/2180376763 learned_addr learned my addr 172.21.15.66:0/2180376763 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55affff640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b00fd5b0 0x7f55b00fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 -- 172.21.15.66:0/2180376763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b00fd5b0 msgr2=0x7f55b00fb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b00fd5b0 0x7f55b00fb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 -- 172.21.15.66:0/2180376763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5598005040 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.659+0000 7f55a7fff640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b00fb9b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5598009ac0 tx=0x7f5598009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.660+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5598038070 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.660+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f559802ae80 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.660+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b01195c0 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.660+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5598009680 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.660+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b0119940 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.661+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b00662b0 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.661+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f5598030020 con 0x7f55b00fdf50 2024-09-12T01:55:28.672 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.662+0000 7f55ad7fa640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f559c06e0b0 0x7f559c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.662+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f55980ae300 con 0x7f55b00fdf50 2024-09-12T01:55:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.662+0000 7f55affff640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f559c06e0b0 0x7f559c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.662+0000 7f55affff640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f559c06e0b0 0x7f559c070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55a0004ce0 tx=0x7f55a000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:28.673 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.666+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5598077470 con 0x7f55b00fdf50 2024-09-12T01:55:28.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.879+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f55b004b720 con 0x7f55b00fdf50 2024-09-12T01:55:28.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.880+0000 7f55ad7fa640 1 -- 172.21.15.66:0/2180376763 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v36) v1 ==== 107+0+4258 (secure 0 0 0) 0x7f559807ab30 con 0x7f55b00fdf50 2024-09-12T01:55:28.881 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:28.881 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":28,"btime":"2024-09-12T01:52:46:481022+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:45.483387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":180,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:28.881 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 28 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.882+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f559c06e0b0 msgr2=0x7f559c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.882+0000 7f55b6926640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f559c06e0b0 0x7f559c070560 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55a0004ce0 tx=0x7f55a000b040 comp rx=0 tx=0).stop 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.882+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 msgr2=0x7f55b00fb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.882+0000 7f55b6926640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b00fb9b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5598009ac0 tx=0x7f5598009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 shutdown_connections 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f559c06e0b0 0x7f559c070560 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55b00fdf50 0x7f55b00fb9b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.883 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 --2- 172.21.15.66:0/2180376763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55b00fd5b0 0x7f55b00fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:28.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 >> 172.21.15.66:0/2180376763 conn(0x7f55b00f7090 msgr2=0x7f55b00f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:28.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 shutdown_connections 2024-09-12T01:55:28.884 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:28.883+0000 7f55b6926640 1 -- 172.21.15.66:0/2180376763 wait complete. 2024-09-12T01:55:29.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:28 smithi066 ceph-mon[110996]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:29.157 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:28 smithi153 ceph-mon[80899]: pgmap v281: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:29.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 29 2024-09-12T01:55:29.753 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:30.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:29 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2180376763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-12T01:55:30.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:29 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2180376763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-12T01:55:31.106 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:30 smithi066 ceph-mon[110996]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:31.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:30 smithi153 ceph-mon[80899]: pgmap v282: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:31.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 -- 172.21.15.66:0/1573350043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102eb0 msgr2=0x7f81a80fac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.292 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/1573350043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102eb0 0x7f81a80fac00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81900048d0 tx=0x7f8190009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 -- 172.21.15.66:0/1573350043 shutdown_connections 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/1573350043 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102eb0 0x7f81a80fac00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/1573350043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8102510 0x7f81a81028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 -- 172.21.15.66:0/1573350043 >> 172.21.15.66:0/1573350043 conn(0x7f81a8070ba0 msgr2=0x7f81a8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 -- 172.21.15.66:0/1573350043 shutdown_connections 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.288+0000 7f81ad6b5640 1 -- 172.21.15.66:0/1573350043 wait complete. 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81ad6b5640 1 Processor -- start 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81ad6b5640 1 -- start start 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81ad6b5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 0x7f81a8113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81ad6b5640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8102eb0 0x7f81a81136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81ad6b5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8113cd0 con 0x7f81a8102510 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81ad6b5640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a810d110 con 0x7f81a8102eb0 2024-09-12T01:55:31.293 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 0x7f81a8113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 0x7f81a8113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:41526/0 (socket says 172.21.15.66:41526) 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 -- 172.21.15.66:0/3030054469 learned_addr learned my addr 172.21.15.66:0/3030054469 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a67fc640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8102eb0 0x7f81a81136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 -- 172.21.15.66:0/3030054469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8102eb0 msgr2=0x7f81a81136d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8102eb0 0x7f81a81136d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 -- 172.21.15.66:0/3030054469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190005040 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.289+0000 7f81a6ffd640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 0x7f81a8113190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f819800eb70 tx=0x7f819800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.290+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8198007c30 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.290+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f819800f040 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.290+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a810d390 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.290+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819800ca60 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.290+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a810d900 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.291+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a8065680 con 0x7f81a8102510 2024-09-12T01:55:31.294 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.291+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f819800cbc0 con 0x7f81a8102510 2024-09-12T01:55:31.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.292+0000 7f819f7fe640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f819406e0c0 0x7f8194070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:31.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.292+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f819808d8d0 con 0x7f81a8102510 2024-09-12T01:55:31.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.292+0000 7f81a67fc640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f819406e0c0 0x7f8194070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:31.295 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.292+0000 7f81a67fc640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f819406e0c0 0x7f8194070570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8190000c00 tx=0x7f8190035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:31.296 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.296+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8198056b70 con 0x7f81a8102510 2024-09-12T01:55:31.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.509+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f81a804b720 con 0x7f81a8102510 2024-09-12T01:55:31.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.510+0000 7f819f7fe640 1 -- 172.21.15.66:0/3030054469 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v36) v1 ==== 107+0+4267 (secure 0 0 0) 0x7f819805a230 con 0x7f81a8102510 2024-09-12T01:55:31.510 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:31.511 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":29,"btime":"2024-09-12T01:52:47:492280+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:47.492277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":0,"incarnation":26,"state":"up:active","state_seq":181,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-09-12T01:55:31.511 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 29 2024-09-12T01:55:31.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f819406e0c0 msgr2=0x7f8194070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f819406e0c0 0x7f8194070570 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8190000c00 tx=0x7f8190035040 comp rx=0 tx=0).stop 2024-09-12T01:55:31.512 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 msgr2=0x7f81a8113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 0x7f81a8113190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f819800eb70 tx=0x7f819800b040 comp rx=0 tx=0).stop 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 shutdown_connections 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f819406e0c0 0x7f8194070570 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f81a8102eb0 0x7f81a81136d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 --2- 172.21.15.66:0/3030054469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81a8102510 0x7f81a8113190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 >> 172.21.15.66:0/3030054469 conn(0x7f81a8070ba0 msgr2=0x7f81a80f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 shutdown_connections 2024-09-12T01:55:31.513 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:31.512+0000 7f81ad6b5640 1 -- 172.21.15.66:0/3030054469 wait complete. 2024-09-12T01:55:32.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:31 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3030054469' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-12T01:55:32.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:31 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3030054469' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-12T01:55:32.208 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 30 2024-09-12T01:55:32.466 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:33.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:32 smithi066 ceph-mon[110996]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:33.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:32 smithi153 ceph-mon[80899]: pgmap v283: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 -- 172.21.15.66:0/4236837334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 msgr2=0x7f63341018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 --2- 172.21.15.66:0/4236837334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341018e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f63240048d0 tx=0x7f6324009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 -- 172.21.15.66:0/4236837334 shutdown_connections 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 --2- 172.21.15.66:0/4236837334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 0x7f63340fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 --2- 172.21.15.66:0/4236837334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341018e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 -- 172.21.15.66:0/4236837334 >> 172.21.15.66:0/4236837334 conn(0x7f63340f7090 msgr2=0x7f63340f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 -- 172.21.15.66:0/4236837334 shutdown_connections 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 -- 172.21.15.66:0/4236837334 wait complete. 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 Processor -- start 2024-09-12T01:55:34.116 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.037+0000 7f633aeb2640 1 -- start start 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f633aeb2640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 0x7f6334113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f633aeb2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341136a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f633aeb2640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6334113ca0 con 0x7f6334101510 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f633aeb2640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6334113e10 con 0x7f63340fb4d0 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f6333fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f6333fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341136a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48508/0 (socket says 172.21.15.66:48508) 2024-09-12T01:55:34.117 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f6338c4e640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 0x7f6334113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.038+0000 7f6333fff640 1 -- 172.21.15.66:0/1193524923 learned_addr learned my addr 172.21.15.66:0/1193524923 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f6333fff640 1 -- 172.21.15.66:0/1193524923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 msgr2=0x7f6334113160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f6333fff640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 0x7f6334113160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f6333fff640 1 -- 172.21.15.66:0/1193524923 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6324005040 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f6338c4e640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 0x7f6334113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f6333fff640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341136a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6328002a50 tx=0x7f6328004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6328007c30 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f632800f040 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633410d290 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f632800dad0 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.039+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633410d830 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.040+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63340fcc10 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.041+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f632800dc30 con 0x7f6334101510 2024-09-12T01:55:34.118 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.041+0000 7f63317fa640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f631c06e0b0 0x7f631c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:34.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.041+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f632808db10 con 0x7f6334101510 2024-09-12T01:55:34.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.041+0000 7f6338c4e640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f631c06e0b0 0x7f631c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:34.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.042+0000 7f6338c4e640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f631c06e0b0 0x7f631c070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ac0 tx=0x7f6324035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:34.119 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.045+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6328056d00 con 0x7f6334101510 2024-09-12T01:55:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.258+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f6334108490 con 0x7f6334101510 2024-09-12T01:55:34.262 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.258+0000 7f63317fa640 1 -- 172.21.15.66:0/1193524923 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v36) v1 ==== 107+0+5117 (secure 0 0 0) 0x7f632805a3c0 con 0x7f6334101510 2024-09-12T01:55:34.262 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:34.262 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":30,"btime":"2024-09-12T01:52:50:500205+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:47.492277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24285":{"gid":24285,"name":"cephfs.smithi153.aiydtj","rank":0,"incarnation":26,"state":"up:active","state_seq":181,"addr":"172.21.15.153:6827/3033263442","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":3033263442},{"type":"v1","addr":"172.21.15.153:6827","nonce":3033263442}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24285,"qdb_cluster":[24285]},"id":1}]} 2024-09-12T01:55:34.263 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 30 2024-09-12T01:55:34.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f631c06e0b0 msgr2=0x7f631c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f631c06e0b0 0x7f631c070560 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ac0 tx=0x7f6324035040 comp rx=0 tx=0).stop 2024-09-12T01:55:34.263 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 msgr2=0x7f63341136a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341136a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6328002a50 tx=0x7f6328004600 comp rx=0 tx=0).stop 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 shutdown_connections 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f631c06e0b0 0x7f631c070560 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6334101510 0x7f63341136a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 --2- 172.21.15.66:0/1193524923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f63340fb4d0 0x7f6334113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 >> 172.21.15.66:0/1193524923 conn(0x7f63340f7090 msgr2=0x7f63340659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 shutdown_connections 2024-09-12T01:55:34.264 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:34.261+0000 7f633aeb2640 1 -- 172.21.15.66:0/1193524923 wait complete. 2024-09-12T01:55:34.922 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 31 2024-09-12T01:55:35.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:34 smithi066 ceph-mon[110996]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:35.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:34 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1193524923' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-12T01:55:35.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:34 smithi153 ceph-mon[80899]: pgmap v284: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:35.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:34 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1193524923' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-12T01:55:35.182 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 -- 172.21.15.66:0/2548006872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fcf80 msgr2=0x7f0d000fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2548006872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fcf80 0x7f0d000fd3d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009c50 tx=0x7f0cf4004d10 comp rx=0 tx=0).stop 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 -- 172.21.15.66:0/2548006872 shutdown_connections 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2548006872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fcf80 0x7f0d000fd3d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2548006872 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000fb810 0x7f0d000fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 -- 172.21.15.66:0/2548006872 >> 172.21.15.66:0/2548006872 conn(0x7f0d000723b0 msgr2=0x7f0d000727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 -- 172.21.15.66:0/2548006872 shutdown_connections 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 -- 172.21.15.66:0/2548006872 wait complete. 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.702+0000 7f0d04c81640 1 Processor -- start 2024-09-12T01:55:36.703 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0d04c81640 1 -- start start 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0d04c81640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 0x7f0d00112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0d04c81640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000fcf80 0x7f0d00112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0d04c81640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00112d10 con 0x7f0d000fb810 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0d04c81640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0010c100 con 0x7f0d000fcf80 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 0x7f0d00112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfe59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 0x7f0d00112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48526/0 (socket says 172.21.15.66:48526) 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfe59c640 1 -- 172.21.15.66:0/2667653716 learned_addr learned my addr 172.21.15.66:0/2667653716 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfdd9b640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000fcf80 0x7f0d00112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.710 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfe59c640 1 -- 172.21.15.66:0/2667653716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000fcf80 msgr2=0x7f0d00112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfe59c640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000fcf80 0x7f0d00112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.703+0000 7f0cfe59c640 1 -- 172.21.15.66:0/2667653716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40098b0 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.704+0000 7f0cfe59c640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 0x7f0d00112140 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000daf0 tx=0x7f0cf000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.704+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf000edb0 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.704+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0cf0017910 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.704+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0010c380 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.704+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0cf00169f0 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.704+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0010c8a0 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.705+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d000fcbc0 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.706+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f0cf0014070 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.706+0000 7f0ceeffd640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0ce806e0b0 0x7f0ce8070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.706+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f0cf008ffa0 con 0x7f0d000fb810 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.706+0000 7f0cfdd9b640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0ce806e0b0 0x7f0ce8070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:36.711 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.707+0000 7f0cfdd9b640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0ce806e0b0 0x7f0ce8070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d0010da40 tx=0x7f0cf4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:36.712 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.710+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0cf00592e0 con 0x7f0d000fb810 2024-09-12T01:55:36.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.926+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f0d0010d7f0 con 0x7f0d000fb810 2024-09-12T01:55:36.928 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.927+0000 7f0ceeffd640 1 -- 172.21.15.66:0/2667653716 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v36) v1 ==== 107+0+4313 (secure 0 0 0) 0x7f0cf005c9a0 con 0x7f0d000fb810 2024-09-12T01:55:36.928 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:36.928 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":31,"btime":"2024-09-12T01:52:59:964998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:59.964995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:36.929 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 31 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0ce806e0b0 msgr2=0x7f0ce8070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0ce806e0b0 0x7f0ce8070560 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0d0010da40 tx=0x7f0cf4004d10 comp rx=0 tx=0).stop 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 msgr2=0x7f0d00112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 0x7f0d00112140 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000daf0 tx=0x7f0cf000b460 comp rx=0 tx=0).stop 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 shutdown_connections 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f0ce806e0b0 0x7f0ce8070560 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000fcf80 0x7f0d00112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 --2- 172.21.15.66:0/2667653716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d000fb810 0x7f0d00112140 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.929+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 >> 172.21.15.66:0/2667653716 conn(0x7f0d000723b0 msgr2=0x7f0d000fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.930+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 shutdown_connections 2024-09-12T01:55:36.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:36.930+0000 7f0d04c81640 1 -- 172.21.15.66:0/2667653716 wait complete. 2024-09-12T01:55:37.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:36 smithi066 ceph-mon[110996]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:37.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:36 smithi153 ceph-mon[80899]: pgmap v285: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:37.602 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 32 2024-09-12T01:55:37.861 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:38.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:37 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2667653716' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-12T01:55:38.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:37 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2667653716' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-12T01:55:39.108 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:38 smithi066 ceph-mon[110996]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:39.158 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:38 smithi153 ceph-mon[80899]: pgmap v286: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 -- 172.21.15.66:0/3986044238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32801025f0 msgr2=0x7f32801029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 --2- 172.21.15.66:0/3986044238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32801025f0 0x7f32801029c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f327c0048d0 tx=0x7f327c009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 -- 172.21.15.66:0/3986044238 shutdown_connections 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 --2- 172.21.15.66:0/3986044238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32800fac60 0x7f32800fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 --2- 172.21.15.66:0/3986044238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32801025f0 0x7f32801029c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 -- 172.21.15.66:0/3986044238 >> 172.21.15.66:0/3986044238 conn(0x7f3280070c80 msgr2=0x7f3280071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:39.554 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 -- 172.21.15.66:0/3986044238 shutdown_connections 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.534+0000 7f32881af640 1 -- 172.21.15.66:0/3986044238 wait complete. 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f32881af640 1 Processor -- start 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f32881af640 1 -- start start 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f32881af640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 0x7f32801131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f32881af640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32801025f0 0x7f3280113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f32881af640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3280113d10 con 0x7f32800fac60 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f32881af640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328010d150 con 0x7f32801025f0 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f3285f4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 0x7f32801131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f3285f4b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 0x7f32801131d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48536/0 (socket says 172.21.15.66:48536) 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f3285f4b640 1 -- 172.21.15.66:0/3683416405 learned_addr learned my addr 172.21.15.66:0/3683416405 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f328574a640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32801025f0 0x7f3280113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f3285f4b640 1 -- 172.21.15.66:0/3683416405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32801025f0 msgr2=0x7f3280113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:39.555 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f3285f4b640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32801025f0 0x7f3280113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.535+0000 7f3285f4b640 1 -- 172.21.15.66:0/3683416405 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c005040 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.536+0000 7f3285f4b640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 0x7f32801131d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f327c003080 tx=0x7f327c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.536+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c038070 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.536+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f327c0097e0 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.536+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328010d3d0 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.536+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328010d910 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.536+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c03d420 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.537+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3280065810 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.538+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f327c030020 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.538+0000 7f32767fc640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f326c06e0b0 0x7f326c070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.538+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f327c0ae4e0 con 0x7f32800fac60 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.538+0000 7f328574a640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f326c06e0b0 0x7f326c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.539+0000 7f328574a640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f326c06e0b0 0x7f326c070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f328010ea90 tx=0x7f3270009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:39.556 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.542+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f327c0776d0 con 0x7f32800fac60 2024-09-12T01:55:39.756 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.754+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f328004b720 con 0x7f32800fac60 2024-09-12T01:55:39.757 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.755+0000 7f32767fc640 1 -- 172.21.15.66:0/3683416405 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v36) v1 ==== 107+0+4392 (secure 0 0 0) 0x7f327c07ad90 con 0x7f32800fac60 2024-09-12T01:55:39.757 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:39.757 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":32,"btime":"2024-09-12T01:52:59:970534+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:52:59.970519+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34376":{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:39.757 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 32 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f326c06e0b0 msgr2=0x7f326c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f326c06e0b0 0x7f326c070560 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f328010ea90 tx=0x7f3270009040 comp rx=0 tx=0).stop 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 msgr2=0x7f32801131d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 0x7f32801131d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f327c003080 tx=0x7f327c009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 shutdown_connections 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f326c06e0b0 0x7f326c070560 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32801025f0 0x7f3280113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 --2- 172.21.15.66:0/3683416405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32800fac60 0x7f32801131d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 >> 172.21.15.66:0/3683416405 conn(0x7f3280070c80 msgr2=0x7f32800f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:39.759 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 shutdown_connections 2024-09-12T01:55:39.760 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:39.757+0000 7f32881af640 1 -- 172.21.15.66:0/3683416405 wait complete. 2024-09-12T01:55:40.069 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:39 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/3683416405' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-12T01:55:40.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:39 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/3683416405' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-12T01:55:40.359 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 33 2024-09-12T01:55:40.620 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:41.003 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:40 smithi066 ceph-mon[110996]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:41.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:40 smithi153 ceph-mon[80899]: pgmap v287: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 -- 172.21.15.66:0/2660155545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 msgr2=0x7fef001018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 --2- 172.21.15.66:0/2660155545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef001018e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feefc0048d0 tx=0x7feefc009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 -- 172.21.15.66:0/2660155545 shutdown_connections 2024-09-12T01:55:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 --2- 172.21.15.66:0/2660155545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000fb4d0 0x7fef000fb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.107 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 --2- 172.21.15.66:0/2660155545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef001018e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 -- 172.21.15.66:0/2660155545 >> 172.21.15.66:0/2660155545 conn(0x7fef000f7090 msgr2=0x7fef000f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 -- 172.21.15.66:0/2660155545 shutdown_connections 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 -- 172.21.15.66:0/2660155545 wait complete. 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 Processor -- start 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 -- start start 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.106+0000 7fef0853b640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000fb4d0 0x7fef000f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef0853b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef000f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef0853b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000f8000 con 0x7fef00101510 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef0853b640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef000f8170 con 0x7fef000fb4d0 2024-09-12T01:55:42.108 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef000f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef062d7640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000fb4d0 0x7fef000f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef000f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48564/0 (socket says 172.21.15.66:48564) 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 -- 172.21.15.66:0/241755101 learned_addr learned my addr 172.21.15.66:0/241755101 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 -- 172.21.15.66:0/241755101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000fb4d0 msgr2=0x7fef000f7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000fb4d0 0x7fef000f7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 -- 172.21.15.66:0/241755101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feefc005040 con 0x7fef00101510 2024-09-12T01:55:42.109 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef05ad6640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef000f7a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feef0002a50 tx=0x7feef0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef0007c30 con 0x7fef00101510 2024-09-12T01:55:42.110 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feef000f040 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.107+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef001194e0 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.108+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef000da10 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.108+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef00119920 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.109+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef000fcc10 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.109+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7feef000dca0 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.110+0000 7feef6ffd640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feeec06e0b0 0x7feeec070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.110+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7feef008d550 con 0x7fef00101510 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.110+0000 7fef062d7640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feeec06e0b0 0x7feeec070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:42.111 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.110+0000 7fef062d7640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feeec06e0b0 0x7feeec070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feefc009ac0 tx=0x7feefc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:42.114 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.114+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feef0056770 con 0x7fef00101510 2024-09-12T01:55:42.314 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:41 smithi066 ceph-mon[110996]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:55:42.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.331+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7fef0004b720 con 0x7fef00101510 2024-09-12T01:55:42.332 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.331+0000 7feef6ffd640 1 -- 172.21.15.66:0/241755101 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v36) v1 ==== 107+0+4396 (secure 0 0 0) 0x7feef0059e30 con 0x7fef00101510 2024-09-12T01:55:42.333 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:42.333 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":33,"btime":"2024-09-12T01:53:07:992771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:53:07.232682+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34376":{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:42.333 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 33 2024-09-12T01:55:42.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feeec06e0b0 msgr2=0x7feeec070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feeec06e0b0 0x7feeec070560 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feefc009ac0 tx=0x7feefc035040 comp rx=0 tx=0).stop 2024-09-12T01:55:42.335 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 msgr2=0x7fef000f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:42.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef000f7a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feef0002a50 tx=0x7feef0004600 comp rx=0 tx=0).stop 2024-09-12T01:55:42.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 shutdown_connections 2024-09-12T01:55:42.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7feeec06e0b0 0x7feeec070560 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef00101510 0x7fef000f7a70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.336 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 --2- 172.21.15.66:0/241755101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000fb4d0 0x7fef000f7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:42.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 >> 172.21.15.66:0/241755101 conn(0x7fef000f7090 msgr2=0x7fef000659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:42.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 shutdown_connections 2024-09-12T01:55:42.337 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:42.334+0000 7fef0853b640 1 -- 172.21.15.66:0/241755101 wait complete. 2024-09-12T01:55:42.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:41 smithi153 ceph-mon[80899]: from='mgr.34104 172.21.15.66:0/414769099' entity='mgr.smithi066.qdwcrh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-12T01:55:42.947 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 34 2024-09-12T01:55:43.222 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:43.344 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:42 smithi066 ceph-mon[110996]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:43.344 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:42 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/241755101' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-12T01:55:43.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:42 smithi153 ceph-mon[80899]: pgmap v288: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:43.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:42 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/241755101' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.946+0000 7f3c44b0f640 1 -- 172.21.15.66:0/1614887968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c401025b0 msgr2=0x7f3c40102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.946+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/1614887968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c401025b0 0x7f3c40102980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3c300048d0 tx=0x7f3c30009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- 172.21.15.66:0/1614887968 shutdown_connections 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/1614887968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c400fac80 0x7f3c400fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/1614887968 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c401025b0 0x7f3c40102980 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- 172.21.15.66:0/1614887968 >> 172.21.15.66:0/1614887968 conn(0x7f3c40070ce0 msgr2=0x7f3c400710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:44.949 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- 172.21.15.66:0/1614887968 shutdown_connections 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- 172.21.15.66:0/1614887968 wait complete. 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 Processor -- start 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- start start 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 0x7f3c40113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c401025b0 0x7f3c40113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40113d80 con 0x7f3c400fac80 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.947+0000 7f3c44b0f640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4010d1c0 con 0x7f3c401025b0 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 0x7f3c40113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 0x7f3c40113240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40624/0 (socket says 172.21.15.66:40624) 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 -- 172.21.15.66:0/76112567 learned_addr learned my addr 172.21.15.66:0/76112567 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3dd9b640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c401025b0 0x7f3c40113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 -- 172.21.15.66:0/76112567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c401025b0 msgr2=0x7f3c40113780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c401025b0 0x7f3c40113780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:44.950 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 -- 172.21.15.66:0/76112567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30005040 con 0x7f3c400fac80 2024-09-12T01:55:44.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c3e59c640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 0x7f3c40113240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c30000c00 tx=0x7f3c30009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:44.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c30038070 con 0x7f3c400fac80 2024-09-12T01:55:44.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3c3002ade0 con 0x7f3c400fac80 2024-09-12T01:55:44.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4010d440 con 0x7f3c400fac80 2024-09-12T01:55:44.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c3002c7e0 con 0x7f3c400fac80 2024-09-12T01:55:44.951 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.948+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4010d8b0 con 0x7f3c400fac80 2024-09-12T01:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.950+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c400657d0 con 0x7f3c400fac80 2024-09-12T01:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.950+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f3c30030020 con 0x7f3c400fac80 2024-09-12T01:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.951+0000 7f3c2effd640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3c2806e0b0 0x7f3c28070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.951+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f3c300ad9d0 con 0x7f3c400fac80 2024-09-12T01:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.951+0000 7f3c3dd9b640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3c2806e0b0 0x7f3c28070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:44.952 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.952+0000 7f3c3dd9b640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3c2806e0b0 0x7f3c28070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c34007fd0 tx=0x7f3c34009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:44.955 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:44.955+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3c30076bf0 con 0x7f3c400fac80 2024-09-12T01:55:45.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:44 smithi066 ceph-mon[110996]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:45.171 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.171+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f3c4004b7b0 con 0x7f3c400fac80 2024-09-12T01:55:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.172+0000 7f3c2effd640 1 -- 172.21.15.66:0/76112567 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v36) v1 ==== 107+0+4393 (secure 0 0 0) 0x7f3c3007a2b0 con 0x7f3c400fac80 2024-09-12T01:55:45.172 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:45.172 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":34,"btime":"2024-09-12T01:53:08:998962+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:53:08.003841+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34376":{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-12T01:55:45.172 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 34 2024-09-12T01:55:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3c2806e0b0 msgr2=0x7f3c28070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3c2806e0b0 0x7f3c28070560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c34007fd0 tx=0x7f3c34009e90 comp rx=0 tx=0).stop 2024-09-12T01:55:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 msgr2=0x7f3c40113240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:45.174 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 0x7f3c40113240 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3c30000c00 tx=0x7f3c30009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 shutdown_connections 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f3c2806e0b0 0x7f3c28070560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c401025b0 0x7f3c40113780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 --2- 172.21.15.66:0/76112567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c400fac80 0x7f3c40113240 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 >> 172.21.15.66:0/76112567 conn(0x7f3c40070ce0 msgr2=0x7f3c40105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 shutdown_connections 2024-09-12T01:55:45.175 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:45.174+0000 7f3c44b0f640 1 -- 172.21.15.66:0/76112567 wait complete. 2024-09-12T01:55:45.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:44 smithi153 ceph-mon[80899]: pgmap v289: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:45.821 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 35 2024-09-12T01:55:46.084 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:46.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:45 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/76112567' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-12T01:55:46.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:45 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/76112567' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-12T01:55:47.202 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:46 smithi066 ceph-mon[110996]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:47.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:46 smithi153 ceph-mon[80899]: pgmap v290: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:47.713 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 -- 172.21.15.66:0/191715754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab80716e0 msgr2=0x7faab806fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 --2- 172.21.15.66:0/191715754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab80716e0 0x7faab806fab0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faab40048d0 tx=0x7faab4009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 -- 172.21.15.66:0/191715754 shutdown_connections 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 --2- 172.21.15.66:0/191715754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab806fff0 0x7faab8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 --2- 172.21.15.66:0/191715754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab80716e0 0x7faab806fab0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 -- 172.21.15.66:0/191715754 >> 172.21.15.66:0/191715754 conn(0x7faab80f81a0 msgr2=0x7faab80fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 -- 172.21.15.66:0/191715754 shutdown_connections 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.702+0000 7faabfe08640 1 -- 172.21.15.66:0/191715754 wait complete. 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabfe08640 1 Processor -- start 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabfe08640 1 -- start start 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabfe08640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 0x7faab81198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabfe08640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab80716e0 0x7faab8119e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.714 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabfe08640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab811a450 con 0x7faab806fff0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabfe08640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab8113860 con 0x7faab80716e0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabdba4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 0x7faab81198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabdba4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 0x7faab81198c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40648/0 (socket says 172.21.15.66:40648) 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabdba4640 1 -- 172.21.15.66:0/2776711651 learned_addr learned my addr 172.21.15.66:0/2776711651 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.703+0000 7faabd3a3640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab80716e0 0x7faab8119e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabdba4640 1 -- 172.21.15.66:0/2776711651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab80716e0 msgr2=0x7faab8119e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabdba4640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab80716e0 0x7faab8119e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabdba4640 1 -- 172.21.15.66:0/2776711651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab4005040 con 0x7faab806fff0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabd3a3640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab80716e0 0x7faab8119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabdba4640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 0x7faab81198c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faab40043d0 tx=0x7faab4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab4038070 con 0x7faab806fff0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab8113ae0 con 0x7faab806fff0 2024-09-12T01:55:47.715 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faab4032b20 con 0x7faab806fff0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faab403d890 con 0x7faab806fff0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.704+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab8113fa0 con 0x7faab806fff0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.705+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab80711f0 con 0x7faab806fff0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.706+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7faab4030020 con 0x7faab806fff0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.706+0000 7faaae7fc640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7faaa406e0b0 0x7faaa4070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.706+0000 7faabd3a3640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7faaa406e0b0 0x7faaa4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.706+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7faab40ae730 con 0x7faab806fff0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.707+0000 7faabd3a3640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7faaa406e0b0 0x7faaa4070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faaa8007fd0 tx=0x7faaa8009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:47.716 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.711+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faab40778a0 con 0x7faab806fff0 2024-09-12T01:55:47.926 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.926+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7faab810fb70 con 0x7faab806fff0 2024-09-12T01:55:47.927 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.926+0000 7faaae7fc640 1 -- 172.21.15.66:0/2776711651 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v36) v1 ==== 107+0+5252 (secure 0 0 0) 0x7faab4077020 con 0x7faab806fff0 2024-09-12T01:55:47.927 INFO:teuthology.orchestra.run.smithi066.stdout: 2024-09-12T01:55:47.927 INFO:teuthology.orchestra.run.smithi066.stdout:{"epoch":35,"btime":"2024-09-12T01:53:10:005178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34408,"name":"cephfs.smithi066.jacfsu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6829/1762724759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":1762724759},{"type":"v1","addr":"172.21.15.66:6829","nonce":1762724759}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":44337,"name":"cephfs.smithi153.cbdplo","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6825/3647246533","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":3647246533},{"type":"v1","addr":"172.21.15.153:6825","nonce":3647246533}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44367,"name":"cephfs.smithi153.aiydtj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6827/1172093134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":1172093134},{"type":"v1","addr":"172.21.15.153:6827","nonce":1172093134}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:40:40.932485+0000","modified":"2024-09-12T01:53:10.005176+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34376":{"gid":34376,"name":"cephfs.smithi066.ipygev","rank":0,"incarnation":32,"state":"up:active","state_seq":20,"addr":"172.21.15.66:6827/274923982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":274923982},{"type":"v1","addr":"172.21.15.66:6827","nonce":274923982}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34376,"qdb_cluster":[34376]},"id":1}]} 2024-09-12T01:55:47.927 INFO:teuthology.orchestra.run.smithi066.stderr:dumped fsmap epoch 35 2024-09-12T01:55:47.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7faaa406e0b0 msgr2=0x7faaa4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7faaa406e0b0 0x7faaa4070560 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faaa8007fd0 tx=0x7faaa8009e90 comp rx=0 tx=0).stop 2024-09-12T01:55:47.929 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 msgr2=0x7faab81198c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 0x7faab81198c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faab40043d0 tx=0x7faab4009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 shutdown_connections 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7faaa406e0b0 0x7faaa4070560 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faab80716e0 0x7faab8119e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 --2- 172.21.15.66:0/2776711651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faab806fff0 0x7faab81198c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 >> 172.21.15.66:0/2776711651 conn(0x7faab80f81a0 msgr2=0x7faab80f93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 shutdown_connections 2024-09-12T01:55:47.930 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:47.929+0000 7faabfe08640 1 -- 172.21.15.66:0/2776711651 wait complete. 2024-09-12T01:55:48.593 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T01:55:48.604 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T01:55:48.605 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:55:48.605 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:55:48.624 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2024-09-12T01:55:48.624 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:55:48.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:55:48.982 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:49.104 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:48 smithi066 ceph-mon[110996]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:49.104 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:48 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2776711651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-12T01:55:49.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:48 smithi153 ceph-mon[80899]: pgmap v291: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:49.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:48 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2776711651' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 -- 172.21.15.66:0/2007110160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fcf80 msgr2=0x7f78f40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/2007110160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fcf80 0x7f78f40fd3d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78f00048d0 tx=0x7f78f0009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 -- 172.21.15.66:0/2007110160 shutdown_connections 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/2007110160 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fcf80 0x7f78f40fd3d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/2007110160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fb810 0x7f78f40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 -- 172.21.15.66:0/2007110160 >> 172.21.15.66:0/2007110160 conn(0x7f78f40723b0 msgr2=0x7f78f40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 -- 172.21.15.66:0/2007110160 shutdown_connections 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.677+0000 7f78fc0bc640 1 -- 172.21.15.66:0/2007110160 wait complete. 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78fc0bc640 1 Processor -- start 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78fc0bc640 1 -- start start 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78fc0bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 0x7f78f40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.687 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78fc0bc640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fcf80 0x7f78f40f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78fc0bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40f8fc0 con 0x7f78f40fb810 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78fc0bc640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f40f9130 con 0x7f78f40fcf80 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 0x7f78f40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 0x7f78f40f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:40676/0 (socket says 172.21.15.66:40676) 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 -- 172.21.15.66:0/1275804493 learned_addr learned my addr 172.21.15.66:0/1275804493 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9657640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fcf80 0x7f78f40f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 -- 172.21.15.66:0/1275804493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fcf80 msgr2=0x7f78f40f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fcf80 0x7f78f40f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 -- 172.21.15.66:0/1275804493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0005040 con 0x7f78f40fb810 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9657640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fcf80 0x7f78f40f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.678+0000 7f78f9e58640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 0x7f78f40f8540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78e400eb70 tx=0x7f78e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.679+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e4007c30 con 0x7f78f40fb810 2024-09-12T01:55:50.688 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.679+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78e400f040 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.679+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f40f9360 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.679+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e40094e0 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.679+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f4119880 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.680+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f40fcbc0 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.680+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f78e4009640 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.681+0000 7f78ea7fc640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f78e006e0b0 0x7f78e0070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.681+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f78e408d9f0 con 0x7f78f40fb810 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.681+0000 7f78f9657640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f78e006e0b0 0x7f78e0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.682+0000 7f78f9657640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f78e006e0b0 0x7f78e0070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78f40f9e80 tx=0x7f78f0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:50.689 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.685+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f78e408fe60 con 0x7f78f40fb810 2024-09-12T01:55:50.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.873+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f78f4072ec0 con 0x7f78f40fb810 2024-09-12T01:55:50.874 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.874+0000 7f78ea7fc640 1 -- 172.21.15.66:0/1275804493 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v92) v1 ==== 81+0+2550 (secure 0 0 0) 0x7f78e408be60 con 0x7f78f40fb810 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6825/27089229 2024-09-13T01:52:37.733397+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/4286226115 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6829/299983733 2024-09-13T01:52:14.904921+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1316790720 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/2996582467 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/2996582467 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/2826711014 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/2001799335 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/151382692 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/3928441794 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:50.875 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1128626831 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/151382692 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6829/1307305426 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/2715666080 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/1778679519 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6827/3743386224 2024-09-13T01:40:56.039712+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6827/3033263442 2024-09-13T01:52:59.964692+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2126394205 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6826/3033263442 2024-09-13T01:52:59.964692+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/1369475095 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/2001799335 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/201526823 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/532912125 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:50.876 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2691404876 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/526626206 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6826/3743386224 2024-09-13T01:40:56.039712+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/109517485 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3969880503 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1372328480 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/666035643 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/3928441794 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6828/299983733 2024-09-13T01:52:14.904921+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2113754837 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/1778679519 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1197929559 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:50.877 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2635713227 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/77725105 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/3847767757 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6828/1307305426 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/671152596 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6824/27089229 2024-09-13T01:52:37.733397+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3667221974 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:50.878 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/3411911395 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:listed 43 entries 2024-09-12T01:55:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f78e006e0b0 msgr2=0x7f78e0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f78e006e0b0 0x7f78e0070560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f78f40f9e80 tx=0x7f78f0035040 comp rx=0 tx=0).stop 2024-09-12T01:55:50.879 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 msgr2=0x7f78f40f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 0x7f78f40f8540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78e400eb70 tx=0x7f78e400b040 comp rx=0 tx=0).stop 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 shutdown_connections 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f78e006e0b0 0x7f78e0070560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78f40fcf80 0x7f78f40f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 --2- 172.21.15.66:0/1275804493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78f40fb810 0x7f78f40f8540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 >> 172.21.15.66:0/1275804493 conn(0x7f78f40723b0 msgr2=0x7f78f40fa680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 shutdown_connections 2024-09-12T01:55:50.880 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:50.877+0000 7f78fc0bc640 1 -- 172.21.15.66:0/1275804493 wait complete. 2024-09-12T01:55:51.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:50 smithi066 ceph-mon[110996]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:51.139 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:50 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/1275804493' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:51.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:50 smithi153 ceph-mon[80899]: pgmap v292: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:51.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:50 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/1275804493' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:51.466 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:55:51.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:51.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:55:51.495 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:55:51.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:51.495 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:55:51.564 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:55:51.564 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:55:51.584 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-12T01:55:51.585 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:55:51.643 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid f9344df4-70a6-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-12T01:55:51.901 INFO:teuthology.orchestra.run.smithi066.stderr:Inferring config /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/mon.smithi066/config 2024-09-12T01:55:53.120 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:52 smithi066 ceph-mon[110996]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:53.307 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 -- 172.21.15.66:0/3548687713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f500fb480 msgr2=0x7f1f500fb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 --2- 172.21.15.66:0/3548687713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f500fb480 0x7f1f500fb8f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0048d0 tx=0x7f1f3c009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 -- 172.21.15.66:0/3548687713 shutdown_connections 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 --2- 172.21.15.66:0/3548687713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f500fb480 0x7f1f500fb8f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 --2- 172.21.15.66:0/3548687713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f501014c0 0x7f1f50101890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 -- 172.21.15.66:0/3548687713 >> 172.21.15.66:0/3548687713 conn(0x7f1f500f7020 msgr2=0x7f1f500f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 -- 172.21.15.66:0/3548687713 shutdown_connections 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 -- 172.21.15.66:0/3548687713 wait complete. 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 Processor -- start 2024-09-12T01:55:53.308 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.307+0000 7f1f57252640 1 -- start start 2024-09-12T01:55:53.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f57252640 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f500fb480 0x7f1f501120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f57252640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 0x7f1f50112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f57252640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f50112c30 con 0x7f1f501014c0 2024-09-12T01:55:53.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f57252640 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5010c070 con 0x7f1f500fb480 2024-09-12T01:55:53.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f4ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 0x7f1f50112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.310 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f4ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 0x7f1f50112630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:47598/0 (socket says 172.21.15.66:47598) 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f4ffff640 1 -- 172.21.15.66:0/2517808816 learned_addr learned my addr 172.21.15.66:0/2517808816 (peer_addr_for_me v2:172.21.15.66:0/0) 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f54fee640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f500fb480 0x7f1f501120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f4ffff640 1 -- 172.21.15.66:0/2517808816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f500fb480 msgr2=0x7f1f501120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f4ffff640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f500fb480 0x7f1f501120f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f4ffff640 1 -- 172.21.15.66:0/2517808816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c005040 con 0x7f1f501014c0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.308+0000 7f1f54fee640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f500fb480 0x7f1f501120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.309+0000 7f1f4ffff640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 0x7f1f50112630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c000c00 tx=0x7f1f3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.309+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f3c038070 con 0x7f1f501014c0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.309+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f3c02ade0 con 0x7f1f501014c0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.309+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5010c2f0 con 0x7f1f501014c0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.309+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f3c02c7e0 con 0x7f1f501014c0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.309+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5010c830 con 0x7f1f501014c0 2024-09-12T01:55:53.311 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.310+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f500fcbc0 con 0x7f1f501014c0 2024-09-12T01:55:53.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.310+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 40) v1 ==== 92203+0+0 (secure 0 0 0) 0x7f1f3c030020 con 0x7f1f501014c0 2024-09-12T01:55:53.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.311+0000 7f1f4d7fa640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1f4006e0b0 0x7f1f40070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:55:53.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.311+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6937+0+0 (secure 0 0 0) 0x7f1f3c0ad930 con 0x7f1f501014c0 2024-09-12T01:55:53.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.311+0000 7f1f54fee640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1f4006e0b0 0x7f1f40070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:55:53.312 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.311+0000 7f1f54fee640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1f4006e0b0 0x7f1f40070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f44004d80 tx=0x7f1f4400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:55:53.316 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.315+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1f3c076bd0 con 0x7f1f501014c0 2024-09-12T01:55:53.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:52 smithi153 ceph-mon[80899]: pgmap v293: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:53.509 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.509+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1f5010d760 con 0x7f1f501014c0 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.509+0000 7f1f4d7fa640 1 -- 172.21.15.66:0/2517808816 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 43 entries v92) v1 ==== 81+0+2550 (secure 0 0 0) 0x7f1f3c07a290 con 0x7f1f501014c0 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6825/27089229 2024-09-13T01:52:37.733397+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/4286226115 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6829/299983733 2024-09-13T01:52:14.904921+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1316790720 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/2996582467 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/2996582467 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/2826711014 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.510 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/2001799335 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/151382692 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/3928441794 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1128626831 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/151382692 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6829/1307305426 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/2715666080 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6800/1778679519 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6827/3743386224 2024-09-13T01:40:56.039712+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6827/3033263442 2024-09-13T01:52:59.964692+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2126394205 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:53.511 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6826/3033263442 2024-09-13T01:52:59.964692+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/1369475095 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/2001799335 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/201526823 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/532912125 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2691404876 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/526626206 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6826/3743386224 2024-09-13T01:40:56.039712+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/109517485 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3969880503 2024-09-13T01:36:02.780216+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1372328480 2024-09-13T01:47:41.386991+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/666035643 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/3928441794 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6828/299983733 2024-09-13T01:52:14.904921+0000 2024-09-12T01:55:53.512 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2113754837 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:6801/1778679519 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/1197929559 2024-09-13T01:34:28.667247+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/2635713227 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/77725105 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/3847767757 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6828/1307305426 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/671152596 2024-09-13T01:34:58.305660+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:6824/27089229 2024-09-13T01:52:37.733397+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66:0/3667221974 2024-09-13T01:43:06.733937+0000 2024-09-12T01:55:53.513 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.153:0/3411911395 2024-09-13T01:44:32.847256+0000 2024-09-12T01:55:53.514 INFO:teuthology.orchestra.run.smithi066.stderr:listed 43 entries 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1f4006e0b0 msgr2=0x7f1f40070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1f4006e0b0 0x7f1f40070560 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f44004d80 tx=0x7f1f4400b040 comp rx=0 tx=0).stop 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 msgr2=0x7f1f50112630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 0x7f1f50112630 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c000c00 tx=0x7f1f3c009da0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 shutdown_connections 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:6800/1244181255,v1:172.21.15.66:6801/1244181255] conn(0x7f1f4006e0b0 0x7f1f40070560 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f501014c0 0x7f1f50112630 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 --2- 172.21.15.66:0/2517808816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1f500fb480 0x7f1f501120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 >> 172.21.15.66:0/2517808816 conn(0x7f1f500f7020 msgr2=0x7f1f500f73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 shutdown_connections 2024-09-12T01:55:53.515 INFO:teuthology.orchestra.run.smithi066.stderr:2024-09-12T01:55:53.512+0000 7f1f57252640 1 -- 172.21.15.66:0/2517808816 wait complete. 2024-09-12T01:55:54.113 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:55:54.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:55:54.148 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T01:55:54.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.149 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:55:54.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.219 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2024-09-12T01:55:54.236 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:55:54.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.236 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:55:54.300 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:53 smithi066 ceph-mon[110996]: from='client.? 172.21.15.66:0/2517808816' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:54.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2024-09-12T01:55:54.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.394 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2024-09-12T01:55:54.404 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:53 smithi153 ceph-mon[80899]: from='client.? 172.21.15.66:0/2517808816' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-12T01:55:54.413 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:55:54.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.414 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:55:54.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:55:54.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2024-09-12T01:55:54.585 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-12T01:55:54.595 INFO:tasks.cephadm:Teardown begin 2024-09-12T01:55:54.596 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:55:54.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:55:54.652 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-12T01:55:54.653 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:55:54.681 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-12T01:55:54.709 INFO:tasks.cephadm:Stopping all daemons... 2024-09-12T01:55:54.709 INFO:tasks.cephadm.mon.smithi066:Stopping mon.smithi066... 2024-09-12T01:55:54.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066 2024-09-12T01:55:54.889 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:54 smithi066 systemd[1]: Stopping Ceph mon.smithi066 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:55:55.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:54 smithi066 ceph-mon[110996]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:55.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:55 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[110992]: 2024-09-12T01:55:55.018+0000 7f25ad8fe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi066 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:55:55.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:55 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066[110992]: 2024-09-12T01:55:55.018+0000 7f25ad8fe640 -1 mon.smithi066@0(leader) e3 *** Got Signal Terminated *** 2024-09-12T01:55:55.313 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:55 smithi066 podman[153493]: 2024-09-12 01:55:55.089985453 +0000 UTC m=+0.179303870 container died f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-12T01:55:55.405 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:54 smithi153 ceph-mon[80899]: pgmap v294: 65 pgs: 65 active+clean; 199 MiB data, 804 MiB used, 536 GiB / 536 GiB avail 2024-09-12T01:55:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:55 smithi066 podman[153493]: 2024-09-12 01:55:55.527339449 +0000 UTC m=+0.616657863 container cleanup f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-b53b6d3) 2024-09-12T01:55:55.639 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:55 smithi066 bash[153493]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066 2024-09-12T01:55:56.092 INFO:journalctl@ceph.mon.smithi066.smithi066.stdout:Sep 12 01:55:55 smithi066 podman[153505]: 2024-09-12 01:55:55.794807266 +0000 UTC m=+0.704246986 container remove f2fa86e9baadb38d8e8a098f03e474f89334c660aa1443179adb5e1a3b558930 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi066, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:55:56.112 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi066.service' 2024-09-12T01:55:56.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:55:56.156 INFO:tasks.cephadm.mon.smithi066:Stopped mon.smithi066 2024-09-12T01:55:56.156 INFO:tasks.cephadm.mon.smithi153:Stopping mon.smithi153... 2024-09-12T01:55:56.156 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi153 2024-09-12T01:55:56.443 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:56 smithi153 systemd[1]: Stopping Ceph mon.smithi153 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:55:56.783 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:56 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153[80895]: 2024-09-12T01:55:56.449+0000 7f8726efe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi153 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:55:56.783 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:56 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153[80895]: 2024-09-12T01:55:56.449+0000 7f8726efe640 -1 mon.smithi153@1(peon) e3 *** Got Signal Terminated *** 2024-09-12T01:55:56.783 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:56 smithi153 podman[113060]: 2024-09-12 01:55:56.541045823 +0000 UTC m=+0.190008747 container died d8441d45e1435eb97c751da87f19dc9e1e514ae27a90bc0d79310ab0c1fab1ff (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T01:55:57.154 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:56 smithi153 podman[113060]: 2024-09-12 01:55:56.999537664 +0000 UTC m=+0.648500578 container cleanup d8441d45e1435eb97c751da87f19dc9e1e514ae27a90bc0d79310ab0c1fab1ff (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-12T01:55:57.155 INFO:journalctl@ceph.mon.smithi153.smithi153.stdout:Sep 12 01:55:57 smithi153 bash[113060]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-mon-smithi153 2024-09-12T01:55:57.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@mon.smithi153.service' 2024-09-12T01:55:57.509 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:55:57.509 INFO:tasks.cephadm.mon.smithi153:Stopped mon.smithi153 2024-09-12T01:55:57.509 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-12T01:55:57.509 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.0 2024-09-12T01:55:57.823 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:55:57 smithi066 systemd[1]: Stopping Ceph osd.0 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:55:58.139 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:55:57 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[122556]: 2024-09-12T01:55:57.822+0000 7f549dd0c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:55:58.139 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:55:57 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[122556]: 2024-09-12T01:55:57.822+0000 7f549dd0c640 -1 osd.0 92 *** Got signal Terminated *** 2024-09-12T01:55:58.139 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:55:57 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0[122556]: 2024-09-12T01:55:57.822+0000 7f549dd0c640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:03.440 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:03 smithi066 podman[153625]: 2024-09-12 01:56:03.155357147 +0000 UTC m=+5.446432908 container died 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-12T01:56:03.865 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:03 smithi066 podman[153625]: 2024-09-12 01:56:03.539652618 +0000 UTC m=+5.830728383 container cleanup 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-12T01:56:03.866 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:03 smithi066 bash[153625]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0 2024-09-12T01:56:04.139 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:03 smithi066 podman[153640]: 2024-09-12 01:56:03.865937248 +0000 UTC m=+0.703783886 container remove 617a3556d4e2d2dad2cb324496b07f82ac56390644ef17810288a1310f4719b7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:04.486 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:04 smithi066 podman[153727]: 2024-09-12 01:56:04.126433526 +0000 UTC m=+0.016850384 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:04.486 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:04 smithi066 podman[153727]: 2024-09-12 01:56:04.258930518 +0000 UTC m=+0.149347362 container create ecb850a08adcec22c31be01d3f1a194a3ca49a3a1f4c67a70d29d4cddf028f12 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:04.486 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:04 smithi066 podman[153727]: 2024-09-12 01:56:04.486450395 +0000 UTC m=+0.376867245 container init ecb850a08adcec22c31be01d3f1a194a3ca49a3a1f4c67a70d29d4cddf028f12 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-12T01:56:04.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:04 smithi066 podman[153727]: 2024-09-12 01:56:04.490062985 +0000 UTC m=+0.380479826 container start ecb850a08adcec22c31be01d3f1a194a3ca49a3a1f4c67a70d29d4cddf028f12 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-12T01:56:04.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:04 smithi066 podman[153727]: 2024-09-12 01:56:04.578242214 +0000 UTC m=+0.468659055 container attach ecb850a08adcec22c31be01d3f1a194a3ca49a3a1f4c67a70d29d4cddf028f12 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-12T01:56:04.889 INFO:journalctl@ceph.osd.0.smithi066.stdout:Sep 12 01:56:04 smithi066 podman[153727]: 2024-09-12 01:56:04.683038251 +0000 UTC m=+0.573455093 container died ecb850a08adcec22c31be01d3f1a194a3ca49a3a1f4c67a70d29d4cddf028f12 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T01:56:05.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.0.service' 2024-09-12T01:56:05.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:05.323 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-12T01:56:05.323 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-12T01:56:05.323 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.1 2024-09-12T01:56:05.639 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:05 smithi066 systemd[1]: Stopping Ceph osd.1 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:56:06.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:05 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[128185]: 2024-09-12T01:56:05.693+0000 7f0f1738b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:06.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:05 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[128185]: 2024-09-12T01:56:05.693+0000 7f0f1738b640 -1 osd.1 92 *** Got signal Terminated *** 2024-09-12T01:56:06.139 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:05 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1[128185]: 2024-09-12T01:56:05.693+0000 7f0f1738b640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:11.469 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:11 smithi066 podman[153830]: 2024-09-12 01:56:11.173072432 +0000 UTC m=+5.610086944 container died f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, ceph=True) 2024-09-12T01:56:11.769 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:11 smithi066 podman[153830]: 2024-09-12 01:56:11.560556791 +0000 UTC m=+5.997571303 container cleanup f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-12T01:56:11.770 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:11 smithi066 bash[153830]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1 2024-09-12T01:56:12.112 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:11 smithi066 podman[153846]: 2024-09-12 01:56:11.770122125 +0000 UTC m=+0.592393522 container remove f1b35e4354cf4547d69b8305be118346fcb555669b7f232c32325ca15971923d (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, io.buildah.version=1.37.2) 2024-09-12T01:56:12.381 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:12 smithi066 podman[153934]: 2024-09-12 01:56:12.112543726 +0000 UTC m=+0.109929865 container create eca0c58e8d48ee64d083f3281cbb853055f2bf9d42b8bd334a44ab341107cbf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:12.381 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:12 smithi066 podman[153934]: 2024-09-12 01:56:12.019341903 +0000 UTC m=+0.016728045 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:12.381 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:12 smithi066 podman[153934]: 2024-09-12 01:56:12.290218295 +0000 UTC m=+0.287604445 container init eca0c58e8d48ee64d083f3281cbb853055f2bf9d42b8bd334a44ab341107cbf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:12.382 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:12 smithi066 podman[153934]: 2024-09-12 01:56:12.294151783 +0000 UTC m=+0.291537923 container start eca0c58e8d48ee64d083f3281cbb853055f2bf9d42b8bd334a44ab341107cbf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-12T01:56:12.382 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:12 smithi066 podman[153934]: 2024-09-12 01:56:12.38155323 +0000 UTC m=+0.378939385 container attach eca0c58e8d48ee64d083f3281cbb853055f2bf9d42b8bd334a44ab341107cbf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-12T01:56:12.639 INFO:journalctl@ceph.osd.1.smithi066.stdout:Sep 12 01:56:12 smithi066 podman[153934]: 2024-09-12 01:56:12.49442633 +0000 UTC m=+0.491812471 container died eca0c58e8d48ee64d083f3281cbb853055f2bf9d42b8bd334a44ab341107cbf4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:13.057 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.1.service' 2024-09-12T01:56:13.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:13.101 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-12T01:56:13.101 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-12T01:56:13.101 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.2 2024-09-12T01:56:13.339 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:13 smithi066 systemd[1]: Stopping Ceph osd.2 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:56:13.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:13 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[133800]: 2024-09-12T01:56:13.479+0000 7f623ee08640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:13.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:13 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[133800]: 2024-09-12T01:56:13.479+0000 7f623ee08640 -1 osd.2 92 *** Got signal Terminated *** 2024-09-12T01:56:13.639 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:13 smithi066 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2[133800]: 2024-09-12T01:56:13.479+0000 7f623ee08640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:19.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:18 smithi066 podman[154037]: 2024-09-12 01:56:18.833364234 +0000 UTC m=+5.475398041 container died a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-b53b6d3) 2024-09-12T01:56:19.439 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:19 smithi066 podman[154037]: 2024-09-12 01:56:19.263101904 +0000 UTC m=+5.905135696 container cleanup a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:19.439 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:19 smithi066 bash[154037]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2 2024-09-12T01:56:19.886 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:19 smithi066 podman[154063]: 2024-09-12 01:56:19.439223427 +0000 UTC m=+0.601703355 container remove a2f1864adfe42615eafb18538d78f9271e6b2206c4bfe9f2f69773922ecb8b78 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-12T01:56:20.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:19 smithi066 podman[154153]: 2024-09-12 01:56:19.789491047 +0000 UTC m=+0.016462271 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:20.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:19 smithi066 podman[154153]: 2024-09-12 01:56:19.898837962 +0000 UTC m=+0.125809176 container create 3317562d5e4b961356294dacb548b3999fab40fba37125dbf509de2ec8c7a366 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-12T01:56:20.139 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:20 smithi066 podman[154153]: 2024-09-12 01:56:20.09285816 +0000 UTC m=+0.319829375 container init 3317562d5e4b961356294dacb548b3999fab40fba37125dbf509de2ec8c7a366 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:20.140 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:20 smithi066 podman[154153]: 2024-09-12 01:56:20.096418815 +0000 UTC m=+0.323390038 container start 3317562d5e4b961356294dacb548b3999fab40fba37125dbf509de2ec8c7a366 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0) 2024-09-12T01:56:20.553 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:20 smithi066 podman[154153]: 2024-09-12 01:56:20.176367146 +0000 UTC m=+0.403338379 container attach 3317562d5e4b961356294dacb548b3999fab40fba37125dbf509de2ec8c7a366 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:20.553 INFO:journalctl@ceph.osd.2.smithi066.stdout:Sep 12 01:56:20 smithi066 podman[154153]: 2024-09-12 01:56:20.302859693 +0000 UTC m=+0.529830908 container died 3317562d5e4b961356294dacb548b3999fab40fba37125dbf509de2ec8c7a366 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:20.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.2.service' 2024-09-12T01:56:20.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:20.869 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-12T01:56:20.869 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-12T01:56:20.869 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.3 2024-09-12T01:56:21.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:20 smithi153 systemd[1]: Stopping Ceph osd.3 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:56:21.654 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:21 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:56:21.169+0000 7f1f69e3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:21.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:21 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:56:21.169+0000 7f1f69e3f640 -1 osd.3 92 *** Got signal Terminated *** 2024-09-12T01:56:21.655 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:21 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:56:21.169+0000 7f1f69e3f640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:23.655 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:23 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:23.570+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:24.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:24 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:24.592+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:25.904 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:25 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3[90184]: 2024-09-12T01:56:25.742+0000 7f1f6243c640 -1 osd.3 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:01.942817+0000 front 2024-09-12T01:56:01.942905+0000 (oldest deadline 2024-09-12T01:56:25.442724+0000) 2024-09-12T01:56:25.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:25 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:25.565+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:26.769 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:26 smithi153 podman[113192]: 2024-09-12 01:56:26.486649119 +0000 UTC m=+5.424203452 container died c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-12T01:56:26.769 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:26 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:26.546+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:27.154 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:26 smithi153 podman[113192]: 2024-09-12 01:56:26.952435799 +0000 UTC m=+5.889990131 container cleanup c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-12T01:56:27.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:26 smithi153 bash[113192]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3 2024-09-12T01:56:27.515 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:27 smithi153 podman[113219]: 2024-09-12 01:56:27.254419038 +0000 UTC m=+0.763676717 container remove c13a64c952ec0b89430aeb12f018044ed4e7aebafc3fd114212b0e1f5d136f77 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-12T01:56:27.836 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:27 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:27.515+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:27.837 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:27 smithi153 podman[113313]: 2024-09-12 01:56:27.48764556 +0000 UTC m=+0.015860307 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:27.837 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:27 smithi153 podman[113313]: 2024-09-12 01:56:27.615149062 +0000 UTC m=+0.143363810 container create bb5776c25e29318ec716f7f4849e14932f0447d2563ee6fd8c6427d5d98d9b2f (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:27.837 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:27 smithi153 podman[113313]: 2024-09-12 01:56:27.837646608 +0000 UTC m=+0.365861356 container init bb5776c25e29318ec716f7f4849e14932f0447d2563ee6fd8c6427d5d98d9b2f (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-12T01:56:28.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:27 smithi153 podman[113313]: 2024-09-12 01:56:27.841139428 +0000 UTC m=+0.369354178 container start bb5776c25e29318ec716f7f4849e14932f0447d2563ee6fd8c6427d5d98d9b2f (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-b53b6d3, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:56:28.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:27 smithi153 podman[113313]: 2024-09-12 01:56:27.92195395 +0000 UTC m=+0.450168706 container attach bb5776c25e29318ec716f7f4849e14932f0447d2563ee6fd8c6427d5d98d9b2f (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:56:28.155 INFO:journalctl@ceph.osd.3.smithi153.stdout:Sep 12 01:56:28 smithi153 podman[113313]: 2024-09-12 01:56:28.029668295 +0000 UTC m=+0.557883052 container died bb5776c25e29318ec716f7f4849e14932f0447d2563ee6fd8c6427d5d98d9b2f (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-3-deactivate, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-12T01:56:28.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.3.service' 2024-09-12T01:56:28.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:28.674 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-12T01:56:28.674 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-12T01:56:28.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.4 2024-09-12T01:56:28.762 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:28 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:28.500+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:28.762 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:28 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:28.565+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:29.014 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:28 smithi153 systemd[1]: Stopping Ceph osd.4 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:56:29.404 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:29.014+0000 7fba8758e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:29.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:29.014+0000 7fba8758e640 -1 osd.4 92 *** Got signal Terminated *** 2024-09-12T01:56:29.405 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:29.014+0000 7fba8758e640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:29.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:29.455+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:29.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:29 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:29.585+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:30.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:30 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:30.434+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:30.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:30 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:30.612+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:31.904 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:31 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:31.468+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:31.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:31 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:31.627+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:31.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:31 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:31.627+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:32.875 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:32 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:32.487+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:32.875 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:32 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:32.657+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:32.875 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:32 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:32.657+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:33.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:33 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4[95441]: 2024-09-12T01:56:33.451+0000 7fba7fb8b640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:55:59.964039+0000 front 2024-09-12T01:55:59.964129+0000 (oldest deadline 2024-09-12T01:56:23.463851+0000) 2024-09-12T01:56:33.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:33 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:33.649+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:33.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:33 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:33.649+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:34.608 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:34 smithi153 podman[113417]: 2024-09-12 01:56:34.352406371 +0000 UTC m=+5.446830517 container died 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-b53b6d3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-12T01:56:34.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:34 smithi153 podman[113417]: 2024-09-12 01:56:34.706309015 +0000 UTC m=+5.800733160 container cleanup 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-12T01:56:34.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:34 smithi153 bash[113417]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4 2024-09-12T01:56:34.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:34 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:34.607+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:34.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:34 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:34.607+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:35.372 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113432]: 2024-09-12 01:56:35.01610305 +0000 UTC m=+0.657585095 container remove 6b77ec5616acfd7076b34c6daba9570a174b7e08ce82dbb245145cccd243bd13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-12T01:56:35.648 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113524]: 2024-09-12 01:56:35.27583028 +0000 UTC m=+0.016236469 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:35.648 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113524]: 2024-09-12 01:56:35.375192338 +0000 UTC m=+0.115598569 container create 34b6e5527ef1d9ad7851575c902a3ae9e0c56b45b16853e193abd17e6dc7fdfe (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-12T01:56:35.648 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113524]: 2024-09-12 01:56:35.598270373 +0000 UTC m=+0.338676572 container init 34b6e5527ef1d9ad7851575c902a3ae9e0c56b45b16853e193abd17e6dc7fdfe (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-b53b6d3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:35.648 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113524]: 2024-09-12 01:56:35.601593832 +0000 UTC m=+0.342000019 container start 34b6e5527ef1d9ad7851575c902a3ae9e0c56b45b16853e193abd17e6dc7fdfe (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=squid-b53b6d3) 2024-09-12T01:56:35.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:35 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:35.647+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:35.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:35 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:35.647+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:35.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113524]: 2024-09-12 01:56:35.700290824 +0000 UTC m=+0.440697019 container attach 34b6e5527ef1d9ad7851575c902a3ae9e0c56b45b16853e193abd17e6dc7fdfe (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-12T01:56:35.905 INFO:journalctl@ceph.osd.4.smithi153.stdout:Sep 12 01:56:35 smithi153 podman[113547]: 2024-09-12 01:56:35.825250125 +0000 UTC m=+0.024119258 container died 34b6e5527ef1d9ad7851575c902a3ae9e0c56b45b16853e193abd17e6dc7fdfe (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-b53b6d3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-12T01:56:36.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.4.service' 2024-09-12T01:56:36.486 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:36.486 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-12T01:56:36.486 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-12T01:56:36.486 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.5 2024-09-12T01:56:36.805 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:36 smithi153 systemd[1]: Stopping Ceph osd.5 for f9344df4-70a6-11ef-bcea-c7b262605968... 2024-09-12T01:56:36.805 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:36 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:36.635+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:36.805 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:36 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:36.635+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:37.154 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:36 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:36.803+0000 7f21d3a9e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-12T01:56:37.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:36 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:36.803+0000 7f21d3a9e640 -1 osd.5 92 *** Got signal Terminated *** 2024-09-12T01:56:37.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:36 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:36.803+0000 7f21d3a9e640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-12T01:56:38.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:37 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:37.677+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:38.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:37 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:37.677+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:39.154 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:38 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:38.701+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:39.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:38 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:38.701+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:40.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:39.709+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:40.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:39 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:39.709+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:41.154 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:40 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:40.664+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:41.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:40 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:40.664+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:42.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:41 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:41.670+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6806 osd.0 since back 2024-09-12T01:56:02.053996+0000 front 2024-09-12T01:56:02.054035+0000 (oldest deadline 2024-09-12T01:56:27.953581+0000) 2024-09-12T01:56:42.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:41 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:41.670+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6814 osd.1 since back 2024-09-12T01:56:07.954061+0000 front 2024-09-12T01:56:07.954106+0000 (oldest deadline 2024-09-12T01:56:31.454010+0000) 2024-09-12T01:56:42.155 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:41 smithi153 ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5[100443]: 2024-09-12T01:56:41.670+0000 7f21cc09b640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.66:6822 osd.2 since back 2024-09-12T01:56:15.554759+0000 front 2024-09-12T01:56:15.554781+0000 (oldest deadline 2024-09-12T01:56:41.454593+0000) 2024-09-12T01:56:42.538 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:42 smithi153 podman[113628]: 2024-09-12 01:56:42.232547688 +0000 UTC m=+5.520615692 container died 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-b53b6d3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-12T01:56:42.904 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:42 smithi153 podman[113628]: 2024-09-12 01:56:42.704831909 +0000 UTC m=+5.992899908 container cleanup 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-12T01:56:42.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:42 smithi153 bash[113628]: ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5 2024-09-12T01:56:43.314 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:42 smithi153 podman[113644]: 2024-09-12 01:56:42.956107027 +0000 UTC m=+0.714948210 container remove 1c0a4ea58d8347430ec3c74d5ed3390765e99f8ab4dacb10d98b6d7a44e9f42b (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-12T01:56:43.617 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:43 smithi153 podman[113733]: 2024-09-12 01:56:43.31524011 +0000 UTC m=+0.109629140 container create 2be657dda1b6f89d32e01855343f29db4bfbb25773cdf459a6173e16f2d78a66 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-b53b6d3) 2024-09-12T01:56:43.617 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:43 smithi153 podman[113733]: 2024-09-12 01:56:43.221633125 +0000 UTC m=+0.016022118 image pull 54467abc55f864c4f73dfaf9c6ac3bb3e87b773123d5badaf790bee57321d594 quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66 2024-09-12T01:56:43.617 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:43 smithi153 podman[113733]: 2024-09-12 01:56:43.534417463 +0000 UTC m=+0.328806452 container init 2be657dda1b6f89d32e01855343f29db4bfbb25773cdf459a6173e16f2d78a66 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-12T01:56:43.617 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:43 smithi153 podman[113733]: 2024-09-12 01:56:43.537890807 +0000 UTC m=+0.332279798 container start 2be657dda1b6f89d32e01855343f29db4bfbb25773cdf459a6173e16f2d78a66 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-b53b6d3, GIT_CLEAN=True) 2024-09-12T01:56:43.617 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:43 smithi153 podman[113733]: 2024-09-12 01:56:43.617489016 +0000 UTC m=+0.411878005 container attach 2be657dda1b6f89d32e01855343f29db4bfbb25773cdf459a6173e16f2d78a66 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-b53b6d3) 2024-09-12T01:56:43.905 INFO:journalctl@ceph.osd.5.smithi153.stdout:Sep 12 01:56:43 smithi153 podman[113733]: 2024-09-12 01:56:43.728179567 +0000 UTC m=+0.522568561 container died 2be657dda1b6f89d32e01855343f29db4bfbb25773cdf459a6173e16f2d78a66 (image=quay.ceph.io/ceph-ci/ceph@sha256:3be30d720e37ec4df7f667e60f22b4d221c4ce7b408e68b90f9ac10220535e66, name=ceph-f9344df4-70a6-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=squid-b53b6d3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-12T01:56:44.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f9344df4-70a6-11ef-bcea-c7b262605968@osd.5.service' 2024-09-12T01:56:44.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-12T01:56:44.444 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-12T01:56:44.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9344df4-70a6-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:57:06.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9344df4-70a6-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-12T01:57:18.643 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:57:18.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-12T01:57:18.706 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-12T01:57:18.708 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552/remote/smithi066/crash 2024-09-12T01:57:18.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:57:18.746 INFO:teuthology.orchestra.run.smithi066.stderr:tar: /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:57:18.746 INFO:teuthology.orchestra.run.smithi066.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:57:18.748 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552/remote/smithi153/crash 2024-09-12T01:57:18.749 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/crash -- . 2024-09-12T01:57:18.773 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-12T01:57:18.774 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2024-09-12T01:57:18.774 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-12T01:57:18.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-12T01:57:18.827 INFO:tasks.cephadm:Compressing logs... 2024-09-12T01:57:18.827 DEBUG:teuthology.orchestra.run.smithi066:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:57:18.870 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:57:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-12T01:57:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:: No such file or directory 2024-09-12T01:57:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mon.smithi066.log 2024-09-12T01:57:18.900 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mon.smithi066.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi066.ipygev.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi066.ipygev.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mgr.smithi066.qdwcrh.log 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.2.log: 86.5% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:57:18.901 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:57:18.903 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mgr.smithi066.qdwcrh.log: 91.1% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mgr.smithi153.jpnqza.log 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:: No such file or directory 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi153.aiydtj.log 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose --/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mgr.smithi153.jpnqza.log: /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi153.aiydtj.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mon.smithi153.log 2024-09-12T01:57:18.909 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi153.cbdplo.log 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mon.smithi153.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi153.cbdplo.log: gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.cephadm.log: 85.5% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.5.log: 91.2% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:57:18.910 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:57:18.911 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi066.jacfsu.log 2024-09-12T01:57:18.915 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-12T01:57:18.916 INFO:teuthology.orchestra.run.smithi066.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-12T01:57:18.917 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi066.jacfsu.log: 91.1% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:57:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:57:18.920 INFO:teuthology.orchestra.run.smithi153.stderr: 91.0% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-12T01:57:18.953 INFO:teuthology.orchestra.run.smithi066.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-12T01:57:18.961 INFO:teuthology.orchestra.run.smithi153.stderr: 89.8% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mgr.smithi153.jpnqza.log.gz 2024-09-12T01:57:19.216 INFO:teuthology.orchestra.run.smithi066.stderr: 88.8% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mgr.smithi066.qdwcrh.log.gz 2024-09-12T01:57:19.331 INFO:teuthology.orchestra.run.smithi153.stderr: 92.4% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mon.smithi153.log.gz 2024-09-12T01:57:19.992 INFO:teuthology.orchestra.run.smithi066.stderr: 90.6% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mon.smithi066.log.gz 2024-09-12T01:57:24.317 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi153.aiydtj.log.gz 2024-09-12T01:57:24.416 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-12T01:57:24.482 INFO:teuthology.orchestra.run.smithi153.stderr: 93.5% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-12T01:57:24.683 INFO:teuthology.orchestra.run.smithi066.stderr: 94.8% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi066.ipygev.log.gz 2024-09-12T01:57:24.966 INFO:teuthology.orchestra.run.smithi066.stderr: 93.3% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-12T01:57:25.064 INFO:teuthology.orchestra.run.smithi153.stderr: 94.8% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi153.cbdplo.log.gz 2024-09-12T01:57:25.758 INFO:teuthology.orchestra.run.smithi066.stderr: 93.3% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-12T01:57:26.444 INFO:teuthology.orchestra.run.smithi066.stderr: 93.3% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-12T01:57:26.811 INFO:teuthology.orchestra.run.smithi153.stderr: 93.5% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-12T01:57:26.812 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-12T01:57:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m7.927s 2024-09-12T01:57:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:user 0m30.026s 2024-09-12T01:57:26.812 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m1.063s 2024-09-12T01:58:53.377 INFO:teuthology.orchestra.run.smithi066.stderr: 92.5% -- replaced with /var/log/ceph/f9344df4-70a6-11ef-bcea-c7b262605968/ceph-mds.cephfs.smithi066.jacfsu.log.gz 2024-09-12T01:58:53.378 INFO:teuthology.orchestra.run.smithi066.stderr: 2024-09-12T01:58:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:real 1m34.494s 2024-09-12T01:58:53.378 INFO:teuthology.orchestra.run.smithi066.stderr:user 1m58.515s 2024-09-12T01:58:53.379 INFO:teuthology.orchestra.run.smithi066.stderr:sys 0m3.483s 2024-09-12T01:58:53.379 INFO:tasks.cephadm:Archiving logs... 2024-09-12T01:58:53.379 DEBUG:teuthology.misc:Transferring archived files from smithi066:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552/remote/smithi066/log 2024-09-12T01:58:53.381 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:59:10.682 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552/remote/smithi153/log 2024-09-12T01:59:10.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:59:14.394 INFO:tasks.cephadm:Removing cluster... 2024-09-12T01:59:14.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9344df4-70a6-11ef-bcea-c7b262605968 --force 2024-09-12T01:59:15.022 DEBUG:teuthology.orchestra.run.smithi153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f9344df4-70a6-11ef-bcea-c7b262605968 --force 2024-09-12T01:59:15.527 INFO:tasks.cephadm:Removing cephadm ... 2024-09-12T01:59:15.528 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:59:15.545 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-12T01:59:15.561 INFO:tasks.cephadm:Teardown complete 2024-09-12T01:59:15.561 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:59:15.572 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:59:15.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:59:15.588 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:59:15.691 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:59:15.700 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:59:15.700 DEBUG:teuthology.orchestra.run.smithi066:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:59:15.703 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:59:15.716 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:59:15.717 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:59:15.721 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:59:15.721 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2024-09-12T01:59:15.721 INFO:teuthology.orchestra.run.smithi066.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 -2572us[-2569us] +/- 50ms 2024-09-12T01:59:15.721 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +571us[ +574us] +/- 59ms 2024-09-12T01:59:15.721 INFO:teuthology.orchestra.run.smithi066.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +2984us[+2986us] +/- 71ms 2024-09-12T01:59:15.721 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:59:15.722 INFO:teuthology.orchestra.run.smithi153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:59:15.723 INFO:teuthology.orchestra.run.smithi153.stdout:=============================================================================== 2024-09-12T01:59:15.723 INFO:teuthology.orchestra.run.smithi153.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -2548us[-2514us] +/- 50ms 2024-09-12T01:59:15.723 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +596us[ +631us] +/- 59ms 2024-09-12T01:59:15.723 INFO:teuthology.orchestra.run.smithi153.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +3006us[+3041us] +/- 71ms 2024-09-12T01:59:15.723 INFO:teuthology.orchestra.run.smithi153.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:59:15.723 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:59:15.733 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:59:15.734 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:59:15.743 DEBUG:teuthology.orchestra.run.smithi066:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:59:15.849 DEBUG:teuthology.orchestra.run.smithi153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:59:15.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:59:15.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:15.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:59:15.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:15.983 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:59:15.994 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:59:16.003 INFO:teuthology.task.internal:Duration was 1923.305916 seconds 2024-09-12T01:59:16.004 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:59:16.014 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:59:16.015 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:59:16.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:59:16.055 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:59:16.062 INFO:teuthology.orchestra.run.smithi153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:59:16.429 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:59:16.429 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi066.front.sepia.ceph.com 2024-09-12T01:59:16.429 DEBUG:teuthology.orchestra.run.smithi066:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:59:16.492 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-12T01:59:16.493 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:59:16.520 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:59:16.520 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:59:16.536 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:59:16.587 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:59:16.587 DEBUG:teuthology.orchestra.run.smithi066:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:59:16.603 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:59:17.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:59:17.304 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:59:17.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:59:17.330 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:59:17.356 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:59:17.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:17.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:17.395 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = core 2024-09-12T01:59:17.421 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-12T01:59:17.434 DEBUG:teuthology.orchestra.run.smithi066:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:17.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:17.464 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:59:17.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:59:17.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:59:17.503 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:59:17.504 DEBUG:teuthology.misc:Transferring archived files from smithi066:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552/remote/smithi066 2024-09-12T01:59:17.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:59:17.561 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901552/remote/smithi153 2024-09-12T01:59:17.561 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:59:17.598 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:59:17.598 DEBUG:teuthology.orchestra.run.smithi066:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:59:17.601 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:59:17.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:59:17.660 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:59:17.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:59:17.672 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:59:17.672 DEBUG:teuthology.orchestra.run.smithi066:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:59:17.675 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:59:17.687 INFO:teuthology.orchestra.run.smithi066.stdout: 265710 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:59 /home/ubuntu/cephtest 2024-09-12T01:59:17.703 INFO:teuthology.orchestra.run.smithi153.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:59 /home/ubuntu/cephtest 2024-09-12T01:59:17.704 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:59:17.716 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:59:17.744 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1923.3059163093567 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T01:59:17.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:59:17.841 INFO:teuthology.run:pass